2024-09-14T10:45:24.951 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:45:24.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:45:25.059 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142 branch: main description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904142' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxejcUkPMwm7TFqWspN7u+/OSJiHFpWtn6Ae+EJlCGlGulLpbfaVxYlvjzn9151Y/shasXRDNC6OwLY1aV+FDU= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdI388+fBFqg8wzhFIV98jM9rwKVDjHSlXcPltQnGPtpEUk+ZkKpUNqo94YCczZKho448IMZiuDUkPJ2IL/+YY= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:45:25.059 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:45:25.060 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:45:25.060 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:45:25.061 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:45:25.082 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:45:25.082 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:45:25.082 INFO:teuthology.packaging:ref: None 2024-09-14T10:45:25.082 INFO:teuthology.packaging:tag: None 2024-09-14T10:45:25.082 INFO:teuthology.packaging:branch: main 2024-09-14T10:45:25.082 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:25.083 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:45:25.324 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:45:25.326 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:45:25.332 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:45:25.332 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:45:25.368 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:45:25.386 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:45:25.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:45:25.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:40:09.975330', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxejcUkPMwm7TFqWspN7u+/OSJiHFpWtn6Ae+EJlCGlGulLpbfaVxYlvjzn9151Y/shasXRDNC6OwLY1aV+FDU='} 2024-09-14T10:45:25.443 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:40:09.976828', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdI388+fBFqg8wzhFIV98jM9rwKVDjHSlXcPltQnGPtpEUk+ZkKpUNqo94YCczZKho448IMZiuDUkPJ2IL/+YY='} 2024-09-14T10:45:25.443 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:45:25.450 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:45:25.450 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:45:25.450 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:45:25.522 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5eb80bbe0>, signals=[15]) 2024-09-14T10:45:25.522 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:45:25.528 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:45:25.528 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:45:25.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:25.606 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:45:25.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:25.681 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:45:25.687 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-09-14T10:45:25.706 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-09-14T10:45:25.706 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-09-14T10:45:25.763 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-09-14T10:45:25.763 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:45:25.764 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:45:25.765 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-09-14T10:45:25.787 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-14T10:45:25.805 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-14T10:45:25.806 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:45:25.864 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:45:25.865 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:45:25.865 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:45:25.865 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:45:25.865 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-14T10:45:25.887 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:45:25.896 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:45:25.926 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:45:25.927 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:45:25.929 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:45:25.945 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:45:25.951 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:45:25.951 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:45:25.987 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:45:26.014 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:45:26.067 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:45:26.083 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:45:26.083 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:45:26.083 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:45:26.084 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:45:26.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:45:26.101 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-14T10:45:26.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:45:26.102 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-14T10:45:26.160 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:45:26.160 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-14T10:45:26.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-14T10:45:26.162 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:45:26.162 INFO:teuthology.task.kernel:Running kernel on smithi029: 5.14.0-503.el9.x86_64 2024-09-14T10:45:26.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum install -y kernel 2024-09-14T10:45:31.057 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-14T10:45:31.916 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.2 MB 00:02 2024-09-14T10:45:34.227 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-14T10:45:34.750 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 20 MB 00:02 2024-09-14T10:45:38.987 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.5 MB 00:00 2024-09-14T10:45:39.233 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 9.1 MB/s | 6.5 MB 00:00 2024-09-14T10:45:40.548 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-14T10:45:40.917 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-14T10:45:41.546 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-14T10:45:41.888 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-14T10:45:47.277 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-14T10:45:47.278 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T10:45:49.350 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:45:49.351 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:45:49.413 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:45:49.413 INFO:teuthology.orchestra.run.smithi029.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:45:49.456 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:45:49.465 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-14T10:45:49.466 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:45:49.467 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-14T10:45:49.467 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-14T10:45:49.467 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T10:45:49.520 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout: Package Architecture Version Repository Size 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-14T10:45:49.536 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout:Install 4 Packages 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:45:49.537 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 79 M 2024-09-14T10:45:49.538 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 126 M 2024-09-14T10:45:49.538 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-14T10:45:49.757 INFO:teuthology.orchestra.run.smithi029.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 278 kB/s | 23 kB 00:00 2024-09-14T10:45:49.887 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 173 kB/s | 23 kB 00:00 2024-09-14T10:45:50.358 INFO:teuthology.orchestra.run.smithi029.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-14T10:45:51.083 INFO:teuthology.orchestra.run.smithi029.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-09-14T10:45:51.912 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 14 MB/s | 29 MB 00:02 2024-09-14T10:45:51.917 INFO:teuthology.orchestra.run.smithi029.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-14T10:45:51.917 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:45:51.917 INFO:teuthology.orchestra.run.smithi029.stdout:Total 33 MB/s | 79 MB 00:02 2024-09-14T10:45:52.187 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 6.4 MB/s | 16 MB 00:02 2024-09-14T10:45:52.631 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-14T10:45:52.871 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-14T10:45:52.871 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:45:52.871 INFO:teuthology.orchestra.run.smithi073.stdout:Total 23 MB/s | 79 MB 00:03 2024-09-14T10:45:53.059 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-14T10:45:53.059 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-14T10:45:53.555 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T10:45:53.904 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T10:45:53.905 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T10:45:54.025 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-14T10:45:54.025 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-14T10:45:54.863 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T10:45:54.863 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T10:45:56.586 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-14T10:45:57.314 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T10:45:57.332 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:57.439 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:57.960 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:58.071 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:00.251 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:00.450 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:00.876 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:00.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:05.573 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:05.623 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:05.850 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:05.889 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:10.745 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:10.773 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:49.233 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:49.272 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:49.621 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:46:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:49.622 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:46:50.485 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T10:46:50.839 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:50.921 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.921 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:50.921 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:46:50.921 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:46:50.921 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:46:50.922 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:46:50.922 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:46:50.922 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:50.981 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:50.981 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-14T10:46:51.013 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:46:51.014 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:46:51.015 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:46:51.015 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:46:51.016 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:46:51.749 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-14T10:46:52.691 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:52.733 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:53.133 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:46:53.172 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-14T10:46:53.174 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-14T10:46:53.186 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:53.186 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:46:53.186 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:53.186 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:53.190 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.0Cdxax8W9d 2024-09-14T10:46:53.190 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0Cdxax8W9d 2024-09-14T10:46:53.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.0Cdxax8W9d 2024-09-14T10:46:53.408 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.0Cdxax8W9d is 6KB 2024-09-14T10:46:53.457 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.0Cdxax8W9d 2024-09-14T10:46:53.472 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:46:53.538 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:46:53.538 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:46:53.538 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:46:53.538 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:46:53.539 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:46:53.685 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:46:54.250 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-14T10:46:54.666 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:54.774 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.774 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:54.774 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:46:54.774 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:46:54.774 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:46:54.774 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:46:54.774 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:46:54.775 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:54.834 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:54.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:54.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.06 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 82.el9 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2024-09-14T10:46:54.865 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Group : Unspecified 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 8274670 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : builder@centos.org 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : CentOS 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:46:54.866 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:46:54.867 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:46:54.867 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:46:54.867 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2024-09-14T10:46:54.867 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:46:54.867 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:46:54.868 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:46:54.868 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:46:54.868 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:46:55.628 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2024-09-14T10:46:57.229 INFO:teuthology.orchestra.run.smithi029.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:46:57.271 INFO:teuthology.orchestra.run.smithi029.stderr:done 2024-09-14T10:46:57.273 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-14T10:46:57.288 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.XpPMgSK5tp 2024-09-14T10:46:57.288 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XpPMgSK5tp 2024-09-14T10:46:57.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.XpPMgSK5tp 2024-09-14T10:46:57.519 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.XpPMgSK5tp is 6KB 2024-09-14T10:46:57.567 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.XpPMgSK5tp 2024-09-14T10:46:57.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:46:57.652 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:46:57.652 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:46:57.652 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:46:57.652 INFO:teuthology.orchestra.run.smithi029.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:46:57.653 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:46:57.815 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2024-09-14T10:47:23.710 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:47:23.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T10:47:23.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:27.821 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:47:27.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-14T10:47:27.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:23.770 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:48:27.828 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:48:32.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T10:48:32.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:33.423 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-14T10:48:33.869 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T10:48:33.869 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:48:33.869 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-14T10:48:33.884 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:48:33.884 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:48:33.884 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:48:33.884 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:48:34.886 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:48:34.886 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:48:34.949 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-14T10:48:34.978 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:36.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-14T10:48:36.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:44.630 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-14T10:48:45.163 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-14T10:48:45.163 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:48:45.163 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2024-09-14T10:48:45.178 INFO:teuthology.orchestra.run.smithi029.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:48:45.179 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:48:45.179 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:48:45.179 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:48:46.179 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:48:46.180 DEBUG:teuthology.orchestra.run.smithi029:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:48:46.324 INFO:teuthology.orchestra.run.smithi029.stdout:ttyS1 2024-09-14T10:48:46.345 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:46.346 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:48:46.352 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:48:46.353 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:46.355 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:46.375 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:48:46.381 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:48:46.407 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:48:46.407 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:46.411 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:46.450 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:48:46.459 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:48:46.460 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:46.484 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:46.515 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:46.526 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:46.549 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:46.560 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:46.561 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:48:46.577 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:48:46.577 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:46.580 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:46.606 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:48:46.617 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:48:46.617 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:46.646 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:46.665 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:46.738 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:46.803 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:46.843 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:46.888 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:48:46.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:46.969 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:47.013 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:47.060 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:47.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:47.185 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:48:47.185 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:47.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2024-09-14T10:48:47.252 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-14T10:48:47.336 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:47.347 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:47.784 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:48:47.798 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:48:47.798 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:48:47.854 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:48:47.887 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2024-09-14T10:48:47.999 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: 2024-09-14T10:48:48.001 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-14T10:48:48.053 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-14T10:48:48.055 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:48:48.056 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2024-09-14T10:48:48.086 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2024-09-14T10:48:48.086 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-14T10:48:48.110 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-14T10:48:48.111 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi029.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-09-14T10:48:48.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:48.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:48.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:48.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:48.184 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:48:48.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:48.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:48.328 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:48:48.338 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:48:48.350 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:48:48.351 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi029.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:52:39.493 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi029.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-09-14T10:52:39.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-14T10:52:39.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:52:39.576 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-09-14T10:52:39.657 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-09-14T10:52:39.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T10:52:39.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:52:39.733 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-14T10:52:39.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-14T10:52:39.814 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:52:39.825 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:52:39.826 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:52:39.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:52:39.829 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:52:39.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:52:39.857 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:52:39.872 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:52:39.885 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:52:39.898 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2024-09-14T10:52:39.900 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:52:39.909 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2024-09-14T10:52:39.924 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:52:39.925 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-14T10:52:39.936 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-14T10:52:39.939 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:52:39.951 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:52:39.964 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:52:39.999 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:52:40.003 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:52:40.004 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-14T10:52:40.004 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.004 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.004 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.004 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.021 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:52:40.025 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:52:40.025 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-14T10:52:40.025 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.025 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.026 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.026 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:40.026 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:52:40.037 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:52:40.037 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:52:40.037 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:52:40.037 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:52:40.042 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:52:40.042 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:52:40.043 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:52:40.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:52:40.045 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:52:40.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:52:40.192 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:52:40.192 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:52:40.197 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:52:40.197 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:52:40.311 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:52:40.312 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:52:40.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:52:40.320 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:52:40.321 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:52:40.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:52:40.340 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:52:40.341 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:52:40.347 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:52:40.347 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:52:40.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:52:40.414 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:52:40.484 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:52:40.490 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:52:40.550 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2024-09-14T10:52:40.551 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2024-09-14T10:52:40.555 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-14T10:52:40.557 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-14T10:52:40.784 INFO:teuthology.orchestra.run.smithi029.stdout:45 files removed 2024-09-14T10:52:40.785 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-14T10:52:40.811 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:52:40.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:52:41.399 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 279 kB/s | 84 kB 00:00 2024-09-14T10:52:41.416 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 278 kB/s | 84 kB 00:00 2024-09-14T10:52:41.699 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-14T10:52:41.717 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-14T10:52:41.984 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-14T10:52:42.003 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-14T10:52:42.504 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-14T10:52:43.642 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-14T10:52:44.507 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-14T10:52:45.677 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-14T10:52:50.169 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-14T10:52:50.210 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-14T10:52:52.071 INFO:teuthology.orchestra.run.smithi029.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 19 kB 00:00 2024-09-14T10:52:52.471 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-14T10:52:53.210 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-14T10:52:53.249 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-14T10:52:58.714 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-14T10:52:58.866 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-14T10:53:01.049 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:53:01.049 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:53:01.138 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-14T10:53:01.164 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-14T10:53:01.164 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:53:01.165 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:53:01.166 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:53:01.167 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:53:01.168 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:53:01.169 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:53:01.170 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:53:01.171 INFO:teuthology.orchestra.run.smithi073.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:53:01.172 INFO:teuthology.orchestra.run.smithi073.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:53:01.173 INFO:teuthology.orchestra.run.smithi073.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:53:01.174 INFO:teuthology.orchestra.run.smithi073.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:53:01.175 INFO:teuthology.orchestra.run.smithi073.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:53:01.176 INFO:teuthology.orchestra.run.smithi073.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:53:01.177 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:53:01.178 INFO:teuthology.orchestra.run.smithi073.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:53:01.179 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:53:01.180 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:53:01.181 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:53:01.182 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:53:01.183 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:53:01.184 INFO:teuthology.orchestra.run.smithi073.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-14T10:53:01.185 INFO:teuthology.orchestra.run.smithi073.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:53:01.186 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout:====================================================================================================== 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout:Install 284 Packages 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2024-09-14T10:53:01.187 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:53:01.188 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 327 M 2024-09-14T10:53:01.188 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-14T10:53:01.408 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:53:01.409 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:53:01.510 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================== 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================== 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:53:01.541 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:53:01.542 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:53:01.543 INFO:teuthology.orchestra.run.smithi029.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:53:01.544 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:53:01.545 INFO:teuthology.orchestra.run.smithi029.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:53:01.546 INFO:teuthology.orchestra.run.smithi029.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:53:01.547 INFO:teuthology.orchestra.run.smithi029.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:53:01.548 INFO:teuthology.orchestra.run.smithi029.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:53:01.549 INFO:teuthology.orchestra.run.smithi029.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:53:01.550 INFO:teuthology.orchestra.run.smithi029.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:53:01.551 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:53:01.552 INFO:teuthology.orchestra.run.smithi029.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:53:01.552 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:53:01.552 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:53:01.552 INFO:teuthology.orchestra.run.smithi029.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:53:01.552 INFO:teuthology.orchestra.run.smithi029.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:53:01.553 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:53:01.554 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:53:01.555 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:53:01.556 INFO:teuthology.orchestra.run.smithi029.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:53:01.557 INFO:teuthology.orchestra.run.smithi029.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:53:01.558 INFO:teuthology.orchestra.run.smithi029.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:53:01.559 INFO:teuthology.orchestra.run.smithi029.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:53:01.560 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:53:01.561 INFO:teuthology.orchestra.run.smithi029.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:53:01.562 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:53:01.563 INFO:teuthology.orchestra.run.smithi029.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:53:01.564 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:53:01.565 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:53:01.566 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:53:01.567 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:53:01.568 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:53:01.569 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:53:01.570 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:53:01.571 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:53:01.571 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:53:01.571 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:53:01.571 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:53:01.571 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:53:01.572 INFO:teuthology.orchestra.run.smithi029.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:53:01.573 INFO:teuthology.orchestra.run.smithi029.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:53:01.574 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:53:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:53:01.576 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:53:01.577 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-14T10:53:01.578 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================== 2024-09-14T10:53:01.578 INFO:teuthology.orchestra.run.smithi029.stdout:Install 284 Packages 2024-09-14T10:53:01.578 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2024-09-14T10:53:01.578 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:53:01.579 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 327 M 2024-09-14T10:53:01.579 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-14T10:53:01.823 INFO:teuthology.orchestra.run.smithi073.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 49 kB/s | 6.6 kB 00:00 2024-09-14T10:53:02.115 INFO:teuthology.orchestra.run.smithi073.stdout:(2/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 13 MB/s | 5.5 MB 00:00 2024-09-14T10:53:02.140 INFO:teuthology.orchestra.run.smithi073.stdout:(3/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 2.8 MB/s | 900 kB 00:00 2024-09-14T10:53:02.166 INFO:teuthology.orchestra.run.smithi073.stdout:(4/286): ceph-immutable-object-cache-19.3.0-490 2.8 MB/s | 145 kB 00:00 2024-09-14T10:53:02.257 INFO:teuthology.orchestra.run.smithi073.stdout:(5/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-14T10:53:02.287 INFO:teuthology.orchestra.run.smithi029.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-09-14T10:53:02.491 INFO:teuthology.orchestra.run.smithi073.stdout:(6/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 6.8 MB/s | 2.4 MB 00:00 2024-09-14T10:53:02.566 INFO:teuthology.orchestra.run.smithi073.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-14T10:53:02.855 INFO:teuthology.orchestra.run.smithi029.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 1.6 MB/s | 900 kB 00:00 2024-09-14T10:53:02.930 INFO:teuthology.orchestra.run.smithi029.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 1.9 MB/s | 145 kB 00:00 2024-09-14T10:53:02.942 INFO:teuthology.orchestra.run.smithi073.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 17 MB/s | 22 MB 00:01 2024-09-14T10:53:02.992 INFO:teuthology.orchestra.run.smithi073.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 506 kB/s | 25 kB 00:00 2024-09-14T10:53:03.134 INFO:teuthology.orchestra.run.smithi073.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 19 MB/s | 11 MB 00:00 2024-09-14T10:53:03.192 INFO:teuthology.orchestra.run.smithi073.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 546 kB/s | 32 kB 00:00 2024-09-14T10:53:03.284 INFO:teuthology.orchestra.run.smithi073.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 8.1 MB/s | 756 kB 00:00 2024-09-14T10:53:03.351 INFO:teuthology.orchestra.run.smithi073.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.4 MB/s | 161 kB 00:00 2024-09-14T10:53:03.427 INFO:teuthology.orchestra.run.smithi073.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.7 MB/s | 127 kB 00:00 2024-09-14T10:53:03.456 INFO:teuthology.orchestra.run.smithi029.stdout:(4/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 4.5 MB/s | 2.4 MB 00:00 2024-09-14T10:53:03.510 INFO:teuthology.orchestra.run.smithi073.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 6.0 MB/s | 508 kB 00:00 2024-09-14T10:53:03.848 INFO:teuthology.orchestra.run.smithi029.stdout:(5/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 3.2 MB/s | 5.5 MB 00:01 2024-09-14T10:53:03.877 INFO:teuthology.orchestra.run.smithi073.stdout:(16/286): librgw2-19.3.0-4907.ga2782315.el9.x86 15 MB/s | 5.5 MB 00:00 2024-09-14T10:53:03.907 INFO:teuthology.orchestra.run.smithi029.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 3.4 MB/s | 1.5 MB 00:00 2024-09-14T10:53:03.927 INFO:teuthology.orchestra.run.smithi073.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 905 kB/s | 45 kB 00:00 2024-09-14T10:53:04.011 INFO:teuthology.orchestra.run.smithi073.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.7 MB/s | 143 kB 00:00 2024-09-14T10:53:04.095 INFO:teuthology.orchestra.run.smithi073.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 1.9 MB/s | 161 kB 00:00 2024-09-14T10:53:04.304 INFO:teuthology.orchestra.run.smithi073.stdout:(20/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 9.5 MB/s | 17 MB 00:01 2024-09-14T10:53:04.329 INFO:teuthology.orchestra.run.smithi073.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 1.3 MB/s | 320 kB 00:00 2024-09-14T10:53:04.354 INFO:teuthology.orchestra.run.smithi073.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 6.0 MB/s | 305 kB 00:00 2024-09-14T10:53:04.379 INFO:teuthology.orchestra.run.smithi073.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T10:53:04.405 INFO:teuthology.orchestra.run.smithi073.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T10:53:04.480 INFO:teuthology.orchestra.run.smithi073.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.2 MB/s | 171 kB 00:00 2024-09-14T10:53:04.608 INFO:teuthology.orchestra.run.smithi029.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 6.3 MB/s | 4.8 MB 00:00 2024-09-14T10:53:04.621 INFO:teuthology.orchestra.run.smithi073.stdout:(26/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 13 MB/s | 3.2 MB 00:00 2024-09-14T10:53:04.647 INFO:teuthology.orchestra.run.smithi073.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 205 kB/s | 34 kB 00:00 2024-09-14T10:53:04.681 INFO:teuthology.orchestra.run.smithi073.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.5 MB/s | 154 kB 00:00 2024-09-14T10:53:05.383 INFO:teuthology.orchestra.run.smithi029.stdout:(8/286): ceph-osd-19.3.0-4907.ga2782315.el9.x86 12 MB/s | 17 MB 00:01 2024-09-14T10:53:05.425 INFO:teuthology.orchestra.run.smithi029.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 606 kB/s | 25 kB 00:00 2024-09-14T10:53:05.548 INFO:teuthology.orchestra.run.smithi073.stdout:(29/286): ceph-test-19.3.0-4907.ga2782315.el9.x 20 MB/s | 50 MB 00:02 2024-09-14T10:53:05.649 INFO:teuthology.orchestra.run.smithi073.stdout:(30/286): ceph-mgr-diskprediction-local-19.3.0- 7.6 MB/s | 7.4 MB 00:00 2024-09-14T10:53:05.674 INFO:teuthology.orchestra.run.smithi073.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 2.3 MB/s | 291 kB 00:00 2024-09-14T10:53:05.707 INFO:teuthology.orchestra.run.smithi073.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 847 kB/s | 49 kB 00:00 2024-09-14T10:53:05.724 INFO:teuthology.orchestra.run.smithi073.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 327 kB/s | 16 kB 00:00 2024-09-14T10:53:05.825 INFO:teuthology.orchestra.run.smithi073.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 2.4 MB/s | 285 kB 00:00 2024-09-14T10:53:05.858 INFO:teuthology.orchestra.run.smithi073.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 5.7 MB/s | 784 kB 00:00 2024-09-14T10:53:05.966 INFO:teuthology.orchestra.run.smithi073.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 784 kB/s | 85 kB 00:00 2024-09-14T10:53:06.000 INFO:teuthology.orchestra.run.smithi073.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.9 MB/s | 335 kB 00:00 2024-09-14T10:53:06.034 INFO:teuthology.orchestra.run.smithi073.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 737 kB/s | 49 kB 00:00 2024-09-14T10:53:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:(39/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2024-09-14T10:53:06.101 INFO:teuthology.orchestra.run.smithi073.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.2 MB/s | 80 kB 00:00 2024-09-14T10:53:06.159 INFO:teuthology.orchestra.run.smithi073.stdout:(41/286): libgfortran-11.5.0-2.el9.x86_64.rpm 9.4 MB/s | 801 kB 00:00 2024-09-14T10:53:06.185 INFO:teuthology.orchestra.run.smithi073.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 322 kB/s | 27 kB 00:00 2024-09-14T10:53:06.235 INFO:teuthology.orchestra.run.smithi073.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-14T10:53:06.260 INFO:teuthology.orchestra.run.smithi073.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-09-14T10:53:06.303 INFO:teuthology.orchestra.run.smithi073.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-14T10:53:06.361 INFO:teuthology.orchestra.run.smithi073.stdout:(46/286): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-14T10:53:06.389 INFO:teuthology.orchestra.run.smithi073.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-09-14T10:53:06.422 INFO:teuthology.orchestra.run.smithi073.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.2 MB/s | 135 kB 00:00 2024-09-14T10:53:06.464 INFO:teuthology.orchestra.run.smithi073.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-14T10:53:06.467 INFO:teuthology.orchestra.run.smithi029.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 5.9 MB/s | 11 MB 00:01 2024-09-14T10:53:06.498 INFO:teuthology.orchestra.run.smithi073.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-14T10:53:06.511 INFO:teuthology.orchestra.run.smithi029.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 736 kB/s | 32 kB 00:00 2024-09-14T10:53:06.640 INFO:teuthology.orchestra.run.smithi073.stdout:(51/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 7.1 MB/s | 14 MB 00:01 2024-09-14T10:53:06.673 INFO:teuthology.orchestra.run.smithi073.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 3.0 MB/s | 650 kB 00:00 2024-09-14T10:53:06.703 INFO:teuthology.orchestra.run.smithi029.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 3.9 MB/s | 756 kB 00:00 2024-09-14T10:53:06.740 INFO:teuthology.orchestra.run.smithi073.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.0 MB/s | 71 kB 00:00 2024-09-14T10:53:06.762 INFO:teuthology.orchestra.run.smithi029.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.7 MB/s | 161 kB 00:00 2024-09-14T10:53:06.899 INFO:teuthology.orchestra.run.smithi073.stdout:(54/286): adwaita-icon-theme-40.1.1-3.el9.noarc 30 MB/s | 12 MB 00:00 2024-09-14T10:53:06.924 INFO:teuthology.orchestra.run.smithi073.stdout:(55/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.8 MB/s | 523 kB 00:00 2024-09-14T10:53:06.949 INFO:teuthology.orchestra.run.smithi073.stdout:(56/286): apache-commons-codec-1.15-7.el9.noarc 1.4 MB/s | 302 kB 00:00 2024-09-14T10:53:06.975 INFO:teuthology.orchestra.run.smithi073.stdout:(57/286): apache-commons-io-2.8.0-8.el9.noarch. 3.7 MB/s | 283 kB 00:00 2024-09-14T10:53:07.008 INFO:teuthology.orchestra.run.smithi073.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 6.5 MB/s | 559 kB 00:00 2024-09-14T10:53:07.034 INFO:teuthology.orchestra.run.smithi073.stdout:(59/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-09-14T10:53:07.059 INFO:teuthology.orchestra.run.smithi073.stdout:(60/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-09-14T10:53:07.084 INFO:teuthology.orchestra.run.smithi073.stdout:(61/286): atinject-1.0.3-6.el9.noarch.rpm 308 kB/s | 23 kB 00:00 2024-09-14T10:53:07.117 INFO:teuthology.orchestra.run.smithi073.stdout:(62/286): atk-2.36.0-5.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-14T10:53:07.143 INFO:teuthology.orchestra.run.smithi073.stdout:(63/286): avahi-glib-0.8-21.el9.x86_64.rpm 178 kB/s | 15 kB 00:00 2024-09-14T10:53:07.168 INFO:teuthology.orchestra.run.smithi073.stdout:(64/286): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-14T10:53:07.193 INFO:teuthology.orchestra.run.smithi073.stdout:(65/286): cdi-api-2.0.2-6.el9.noarch.rpm 706 kB/s | 53 kB 00:00 2024-09-14T10:53:07.227 INFO:teuthology.orchestra.run.smithi073.stdout:(66/286): colord-libs-1.4.5-4.el9.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2024-09-14T10:53:07.252 INFO:teuthology.orchestra.run.smithi073.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 727 kB/s | 61 kB 00:00 2024-09-14T10:53:07.278 INFO:teuthology.orchestra.run.smithi073.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 336 kB/s | 28 kB 00:00 2024-09-14T10:53:07.303 INFO:teuthology.orchestra.run.smithi073.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-14T10:53:07.328 INFO:teuthology.orchestra.run.smithi073.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-14T10:53:07.370 INFO:teuthology.orchestra.run.smithi073.stdout:(71/286): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 980 kB 00:00 2024-09-14T10:53:07.404 INFO:teuthology.orchestra.run.smithi073.stdout:(72/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.6 MB/s | 781 kB 00:00 2024-09-14T10:53:07.429 INFO:teuthology.orchestra.run.smithi073.stdout:(73/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.2 MB/s | 325 kB 00:00 2024-09-14T10:53:07.454 INFO:teuthology.orchestra.run.smithi073.stdout:(74/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-14T10:53:07.496 INFO:teuthology.orchestra.run.smithi073.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 322 kB/s | 22 kB 00:00 2024-09-14T10:53:07.521 INFO:teuthology.orchestra.run.smithi073.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.1 MB/s | 73 kB 00:00 2024-09-14T10:53:07.555 INFO:teuthology.orchestra.run.smithi073.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2024-09-14T10:53:07.581 INFO:teuthology.orchestra.run.smithi073.stdout:(78/286): flexiblas-3.0.4-8.el9.x86_64.rpm 389 kB/s | 33 kB 00:00 2024-09-14T10:53:07.604 INFO:teuthology.orchestra.run.smithi029.stdout:(14/286): ceph-test-19.3.0-4907.ga2782315.el9.x 23 MB/s | 50 MB 00:02 2024-09-14T10:53:07.630 INFO:teuthology.orchestra.run.smithi029.stdout:(15/286): librados-devel-19.3.0-4907.ga2782315. 146 kB/s | 127 kB 00:00 2024-09-14T10:53:07.639 INFO:teuthology.orchestra.run.smithi073.stdout:(79/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 25 MB/s | 3.0 MB 00:00 2024-09-14T10:53:07.664 INFO:teuthology.orchestra.run.smithi073.stdout:(80/286): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-14T10:53:07.680 INFO:teuthology.orchestra.run.smithi029.stdout:(16/286): libradosstriper1-19.3.0-4907.ga278231 6.6 MB/s | 508 kB 00:00 2024-09-14T10:53:07.689 INFO:teuthology.orchestra.run.smithi073.stdout:(81/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 818 kB/s | 89 kB 00:00 2024-09-14T10:53:07.715 INFO:teuthology.orchestra.run.smithi073.stdout:(82/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.6 MB/s | 124 kB 00:00 2024-09-14T10:53:07.731 INFO:teuthology.orchestra.run.smithi029.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 902 kB/s | 45 kB 00:00 2024-09-14T10:53:07.740 INFO:teuthology.orchestra.run.smithi073.stdout:(83/286): giflib-5.2.1-9.el9.x86_64.rpm 642 kB/s | 49 kB 00:00 2024-09-14T10:53:07.765 INFO:teuthology.orchestra.run.smithi073.stdout:(84/286): google-guice-4.2.3-9.el9.noarch.rpm 6.1 MB/s | 473 kB 00:00 2024-09-14T10:53:07.781 INFO:teuthology.orchestra.run.smithi029.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 2.8 MB/s | 143 kB 00:00 2024-09-14T10:53:07.790 INFO:teuthology.orchestra.run.smithi073.stdout:(85/286): graphene-1.10.6-2.el9.x86_64.rpm 854 kB/s | 64 kB 00:00 2024-09-14T10:53:07.832 INFO:teuthology.orchestra.run.smithi029.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 3.1 MB/s | 161 kB 00:00 2024-09-14T10:53:07.841 INFO:teuthology.orchestra.run.smithi073.stdout:(86/286): gsm-1.0.19-6.el9.x86_64.rpm 339 kB/s | 34 kB 00:00 2024-09-14T10:53:07.883 INFO:teuthology.orchestra.run.smithi073.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-14T10:53:07.891 INFO:teuthology.orchestra.run.smithi029.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 5.3 MB/s | 320 kB 00:00 2024-09-14T10:53:07.908 INFO:teuthology.orchestra.run.smithi073.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 493 kB/s | 33 kB 00:00 2024-09-14T10:53:07.942 INFO:teuthology.orchestra.run.smithi029.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 5.9 MB/s | 305 kB 00:00 2024-09-14T10:53:07.950 INFO:teuthology.orchestra.run.smithi073.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 14 MB/s | 2.2 MB 00:00 2024-09-14T10:53:07.992 INFO:teuthology.orchestra.run.smithi029.stdout:(22/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.9 MB/s | 99 kB 00:00 2024-09-14T10:53:08.026 INFO:teuthology.orchestra.run.smithi073.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 20 MB/s | 2.3 MB 00:00 2024-09-14T10:53:08.042 INFO:teuthology.orchestra.run.smithi029.stdout:(23/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-14T10:53:08.050 INFO:teuthology.orchestra.run.smithi073.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.1 MB/s | 219 kB 00:00 2024-09-14T10:53:08.118 INFO:teuthology.orchestra.run.smithi073.stdout:(92/286): gtk3-3.24.31-5.el9.x86_64.rpm 21 MB/s | 4.9 MB 00:00 2024-09-14T10:53:08.151 INFO:teuthology.orchestra.run.smithi073.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 6.2 MB/s | 632 kB 00:00 2024-09-14T10:53:08.185 INFO:teuthology.orchestra.run.smithi073.stdout:(94/286): httpcomponents-client-4.5.13-3.el9.no 4.0 MB/s | 657 kB 00:00 2024-09-14T10:53:08.201 INFO:teuthology.orchestra.run.smithi073.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 896 kB/s | 45 kB 00:00 2024-09-14T10:53:08.212 INFO:teuthology.orchestra.run.smithi029.stdout:(24/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 19 MB/s | 3.2 MB 00:00 2024-09-14T10:53:08.277 INFO:teuthology.orchestra.run.smithi073.stdout:(96/286): iso-codes-4.6.0-3.el9.noarch.rpm 22 MB/s | 3.5 MB 00:00 2024-09-14T10:53:08.302 INFO:teuthology.orchestra.run.smithi073.stdout:(97/286): jansi-2.3.3-6.el9.x86_64.rpm 935 kB/s | 110 kB 00:00 2024-09-14T10:53:08.318 INFO:teuthology.orchestra.run.smithi029.stdout:(25/286): librgw2-19.3.0-4907.ga2782315.el9.x86 8.0 MB/s | 5.5 MB 00:00 2024-09-14T10:53:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:(98/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.2 MB/s | 413 kB 00:00 2024-09-14T10:53:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:(26/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 1.2 MB/s | 171 kB 00:00 2024-09-14T10:53:08.380 INFO:teuthology.orchestra.run.smithi029.stdout:(27/286): ceph-grafana-dashboards-19.3.0-4907.g 566 kB/s | 34 kB 00:00 2024-09-14T10:53:08.403 INFO:teuthology.orchestra.run.smithi073.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 26 MB/s | 3.3 MB 00:00 2024-09-14T10:53:08.414 INFO:teuthology.orchestra.run.smithi029.stdout:(28/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.6 MB/s | 154 kB 00:00 2024-09-14T10:53:08.428 INFO:teuthology.orchestra.run.smithi073.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 130 kB/s | 13 kB 00:00 2024-09-14T10:53:08.470 INFO:teuthology.orchestra.run.smithi073.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 793 kB/s | 53 kB 00:00 2024-09-14T10:53:08.495 INFO:teuthology.orchestra.run.smithi073.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 358 kB/s | 24 kB 00:00 2024-09-14T10:53:08.537 INFO:teuthology.orchestra.run.smithi073.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 5.5 MB/s | 377 kB 00:00 2024-09-14T10:53:08.563 INFO:teuthology.orchestra.run.smithi073.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 530 kB/s | 35 kB 00:00 2024-09-14T10:53:08.613 INFO:teuthology.orchestra.run.smithi073.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 2.2 MB/s | 168 kB 00:00 2024-09-14T10:53:08.638 INFO:teuthology.orchestra.run.smithi073.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 147 kB/s | 11 kB 00:00 2024-09-14T10:53:08.696 INFO:teuthology.orchestra.run.smithi073.stdout:(107/286): libXcursor-1.2.0-7.el9.x86_64.rpm 527 kB/s | 31 kB 00:00 2024-09-14T10:53:08.722 INFO:teuthology.orchestra.run.smithi073.stdout:(108/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 221 kB/s | 24 kB 00:00 2024-09-14T10:53:08.723 INFO:teuthology.orchestra.run.smithi029.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 24 MB/s | 7.4 MB 00:00 2024-09-14T10:53:08.747 INFO:teuthology.orchestra.run.smithi073.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 454 kB/s | 23 kB 00:00 2024-09-14T10:53:08.773 INFO:teuthology.orchestra.run.smithi029.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 5.7 MB/s | 291 kB 00:00 2024-09-14T10:53:08.781 INFO:teuthology.orchestra.run.smithi073.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 338 kB/s | 20 kB 00:00 2024-09-14T10:53:08.814 INFO:teuthology.orchestra.run.smithi073.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 592 kB/s | 40 kB 00:00 2024-09-14T10:53:08.823 INFO:teuthology.orchestra.run.smithi029.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 983 kB/s | 49 kB 00:00 2024-09-14T10:53:08.840 INFO:teuthology.orchestra.run.smithi073.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 256 kB/s | 15 kB 00:00 2024-09-14T10:53:08.874 INFO:teuthology.orchestra.run.smithi073.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 484 kB/s | 28 kB 00:00 2024-09-14T10:53:08.874 INFO:teuthology.orchestra.run.smithi029.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 328 kB/s | 16 kB 00:00 2024-09-14T10:53:08.899 INFO:teuthology.orchestra.run.smithi073.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 366 kB/s | 21 kB 00:00 2024-09-14T10:53:08.933 INFO:teuthology.orchestra.run.smithi029.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 4.8 MB/s | 285 kB 00:00 2024-09-14T10:53:09.008 INFO:teuthology.orchestra.run.smithi029.stdout:(34/286): cephadm-19.3.0-4907.ga2782315.el9.noa 10 MB/s | 784 kB 00:00 2024-09-14T10:53:09.134 INFO:teuthology.orchestra.run.smithi029.stdout:(35/286): ModemManager-glib-1.20.2-1.el9.x86_64 2.6 MB/s | 335 kB 00:00 2024-09-14T10:53:09.176 INFO:teuthology.orchestra.run.smithi029.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 2.0 MB/s | 85 kB 00:00 2024-09-14T10:53:09.210 INFO:teuthology.orchestra.run.smithi029.stdout:(37/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-14T10:53:09.261 INFO:teuthology.orchestra.run.smithi029.stdout:(38/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 5.1 MB/s | 262 kB 00:00 2024-09-14T10:53:09.311 INFO:teuthology.orchestra.run.smithi029.stdout:(39/286): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-14T10:53:09.332 INFO:teuthology.orchestra.run.smithi073.stdout:(115/286): java-11-openjdk-headless-11.0.20.1.1 38 MB/s | 39 MB 00:01 2024-09-14T10:53:09.358 INFO:teuthology.orchestra.run.smithi073.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 39 kB/s | 19 kB 00:00 2024-09-14T10:53:09.383 INFO:teuthology.orchestra.run.smithi073.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 39 kB/s | 19 kB 00:00 2024-09-14T10:53:09.397 INFO:teuthology.orchestra.run.smithi029.stdout:(40/286): libgfortran-11.5.0-2.el9.x86_64.rpm 9.2 MB/s | 801 kB 00:00 2024-09-14T10:53:09.408 INFO:teuthology.orchestra.run.smithi073.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 405 kB/s | 30 kB 00:00 2024-09-14T10:53:09.433 INFO:teuthology.orchestra.run.smithi073.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 636 kB/s | 32 kB 00:00 2024-09-14T10:53:09.440 INFO:teuthology.orchestra.run.smithi029.stdout:(41/286): libpciaccess-0.16-7.el9.x86_64.rpm 642 kB/s | 27 kB 00:00 2024-09-14T10:53:09.458 INFO:teuthology.orchestra.run.smithi073.stdout:(120/286): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-14T10:53:09.481 INFO:teuthology.orchestra.run.smithi029.stdout:(42/286): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-14T10:53:09.484 INFO:teuthology.orchestra.run.smithi073.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 2.1 MB/s | 161 kB 00:00 2024-09-14T10:53:09.524 INFO:teuthology.orchestra.run.smithi029.stdout:(43/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 2.2 MB/s | 94 kB 00:00 2024-09-14T10:53:09.526 INFO:teuthology.orchestra.run.smithi073.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 6.4 MB/s | 435 kB 00:00 2024-09-14T10:53:09.551 INFO:teuthology.orchestra.run.smithi073.stdout:(123/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-09-14T10:53:09.574 INFO:teuthology.orchestra.run.smithi029.stdout:(44/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-14T10:53:09.576 INFO:teuthology.orchestra.run.smithi073.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 336 kB/s | 31 kB 00:00 2024-09-14T10:53:09.601 INFO:teuthology.orchestra.run.smithi073.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-09-14T10:53:09.643 INFO:teuthology.orchestra.run.smithi073.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 551 kB/s | 37 kB 00:00 2024-09-14T10:53:09.650 INFO:teuthology.orchestra.run.smithi029.stdout:(45/286): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-14T10:53:09.669 INFO:teuthology.orchestra.run.smithi073.stdout:(127/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.4 MB/s | 135 kB 00:00 2024-09-14T10:53:09.692 INFO:teuthology.orchestra.run.smithi029.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-14T10:53:09.694 INFO:teuthology.orchestra.run.smithi073.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.5 MB/s | 142 kB 00:00 2024-09-14T10:53:09.719 INFO:teuthology.orchestra.run.smithi073.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 3.3 MB/s | 256 kB 00:00 2024-09-14T10:53:09.734 INFO:teuthology.orchestra.run.smithi029.stdout:(47/286): python3-pycparser-2.20-6.el9.noarch.r 3.1 MB/s | 135 kB 00:00 2024-09-14T10:53:09.769 INFO:teuthology.orchestra.run.smithi073.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 818 kB/s | 61 kB 00:00 2024-09-14T10:53:09.785 INFO:teuthology.orchestra.run.smithi029.stdout:(48/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-14T10:53:09.794 INFO:teuthology.orchestra.run.smithi073.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 550 kB/s | 41 kB 00:00 2024-09-14T10:53:09.820 INFO:teuthology.orchestra.run.smithi073.stdout:(132/286): libgxps-0.3.2-3.el9.x86_64.rpm 628 kB/s | 79 kB 00:00 2024-09-14T10:53:09.827 INFO:teuthology.orchestra.run.smithi029.stdout:(49/286): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-14T10:53:09.845 INFO:teuthology.orchestra.run.smithi073.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-14T10:53:09.870 INFO:teuthology.orchestra.run.smithi073.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 578 kB/s | 44 kB 00:00 2024-09-14T10:53:09.895 INFO:teuthology.orchestra.run.smithi073.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 445 kB/s | 34 kB 00:00 2024-09-14T10:53:09.921 INFO:teuthology.orchestra.run.smithi073.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-14T10:53:09.946 INFO:teuthology.orchestra.run.smithi073.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-14T10:53:09.971 INFO:teuthology.orchestra.run.smithi073.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-09-14T10:53:10.005 INFO:teuthology.orchestra.run.smithi073.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 760 kB/s | 45 kB 00:00 2024-09-14T10:53:10.039 INFO:teuthology.orchestra.run.smithi073.stdout:(140/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-14T10:53:10.064 INFO:teuthology.orchestra.run.smithi073.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 2.2 MB/s | 206 kB 00:00 2024-09-14T10:53:10.089 INFO:teuthology.orchestra.run.smithi073.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.9 MB/s | 164 kB 00:00 2024-09-14T10:53:10.115 INFO:teuthology.orchestra.run.smithi073.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-14T10:53:10.128 INFO:teuthology.orchestra.run.smithi029.stdout:(50/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 8.1 MB/s | 14 MB 00:01 2024-09-14T10:53:10.157 INFO:teuthology.orchestra.run.smithi073.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 4.7 MB/s | 324 kB 00:00 2024-09-14T10:53:10.174 INFO:teuthology.orchestra.run.smithi073.stdout:(145/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 326 kB/s | 36 kB 00:00 2024-09-14T10:53:10.199 INFO:teuthology.orchestra.run.smithi073.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-14T10:53:10.224 INFO:teuthology.orchestra.run.smithi073.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 2.8 MB/s | 193 kB 00:00 2024-09-14T10:53:10.249 INFO:teuthology.orchestra.run.smithi073.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 442 kB/s | 33 kB 00:00 2024-09-14T10:53:10.275 INFO:teuthology.orchestra.run.smithi073.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 257 kB/s | 19 kB 00:00 2024-09-14T10:53:10.300 INFO:teuthology.orchestra.run.smithi073.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-14T10:53:10.325 INFO:teuthology.orchestra.run.smithi073.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 554 kB/s | 42 kB 00:00 2024-09-14T10:53:10.350 INFO:teuthology.orchestra.run.smithi073.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 277 kB 00:00 2024-09-14T10:53:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 133 kB 00:00 2024-09-14T10:53:10.401 INFO:teuthology.orchestra.run.smithi073.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-14T10:53:10.426 INFO:teuthology.orchestra.run.smithi073.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 474 kB/s | 36 kB 00:00 2024-09-14T10:53:10.460 INFO:teuthology.orchestra.run.smithi073.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-14T10:53:10.485 INFO:teuthology.orchestra.run.smithi073.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-14T10:53:10.495 INFO:teuthology.orchestra.run.smithi029.stdout:(51/286): ceph-common-19.3.0-4907.ga2782315.el9 2.6 MB/s | 22 MB 00:08 2024-09-14T10:53:10.510 INFO:teuthology.orchestra.run.smithi073.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-09-14T10:53:10.536 INFO:teuthology.orchestra.run.smithi073.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 234 kB/s | 18 kB 00:00 2024-09-14T10:53:10.561 INFO:teuthology.orchestra.run.smithi073.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 179 kB/s | 9.0 kB 00:00 2024-09-14T10:53:10.603 INFO:teuthology.orchestra.run.smithi073.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 13 MB/s | 1.5 MB 00:00 2024-09-14T10:53:10.628 INFO:teuthology.orchestra.run.smithi073.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-14T10:53:10.653 INFO:teuthology.orchestra.run.smithi073.stdout:(163/286): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-14T10:53:10.679 INFO:teuthology.orchestra.run.smithi073.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.5 MB/s | 112 kB 00:00 2024-09-14T10:53:10.720 INFO:teuthology.orchestra.run.smithi073.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-14T10:53:10.745 INFO:teuthology.orchestra.run.smithi073.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-14T10:53:10.779 INFO:teuthology.orchestra.run.smithi073.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-09-14T10:53:10.804 INFO:teuthology.orchestra.run.smithi073.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 617 kB/s | 36 kB 00:00 2024-09-14T10:53:10.830 INFO:teuthology.orchestra.run.smithi073.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 917 kB/s | 46 kB 00:00 2024-09-14T10:53:10.845 INFO:teuthology.orchestra.run.smithi029.stdout:(52/286): adwaita-cursor-theme-40.1.1-3.el9.noa 639 kB/s | 650 kB 00:01 2024-09-14T10:53:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 548 kB/s | 32 kB 00:00 2024-09-14T10:53:10.889 INFO:teuthology.orchestra.run.smithi073.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 655 kB/s | 38 kB 00:00 2024-09-14T10:53:10.921 INFO:teuthology.orchestra.run.smithi029.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 940 kB/s | 71 kB 00:00 2024-09-14T10:53:10.989 INFO:teuthology.orchestra.run.smithi073.stdout:(172/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 24 MB/s | 8.8 MB 00:00 2024-09-14T10:53:11.033 INFO:teuthology.orchestra.run.smithi073.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-14T10:53:11.058 INFO:teuthology.orchestra.run.smithi073.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2024-09-14T10:53:11.063 INFO:teuthology.orchestra.run.smithi029.stdout:(54/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 922 kB/s | 523 kB 00:00 2024-09-14T10:53:11.092 INFO:teuthology.orchestra.run.smithi073.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-14T10:53:11.099 INFO:teuthology.orchestra.run.smithi029.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 1.7 MB/s | 302 kB 00:00 2024-09-14T10:53:11.167 INFO:teuthology.orchestra.run.smithi073.stdout:(176/286): openblas-openmp-0.3.26-2.el9.x86_64. 16 MB/s | 4.9 MB 00:00 2024-09-14T10:53:11.192 INFO:teuthology.orchestra.run.smithi073.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 737 kB/s | 74 kB 00:00 2024-09-14T10:53:11.217 INFO:teuthology.orchestra.run.smithi073.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 3.3 MB/s | 531 kB 00:00 2024-09-14T10:53:11.232 INFO:teuthology.orchestra.run.smithi029.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 1.6 MB/s | 283 kB 00:00 2024-09-14T10:53:11.243 INFO:teuthology.orchestra.run.smithi073.stdout:(179/286): ostree-libs-2024.7-2.el9.x86_64.rpm 6.0 MB/s | 468 kB 00:00 2024-09-14T10:53:11.268 INFO:teuthology.orchestra.run.smithi073.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 3.2 MB/s | 246 kB 00:00 2024-09-14T10:53:11.275 INFO:teuthology.orchestra.run.smithi029.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 3.1 MB/s | 559 kB 00:00 2024-09-14T10:53:11.293 INFO:teuthology.orchestra.run.smithi073.stdout:(181/286): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-14T10:53:11.317 INFO:teuthology.orchestra.run.smithi029.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-09-14T10:53:11.319 INFO:teuthology.orchestra.run.smithi073.stdout:(182/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 757 kB/s | 57 kB 00:00 2024-09-14T10:53:11.344 INFO:teuthology.orchestra.run.smithi073.stdout:(183/286): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-14T10:53:11.369 INFO:teuthology.orchestra.run.smithi073.stdout:(184/286): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-09-14T10:53:11.384 INFO:teuthology.orchestra.run.smithi029.stdout:(59/286): atinject-1.0.3-6.el9.noarch.rpm 347 kB/s | 23 kB 00:00 2024-09-14T10:53:11.411 INFO:teuthology.orchestra.run.smithi073.stdout:(185/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-09-14T10:53:11.418 INFO:teuthology.orchestra.run.smithi029.stdout:(60/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-09-14T10:53:11.436 INFO:teuthology.orchestra.run.smithi073.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-09-14T10:53:11.470 INFO:teuthology.orchestra.run.smithi073.stdout:(187/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.5 MB/s | 192 kB 00:00 2024-09-14T10:53:11.485 INFO:teuthology.orchestra.run.smithi029.stdout:(61/286): avahi-glib-0.8-21.el9.x86_64.rpm 223 kB/s | 15 kB 00:00 2024-09-14T10:53:11.495 INFO:teuthology.orchestra.run.smithi073.stdout:(188/286): plexus-classworlds-2.6.0-11.el9.noar 717 kB/s | 60 kB 00:00 2024-09-14T10:53:11.519 INFO:teuthology.orchestra.run.smithi029.stdout:(62/286): atk-2.36.0-5.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-14T10:53:11.520 INFO:teuthology.orchestra.run.smithi073.stdout:(189/286): plexus-containers-component-annotati 219 kB/s | 18 kB 00:00 2024-09-14T10:53:11.546 INFO:teuthology.orchestra.run.smithi073.stdout:(190/286): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-14T10:53:11.571 INFO:teuthology.orchestra.run.smithi073.stdout:(191/286): plexus-sec-dispatcher-1.4-37.el9.noa 444 kB/s | 34 kB 00:00 2024-09-14T10:53:11.595 INFO:teuthology.orchestra.run.smithi029.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 980 kB/s | 107 kB 00:00 2024-09-14T10:53:11.596 INFO:teuthology.orchestra.run.smithi073.stdout:(192/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-14T10:53:11.637 INFO:teuthology.orchestra.run.smithi029.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 454 kB/s | 53 kB 00:00 2024-09-14T10:53:11.655 INFO:teuthology.orchestra.run.smithi073.stdout:(193/286): poppler-data-0.4.9-9.el9.noarch.rpm 22 MB/s | 1.9 MB 00:00 2024-09-14T10:53:11.688 INFO:teuthology.orchestra.run.smithi073.stdout:(194/286): poppler-21.01.0-21.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-09-14T10:53:11.712 INFO:teuthology.orchestra.run.smithi029.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T10:53:11.714 INFO:teuthology.orchestra.run.smithi073.stdout:(195/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-14T10:53:11.746 INFO:teuthology.orchestra.run.smithi029.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 560 kB/s | 61 kB 00:00 2024-09-14T10:53:11.747 INFO:teuthology.orchestra.run.smithi073.stdout:(196/286): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-09-14T10:53:11.780 INFO:teuthology.orchestra.run.smithi029.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 418 kB/s | 28 kB 00:00 2024-09-14T10:53:11.781 INFO:teuthology.orchestra.run.smithi073.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 9.9 MB/s | 679 kB 00:00 2024-09-14T10:53:11.814 INFO:teuthology.orchestra.run.smithi029.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-14T10:53:11.839 INFO:teuthology.orchestra.run.smithi073.stdout:(198/286): publicsuffix-list-20210518-3.el9.noa 548 kB/s | 83 kB 00:00 2024-09-14T10:53:11.906 INFO:teuthology.orchestra.run.smithi073.stdout:(199/286): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-14T10:53:11.932 INFO:teuthology.orchestra.run.smithi073.stdout:(200/286): python3-devel-3.9.19-8.el9.x86_64.rp 1.6 MB/s | 245 kB 00:00 2024-09-14T10:53:11.948 INFO:teuthology.orchestra.run.smithi029.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 3.1 MB/s | 525 kB 00:00 2024-09-14T10:53:11.957 INFO:teuthology.orchestra.run.smithi073.stdout:(201/286): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-14T10:53:11.982 INFO:teuthology.orchestra.run.smithi073.stdout:(202/286): python3-jsonpatch-1.21-16.el9.noarch 339 kB/s | 26 kB 00:00 2024-09-14T10:53:12.008 INFO:teuthology.orchestra.run.smithi073.stdout:(203/286): python3-jsonpointer-2.0-4.el9.noarch 253 kB/s | 19 kB 00:00 2024-09-14T10:53:12.033 INFO:teuthology.orchestra.run.smithi073.stdout:(204/286): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-14T10:53:12.058 INFO:teuthology.orchestra.run.smithi073.stdout:(205/286): python3-markupsafe-1.1.1-12.el9.x86_ 459 kB/s | 35 kB 00:00 2024-09-14T10:53:12.076 INFO:teuthology.orchestra.run.smithi029.stdout:(70/286): exiv2-0.27.5-2.el9.x86_64.rpm 3.7 MB/s | 980 kB 00:00 2024-09-14T10:53:12.100 INFO:teuthology.orchestra.run.smithi073.stdout:(206/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.7 MB/s | 250 kB 00:00 2024-09-14T10:53:12.128 INFO:teuthology.orchestra.run.smithi073.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 3.3 MB/s | 222 kB 00:00 2024-09-14T10:53:12.201 INFO:teuthology.orchestra.run.smithi029.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 3.0 MB/s | 781 kB 00:00 2024-09-14T10:53:12.201 INFO:teuthology.orchestra.run.smithi073.stdout:(208/286): python3-numpy-1.20.1-5.el9.x86_64.rp 26 MB/s | 5.1 MB 00:00 2024-09-14T10:53:12.226 INFO:teuthology.orchestra.run.smithi073.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 421 kB/s | 42 kB 00:00 2024-09-14T10:53:12.234 INFO:teuthology.orchestra.run.smithi029.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.0 MB/s | 325 kB 00:00 2024-09-14T10:53:12.251 INFO:teuthology.orchestra.run.smithi073.stdout:(210/286): python3-packaging-20.9-5.el9.noarch. 512 kB/s | 77 kB 00:00 2024-09-14T10:53:12.285 INFO:teuthology.orchestra.run.smithi073.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.7 MB/s | 159 kB 00:00 2024-09-14T10:53:12.312 INFO:teuthology.orchestra.run.smithi073.stdout:(212/286): python3-protobuf-3.14.0-13.el9.noarc 2.4 MB/s | 269 kB 00:00 2024-09-14T10:53:12.312 INFO:teuthology.orchestra.run.smithi029.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 2.0 MB/s | 218 kB 00:00 2024-09-14T10:53:12.335 INFO:teuthology.orchestra.run.smithi073.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 3.3 MB/s | 279 kB 00:00 2024-09-14T10:53:12.352 INFO:teuthology.orchestra.run.smithi073.stdout:(214/286): python3-pytz-2021.1-5.el9.noarch.rpm 759 kB/s | 51 kB 00:00 2024-09-14T10:53:12.369 INFO:teuthology.orchestra.run.smithi073.stdout:(215/286): python3-requests-oauthlib-1.3.0-12.e 913 kB/s | 54 kB 00:00 2024-09-14T10:53:12.377 INFO:teuthology.orchestra.run.smithi029.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-14T10:53:12.403 INFO:teuthology.orchestra.run.smithi073.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 831 kB/s | 42 kB 00:00 2024-09-14T10:53:12.445 INFO:teuthology.orchestra.run.smithi073.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-14T10:53:12.453 INFO:teuthology.orchestra.run.smithi029.stdout:(75/286): flatpak-session-helper-1.12.9-1.el9.x 971 kB/s | 73 kB 00:00 2024-09-14T10:53:12.461 INFO:teuthology.orchestra.run.smithi073.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-14T10:53:12.495 INFO:teuthology.orchestra.run.smithi073.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-14T10:53:12.512 INFO:teuthology.orchestra.run.smithi073.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T10:53:12.520 INFO:teuthology.orchestra.run.smithi029.stdout:(76/286): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-14T10:53:12.563 INFO:teuthology.orchestra.run.smithi073.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-14T10:53:12.588 INFO:teuthology.orchestra.run.smithi073.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 917 kB/s | 69 kB 00:00 2024-09-14T10:53:12.630 INFO:teuthology.orchestra.run.smithi073.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-14T10:53:12.664 INFO:teuthology.orchestra.run.smithi073.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 5.0 MB/s | 383 kB 00:00 2024-09-14T10:53:12.689 INFO:teuthology.orchestra.run.smithi073.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 2.6 MB/s | 152 kB 00:00 2024-09-14T10:53:12.704 INFO:teuthology.orchestra.run.smithi029.stdout:(77/286): flatpak-1.12.9-1.el9.x86_64.rpm 3.7 MB/s | 1.7 MB 00:00 2024-09-14T10:53:12.780 INFO:teuthology.orchestra.run.smithi029.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-14T10:53:12.855 INFO:teuthology.orchestra.run.smithi029.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.2 MB/s | 89 kB 00:00 2024-09-14T10:53:12.856 INFO:teuthology.orchestra.run.smithi073.stdout:(226/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-14T10:53:12.889 INFO:teuthology.orchestra.run.smithi073.stdout:(227/286): tracker-3.1.2-3.el9.x86_64.rpm 2.4 MB/s | 555 kB 00:00 2024-09-14T10:53:12.922 INFO:teuthology.orchestra.run.smithi029.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-14T10:53:12.931 INFO:teuthology.orchestra.run.smithi073.stdout:(228/286): tracker-miners-3.1.2-4.el9.x86_64.rp 3.8 MB/s | 944 kB 00:00 2024-09-14T10:53:12.956 INFO:teuthology.orchestra.run.smithi073.stdout:(229/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 530 kB/s | 53 kB 00:00 2024-09-14T10:53:12.982 INFO:teuthology.orchestra.run.smithi073.stdout:(230/286): tzdata-java-2024a-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-14T10:53:13.007 INFO:teuthology.orchestra.run.smithi073.stdout:(231/286): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-14T10:53:13.031 INFO:teuthology.orchestra.run.smithi029.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 447 kB/s | 49 kB 00:00 2024-09-14T10:53:13.032 INFO:teuthology.orchestra.run.smithi073.stdout:(232/286): webrtc-audio-processing-0.3.1-8.el9. 3.9 MB/s | 306 kB 00:00 2024-09-14T10:53:13.058 INFO:teuthology.orchestra.run.smithi073.stdout:(233/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-14T10:53:13.083 INFO:teuthology.orchestra.run.smithi073.stdout:(234/286): wireplumber-libs-0.4.14-1.el9.x86_64 4.6 MB/s | 358 kB 00:00 2024-09-14T10:53:13.108 INFO:teuthology.orchestra.run.smithi073.stdout:(235/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 562 kB/s | 42 kB 00:00 2024-09-14T10:53:13.134 INFO:teuthology.orchestra.run.smithi073.stdout:(236/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-14T10:53:13.150 INFO:teuthology.orchestra.run.smithi073.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.0 MB/s | 134 kB 00:00 2024-09-14T10:53:13.190 INFO:teuthology.orchestra.run.smithi029.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 2.9 MB/s | 473 kB 00:00 2024-09-14T10:53:13.193 INFO:teuthology.orchestra.run.smithi073.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 10 MB/s | 859 kB 00:00 2024-09-14T10:53:13.218 INFO:teuthology.orchestra.run.smithi073.stdout:(239/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 760 kB/s | 64 kB 00:00 2024-09-14T10:53:13.243 INFO:teuthology.orchestra.run.smithi073.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-14T10:53:13.293 INFO:teuthology.orchestra.run.smithi073.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-14T10:53:13.299 INFO:teuthology.orchestra.run.smithi029.stdout:(83/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.8 MB/s | 3.0 MB 00:00 2024-09-14T10:53:13.318 INFO:teuthology.orchestra.run.smithi073.stdout:(242/286): lua-devel-5.4.4-4.el9.x86_64.rpm 177 kB/s | 22 kB 00:00 2024-09-14T10:53:13.326 INFO:teuthology.orchestra.run.smithi029.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 475 kB/s | 64 kB 00:00 2024-09-14T10:53:13.352 INFO:teuthology.orchestra.run.smithi073.stdout:(243/286): gperftools-libs-2.9.1-3.el9.x86_64.r 5.2 MB/s | 308 kB 00:00 2024-09-14T10:53:13.368 INFO:teuthology.orchestra.run.smithi029.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 492 kB/s | 34 kB 00:00 2024-09-14T10:53:13.377 INFO:teuthology.orchestra.run.smithi073.stdout:(244/286): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-14T10:53:13.402 INFO:teuthology.orchestra.run.smithi073.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-14T10:53:13.428 INFO:teuthology.orchestra.run.smithi073.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T10:53:13.461 INFO:teuthology.orchestra.run.smithi073.stdout:(247/286): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-09-14T10:53:13.495 INFO:teuthology.orchestra.run.smithi073.stdout:(248/286): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-14T10:53:13.528 INFO:teuthology.orchestra.run.smithi073.stdout:(249/286): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-14T10:53:13.571 INFO:teuthology.orchestra.run.smithi073.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-14T10:53:13.604 INFO:teuthology.orchestra.run.smithi073.stdout:(251/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 839 kB 00:00 2024-09-14T10:53:13.630 INFO:teuthology.orchestra.run.smithi073.stdout:(252/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-14T10:53:13.655 INFO:teuthology.orchestra.run.smithi073.stdout:(253/286): python3-cachetools-4.2.4-1.el9.noarc 643 kB/s | 32 kB 00:00 2024-09-14T10:53:13.672 INFO:teuthology.orchestra.run.smithi073.stdout:(254/286): python3-certifi-2023.05.07-4.el9.noa 338 kB/s | 14 kB 00:00 2024-09-14T10:53:13.721 INFO:teuthology.orchestra.run.smithi029.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 4.1 MB/s | 1.4 MB 00:00 2024-09-14T10:53:13.722 INFO:teuthology.orchestra.run.smithi073.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-09-14T10:53:13.730 INFO:teuthology.orchestra.run.smithi073.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-14T10:53:13.744 INFO:teuthology.orchestra.run.smithi029.stdout:(87/286): gtk-update-icon-cache-3.24.31-5.el9.x 495 kB/s | 33 kB 00:00 2024-09-14T10:53:13.756 INFO:teuthology.orchestra.run.smithi073.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T10:53:13.790 INFO:teuthology.orchestra.run.smithi073.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T10:53:13.815 INFO:teuthology.orchestra.run.smithi073.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-14T10:53:13.840 INFO:teuthology.orchestra.run.smithi073.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-14T10:53:13.874 INFO:teuthology.orchestra.run.smithi073.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 694 kB/s | 23 kB 00:00 2024-09-14T10:53:13.899 INFO:teuthology.orchestra.run.smithi073.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-14T10:53:13.925 INFO:teuthology.orchestra.run.smithi073.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-14T10:53:14.000 INFO:teuthology.orchestra.run.smithi073.stdout:(264/286): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-14T10:53:14.025 INFO:teuthology.orchestra.run.smithi073.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:53:14.050 INFO:teuthology.orchestra.run.smithi073.stdout:(266/286): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-14T10:53:14.070 INFO:teuthology.orchestra.run.smithi029.stdout:(88/286): adwaita-icon-theme-40.1.1-3.el9.noarc 3.0 MB/s | 12 MB 00:03 2024-09-14T10:53:14.085 INFO:teuthology.orchestra.run.smithi073.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-14T10:53:14.118 INFO:teuthology.orchestra.run.smithi073.stdout:(268/286): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-14T10:53:14.143 INFO:teuthology.orchestra.run.smithi073.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-14T10:53:14.185 INFO:teuthology.orchestra.run.smithi073.stdout:(270/286): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-09-14T10:53:14.221 INFO:teuthology.orchestra.run.smithi029.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 2.6 MB/s | 2.2 MB 00:00 2024-09-14T10:53:14.235 INFO:teuthology.orchestra.run.smithi073.stdout:(271/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-09-14T10:53:14.261 INFO:teuthology.orchestra.run.smithi073.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-09-14T10:53:14.285 INFO:teuthology.orchestra.run.smithi073.stdout:(273/286): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-14T10:53:14.311 INFO:teuthology.orchestra.run.smithi073.stdout:(274/286): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-14T10:53:14.336 INFO:teuthology.orchestra.run.smithi073.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T10:53:14.337 INFO:teuthology.orchestra.run.smithi029.stdout:(90/286): hicolor-icon-theme-0.17-13.el9.noarch 1.8 MB/s | 219 kB 00:00 2024-09-14T10:53:14.361 INFO:teuthology.orchestra.run.smithi073.stdout:(276/286): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-14T10:53:14.378 INFO:teuthology.orchestra.run.smithi073.stdout:(277/286): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-14T10:53:14.404 INFO:teuthology.orchestra.run.smithi073.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-14T10:53:14.429 INFO:teuthology.orchestra.run.smithi073.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-14T10:53:14.454 INFO:teuthology.orchestra.run.smithi073.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-14T10:53:14.479 INFO:teuthology.orchestra.run.smithi073.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T10:53:14.505 INFO:teuthology.orchestra.run.smithi073.stdout:(282/286): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-14T10:53:14.530 INFO:teuthology.orchestra.run.smithi073.stdout:(283/286): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-14T10:53:14.580 INFO:teuthology.orchestra.run.smithi073.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T10:53:14.622 INFO:teuthology.orchestra.run.smithi029.stdout:(91/286): httpcomponents-client-4.5.13-3.el9.no 2.3 MB/s | 657 kB 00:00 2024-09-14T10:53:14.805 INFO:teuthology.orchestra.run.smithi073.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-14T10:53:14.872 INFO:teuthology.orchestra.run.smithi073.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-14T10:53:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:14.879 INFO:teuthology.orchestra.run.smithi073.stdout:Total 24 MB/s | 327 MB 00:13 2024-09-14T10:53:15.339 INFO:teuthology.orchestra.run.smithi029.stdout:(92/286): guava-30.1-6.el9.noarch.rpm 1.8 MB/s | 2.3 MB 00:01 2024-09-14T10:53:15.414 INFO:teuthology.orchestra.run.smithi029.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 797 kB/s | 632 kB 00:00 2024-09-14T10:53:15.482 INFO:teuthology.orchestra.run.smithi029.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 674 kB/s | 45 kB 00:00 2024-09-14T10:53:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:(95/286): jansi-2.3.3-6.el9.x86_64.rpm 1.0 MB/s | 110 kB 00:00 2024-09-14T10:53:15.916 INFO:teuthology.orchestra.run.smithi029.stdout:(96/286): gtk3-3.24.31-5.el9.x86_64.rpm 2.2 MB/s | 4.9 MB 00:02 2024-09-14T10:53:15.967 INFO:teuthology.orchestra.run.smithi029.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 1.1 MB/s | 413 kB 00:00 2024-09-14T10:53:16.984 INFO:teuthology.orchestra.run.smithi029.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 2.1 MB/s | 3.5 MB 00:01 2024-09-14T10:53:17.061 INFO:teuthology.orchestra.run.smithi029.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 170 kB/s | 13 kB 00:00 2024-09-14T10:53:17.178 INFO:teuthology.orchestra.run.smithi029.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 454 kB/s | 53 kB 00:00 2024-09-14T10:53:17.253 INFO:teuthology.orchestra.run.smithi029.stdout:(101/286): java-11-openjdk-devel-11.0.20.1.1-2. 2.5 MB/s | 3.3 MB 00:01 2024-09-14T10:53:17.279 INFO:teuthology.orchestra.run.smithi029.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 238 kB/s | 24 kB 00:00 2024-09-14T10:53:17.346 INFO:teuthology.orchestra.run.smithi029.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 531 kB/s | 35 kB 00:00 2024-09-14T10:53:17.421 INFO:teuthology.orchestra.run.smithi029.stdout:(104/286): jsoup-1.13.1-10.el9.noarch.rpm 2.2 MB/s | 377 kB 00:00 2024-09-14T10:53:17.464 INFO:teuthology.orchestra.run.smithi029.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 1.4 MB/s | 168 kB 00:00 2024-09-14T10:53:17.489 INFO:teuthology.orchestra.run.smithi029.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 164 kB/s | 11 kB 00:00 2024-09-14T10:53:17.531 INFO:teuthology.orchestra.run.smithi029.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 360 kB/s | 24 kB 00:00 2024-09-14T10:53:17.557 INFO:teuthology.orchestra.run.smithi029.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 456 kB/s | 31 kB 00:00 2024-09-14T10:53:17.607 INFO:teuthology.orchestra.run.smithi029.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 301 kB/s | 23 kB 00:00 2024-09-14T10:53:17.633 INFO:teuthology.orchestra.run.smithi029.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 261 kB/s | 20 kB 00:00 2024-09-14T10:53:17.675 INFO:teuthology.orchestra.run.smithi029.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 588 kB/s | 40 kB 00:00 2024-09-14T10:53:17.701 INFO:teuthology.orchestra.run.smithi029.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 223 kB/s | 15 kB 00:00 2024-09-14T10:53:17.743 INFO:teuthology.orchestra.run.smithi029.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 421 kB/s | 28 kB 00:00 2024-09-14T10:53:17.769 INFO:teuthology.orchestra.run.smithi029.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 318 kB/s | 21 kB 00:00 2024-09-14T10:53:17.821 INFO:teuthology.orchestra.run.smithi029.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 247 kB/s | 19 kB 00:00 2024-09-14T10:53:17.838 INFO:teuthology.orchestra.run.smithi029.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 272 kB/s | 19 kB 00:00 2024-09-14T10:53:17.888 INFO:teuthology.orchestra.run.smithi029.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 452 kB/s | 30 kB 00:00 2024-09-14T10:53:17.914 INFO:teuthology.orchestra.run.smithi029.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-14T10:53:17.956 INFO:teuthology.orchestra.run.smithi029.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 472 kB/s | 32 kB 00:00 2024-09-14T10:53:18.023 INFO:teuthology.orchestra.run.smithi029.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-14T10:53:18.084 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-14T10:53:18.099 INFO:teuthology.orchestra.run.smithi029.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 1.7 MB/s | 241 kB 00:00 2024-09-14T10:53:18.166 INFO:teuthology.orchestra.run.smithi029.stdout:(122/286): libfontenc-1.1.3-17.el9.x86_64.rpm 464 kB/s | 31 kB 00:00 2024-09-14T10:53:18.200 INFO:teuthology.orchestra.run.smithi029.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 2.4 MB/s | 435 kB 00:00 2024-09-14T10:53:18.234 INFO:teuthology.orchestra.run.smithi029.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-09-14T10:53:18.268 INFO:teuthology.orchestra.run.smithi029.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 135 kB 00:00 2024-09-14T10:53:18.269 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-14T10:53:18.269 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-14T10:53:18.302 INFO:teuthology.orchestra.run.smithi029.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 545 kB/s | 37 kB 00:00 2024-09-14T10:53:18.385 INFO:teuthology.orchestra.run.smithi029.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.2 MB/s | 142 kB 00:00 2024-09-14T10:53:18.419 INFO:teuthology.orchestra.run.smithi029.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-14T10:53:18.528 INFO:teuthology.orchestra.run.smithi029.stdout:(129/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 565 kB/s | 61 kB 00:00 2024-09-14T10:53:18.597 INFO:teuthology.orchestra.run.smithi029.stdout:(130/286): libldac-2.0.2.3-10.el9.x86_64.rpm 604 kB/s | 41 kB 00:00 2024-09-14T10:53:18.681 INFO:teuthology.orchestra.run.smithi029.stdout:(131/286): libgxps-0.3.2-3.el9.x86_64.rpm 267 kB/s | 79 kB 00:00 2024-09-14T10:53:18.715 INFO:teuthology.orchestra.run.smithi029.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-14T10:53:18.749 INFO:teuthology.orchestra.run.smithi029.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 648 kB/s | 44 kB 00:00 2024-09-14T10:53:18.783 INFO:teuthology.orchestra.run.smithi029.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 498 kB/s | 34 kB 00:00 2024-09-14T10:53:18.900 INFO:teuthology.orchestra.run.smithi029.stdout:(135/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-14T10:53:18.975 INFO:teuthology.orchestra.run.smithi029.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 1.4 MB/s | 319 kB 00:00 2024-09-14T10:53:19.001 INFO:teuthology.orchestra.run.smithi029.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-09-14T10:53:19.068 INFO:teuthology.orchestra.run.smithi029.stdout:(138/286): libsbc-1.4-9.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-14T10:53:19.185 INFO:teuthology.orchestra.run.smithi029.stdout:(139/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.7 MB/s | 206 kB 00:00 2024-09-14T10:53:19.303 INFO:teuthology.orchestra.run.smithi029.stdout:(140/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.4 MB/s | 164 kB 00:00 2024-09-14T10:53:19.453 INFO:teuthology.orchestra.run.smithi029.stdout:(141/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2024-09-14T10:53:19.862 INFO:teuthology.orchestra.run.smithi029.stdout:(142/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 87 kB/s | 36 kB 00:00 2024-09-14T10:53:19.955 INFO:teuthology.orchestra.run.smithi029.stdout:(143/286): librdkafka-1.6.1-102.el9.x86_64.rpm 677 kB/s | 662 kB 00:00 2024-09-14T10:53:20.193 INFO:teuthology.orchestra.run.smithi029.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 989 kB/s | 324 kB 00:00 2024-09-14T10:53:20.216 INFO:teuthology.orchestra.run.smithi029.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 552 kB/s | 144 kB 00:00 2024-09-14T10:53:20.291 INFO:teuthology.orchestra.run.smithi029.stdout:(146/286): libwayland-client-1.21.0-1.el9.x86_6 443 kB/s | 33 kB 00:00 2024-09-14T10:53:20.358 INFO:teuthology.orchestra.run.smithi029.stdout:(147/286): libwayland-cursor-1.21.0-1.el9.x86_6 291 kB/s | 19 kB 00:00 2024-09-14T10:53:20.409 INFO:teuthology.orchestra.run.smithi029.stdout:(148/286): libvorbis-1.3.7-5.el9.x86_64.rpm 884 kB/s | 193 kB 00:00 2024-09-14T10:53:20.440 INFO:teuthology.orchestra.run.smithi029.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 158 kB/s | 13 kB 00:00 2024-09-14T10:53:20.482 INFO:teuthology.orchestra.run.smithi029.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 574 kB/s | 42 kB 00:00 2024-09-14T10:53:20.600 INFO:teuthology.orchestra.run.smithi029.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 1.7 MB/s | 277 kB 00:00 2024-09-14T10:53:20.642 INFO:teuthology.orchestra.run.smithi029.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 838 kB/s | 133 kB 00:00 2024-09-14T10:53:20.676 INFO:teuthology.orchestra.run.smithi029.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-14T10:53:20.709 INFO:teuthology.orchestra.run.smithi029.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 533 kB/s | 36 kB 00:00 2024-09-14T10:53:20.827 INFO:teuthology.orchestra.run.smithi029.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.9 MB/s | 292 kB 00:00 2024-09-14T10:53:20.912 INFO:teuthology.orchestra.run.smithi029.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 938 kB/s | 188 kB 00:00 2024-09-14T10:53:20.944 INFO:teuthology.orchestra.run.smithi029.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 1.3 MB/s | 151 kB 00:00 2024-09-14T10:53:20.979 INFO:teuthology.orchestra.run.smithi029.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 262 kB/s | 18 kB 00:00 2024-09-14T10:53:21.046 INFO:teuthology.orchestra.run.smithi029.stdout:(159/286): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-14T10:53:21.421 INFO:teuthology.orchestra.run.smithi029.stdout:(160/286): maven-resolver-1.6.1-10.el9.noarch.r 1.3 MB/s | 517 kB 00:00 2024-09-14T10:53:21.456 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-14T10:53:21.456 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-14T10:53:21.505 INFO:teuthology.orchestra.run.smithi029.stdout:(161/286): maven-lib-3.6.3-15.el9.noarch.rpm 2.6 MB/s | 1.5 MB 00:00 2024-09-14T10:53:21.582 INFO:teuthology.orchestra.run.smithi029.stdout:(162/286): maven-wagon-3.4.2-7.el9.noarch.rpm 1.4 MB/s | 112 kB 00:00 2024-09-14T10:53:21.616 INFO:teuthology.orchestra.run.smithi029.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 777 kB/s | 151 kB 00:00 2024-09-14T10:53:21.683 INFO:teuthology.orchestra.run.smithi029.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-14T10:53:21.801 INFO:teuthology.orchestra.run.smithi029.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 139 kB 00:00 2024-09-14T10:53:21.959 INFO:teuthology.orchestra.run.smithi029.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-14T10:53:22.051 INFO:teuthology.orchestra.run.smithi029.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 395 kB/s | 36 kB 00:00 2024-09-14T10:53:22.127 INFO:teuthology.orchestra.run.smithi029.stdout:(168/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 609 kB/s | 46 kB 00:00 2024-09-14T10:53:22.194 INFO:teuthology.orchestra.run.smithi029.stdout:(169/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 484 kB/s | 32 kB 00:00 2024-09-14T10:53:22.261 INFO:teuthology.orchestra.run.smithi029.stdout:(170/286): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-14T10:53:24.795 INFO:teuthology.orchestra.run.smithi029.stdout:(171/286): openblas-openmp-0.3.26-2.el9.x86_64. 1.9 MB/s | 4.9 MB 00:02 2024-09-14T10:53:24.912 INFO:teuthology.orchestra.run.smithi029.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.4 MB/s | 163 kB 00:00 2024-09-14T10:53:25.285 INFO:teuthology.orchestra.run.smithi029.stdout:(173/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 2.4 MB/s | 8.8 MB 00:03 2024-09-14T10:53:25.438 INFO:teuthology.orchestra.run.smithi029.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 380 kB/s | 200 kB 00:00 2024-09-14T10:53:25.464 INFO:teuthology.orchestra.run.smithi029.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 1.0 MB/s | 183 kB 00:00 2024-09-14T10:53:25.531 INFO:teuthology.orchestra.run.smithi029.stdout:(176/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-14T10:53:25.842 INFO:teuthology.orchestra.run.smithi029.stdout:(177/286): ostree-libs-2024.7-2.el9.x86_64.rpm 1.5 MB/s | 468 kB 00:00 2024-09-14T10:53:25.901 INFO:teuthology.orchestra.run.smithi029.stdout:(178/286): osinfo-db-20240701-2.el9.noarch.rpm 1.1 MB/s | 531 kB 00:00 2024-09-14T10:53:26.009 INFO:teuthology.orchestra.run.smithi029.stdout:(179/286): pipewire-1.0.1-1.el9.x86_64.rpm 982 kB/s | 107 kB 00:00 2024-09-14T10:53:26.102 INFO:teuthology.orchestra.run.smithi029.stdout:(180/286): p11-kit-server-0.25.3-2.el9.x86_64.r 948 kB/s | 246 kB 00:00 2024-09-14T10:53:26.136 INFO:teuthology.orchestra.run.smithi029.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 455 kB/s | 57 kB 00:00 2024-09-14T10:53:26.178 INFO:teuthology.orchestra.run.smithi029.stdout:(182/286): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-14T10:53:26.254 INFO:teuthology.orchestra.run.smithi029.stdout:(183/286): pipewire-jack-audio-connection-kit-l 1.1 MB/s | 135 kB 00:00 2024-09-14T10:53:26.412 INFO:teuthology.orchestra.run.smithi029.stdout:(184/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.2 MB/s | 192 kB 00:00 2024-09-14T10:53:26.479 INFO:teuthology.orchestra.run.smithi029.stdout:(185/286): plexus-cipher-1.7-27.el9.noarch.rpm 385 kB/s | 26 kB 00:00 2024-09-14T10:53:26.597 INFO:teuthology.orchestra.run.smithi029.stdout:(186/286): plexus-classworlds-2.6.0-11.el9.noar 514 kB/s | 60 kB 00:00 2024-09-14T10:53:26.672 INFO:teuthology.orchestra.run.smithi029.stdout:(187/286): plexus-containers-component-annotati 245 kB/s | 18 kB 00:00 2024-09-14T10:53:26.748 INFO:teuthology.orchestra.run.smithi029.stdout:(188/286): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-14T10:53:26.815 INFO:teuthology.orchestra.run.smithi029.stdout:(189/286): plexus-sec-dispatcher-1.4-37.el9.noa 503 kB/s | 34 kB 00:00 2024-09-14T10:53:26.974 INFO:teuthology.orchestra.run.smithi029.stdout:(190/286): plexus-utils-3.3.0-10.el9.noarch.rpm 1.6 MB/s | 254 kB 00:00 2024-09-14T10:53:27.166 INFO:teuthology.orchestra.run.smithi029.stdout:(191/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 1.9 MB/s | 1.9 MB 00:00 2024-09-14T10:53:27.493 INFO:teuthology.orchestra.run.smithi029.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 2.0 MB/s | 1.1 MB 00:00 2024-09-14T10:53:27.610 INFO:teuthology.orchestra.run.smithi029.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-14T10:53:28.036 INFO:teuthology.orchestra.run.smithi029.stdout:(194/286): protobuf-3.14.0-13.el9.x86_64.rpm 2.4 MB/s | 1.0 MB 00:00 2024-09-14T10:53:28.103 INFO:teuthology.orchestra.run.smithi029.stdout:(195/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-14T10:53:28.304 INFO:teuthology.orchestra.run.smithi029.stdout:(196/286): poppler-data-0.4.9-9.el9.noarch.rpm 1.6 MB/s | 1.9 MB 00:01 2024-09-14T10:53:28.388 INFO:teuthology.orchestra.run.smithi029.stdout:(197/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 2.3 MB/s | 679 kB 00:00 2024-09-14T10:53:28.505 INFO:teuthology.orchestra.run.smithi029.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 2.0 MB/s | 245 kB 00:00 2024-09-14T10:53:28.622 INFO:teuthology.orchestra.run.smithi029.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-14T10:53:28.698 INFO:teuthology.orchestra.run.smithi029.stdout:(200/286): python3-jsonpatch-1.21-16.el9.noarch 340 kB/s | 26 kB 00:00 2024-09-14T10:53:28.765 INFO:teuthology.orchestra.run.smithi029.stdout:(201/286): python3-jsonpointer-2.0-4.el9.noarch 286 kB/s | 19 kB 00:00 2024-09-14T10:53:28.874 INFO:teuthology.orchestra.run.smithi029.stdout:(202/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-14T10:53:28.941 INFO:teuthology.orchestra.run.smithi029.stdout:(203/286): python3-markupsafe-1.1.1-12.el9.x86_ 520 kB/s | 35 kB 00:00 2024-09-14T10:53:30.776 INFO:teuthology.orchestra.run.smithi029.stdout:(204/286): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-14T10:53:31.059 INFO:teuthology.orchestra.run.smithi029.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 888 kB/s | 250 kB 00:00 2024-09-14T10:53:31.178 INFO:teuthology.orchestra.run.smithi029.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 1.8 MB/s | 222 kB 00:00 2024-09-14T10:53:31.245 INFO:teuthology.orchestra.run.smithi029.stdout:(207/286): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-09-14T10:53:31.354 INFO:teuthology.orchestra.run.smithi029.stdout:(208/286): python3-numpy-1.20.1-5.el9.x86_64.rp 2.1 MB/s | 5.1 MB 00:02 2024-09-14T10:53:31.379 INFO:teuthology.orchestra.run.smithi029.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 315 kB/s | 42 kB 00:00 2024-09-14T10:53:31.496 INFO:teuthology.orchestra.run.smithi029.stdout:(210/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.3 MB/s | 159 kB 00:00 2024-09-14T10:53:31.530 INFO:teuthology.orchestra.run.smithi029.stdout:(211/286): python3-protobuf-3.14.0-13.el9.noarc 1.5 MB/s | 269 kB 00:00 2024-09-14T10:53:31.566 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:53:31.647 INFO:teuthology.orchestra.run.smithi029.stdout:(212/286): python3-pytz-2021.1-5.el9.noarch.rpm 436 kB/s | 51 kB 00:00 2024-09-14T10:53:31.673 INFO:teuthology.orchestra.run.smithi029.stdout:(213/286): python3-pyasn1-modules-0.4.8-6.el9.n 1.5 MB/s | 279 kB 00:00 2024-09-14T10:53:31.723 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:53:31.765 INFO:teuthology.orchestra.run.smithi029.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 457 kB/s | 54 kB 00:00 2024-09-14T10:53:31.841 INFO:teuthology.orchestra.run.smithi029.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-09-14T10:53:31.876 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-14T10:53:31.949 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:53:31.950 INFO:teuthology.orchestra.run.smithi029.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-14T10:53:32.012 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:53:32.025 INFO:teuthology.orchestra.run.smithi029.stdout:(217/286): qatlib-service-24.02.0-1.el9.x86_64. 477 kB/s | 36 kB 00:00 2024-09-14T10:53:32.101 INFO:teuthology.orchestra.run.smithi029.stdout:(218/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-09-14T10:53:32.218 INFO:teuthology.orchestra.run.smithi029.stdout:(219/286): rtkit-0.11-29.el9.x86_64.rpm 479 kB/s | 56 kB 00:00 2024-09-14T10:53:32.315 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:53:32.371 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:53:32.419 INFO:teuthology.orchestra.run.smithi029.stdout:(220/286): sisu-0.3.4-10.el9.noarch.rpm 2.5 MB/s | 510 kB 00:00 2024-09-14T10:53:32.430 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:53:32.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:53:32.488 INFO:teuthology.orchestra.run.smithi029.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-14T10:53:32.495 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:53:32.552 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:53:32.638 INFO:teuthology.orchestra.run.smithi029.stdout:(222/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.0 MB/s | 304 kB 00:00 2024-09-14T10:53:32.880 INFO:teuthology.orchestra.run.smithi029.stdout:(223/286): sound-theme-freedesktop-0.8-17.el9.n 1.5 MB/s | 383 kB 00:00 2024-09-14T10:53:32.891 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:53:32.996 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:33.039 INFO:teuthology.orchestra.run.smithi029.stdout:(224/286): totem-pl-parser-3.26.6-2.el9.x86_64. 962 kB/s | 152 kB 00:00 2024-09-14T10:53:33.104 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:33.131 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:33.223 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:33.252 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:53:33.291 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:53:33.323 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:53:33.354 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:53:33.380 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:53:33.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:53:33.486 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:53:33.506 INFO:teuthology.orchestra.run.smithi029.stdout:(225/286): tracker-3.1.2-3.el9.x86_64.rpm 1.2 MB/s | 555 kB 00:00 2024-09-14T10:53:33.512 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:53:33.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:53:33.695 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:53:33.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:53:33.864 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:53:33.900 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:53:33.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:34.033 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:34.063 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:34.117 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:34.150 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:53:34.173 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:34.199 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:34.307 INFO:teuthology.orchestra.run.smithi029.stdout:(226/286): tracker-miners-3.1.2-4.el9.x86_64.rp 1.2 MB/s | 944 kB 00:00 2024-09-14T10:53:34.392 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:34.423 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:34.424 INFO:teuthology.orchestra.run.smithi029.stdout:(227/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 456 kB/s | 53 kB 00:00 2024-09-14T10:53:34.535 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:53:34.565 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:53:34.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:53:34.625 INFO:teuthology.orchestra.run.smithi029.stdout:(228/286): tzdata-java-2024a-2.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-09-14T10:53:34.676 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:53:34.728 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:53:34.760 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:53:34.812 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:53:34.825 INFO:teuthology.orchestra.run.smithi029.stdout:(229/286): upower-0.99.11-11.el9.x86_64.rpm 862 kB/s | 173 kB 00:00 2024-09-14T10:53:34.844 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:53:34.870 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:53:34.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:53:34.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:53:34.950 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:53:34.982 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:53:35.007 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:53:35.047 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:53:35.071 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:35.109 INFO:teuthology.orchestra.run.smithi029.stdout:(230/286): webrtc-audio-processing-0.3.1-8.el9. 1.1 MB/s | 306 kB 00:00 2024-09-14T10:53:35.137 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:35.199 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:53:35.228 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:53:35.235 INFO:teuthology.orchestra.run.smithi029.stdout:(231/286): wireplumber-0.4.14-1.el9.x86_64.rpm 772 kB/s | 96 kB 00:00 2024-09-14T10:53:35.272 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:53:35.307 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:53:35.340 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:53:35.418 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:53:35.450 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:53:35.477 INFO:teuthology.orchestra.run.smithi029.stdout:(232/286): wireplumber-libs-0.4.14-1.el9.x86_64 1.4 MB/s | 358 kB 00:00 2024-09-14T10:53:35.494 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:53:35.536 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:53:35.544 INFO:teuthology.orchestra.run.smithi029.stdout:(233/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 634 kB/s | 42 kB 00:00 2024-09-14T10:53:35.620 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:53:35.766 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:53:35.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:53:35.939 INFO:teuthology.orchestra.run.smithi029.stdout:(234/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-14T10:53:35.972 INFO:teuthology.orchestra.run.smithi029.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 901 kB/s | 385 kB 00:00 2024-09-14T10:53:36.181 INFO:teuthology.orchestra.run.smithi029.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 557 kB/s | 134 kB 00:00 2024-09-14T10:53:36.290 INFO:teuthology.orchestra.run.smithi029.stdout:(237/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-14T10:53:36.355 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:53:36.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:53:36.472 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:53:36.491 INFO:teuthology.orchestra.run.smithi029.stdout:(238/286): xkeyboard-config-2.33-2.el9.noarch.r 1.6 MB/s | 859 kB 00:00 2024-09-14T10:53:36.542 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:53:36.549 INFO:teuthology.orchestra.run.smithi029.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 382 kB/s | 22 kB 00:00 2024-09-14T10:53:36.583 INFO:teuthology.orchestra.run.smithi029.stdout:(240/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 1.7 MB/s | 505 kB 00:00 2024-09-14T10:53:36.586 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:53:36.641 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:53:36.642 INFO:teuthology.orchestra.run.smithi029.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-14T10:53:36.676 INFO:teuthology.orchestra.run.smithi029.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-14T10:53:36.677 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:53:36.702 INFO:teuthology.orchestra.run.smithi029.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-14T10:53:36.744 INFO:teuthology.orchestra.run.smithi029.stdout:(244/286): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-14T10:53:36.748 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:53:36.779 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:53:36.794 INFO:teuthology.orchestra.run.smithi029.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 518 kB/s | 26 kB 00:00 2024-09-14T10:53:36.812 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:53:36.828 INFO:teuthology.orchestra.run.smithi029.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-14T10:53:36.847 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:53:36.853 INFO:teuthology.orchestra.run.smithi029.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T10:53:36.885 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:53:36.888 INFO:teuthology.orchestra.run.smithi029.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-14T10:53:36.926 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:53:36.948 INFO:teuthology.orchestra.run.smithi029.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-14T10:53:36.959 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:53:37.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:53:37.041 INFO:teuthology.orchestra.run.smithi029.stdout:(250/286): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-14T10:53:37.059 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:53:37.066 INFO:teuthology.orchestra.run.smithi029.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:53:37.091 INFO:teuthology.orchestra.run.smithi029.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.2 MB/s | 32 kB 00:00 2024-09-14T10:53:37.094 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:53:37.117 INFO:teuthology.orchestra.run.smithi029.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 563 kB/s | 14 kB 00:00 2024-09-14T10:53:37.130 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:53:37.159 INFO:teuthology.orchestra.run.smithi029.stdout:(254/286): python3-asyncssh-2.13.2-5.el9.noarch 2.5 MB/s | 548 kB 00:00 2024-09-14T10:53:37.193 INFO:teuthology.orchestra.run.smithi029.stdout:(255/286): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-14T10:53:37.222 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:53:37.227 INFO:teuthology.orchestra.run.smithi029.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-14T10:53:37.252 INFO:teuthology.orchestra.run.smithi029.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-14T10:53:37.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:53:37.286 INFO:teuthology.orchestra.run.smithi029.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T10:53:37.312 INFO:teuthology.orchestra.run.smithi029.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 424 kB/s | 11 kB 00:00 2024-09-14T10:53:37.346 INFO:teuthology.orchestra.run.smithi029.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 532 kB/s | 18 kB 00:00 2024-09-14T10:53:37.368 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:53:37.380 INFO:teuthology.orchestra.run.smithi029.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 690 kB/s | 23 kB 00:00 2024-09-14T10:53:37.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:53:37.405 INFO:teuthology.orchestra.run.smithi029.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 770 kB/s | 19 kB 00:00 2024-09-14T10:53:37.436 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:53:37.439 INFO:teuthology.orchestra.run.smithi029.stdout:(263/286): python3-jaraco-text-3.2.0-6.el9.noar 589 kB/s | 20 kB 00:00 2024-09-14T10:53:37.491 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:53:37.491 INFO:teuthology.orchestra.run.smithi029.stdout:(264/286): python3-kubernetes-26.1.0-2.el9.noar 20 MB/s | 1.0 MB 00:00 2024-09-14T10:53:37.536 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:53:37.542 INFO:teuthology.orchestra.run.smithi029.stdout:(265/286): python3-grpcio-1.46.7-10.el9.x86_64. 6.5 MB/s | 2.0 MB 00:00 2024-09-14T10:53:37.567 INFO:teuthology.orchestra.run.smithi029.stdout:(266/286): python3-logutils-0.3.5-21.el9.noarch 611 kB/s | 46 kB 00:00 2024-09-14T10:53:37.578 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:53:37.593 INFO:teuthology.orchestra.run.smithi029.stdout:(267/286): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-14T10:53:37.618 INFO:teuthology.orchestra.run.smithi029.stdout:(268/286): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-14T10:53:37.644 INFO:teuthology.orchestra.run.smithi029.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 653 kB/s | 16 kB 00:00 2024-09-14T10:53:37.670 INFO:teuthology.orchestra.run.smithi029.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-14T10:53:37.703 INFO:teuthology.orchestra.run.smithi029.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-14T10:53:37.716 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:53:37.729 INFO:teuthology.orchestra.run.smithi029.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 522 kB/s | 31 kB 00:00 2024-09-14T10:53:37.754 INFO:teuthology.orchestra.run.smithi029.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T10:53:37.763 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:53:37.780 INFO:teuthology.orchestra.run.smithi029.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T10:53:37.804 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:53:37.805 INFO:teuthology.orchestra.run.smithi029.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 705 kB/s | 36 kB 00:00 2024-09-14T10:53:37.831 INFO:teuthology.orchestra.run.smithi029.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-14T10:53:37.857 INFO:teuthology.orchestra.run.smithi029.stdout:(277/286): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-14T10:53:37.891 INFO:teuthology.orchestra.run.smithi029.stdout:(278/286): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-14T10:53:37.908 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:53:37.926 INFO:teuthology.orchestra.run.smithi029.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 572 kB/s | 20 kB 00:00 2024-09-14T10:53:37.946 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:53:37.960 INFO:teuthology.orchestra.run.smithi029.stdout:(280/286): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-14T10:53:37.987 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:53:37.994 INFO:teuthology.orchestra.run.smithi029.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-14T10:53:38.020 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:53:38.036 INFO:teuthology.orchestra.run.smithi029.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 2.7 MB/s | 206 kB 00:00 2024-09-14T10:53:38.044 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:53:38.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:53:38.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:53:38.300 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:53:38.514 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:53:38.557 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:53:38.588 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:53:38.618 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:53:38.645 INFO:teuthology.orchestra.run.smithi029.stdout:(283/286): java-11-openjdk-headless-11.0.20.1.1 1.7 MB/s | 39 MB 00:22 2024-09-14T10:53:38.667 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:53:38.696 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:38.709 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:38.710 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:53:38.710 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:53:38.712 INFO:teuthology.orchestra.run.smithi029.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 2.2 MB/s | 1.6 MB 00:00 2024-09-14T10:53:38.796 INFO:teuthology.orchestra.run.smithi029.stdout:(285/286): librados2-19.3.0-4907.ga2782315.el9. 4.6 MB/s | 3.5 MB 00:00 2024-09-14T10:53:38.891 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:53:38.968 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:53:39.019 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:53:39.044 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:39.046 INFO:teuthology.orchestra.run.smithi029.stdout:(286/286): librbd1-19.3.0-4907.ga2782315.el9.x8 8.1 MB/s | 3.2 MB 00:00 2024-09-14T10:53:39.052 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:39.052 INFO:teuthology.orchestra.run.smithi029.stdout:Total 8.7 MB/s | 327 MB 00:37 2024-09-14T10:53:39.074 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:39.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:53:39.504 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.556 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.556 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:53:39.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:53:39.597 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:53:39.632 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:53:39.665 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:53:39.715 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:53:39.749 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:53:39.838 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:53:39.888 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:53:39.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:53:40.025 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:53:40.079 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:53:40.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:53:40.878 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:53:40.911 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:53:41.012 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:53:41.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:53:41.244 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:53:41.285 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:53:41.328 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:53:41.826 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:53:41.884 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:53:41.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:53:41.956 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:53:41.988 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:53:42.180 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:53:42.211 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:53:42.214 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-14T10:53:42.298 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:53:42.420 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-14T10:53:42.420 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-14T10:53:42.968 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:53:43.101 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:53:44.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:53:44.481 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:53:44.532 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:53:44.566 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:53:44.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:53:44.623 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:44.635 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:53:44.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:53:44.682 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:53:44.710 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:53:44.738 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:53:45.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:53:45.109 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:45.211 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:45.242 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:53:45.274 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:53:45.304 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:53:45.364 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:53:45.403 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:53:45.428 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:53:45.471 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:53:45.501 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:45.761 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:45.803 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:53:45.831 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:53:45.856 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:53:45.882 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:53:45.907 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:53:45.932 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:53:45.946 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-14T10:53:45.947 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-14T10:53:45.960 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:53:45.996 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:53:46.042 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:53:46.080 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:53:46.128 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:53:46.155 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:53:46.622 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:53:46.765 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:53:46.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:53:46.854 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:53:46.882 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:53:46.954 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:53:46.999 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:53:47.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:47.042 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:47.068 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:53:47.095 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:53:47.132 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:53:47.158 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:56.015 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:53:56.227 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:53:56.391 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-14T10:53:56.475 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:53:56.522 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:53:56.608 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:53:56.672 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:53:56.726 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:53:56.777 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:53:56.812 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:53:56.883 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:53:57.235 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:53:57.433 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:57.567 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:57.601 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:57.696 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:57.725 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:53:57.783 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:53:57.818 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:53:57.845 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:53:57.880 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:53:57.920 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:53:57.962 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:53:57.991 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:53:58.020 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:53:58.185 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:53:58.319 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:53:58.371 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:53:58.413 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:53:58.449 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:58.566 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:58.583 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:58.603 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:58.626 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:53:58.661 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:53:58.665 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:58.699 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:53:58.703 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:53:58.731 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:58.736 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:53:58.753 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:58.772 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:53:58.951 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:58.992 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:59.111 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:53:59.141 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:53:59.178 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:53:59.256 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:53:59.286 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:53:59.314 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:53:59.318 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:53:59.354 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:53:59.399 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:53:59.408 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:53:59.429 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:53:59.440 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:53:59.476 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:53:59.510 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:53:59.544 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:53:59.582 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:53:59.614 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:53:59.640 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:53:59.701 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:53:59.733 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:59.807 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:59.861 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:53:59.899 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:53:59.940 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:53:59.976 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:54:00.017 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:54:00.099 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:54:00.139 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:54:00.183 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:54:00.225 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:54:00.314 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:54:00.462 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:54:00.540 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:54:01.122 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:54:01.217 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:54:01.259 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:54:01.331 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:54:01.386 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:54:01.423 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:54:01.453 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:54:01.530 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:54:01.575 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:54:01.608 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:54:01.653 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:54:01.692 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:54:01.724 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:54:01.764 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:01.765 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:54:01.808 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:54:01.811 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:01.869 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:54:01.904 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:54:01.950 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:54:02.056 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:54:02.118 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:54:02.202 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:54:02.248 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:54:02.285 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:54:02.342 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:54:02.371 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:02.395 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:54:02.414 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:02.447 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:54:02.506 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:02.507 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:54:02.507 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:54:02.507 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:02.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:02.602 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:54:02.651 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:54:02.694 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:54:02.803 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:54:02.844 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:54:02.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:54:02.921 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:54:02.946 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:54:03.029 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:54:03.169 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:54:03.212 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:54:03.433 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:54:03.485 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:54:03.517 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:54:03.556 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:54:03.610 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:54:03.644 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:54:03.657 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:54:03.657 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:54:03.658 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:03.859 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:54:03.942 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:54:04.002 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:54:04.034 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:54:04.059 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:54:04.095 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:54:04.557 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:54:04.587 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:54:04.601 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:54:04.601 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:54:04.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:04.644 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:54:04.679 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:54:04.713 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:54:04.758 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:54:04.792 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:54:04.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:54:04.942 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:54:04.981 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:54:05.101 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:54:05.161 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:54:05.953 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:54:06.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:54:06.046 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:54:06.154 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:54:06.206 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:54:06.410 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:54:06.454 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:54:06.503 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:54:07.065 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:54:07.193 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:54:07.413 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:54:07.577 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:54:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:54:08.004 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:54:08.037 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:54:08.130 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:54:08.877 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:54:09.015 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:54:10.392 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:54:10.496 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:54:10.563 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:54:10.608 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:54:10.646 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:54:10.676 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:54:10.687 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:54:10.687 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:54:10.688 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:10.743 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:54:10.781 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:54:10.810 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:54:11.151 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:54:11.212 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:54:11.314 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:54:11.347 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:54:11.379 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:54:11.411 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:54:11.487 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:54:11.529 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:54:11.564 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:54:11.617 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:54:11.647 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-14T10:54:11.751 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:11.923 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:11.939 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:11.939 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:11.939 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:54:11.939 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:11.983 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:54:12.034 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:54:12.063 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:54:12.088 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:54:12.128 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:54:12.167 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:54:12.201 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:54:12.237 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:54:12.274 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:54:12.323 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:54:12.360 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:54:12.409 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:54:12.445 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:54:12.964 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:54:13.121 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:54:13.199 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:54:13.233 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:54:13.262 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:54:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:54:13.390 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:54:13.390 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:13.418 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:13.423 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:54:13.444 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:54:13.463 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:54:13.498 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:54:13.537 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:54:13.641 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:13.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:14.108 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:14.132 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:14.234 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:54:17.089 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:54:17.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:54:17.257 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:54:17.314 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:54:17.499 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:54:17.546 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:54:17.624 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:54:17.779 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:54:17.928 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:54:17.972 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:54:18.005 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:54:18.866 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:54:18.911 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:19.263 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:19.301 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:54:19.331 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:54:19.359 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:54:19.394 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:54:19.431 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:54:19.458 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:54:19.484 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:54:19.510 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:54:19.534 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:54:19.561 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:54:19.586 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:54:19.613 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:54:19.644 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:54:19.672 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:54:19.706 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:54:19.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:54:19.773 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:54:19.808 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:54:19.842 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:54:19.878 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:54:19.917 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:54:19.959 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:54:20.004 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:54:20.036 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:54:20.058 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:54:20.111 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:54:20.144 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:54:20.166 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:54:20.195 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:54:20.221 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:54:20.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:54:20.438 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:54:20.465 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:54:20.491 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:54:20.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:54:20.655 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:54:20.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:54:20.785 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:54:20.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:20.937 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:20.976 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:20.997 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:21.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:54:21.052 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:54:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:21.572 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:54:21.572 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:21.790 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:54:21.850 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:54:21.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:54:21.926 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:54:21.951 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:54:22.334 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:22.380 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:22.848 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:22.936 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:22.999 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:23.028 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:23.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:54:23.289 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:54:23.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:23.338 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:23.366 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:23.431 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:23.461 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:23.472 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:23.503 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:23.527 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:23.554 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:54:24.009 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:24.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:24.077 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:54:24.143 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:54:24.168 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:54:27.355 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:54:27.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:54:28.372 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:54:28.399 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:54:28.515 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:54:28.671 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:54:28.693 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:54:28.717 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:54:28.717 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:54:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:54:28.718 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:54:28.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:28.769 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:54:28.781 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:54:28.795 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:54:28.824 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:54:28.873 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:54:28.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:54:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:54:28.913 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:54:28.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:29.064 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:54:29.107 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:54:29.146 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:54:29.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:54:29.221 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:54:29.266 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:54:29.789 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:54:29.820 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:54:29.872 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:54:29.893 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:54:29.896 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:54:29.896 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:29.897 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:54:29.897 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:54:29.897 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:54:29.897 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:29.926 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:54:29.940 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:54:29.963 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:54:29.963 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:29.963 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:54:29.963 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:30.274 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:30.298 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:32.426 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:32.466 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:33.052 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:33.099 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:33.193 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:33.193 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:54:33.194 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:54:33.194 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:33.227 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:34.994 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:54:35.043 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:54:35.075 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:54:35.179 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:54:35.235 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:35.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:54:35.267 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:35.343 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:35.343 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:35.417 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:35.441 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:54:35.448 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:54:35.457 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:54:35.467 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:54:35.468 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:35.468 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:35.468 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:35.514 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:35.583 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:44.300 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:44.300 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /root 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2024-09-14T10:54:44.301 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:44.490 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:44.505 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:44.505 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:44.505 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:54:44.505 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:54:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:54:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:54:46.000 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:54:46.001 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:54:46.002 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:54:46.003 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:54:46.004 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:54:46.005 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:54:46.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:54:46.007 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:54:46.008 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:54:46.009 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:54:46.010 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:54:46.011 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:54:46.012 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:54:46.013 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:54:46.014 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:54:46.015 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:54:46.016 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:54:46.017 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:54:46.018 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:54:46.019 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:54:46.020 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:54:46.021 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:54:46.022 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:54:46.058 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:46.086 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:46.326 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:46.350 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:46.820 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:46.845 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:46.960 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:54:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:49.519 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:54:49.520 INFO:teuthology.orchestra.run.smithi073.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.521 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.522 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:54:49.523 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:54:49.524 INFO:teuthology.orchestra.run.smithi073.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:49.525 INFO:teuthology.orchestra.run.smithi073.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:54:49.526 INFO:teuthology.orchestra.run.smithi073.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.527 INFO:teuthology.orchestra.run.smithi073.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:54:49.528 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:54:49.529 INFO:teuthology.orchestra.run.smithi073.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:54:49.530 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.531 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.532 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:54:49.533 INFO:teuthology.orchestra.run.smithi073.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:54:49.534 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:54:49.535 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:54:49.536 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:54:49.537 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.538 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:54:49.539 INFO:teuthology.orchestra.run.smithi073.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:54:49.540 INFO:teuthology.orchestra.run.smithi073.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:54:49.541 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:54:49.541 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-14T10:54:49.964 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:50.059 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:54:50.198 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:54:50.256 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:54:50.330 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:54:50.546 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:54:50.606 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:54:50.698 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:54:50.797 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:54:50.957 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:54:51.010 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:54:51.058 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:54:52.001 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:54:52.066 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:52.442 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:52.474 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:54:52.505 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:54:52.533 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:54:52.568 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:54:52.607 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:54:52.643 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:54:52.678 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:54:52.712 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:54:52.745 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:54:52.772 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:54:52.798 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:54:52.834 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:54:52.864 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:54:52.901 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:54:52.946 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:54:52.991 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:54:53.031 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:54:53.066 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:54:53.101 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:54:53.147 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:54:53.194 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:54:53.237 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:54:53.291 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:54:53.323 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:54:53.346 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:54:53.412 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:54:53.450 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:54:53.489 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:54:53.519 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:54:53.555 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:54:53.741 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:54:53.772 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:54:53.808 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:54:53.844 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:54:53.877 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:54:54.013 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:54:54.083 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:54:54.165 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:54:54.208 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:54.326 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:54.378 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:54.394 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:54.432 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:54:54.464 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:54:54.937 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:54.965 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:54.982 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:54.982 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:54:54.982 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:54:55.252 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:54:55.332 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:54:55.388 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:54:55.425 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:54:55.450 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:54:55.940 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:55.977 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:55.994 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:56.570 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:56.670 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:56.720 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:56.750 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:56.972 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:54:57.045 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:54:57.080 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:57.103 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:57.140 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:57.209 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:57.255 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:57.266 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:57.298 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:57.318 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:57.349 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:54:57.820 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:57.852 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:57.886 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:54:57.957 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:54:57.994 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:55:01.409 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:55:01.482 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:55:02.497 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:55:02.534 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:55:02.659 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:55:02.831 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:55:02.863 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:55:02.889 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:02.940 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:55:02.951 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:55:02.974 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:55:03.012 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:55:03.065 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:55:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:55:03.112 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:55:03.112 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:55:03.112 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:04.131 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:55:04.156 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:04.207 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:55:04.231 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:55:04.231 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:55:04.231 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:55:04.231 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:04.566 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:55:04.591 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:09.609 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:55:09.659 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:55:09.691 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:55:09.802 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:55:09.864 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:55:09.902 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:55:09.902 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:55:10.004 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:55:10.004 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:55:10.104 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:55:10.125 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:55:10.131 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:55:10.140 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:55:10.150 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:55:10.150 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:55:10.151 INFO:teuthology.orchestra.run.smithi029.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:55:10.151 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:10.218 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:55:10.291 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:55:27.314 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:55:27.315 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:55:27.316 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:55:27.341 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:55:27.341 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:55:27.341 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:55:27.342 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:55:27.343 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:55:27.344 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:55:27.345 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:55:27.346 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:55:27.347 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:55:27.348 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:55:27.349 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:55:27.350 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:55:27.351 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:55:27.352 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:55:27.353 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:55:27.354 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:55:27.355 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:55:27.356 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:55:27.357 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:55:27.358 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:55:27.359 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:55:27.360 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:55:27.361 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:55:27.362 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:55:27.363 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:55:27.364 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:55:30.822 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:55:30.822 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:30.822 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:55:30.823 INFO:teuthology.orchestra.run.smithi029.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.824 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.825 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:55:30.826 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:55:30.827 INFO:teuthology.orchestra.run.smithi029.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:55:30.828 INFO:teuthology.orchestra.run.smithi029.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:55:30.829 INFO:teuthology.orchestra.run.smithi029.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:55:30.830 INFO:teuthology.orchestra.run.smithi029.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:55:30.831 INFO:teuthology.orchestra.run.smithi029.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:55:30.832 INFO:teuthology.orchestra.run.smithi029.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:55:30.833 INFO:teuthology.orchestra.run.smithi029.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.834 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:55:30.835 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:55:30.836 INFO:teuthology.orchestra.run.smithi029.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:55:30.837 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:55:30.838 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:55:30.839 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.840 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:55:30.841 INFO:teuthology.orchestra.run.smithi029.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:55:30.842 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:55:30.843 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:55:30.844 INFO:teuthology.orchestra.run.smithi029.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:55:30.844 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:30.844 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-14T10:55:31.417 DEBUG:teuthology.parallel:result is None 2024-09-14T10:55:31.418 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:55:31.559 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:55:31.639 INFO:teuthology.orchestra.run.smithi029.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:55:31.639 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:55:31.639 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:55:31.641 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:55:31.776 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:55:31.926 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:55:31.927 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:55:31.927 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:55:31.929 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:55:31.930 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:31.930 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:55:31.980 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:31.980 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:55:32.026 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:55:32.027 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:32.027 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:55:32.072 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:55:32.155 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:32.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:55:32.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:55:32.279 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:55:32.279 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:32.279 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:55:32.321 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:55:32.402 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:32.403 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:55:32.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:55:32.520 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:55:32.520 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:32.520 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:55:32.561 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:55:32.642 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:32.642 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:55:32.679 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:55:32.762 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:55:32.839 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:55:32.839 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2024-09-14T10:55:32.842 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2024-09-14T10:55:32.881 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:55:32.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:55:32.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:55:32.966 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:55:32.966 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:55:33.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:55:33.058 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:55:33.059 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:55:33.059 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904142', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxejcUkPMwm7TFqWspN7u+/OSJiHFpWtn6Ae+EJlCGlGulLpbfaVxYlvjzn9151Y/shasXRDNC6OwLY1aV+FDU=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdI388+fBFqg8wzhFIV98jM9rwKVDjHSlXcPltQnGPtpEUk+ZkKpUNqo94YCczZKho448IMZiuDUkPJ2IL/+YY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:55:33.059 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:55:33.090 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:55:33.119 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:55:33.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:55:33.199 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:33.199 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:55:33.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:55:33.267 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-14 10:55:11.550926644 +0000 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-14 10:52:20.947455003 +0000 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-14 10:52:20.947455003 +0000 2024-09-14T10:55:33.337 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-14 10:52:20.947455003 +0000 2024-09-14T10:55:33.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:55:33.415 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-14T10:55:33.415 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-14T10:55:33.416 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000102582 s, 5.0 MB/s 2024-09-14T10:55:33.417 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:55:33.488 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-14 10:55:11.551926628 +0000 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-14 10:52:21.283449526 +0000 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-14 10:52:21.283449526 +0000 2024-09-14T10:55:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-14 10:52:21.283449526 +0000 2024-09-14T10:55:33.560 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:55:33.636 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-14T10:55:33.636 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-14T10:55:33.637 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 9.8948e-05 s, 5.2 MB/s 2024-09-14T10:55:33.638 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:55:33.709 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-14 10:55:11.551926628 +0000 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-14 10:52:21.611444180 +0000 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-14 10:52:21.611444180 +0000 2024-09-14T10:55:33.780 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-14 10:52:21.611444180 +0000 2024-09-14T10:55:33.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:55:33.858 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-14T10:55:33.858 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-14T10:55:33.858 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.00010217 s, 5.0 MB/s 2024-09-14T10:55:33.859 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:55:33.929 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2024-09-14T10:55:33.999 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2024-09-14 10:55:11.551926628 +0000 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2024-09-14 10:52:21.935438899 +0000 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2024-09-14 10:52:21.935438899 +0000 2024-09-14T10:55:34.000 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: 2024-09-14 10:52:21.935438899 +0000 2024-09-14T10:55:34.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:55:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2024-09-14T10:55:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2024-09-14T10:55:34.077 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000103049 s, 5.0 MB/s 2024-09-14T10:55:34.078 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:55:34.148 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:34.149 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:34.149 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:55:34.180 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:55:34.180 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-14T10:55:34.252 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:55:34.252 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:34.252 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-09-14T10:55:34.252 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:34.253 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:34.253 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 10:54:36.624747287 +0000 2024-09-14T10:55:34.253 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 10:52:11.788781629 +0000 2024-09-14T10:55:34.253 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 10:52:11.788781629 +0000 2024-09-14T10:55:34.253 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 10:52:11.788781629 +0000 2024-09-14T10:55:34.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:55:34.332 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T10:55:34.332 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T10:55:34.332 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000206606 s, 2.5 MB/s 2024-09-14T10:55:34.334 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:55:34.404 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 10:54:36.624747287 +0000 2024-09-14T10:55:34.472 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 10:52:12.127773247 +0000 2024-09-14T10:55:34.473 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 10:52:12.127773247 +0000 2024-09-14T10:55:34.473 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 10:52:12.127773247 +0000 2024-09-14T10:55:34.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:55:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T10:55:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T10:55:34.548 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000186175 s, 2.8 MB/s 2024-09-14T10:55:34.549 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:55:34.619 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 10:54:36.625747262 +0000 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 10:52:12.455765138 +0000 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 10:52:12.455765138 +0000 2024-09-14T10:55:34.688 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 10:52:12.455765138 +0000 2024-09-14T10:55:34.689 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:55:34.764 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T10:55:34.764 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T10:55:34.764 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000192274 s, 2.7 MB/s 2024-09-14T10:55:34.765 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:55:34.835 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-14T10:55:34.905 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:55:34.905 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-14 10:54:36.625747262 +0000 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-14 10:52:12.772757300 +0000 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-14 10:52:12.772757300 +0000 2024-09-14T10:55:34.906 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-14 10:52:12.772757300 +0000 2024-09-14T10:55:34.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:55:34.982 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-14T10:55:34.982 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-14T10:55:34.982 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000248626 s, 2.1 MB/s 2024-09-14T10:55:34.983 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:55:35.053 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:35.053 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:55:35.053 INFO:tasks.ceph:Generating config... 2024-09-14T10:55:35.055 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:55:35.055 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T10:55:35.055 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T10:55:35.055 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:55:35.056 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:55:35.056 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T10:55:35.057 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T10:55:35.057 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T10:55:35.057 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T10:55:35.057 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:55:35.057 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T10:55:35.057 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:55:35.057 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:55:35.057 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:55:35.057 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:55:35.057 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:55:35.058 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T10:55:35.059 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:55:35.059 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:55:35.133 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:55:35.136 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:55:35.199 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:55:35.238 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.29'), ('mon.c', '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]'), ('mon.b', '172.21.15.73')] 2024-09-14T10:55:35.239 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.73', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T10:55:35.240 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:35.240 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:55:35.308 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.29 --addv c '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]' --add b 172.21.15.73 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:35.409 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: generated fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:setting min_mon_release = quincy 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:epoch 0 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T10:55:35.410 INFO:teuthology.orchestra.run.smithi029.stdout:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:created 2024-09-14T10:55:35.413471+0000 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:min_mon_release 17 (quincy) 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:election_strategy: 1 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T10:55:35.411 INFO:teuthology.orchestra.run.smithi029.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T10:55:35.412 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:55:35.442 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e989b7a3-862f-4ff0-8d06-d31959c32218... 2024-09-14T10:55:35.443 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:55:35.485 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:55:35.541 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2024-09-14T10:55:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2024-09-14T10:55:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:55:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2024-09-14T10:55:35.541 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:55:35.542 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2024-09-14T10:55:35.543 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.73" 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: mon client directed command retry = 5 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: ms inject socket failures = 5000 2024-09-14T10:55:35.544 INFO:teuthology.orchestra.run.smithi029.stdout: osd heartbeat grace = 40 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2024-09-14T10:55:35.545 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug trim objects = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.546 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-14T10:55:35.547 INFO:teuthology.orchestra.run.smithi029.stdout: debug objclass = 20 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: osd fast shutdown = False 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: osd shutdown pgref assert = True 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2024-09-14T10:55:35.548 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2024-09-14T10:55:35.549 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:55:35.550 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd crush smoke test = False 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = True 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: debug rgw = 20 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: debug rgw notification = 20 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw bucket counters cache = True 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw crypt require ssl = False 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:55:35.551 INFO:teuthology.orchestra.run.smithi029.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw s3 auth use sts = True 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw torrent flag = True 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: rgw user counters cache = True 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: setgroup = ceph 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout: setuser = ceph 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2024-09-14T10:55:35.552 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2024-09-14T10:55:35.553 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:55:35.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:55:35.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790],172.21.15.73" 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 5000 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: osd heartbeat grace = 40 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:55:35.556 INFO:teuthology.orchestra.run.smithi073.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:55:35.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug trim objects = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.558 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2024-09-14T10:55:35.559 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = bitmap 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 1/20 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 1/20 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug objclass = 20 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 4/10 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:55:35.560 INFO:teuthology.orchestra.run.smithi073.stdout: osd fast shutdown = False 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: osd shutdown pgref assert = True 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2024-09-14T10:55:35.561 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:55:35.562 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd crush smoke test = False 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2024-09-14T10:55:35.563 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = True 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw = 20 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: debug rgw notification = 20 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw bucket counters cache = True 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt require ssl = False 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-09-14T10:55:35.564 INFO:teuthology.orchestra.run.smithi073.stdout: rgw d3n l1 datacache size = 10737418240 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw d3n l1 local datacache enabled = True 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw s3 auth use sts = True 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw torrent flag = True 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: rgw user counters cache = True 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: setgroup = ceph 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout: setuser = ceph 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2024-09-14T10:55:35.565 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2024-09-14T10:55:35.567 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:55:35.567 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:55:35.636 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:55:35.637 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:35.637 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:55:35.666 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:35.667 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:55:35.736 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:55:35.736 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:35.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:55:35.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:55:35.825 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:55:35.825 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:35.895 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:55:35.895 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:35.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:55:35.895 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:55:35.943 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:55:35.943 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:36.013 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:55:36.014 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:55:36.014 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:55:36.081 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:55:36.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:55:36.172 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:55:36.175 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:55:36.175 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:55:36.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:55:36.231 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:55:36.244 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T10:55:36.303 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T10:55:36.316 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:55:36.316 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:55:36.316 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:55:36.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:36.356 INFO:tasks.ceph:role: osd.0 2024-09-14T10:55:36.356 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:55:36.356 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:36.435 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:36.436 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:36.436 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:36.468 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-14T10:55:36.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-14T10:55:36.470 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:55:36.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:55:36.638 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:55:36.719 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:36.719 INFO:tasks.ceph:role: osd.1 2024-09-14T10:55:36.719 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:55:36.720 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:55:36.798 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:36.799 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:36.831 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-14T10:55:36.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-14T10:55:36.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T10:55:36.917 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:55:37.001 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:55:37.082 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:37.082 INFO:tasks.ceph:role: osd.2 2024-09-14T10:55:37.082 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:55:37.082 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:55:37.162 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:37.163 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:37.199 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-14T10:55:37.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-14T10:55:37.201 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T10:55:37.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:55:37.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:55:37.407 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:37.407 INFO:tasks.ceph:role: osd.3 2024-09-14T10:55:37.407 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T10:55:37.407 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:55:37.486 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:37.486 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:37.486 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:37.487 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:37.519 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2024-09-14T10:55:37.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2024-09-14T10:55:37.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T10:55:37.606 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:55:37.654 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:37.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:37.778+0000 7f08e6102640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:55:37.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:37.778+0000 7f08e6102640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:55:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:37.778+0000 7f08e6102640 -1 bdev(0x55e76a00f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:37.778+0000 7f08e6102640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:55:40.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:55:40.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:40.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:40.806+0000 7f07fcd4d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:55:40.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:40.806+0000 7f07fcd4d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:55:40.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:40.806+0000 7f07fcd4d640 -1 bdev(0x5603f6429800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:40.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:40.806+0000 7f07fcd4d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:55:43.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:55:44.020 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:44.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:44.088+0000 7fdd02fa4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:55:44.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:44.088+0000 7fdd02fa4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:55:44.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:44.088+0000 7fdd02fa4640 -1 bdev(0x5558f5287800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:44.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:44.088+0000 7fdd02fa4640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:55:47.509 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:55:47.556 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:47.623+0000 7fa9f3683640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:55:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:47.623+0000 7fa9f3683640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:55:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:47.623+0000 7fa9f3683640 -1 bdev(0x5573a7a35800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:47.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:55:47.623+0000 7fa9f3683640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:55:51.032 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:55:51.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:51.120 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:51.120 INFO:tasks.ceph:role: osd.4 2024-09-14T10:55:51.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:55:51.121 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:55:51.169 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:51.169 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:51.169 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:51.169 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:51.170 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:51.684 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T10:55:51.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T10:55:51.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:51.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:51.848 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:51.887 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:51.887 INFO:tasks.ceph:role: osd.5 2024-09-14T10:55:51.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:55:51.887 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:51.973 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:51.974 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:52.439 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T10:55:52.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T10:55:52.441 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:52.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:52.547 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:52.624 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:52.624 INFO:tasks.ceph:role: osd.6 2024-09-14T10:55:52.624 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:55:52.625 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:55:52.710 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:52.711 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:53.201 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T10:55:53.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T10:55:53.204 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:53.321 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:53.365 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:53.445 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:53.446 INFO:tasks.ceph:role: osd.7 2024-09-14T10:55:53.446 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T10:55:53.446 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:55:53.532 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:53.532 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:53.532 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:53.533 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:54.058 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2024-09-14T10:55:54.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2024-09-14T10:55:54.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:54.181 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:54.225 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:54.336+0000 7fef219dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T10:55:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:54.336+0000 7fef219dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T10:55:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:54.336+0000 7fef219dd640 -1 bdev(0x5644c82a9800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:54.334 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:54.336+0000 7fef219dd640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T10:55:57.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:57.541 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:57.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:57.647+0000 7f33f8545640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T10:55:57.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:57.647+0000 7f33f8545640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T10:55:57.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:57.647+0000 7f33f8545640 -1 bdev(0x559783775800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:57.645 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:55:57.647+0000 7f33f8545640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T10:56:00.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T10:56:00.851 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:56:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:00.957+0000 7f43715b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T10:56:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:00.957+0000 7f43715b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T10:56:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:00.957+0000 7f43715b2640 -1 bdev(0x56302701d800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T10:56:00.956 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:00.957+0000 7f43715b2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T10:56:04.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T10:56:04.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:56:04.227 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:04.229+0000 7f020e044640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T10:56:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:04.229+0000 7f020e044640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T10:56:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:04.229+0000 7f020e044640 -1 bdev(0x5564a2ecd800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T10:56:04.228 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:04.230+0000 7f020e044640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T10:56:07.393 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T10:56:07.438 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:56:07.438 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:07.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T10:56:07.485 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:07.486 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:56:07.569 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:07.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:56:07.651 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:07.652 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:56:07.732 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:07.733 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:56:07.812 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:07.812 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:56:07.859 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:07.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T10:56:07.942 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:07.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T10:56:08.022 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:08.022 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T10:56:08.101 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:08.101 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T10:56:08.181 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:08.181 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:56:08.213 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:08.213 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T10:56:08.250 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:56:08.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:56:08.255 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCoa+VmIv4HBRAAIxfPCyV0NSjF5CYBSEYq2g== 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCpa+VmuuByLhAA/vVJcyW+LxwQByWh2gMSaA== 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCsa+Vmvd0aMBAAJymcgDC8+1fHNdRT5oR/kQ== 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2024-09-14T10:56:08.294 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCwa+Vm2YxMBRAAcpx4/1gBBmC7XmTcGU5i0A== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCza+Vmbz0wJRAAAalsyy1AkE7avmBxI3WYaw== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCoa+VmVJ94ChAAdDmg3PWnT2wnXio772mw7g== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQC6a+VmKKIWFBAAZ/i2+fEYpn5zqdfVFU3vgA== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQC9a+VmlUCiJhAAjTSnoRLwwCPlC6Mhp3sQ4g== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDAa+VmfOghORAA1NcmFYtLNSqXOGp/JzHkmg== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDEa+VmSk6+DRAAnFxXNKJZf0lbwlGCNdVv7w== 2024-09-14T10:56:08.295 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2024-09-14T10:56:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCoa+VmMG74DRAALrpXoFbdZtHBLCBd3vVZOw== 2024-09-14T10:56:08.296 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2024-09-14T10:56:08.296 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQCoa+VmVSdFEhAAkJEuVT1WU2qRA5EaHG0WHQ== 2024-09-14T10:56:08.327 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCoa+VmIv4HBRAAIxfPCyV0NSjF5CYBSEYq2g== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCpa+VmuuByLhAA/vVJcyW+LxwQByWh2gMSaA== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCsa+Vmvd0aMBAAJymcgDC8+1fHNdRT5oR/kQ== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCwa+Vm2YxMBRAAcpx4/1gBBmC7XmTcGU5i0A== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCza+Vmbz0wJRAAAalsyy1AkE7avmBxI3WYaw== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCoa+VmVJ94ChAAdDmg3PWnT2wnXio772mw7g== 2024-09-14T10:56:08.328 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC6a+VmKKIWFBAAZ/i2+fEYpn5zqdfVFU3vgA== 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQC9a+VmlUCiJhAAjTSnoRLwwCPlC6Mhp3sQ4g== 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDAa+VmfOghORAA1NcmFYtLNSqXOGp/JzHkmg== 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDEa+VmSk6+DRAAnFxXNKJZf0lbwlGCNdVv7w== 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCoa+VmMG74DRAALrpXoFbdZtHBLCBd3vVZOw== 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2024-09-14T10:56:08.329 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQCoa+VmVSdFEhAAkJEuVT1WU2qRA5EaHG0WHQ== 2024-09-14T10:56:08.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:56:08.339 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:56:08.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.436 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.501 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.568 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.570 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.635 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.637 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.702 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:56:08.704 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:56:08.768 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.837 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.901 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.968 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:08.970 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:56:09.035 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:56:09.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:56:09.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:56:09.108 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:56:09.176 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:56:09.176 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:56:09.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:56:09.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:56:09.367 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T10:56:09.446 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:56:09.557 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T10:56:09.597 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T10:56:09.636 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:56:09.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T10:56:09.783 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:56:09.785 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:56:09.852 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:56:09.852 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:56:09.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:56:09.856 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:56:09.856 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T10:56:09.856 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T10:56:09.858 INFO:tasks.ceph.mon.c:Started 2024-09-14T10:56:09.859 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T10:56:09.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T10:56:09.896 INFO:tasks.ceph.mon.b:Started 2024-09-14T10:56:09.897 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:56:09.897 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T10:56:09.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T10:56:09.900 INFO:tasks.ceph.mgr.y:Started 2024-09-14T10:56:09.901 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:56:09.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:56:09.904 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:56:09.904 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:56:09.904 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:56:09.905 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:56:10.261 INFO:teuthology.orchestra.run.smithi029.stderr:adjusted tunables profile to default 2024-09-14T10:56:10.272 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:56:10.272 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:56:10.272 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:10.272 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:56:10.312 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:10.312 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:56:10.392 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:10.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:56:10.472 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:56:10.473 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:56:10.552 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:10.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T10:56:10.591 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:10.591 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T10:56:10.669 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:10.669 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T10:56:10.748 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-14T10:56:10.748 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T10:56:10.826 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 69016441-5c87-42ed-b731-a9248b80f866 0 2024-09-14T10:56:11.063 INFO:teuthology.orchestra.run.smithi073.stdout:0 2024-09-14T10:56:11.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 99dd9457-a79a-41d3-9825-68fcae988978 1 2024-09-14T10:56:11.273 INFO:teuthology.orchestra.run.smithi073.stdout:1 2024-09-14T10:56:11.284 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 9b83928e-8f2b-4f39-9bd8-6a365f21cb75 2 2024-09-14T10:56:11.600 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-14T10:56:11.602+0000 7f1120f86640 0 --2- 172.21.15.73:0/1234296966 >> v2:172.21.15.73:3300/0 conn(0x7f111c0b42a0 0x7f111c0b34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T10:56:11.682 INFO:teuthology.orchestra.run.smithi073.stdout:2 2024-09-14T10:56:11.694 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new fa187967-d17c-4f9b-8d7c-31a1ab7b1f70 3 2024-09-14T10:56:11.890 INFO:teuthology.orchestra.run.smithi073.stdout:3 2024-09-14T10:56:11.901 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 14dec141-026f-4ab3-8ff4-d95380b5c43c 4 2024-09-14T10:56:12.098 INFO:teuthology.orchestra.run.smithi073.stdout:4 2024-09-14T10:56:12.109 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 6e41ff57-9f1b-467b-bb4d-14011ba77ccf 5 2024-09-14T10:56:12.309 INFO:teuthology.orchestra.run.smithi073.stdout:5 2024-09-14T10:56:12.320 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new e5a5965b-d805-4a69-b2fe-dc96dfb37997 6 2024-09-14T10:56:12.513 INFO:teuthology.orchestra.run.smithi073.stdout:6 2024-09-14T10:56:12.524 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new a31cc6f9-8715-4b42-916c-66a956178c8c 7 2024-09-14T10:56:12.723 INFO:teuthology.orchestra.run.smithi073.stdout:7 2024-09-14T10:56:12.734 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:56:12.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:56:12.738 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:56:12.738 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:56:12.738 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:56:12.740 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:56:12.740 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:56:12.740 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:56:12.742 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:56:12.742 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:56:12.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:56:12.744 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:56:12.745 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T10:56:12.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T10:56:12.747 INFO:tasks.ceph.osd.4:Started 2024-09-14T10:56:12.747 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T10:56:12.747 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T10:56:12.749 INFO:tasks.ceph.osd.5:Started 2024-09-14T10:56:12.749 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T10:56:12.749 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T10:56:12.753 INFO:tasks.ceph.osd.6:Started 2024-09-14T10:56:12.753 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T10:56:12.753 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T10:56:12.755 INFO:tasks.ceph.osd.7:Started 2024-09-14T10:56:12.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:12.969 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:12.970 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":10,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:12.719139+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:12.981 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:56:12.981 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:56:13.787 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:13.968 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-14T10:56:13.968 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":10,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:12.719139+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:13.978 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:56:14.004 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-09-14T10:56:14.006+0000 7f8f6dfd4640 -1 Falling back to public interface 2024-09-14T10:56:14.230 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-09-14T10:56:14.232+0000 7f1e7a189640 -1 Falling back to public interface 2024-09-14T10:56:14.240 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-14T10:56:14.241+0000 7fdefa117640 -1 Falling back to public interface 2024-09-14T10:56:14.243 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T10:56:14.245+0000 7f9ae6d58640 -1 Falling back to public interface 2024-09-14T10:56:14.255 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T10:56:14.257+0000 7f6977145640 -1 Falling back to public interface 2024-09-14T10:56:14.495 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-14T10:56:14.496+0000 7ff5e140c640 -1 Falling back to public interface 2024-09-14T10:56:14.717 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-14T10:56:14.718+0000 7f643e302640 -1 Falling back to public interface 2024-09-14T10:56:14.733 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-14T10:56:14.734+0000 7f53266f1640 -1 Falling back to public interface 2024-09-14T10:56:15.414 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T10:56:15.416+0000 7f1c9993a640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T10:56:15.414 INFO:tasks.ceph.mgr.x.smithi073.stderr:2024-09-14T10:56:15.416+0000 7f1c9993a640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T10:56:17.566 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-09-14T10:56:17.568+0000 7f8f6dfd4640 -1 osd.7 0 log_to_monitors true 2024-09-14T10:56:17.792 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-14T10:56:17.793+0000 7fdefa117640 -1 osd.1 0 log_to_monitors true 2024-09-14T10:56:18.028 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-14T10:56:18.029+0000 7ff5e140c640 -1 osd.0 0 log_to_monitors true 2024-09-14T10:56:18.259 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T10:56:18.261+0000 7f9ae6d58640 -1 osd.5 0 log_to_monitors true 2024-09-14T10:56:18.272 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-14T10:56:18.274+0000 7f53266f1640 -1 osd.2 0 log_to_monitors true 2024-09-14T10:56:18.464 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-09-14T10:56:18.466+0000 7f1e7a189640 -1 osd.6 0 log_to_monitors true 2024-09-14T10:56:18.736 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-14T10:56:18.737+0000 7f643e302640 -1 osd.3 0 log_to_monitors true 2024-09-14T10:56:18.788 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T10:56:18.790+0000 7f6977145640 -1 osd.4 0 log_to_monitors true 2024-09-14T10:56:20.534 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-14T10:56:20.535+0000 7ff5dcc8b640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:56:20.543 INFO:tasks.ceph.osd.0.smithi029.stderr:2024-09-14T10:56:20.545+0000 7ff5d4aaa640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:20.568 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-14T10:56:20.569+0000 7f5322e99640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:56:20.579 INFO:tasks.ceph.osd.2.smithi029.stderr:2024-09-14T10:56:20.581+0000 7f531a4a4640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:20.784 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:20.857 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-09-14T10:56:20.859+0000 7f8f6a77c640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T10:56:20.905 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T10:56:20.907+0000 7f9ae2cec640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T10:56:20.908 INFO:tasks.ceph.osd.7.smithi073.stderr:2024-09-14T10:56:20.910+0000 7f8f61d87640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:20.938 INFO:tasks.ceph.osd.5.smithi073.stderr:2024-09-14T10:56:20.940+0000 7f9adab0b640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:21.038 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-14T10:56:21.039+0000 7fdef60ab640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:56:21.050 INFO:tasks.ceph.osd.1.smithi029.stderr:2024-09-14T10:56:21.052+0000 7fdeedeca640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:21.199 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-14T10:56:21.199 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":13,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:20.420805+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:21.211 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:56:21.351 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-14T10:56:21.352+0000 7f643a296640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:56:21.361 INFO:tasks.ceph.osd.3.smithi029.stderr:2024-09-14T10:56:21.363+0000 7f64320b5640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:21.710 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-09-14T10:56:21.712+0000 7f1e7611d640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T10:56:21.724 INFO:tasks.ceph.osd.6.smithi073.stderr:2024-09-14T10:56:21.727+0000 7f1e6df3c640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:21.745 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T10:56:21.747+0000 7f69730d9640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T10:56:21.761 INFO:tasks.ceph.osd.4.smithi073.stderr:2024-09-14T10:56:21.763+0000 7f696aef8640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:56:28.018 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:28.339 INFO:teuthology.misc.health.smithi029.stdout: 2024-09-14T10:56:28.340 INFO:teuthology.misc.health.smithi029.stdout:{"epoch":17,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:24.577810+0000","last_up_change":"2024-09-14T10:56:22.575106+0000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:56:22.422947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6809","nonce":1395949130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6811","nonce":1395949130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6815","nonce":1395949130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6813","nonce":1395949130}]},"public_addr":"172.21.15.29:6809/1395949130","cluster_addr":"172.21.15.29:6811/1395949130","heartbeat_back_addr":"172.21.15.29:6815/1395949130","heartbeat_front_addr":"172.21.15.29:6813/1395949130","state":["exists","up"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6801","nonce":277470273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6803","nonce":277470273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6807","nonce":277470273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6805","nonce":277470273}]},"public_addr":"172.21.15.29:6801/277470273","cluster_addr":"172.21.15.29:6803/277470273","heartbeat_back_addr":"172.21.15.29:6807/277470273","heartbeat_front_addr":"172.21.15.29:6805/277470273","state":["exists","up"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6825","nonce":2902667139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6827","nonce":2902667139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6831","nonce":2902667139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6829","nonce":2902667139}]},"public_addr":"172.21.15.29:6825/2902667139","cluster_addr":"172.21.15.29:6827/2902667139","heartbeat_back_addr":"172.21.15.29:6831/2902667139","heartbeat_front_addr":"172.21.15.29:6829/2902667139","state":["exists","up"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6817","nonce":4274424687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6819","nonce":4274424687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6823","nonce":4274424687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6821","nonce":4274424687}]},"public_addr":"172.21.15.29:6817/4274424687","cluster_addr":"172.21.15.29:6819/4274424687","heartbeat_back_addr":"172.21.15.29:6823/4274424687","heartbeat_front_addr":"172.21.15.29:6821/4274424687","state":["exists","up"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6825","nonce":2654257519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6827","nonce":2654257519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6831","nonce":2654257519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6829","nonce":2654257519}]},"public_addr":"172.21.15.73:6825/2654257519","cluster_addr":"172.21.15.73:6827/2654257519","heartbeat_back_addr":"172.21.15.73:6831/2654257519","heartbeat_front_addr":"172.21.15.73:6829/2654257519","state":["exists","up"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6817","nonce":3705727448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6819","nonce":3705727448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6823","nonce":3705727448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6821","nonce":3705727448}]},"public_addr":"172.21.15.73:6817/3705727448","cluster_addr":"172.21.15.73:6819/3705727448","heartbeat_back_addr":"172.21.15.73:6823/3705727448","heartbeat_front_addr":"172.21.15.73:6821/3705727448","state":["exists","up"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6809","nonce":1291450503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6811","nonce":1291450503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6815","nonce":1291450503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6813","nonce":1291450503}]},"public_addr":"172.21.15.73:6809/1291450503","cluster_addr":"172.21.15.73:6811/1291450503","heartbeat_back_addr":"172.21.15.73:6815/1291450503","heartbeat_front_addr":"172.21.15.73:6813/1291450503","state":["exists","up"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6801","nonce":3037189412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6803","nonce":3037189412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6807","nonce":3037189412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6805","nonce":3037189412}]},"public_addr":"172.21.15.73:6801/3037189412","cluster_addr":"172.21.15.73:6803/3037189412","heartbeat_back_addr":"172.21.15.73:6807/3037189412","heartbeat_front_addr":"172.21.15.73:6805/3037189412","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.038491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.794972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.227653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.715192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.810378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.282202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.436323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.587160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:28.351 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T10:56:28.351 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:56:28.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:56:29.596 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'rbd' created 2024-09-14T10:56:29.613 DEBUG:teuthology.orchestra.run.smithi029:> rbd --cluster ceph pool init rbd 2024-09-14T10:56:29.680 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:29.680 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:32.633 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:56:32.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:56:32.634 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:56:32.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:32.972 INFO:teuthology.orchestra.run.smithi029.stdout:[{"version":9,"timestamp":"2024-09-14T10:56:21.749456+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"6372.665432"}]}] 2024-09-14T10:56:32.972 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T10:56:32.972 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:56:32.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:56:32.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:56:33.340 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:33.351 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4184533150},{"type":"v1","addr":"172.21.15.73:6833","nonce":4184533150}]},"active_addr":"172.21.15.73:6833/4184533150","active_change":"2024-09-14T10:56:14.402987+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3387422489}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":708272198}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":2111612600}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":703499043}]}]} 2024-09-14T10:56:33.386 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:56:33.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:56:33.387 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:33.704 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:33.704 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:32.605158+0000","last_up_change":"2024-09-14T10:56:22.575106+0000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:56:22.422947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:56:28.667570+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6809","nonce":1395949130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6811","nonce":1395949130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6815","nonce":1395949130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6813","nonce":1395949130}]},"public_addr":"172.21.15.29:6809/1395949130","cluster_addr":"172.21.15.29:6811/1395949130","heartbeat_back_addr":"172.21.15.29:6815/1395949130","heartbeat_front_addr":"172.21.15.29:6813/1395949130","state":["exists","up"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6801","nonce":277470273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6803","nonce":277470273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6807","nonce":277470273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6805","nonce":277470273}]},"public_addr":"172.21.15.29:6801/277470273","cluster_addr":"172.21.15.29:6803/277470273","heartbeat_back_addr":"172.21.15.29:6807/277470273","heartbeat_front_addr":"172.21.15.29:6805/277470273","state":["exists","up"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6825","nonce":2902667139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6827","nonce":2902667139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6831","nonce":2902667139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6829","nonce":2902667139}]},"public_addr":"172.21.15.29:6825/2902667139","cluster_addr":"172.21.15.29:6827/2902667139","heartbeat_back_addr":"172.21.15.29:6831/2902667139","heartbeat_front_addr":"172.21.15.29:6829/2902667139","state":["exists","up"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6817","nonce":4274424687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6819","nonce":4274424687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6823","nonce":4274424687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6821","nonce":4274424687}]},"public_addr":"172.21.15.29:6817/4274424687","cluster_addr":"172.21.15.29:6819/4274424687","heartbeat_back_addr":"172.21.15.29:6823/4274424687","heartbeat_front_addr":"172.21.15.29:6821/4274424687","state":["exists","up"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6825","nonce":2654257519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6827","nonce":2654257519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6831","nonce":2654257519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6829","nonce":2654257519}]},"public_addr":"172.21.15.73:6825/2654257519","cluster_addr":"172.21.15.73:6827/2654257519","heartbeat_back_addr":"172.21.15.73:6831/2654257519","heartbeat_front_addr":"172.21.15.73:6829/2654257519","state":["exists","up"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6817","nonce":3705727448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6819","nonce":3705727448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6823","nonce":3705727448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6821","nonce":3705727448}]},"public_addr":"172.21.15.73:6817/3705727448","cluster_addr":"172.21.15.73:6819/3705727448","heartbeat_back_addr":"172.21.15.73:6823/3705727448","heartbeat_front_addr":"172.21.15.73:6821/3705727448","state":["exists","up"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6809","nonce":1291450503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6811","nonce":1291450503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6815","nonce":1291450503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6813","nonce":1291450503}]},"public_addr":"172.21.15.73:6809/1291450503","cluster_addr":"172.21.15.73:6811/1291450503","heartbeat_back_addr":"172.21.15.73:6815/1291450503","heartbeat_front_addr":"172.21.15.73:6813/1291450503","state":["exists","up"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6801","nonce":3037189412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6803","nonce":3037189412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6807","nonce":3037189412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6805","nonce":3037189412}]},"public_addr":"172.21.15.73:6801/3037189412","cluster_addr":"172.21.15.73:6803/3037189412","heartbeat_back_addr":"172.21.15.73:6807/3037189412","heartbeat_front_addr":"172.21.15.73:6805/3037189412","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.038491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.794972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.227653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.715192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.810378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.282202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.436323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.587160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:33.717 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:56:33.717 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:34.032 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:34.032 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":21,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T10:56:32.605158+0000","last_up_change":"2024-09-14T10:56:22.575106+0000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:56:22.422947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:56:28.667570+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6809","nonce":1395949130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6811","nonce":1395949130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6815","nonce":1395949130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6813","nonce":1395949130}]},"public_addr":"172.21.15.29:6809/1395949130","cluster_addr":"172.21.15.29:6811/1395949130","heartbeat_back_addr":"172.21.15.29:6815/1395949130","heartbeat_front_addr":"172.21.15.29:6813/1395949130","state":["exists","up"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6801","nonce":277470273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6803","nonce":277470273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6807","nonce":277470273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6805","nonce":277470273}]},"public_addr":"172.21.15.29:6801/277470273","cluster_addr":"172.21.15.29:6803/277470273","heartbeat_back_addr":"172.21.15.29:6807/277470273","heartbeat_front_addr":"172.21.15.29:6805/277470273","state":["exists","up"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6825","nonce":2902667139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6827","nonce":2902667139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6831","nonce":2902667139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6829","nonce":2902667139}]},"public_addr":"172.21.15.29:6825/2902667139","cluster_addr":"172.21.15.29:6827/2902667139","heartbeat_back_addr":"172.21.15.29:6831/2902667139","heartbeat_front_addr":"172.21.15.29:6829/2902667139","state":["exists","up"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6817","nonce":4274424687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6819","nonce":4274424687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6823","nonce":4274424687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6821","nonce":4274424687}]},"public_addr":"172.21.15.29:6817/4274424687","cluster_addr":"172.21.15.29:6819/4274424687","heartbeat_back_addr":"172.21.15.29:6823/4274424687","heartbeat_front_addr":"172.21.15.29:6821/4274424687","state":["exists","up"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6825","nonce":2654257519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6827","nonce":2654257519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6831","nonce":2654257519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6829","nonce":2654257519}]},"public_addr":"172.21.15.73:6825/2654257519","cluster_addr":"172.21.15.73:6827/2654257519","heartbeat_back_addr":"172.21.15.73:6831/2654257519","heartbeat_front_addr":"172.21.15.73:6829/2654257519","state":["exists","up"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6817","nonce":3705727448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6819","nonce":3705727448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6823","nonce":3705727448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6821","nonce":3705727448}]},"public_addr":"172.21.15.73:6817/3705727448","cluster_addr":"172.21.15.73:6819/3705727448","heartbeat_back_addr":"172.21.15.73:6823/3705727448","heartbeat_front_addr":"172.21.15.73:6821/3705727448","state":["exists","up"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6809","nonce":1291450503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6811","nonce":1291450503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6815","nonce":1291450503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6813","nonce":1291450503}]},"public_addr":"172.21.15.73:6809/1291450503","cluster_addr":"172.21.15.73:6811/1291450503","heartbeat_back_addr":"172.21.15.73:6815/1291450503","heartbeat_front_addr":"172.21.15.73:6813/1291450503","state":["exists","up"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6801","nonce":3037189412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6803","nonce":3037189412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6807","nonce":3037189412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6805","nonce":3037189412}]},"public_addr":"172.21.15.73:6801/3037189412","cluster_addr":"172.21.15.73:6803/3037189412","heartbeat_back_addr":"172.21.15.73:6807/3037189412","heartbeat_front_addr":"172.21.15.73:6805/3037189412","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.038491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.794972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.227653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.715192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.810378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.282202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.436323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.587160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:34.046 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:56:34.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:56:34.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:56:34.047 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:56:34.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T10:56:34.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T10:56:34.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T10:56:34.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T10:56:34.325 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-09-14T10:56:34.325 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:56:34.326 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-09-14T10:56:34.326 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:56:34.327 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-09-14T10:56:34.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:56:34.328 INFO:teuthology.orchestra.run.smithi029.stdout:60129542149 2024-09-14T10:56:34.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:56:34.329 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-09-14T10:56:34.330 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:56:34.330 INFO:teuthology.orchestra.run.smithi029.stdout:60129542149 2024-09-14T10:56:34.331 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:56:34.331 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-09-14T10:56:34.332 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:56:34.333 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-09-14T10:56:34.333 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:56:34.938 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-09-14T10:56:34.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-14T10:56:34.958 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.000 INFO:teuthology.orchestra.run.smithi029.stdout:60129542149 2024-09-14T10:56:35.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-14T10:56:35.015 INFO:teuthology.orchestra.run.smithi029.stdout:60129542149 2024-09-14T10:56:35.015 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.026 INFO:teuthology.orchestra.run.smithi029.stdout:60129542150 2024-09-14T10:56:35.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-14T10:56:35.030 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.031 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-09-14T10:56:35.037 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-09-14T10:56:35.039 INFO:teuthology.orchestra.run.smithi029.stdout:64424509446 2024-09-14T10:56:35.046 INFO:teuthology.orchestra.run.smithi029.stdout:60129542148 2024-09-14T10:56:35.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-09-14T10:56:35.048 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-09-14T10:56:35.052 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-14T10:56:35.054 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-14T10:56:35.059 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-09-14T10:56:35.061 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:35.061 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:56:35.062 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:56:35.412 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:35.413 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T10:56:35.424 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T10:56:34.965824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239856,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734864,"statfs":{"total":773094113280,"available":772848500736,"internally_reserved":0,"allocated":2867200,"data_stored":1752702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.555067"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000969+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T10:56:33.000969+0000","last_peered":"2024-09-14T10:56:33.000969+0000","last_clean":"2024-09-14T10:56:33.000969+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T10:56:33.000969+0000","last_undegraded":"2024-09-14T10:56:33.000969+0000","last_fullsized":"2024-09-14T10:56:33.000969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612098+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T10:56:32.612098+0000","last_peered":"2024-09-14T10:56:32.612098+0000","last_clean":"2024-09-14T10:56:32.612098+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T10:56:32.612098+0000","last_undegraded":"2024-09-14T10:56:32.612098+0000","last_fullsized":"2024-09-14T10:56:32.612098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.001015+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T10:56:33.001015+0000","last_peered":"2024-09-14T10:56:33.001015+0000","last_clean":"2024-09-14T10:56:33.001015+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T10:56:33.001015+0000","last_undegraded":"2024-09-14T10:56:33.001015+0000","last_fullsized":"2024-09-14T10:56:33.001015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612051+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T10:56:32.612051+0000","last_peered":"2024-09-14T10:56:32.612051+0000","last_clean":"2024-09-14T10:56:32.612051+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T10:56:32.612051+0000","last_undegraded":"2024-09-14T10:56:32.612051+0000","last_fullsized":"2024-09-14T10:56:32.612051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.617027+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T10:56:32.617027+0000","last_peered":"2024-09-14T10:56:32.617027+0000","last_clean":"2024-09-14T10:56:32.617027+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T10:56:32.617027+0000","last_undegraded":"2024-09-14T10:56:32.617027+0000","last_fullsized":"2024-09-14T10:56:32.617027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612672+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T10:56:32.612672+0000","last_peered":"2024-09-14T10:56:32.612672+0000","last_clean":"2024-09-14T10:56:32.612672+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T10:56:32.612672+0000","last_undegraded":"2024-09-14T10:56:32.612672+0000","last_fullsized":"2024-09-14T10:56:32.612672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000944+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T10:56:33.000944+0000","last_peered":"2024-09-14T10:56:33.000944+0000","last_clean":"2024-09-14T10:56:33.000944+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T10:56:33.000944+0000","last_undegraded":"2024-09-14T10:56:33.000944+0000","last_fullsized":"2024-09-14T10:56:33.000944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.616047+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T10:56:32.616047+0000","last_peered":"2024-09-14T10:56:32.616047+0000","last_clean":"2024-09-14T10:56:32.616047+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T10:56:32.616047+0000","last_undegraded":"2024-09-14T10:56:32.616047+0000","last_fullsized":"2024-09-14T10:56:32.616047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000680+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T10:56:33.000680+0000","last_peered":"2024-09-14T10:56:33.000680+0000","last_clean":"2024-09-14T10:56:33.000680+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T10:56:33.000680+0000","last_undegraded":"2024-09-14T10:56:33.000680+0000","last_fullsized":"2024-09-14T10:56:33.000680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:56:35.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:56:35.736 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:35.737 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T10:56:35.750 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-14T10:56:34.965824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239856,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734864,"statfs":{"total":773094113280,"available":772848500736,"internally_reserved":0,"allocated":2867200,"data_stored":1752702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.555067"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000969+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T10:56:33.000969+0000","last_peered":"2024-09-14T10:56:33.000969+0000","last_clean":"2024-09-14T10:56:33.000969+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T10:56:33.000969+0000","last_undegraded":"2024-09-14T10:56:33.000969+0000","last_fullsized":"2024-09-14T10:56:33.000969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612098+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T10:56:32.612098+0000","last_peered":"2024-09-14T10:56:32.612098+0000","last_clean":"2024-09-14T10:56:32.612098+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T10:56:32.612098+0000","last_undegraded":"2024-09-14T10:56:32.612098+0000","last_fullsized":"2024-09-14T10:56:32.612098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.001015+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T10:56:33.001015+0000","last_peered":"2024-09-14T10:56:33.001015+0000","last_clean":"2024-09-14T10:56:33.001015+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T10:56:33.001015+0000","last_undegraded":"2024-09-14T10:56:33.001015+0000","last_fullsized":"2024-09-14T10:56:33.001015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612051+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T10:56:32.612051+0000","last_peered":"2024-09-14T10:56:32.612051+0000","last_clean":"2024-09-14T10:56:32.612051+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T10:56:32.612051+0000","last_undegraded":"2024-09-14T10:56:32.612051+0000","last_fullsized":"2024-09-14T10:56:32.612051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.617027+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T10:56:32.617027+0000","last_peered":"2024-09-14T10:56:32.617027+0000","last_clean":"2024-09-14T10:56:32.617027+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T10:56:32.617027+0000","last_undegraded":"2024-09-14T10:56:32.617027+0000","last_fullsized":"2024-09-14T10:56:32.617027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.612672+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T10:56:32.612672+0000","last_peered":"2024-09-14T10:56:32.612672+0000","last_clean":"2024-09-14T10:56:32.612672+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T10:56:32.612672+0000","last_undegraded":"2024-09-14T10:56:32.612672+0000","last_fullsized":"2024-09-14T10:56:32.612672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000944+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T10:56:33.000944+0000","last_peered":"2024-09-14T10:56:33.000944+0000","last_clean":"2024-09-14T10:56:33.000944+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T10:56:33.000944+0000","last_undegraded":"2024-09-14T10:56:33.000944+0000","last_fullsized":"2024-09-14T10:56:33.000944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:32.616047+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T10:56:32.616047+0000","last_peered":"2024-09-14T10:56:32.616047+0000","last_clean":"2024-09-14T10:56:32.616047+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T10:56:32.616047+0000","last_undegraded":"2024-09-14T10:56:32.616047+0000","last_fullsized":"2024-09-14T10:56:32.616047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:56:33.000680+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T10:56:33.000680+0000","last_peered":"2024-09-14T10:56:33.000680+0000","last_clean":"2024-09-14T10:56:33.000680+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T10:56:33.000680+0000","last_undegraded":"2024-09-14T10:56:33.000680+0000","last_fullsized":"2024-09-14T10:56:33.000680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27244,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35552,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336288,"statfs":{"total":96636764160,"available":96600358912,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:56:35.751 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:56:35.751 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:56:35.751 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:56:35.751 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:56:36.099 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T10:56:36.099 INFO:teuthology.orchestra.run.smithi029.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:56:36.111 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:56:36.112 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T10:56:36.124 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:56:36.166 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T10:56:36.167 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:56:36.167 INFO:tasks.rgw:Creating data pools 2024-09-14T10:56:36.167 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:56:36.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-14T10:56:36.655 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T10:56:38.651 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:56:38.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:56:39.644 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:56:39.694 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:56:40.671 INFO:teuthology.orchestra.run.smithi029.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:56:40.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:56:41.668 INFO:teuthology.orchestra.run.smithi029.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:56:41.705 DEBUG:tasks.rgw:Pools created 2024-09-14T10:56:41.705 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T10:56:41.705 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:41.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:41.705 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:41.834 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:41.834 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:43.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.732+0000 7f70f904c640 0 -- 172.21.15.29:0/805838768 >> [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] conn(0x7f6fd4077140 msgr2=0x7f6fd4079600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:56:43.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.737+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.738+0000 7f70f884b640 0 -- 172.21.15.29:0/3964333237 >> [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] conn(0x7f6fc0077230 msgr2=0x7f6fc00796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.738+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.738+0000 7f70fcb26800 20 realm 2024-09-14T10:56:43.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.738+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.739+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.739+0000 7f70fcb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.739+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.739+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:43.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.739+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.740+0000 7f70fcb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:43.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.740+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.741+0000 7f70fcb26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:43.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.741+0000 7f70fcb26800 20 searching for the correct realm 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.752+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:43.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 zone default found 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 4 Realm: () 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 zonegroup default 2024-09-14T10:56:43.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.753+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:43.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.754+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:43.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:43.754+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:45.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:45.722+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:45.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:45.722+0000 7f70fcb26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:45.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:45.722+0000 7f70fcb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:45.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:45.722+0000 7f70fcb26800 20 started sync module instance, tier type = 2024-09-14T10:56:45.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:45.722+0000 7f70fcb26800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:56:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.746+0000 7f70fcb26800 20 add_watcher() i=0 2024-09-14T10:56:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=1 2024-09-14T10:56:47.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=2 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=3 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=4 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=5 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.747+0000 7f70fcb26800 20 add_watcher() i=6 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.748+0000 7f70fcb26800 20 add_watcher() i=7 2024-09-14T10:56:47.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.748+0000 7f70fcb26800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.748+0000 7f70fcb26800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.748+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.748+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.749+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.750+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T10:56:47.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T10:56:47.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.751+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.752+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.753 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.753+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T10:56:47.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.754+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T10:56:47.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T10:56:47.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.755+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T10:56:47.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T10:56:47.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.756+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.757+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T10:56:47.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.758+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.761 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.759+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T10:56:47.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.760+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T10:56:47.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.761+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.762+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T10:56:47.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.763+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T10:56:47.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.764+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T10:56:47.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.765+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.766+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T10:56:47.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.767+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.768+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T10:56:47.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.769+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.770+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T10:56:47.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.771+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.772+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T10:56:47.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.773+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.774+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T10:56:47.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.775+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T10:56:47.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.776+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T10:56:47.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.777+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T10:56:47.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.778+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T10:56:47.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.779+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T10:56:47.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T10:56:47.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T10:56:47.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.780+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T10:56:47.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.781+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.782+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T10:56:47.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T10:56:47.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.783+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T10:56:47.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.785+0000 7f70fcb26800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:47.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.788+0000 7f6faafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:47.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.788+0000 7f70fcb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:47.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:47.788+0000 7f70fcb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:50.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f70fcb26800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T10:56:50.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f70fcb26800 5 note: GC not initialized 2024-09-14T10:56:50.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f6fa9fe3640 20 reqs_thread_entry: start 2024-09-14T10:56:50.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f70fcb26800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:50.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f70fcb26800 20 Filter name: none 2024-09-14T10:56:50.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.734+0000 7f6f0b7fe640 20 reqs_thread_entry: start 2024-09-14T10:56:50.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.764+0000 7f6faafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.768+0000 7f70fcb26800 20 remove_watcher() i=0 2024-09-14T10:56:50.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.768+0000 7f70fcb26800 2 removed watcher, disabling cache 2024-09-14T10:56:50.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.769+0000 7f70fcb26800 20 remove_watcher() i=1 2024-09-14T10:56:50.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.770+0000 7f70fcb26800 20 remove_watcher() i=2 2024-09-14T10:56:50.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.772+0000 7f70fcb26800 20 remove_watcher() i=3 2024-09-14T10:56:50.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.773+0000 7f70fcb26800 20 remove_watcher() i=4 2024-09-14T10:56:50.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.774+0000 7f70fcb26800 20 remove_watcher() i=5 2024-09-14T10:56:50.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.775+0000 7f70fcb26800 20 remove_watcher() i=6 2024-09-14T10:56:50.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.777+0000 7f70fcb26800 20 remove_watcher() i=7 2024-09-14T10:56:50.800 INFO:teuthology.orchestra.run.smithi029.stdout:[] 2024-09-14T10:56:50.801 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:50.801 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:56:50.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:56:50.801 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T10:56:50.870 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:50.870 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.900+0000 7f43d342f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:50.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.900+0000 7f43d342f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:50.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:50.904+0000 7f4226ffd640 20 reqs_thread_entry: start 2024-09-14T10:56:50.918 INFO:teuthology.orchestra.run.smithi029.stdout:{"id":"11989569-703c-4397-b0f1-7ddb0279a491","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:56:50.919 DEBUG:tasks.util.rgw: json result: {'id': '11989569-703c-4397-b0f1-7ddb0279a491', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:56:50.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:50.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:50.919 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:50.978 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:51.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.015+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.017+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.017+0000 7fd117f46800 20 realm 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.017+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.017+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.017+0000 7fd117f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:51.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.018+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.018+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.018+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.019+0000 7fd117f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:51.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.019+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.019+0000 7fd117f46800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:56:51.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.019+0000 7fd117f46800 20 searching for the correct realm 2024-09-14T10:56:51.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.021+0000 7fd116238640 0 -- 172.21.15.29:0/2914027783 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd110061040 msgr2=0x7fd1100a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:51.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.227+0000 7fd115236640 0 -- 172.21.15.29:0/2914027783 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd1100af920 msgr2=0x7fd1100bb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:51.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.435+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 zone default found 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 4 Realm: () 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 zonegroup default 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.436+0000 7fd117f46800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.437+0000 7fd117f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.437+0000 7fd117f46800 20 started sync module instance, tier type = 2024-09-14T10:56:51.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.437+0000 7fd117f46800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:56:51.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=0 2024-09-14T10:56:51.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=1 2024-09-14T10:56:51.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=2 2024-09-14T10:56:51.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=3 2024-09-14T10:56:51.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=4 2024-09-14T10:56:51.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=5 2024-09-14T10:56:51.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.449+0000 7fd117f46800 20 add_watcher() i=6 2024-09-14T10:56:51.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.450+0000 7fd117f46800 20 add_watcher() i=7 2024-09-14T10:56:51.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.450+0000 7fd117f46800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.452+0000 7fcfc7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.452+0000 7fd117f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.452+0000 7fd117f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.452+0000 7fd117f46800 5 note: GC not initialized 2024-09-14T10:56:51.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.452+0000 7fcfc6ffd640 20 reqs_thread_entry: start 2024-09-14T10:56:51.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.453+0000 7fd117f46800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:51.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.453+0000 7fd117f46800 20 Filter name: none 2024-09-14T10:56:51.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.453+0000 7fcfc4ff9640 20 reqs_thread_entry: start 2024-09-14T10:56:51.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.464+0000 7fcfc7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:51.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.466+0000 7fd117f46800 20 remove_watcher() i=0 2024-09-14T10:56:51.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.466+0000 7fd117f46800 2 removed watcher, disabling cache 2024-09-14T10:56:51.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.468+0000 7fd117f46800 20 remove_watcher() i=1 2024-09-14T10:56:51.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.469+0000 7fd117f46800 20 remove_watcher() i=2 2024-09-14T10:56:51.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.470+0000 7fd117f46800 20 remove_watcher() i=3 2024-09-14T10:56:51.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.471+0000 7fd117f46800 20 remove_watcher() i=4 2024-09-14T10:56:51.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.473+0000 7fd117f46800 20 remove_watcher() i=5 2024-09-14T10:56:51.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.474+0000 7fd117f46800 20 remove_watcher() i=6 2024-09-14T10:56:51.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.475+0000 7fd117f46800 20 remove_watcher() i=7 2024-09-14T10:56:51.484 INFO:teuthology.orchestra.run.smithi029.stdout:[] 2024-09-14T10:56:51.485 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:51.485 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:56:51.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:56:51.485 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T10:56:51.553 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:51.553 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:51.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.582+0000 7fe8edb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:51.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.582+0000 7fe8edb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:51.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.586+0000 7fe771ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:51.600 INFO:teuthology.orchestra.run.smithi029.stdout:{"id":"11989569-703c-4397-b0f1-7ddb0279a491","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:51.601 DEBUG:tasks.util.rgw: json result: {'id': '11989569-703c-4397-b0f1-7ddb0279a491', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:51.601 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-09-14T10:56:51.601 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p /tmp/rgw_datacache 2024-09-14T10:56:51.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a+rwx /tmp/rgw_datacache 2024-09-14T10:56:51.711 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:51.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:51.711 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:51.808 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:51.808 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:51.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.845+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.847+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.847+0000 7f3c98ebb800 20 realm 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.847+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.848+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.848+0000 7f3c98ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.848+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.848+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.848+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.849+0000 7f3c98ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:51.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.849+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:51.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.849+0000 7f3c98ebb800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:56:51.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.849+0000 7f3c98ebb800 20 searching for the correct realm 2024-09-14T10:56:51.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:51.851+0000 7f3c971a6640 0 -- 172.21.15.29:0/1487649281 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f3c90061040 msgr2=0x7f3c90096250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:56:52.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.057+0000 7f3c961a4640 0 -- 172.21.15.29:0/1487649281 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f3c900aeeb0 msgr2=0x7f3c900bb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:52.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.264+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 zone default found 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 4 Realm: () 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 zonegroup default 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:52.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.265+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.266+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.266+0000 7f3c98ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:56:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.266+0000 7f3c98ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.266+0000 7f3c98ebb800 20 started sync module instance, tier type = 2024-09-14T10:56:52.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.266+0000 7f3c98ebb800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:56:52.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=0 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=1 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=2 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=3 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=4 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=5 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.276+0000 7f3c98ebb800 20 add_watcher() i=6 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.277+0000 7f3c98ebb800 20 add_watcher() i=7 2024-09-14T10:56:52.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.277+0000 7f3c98ebb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3b4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3c98ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3c98ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3c98ebb800 5 note: GC not initialized 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3ac7fff640 20 reqs_thread_entry: start 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3c98ebb800 20 init_complete bucket index max shards: 11 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3c98ebb800 20 Filter name: none 2024-09-14T10:56:52.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.279+0000 7f3ac5ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:52.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.290+0000 7f3b4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:52.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.292+0000 7f3c98ebb800 20 remove_watcher() i=0 2024-09-14T10:56:52.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.292+0000 7f3c98ebb800 2 removed watcher, disabling cache 2024-09-14T10:56:52.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.293+0000 7f3c98ebb800 20 remove_watcher() i=1 2024-09-14T10:56:52.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.294+0000 7f3c98ebb800 20 remove_watcher() i=2 2024-09-14T10:56:52.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.295+0000 7f3c98ebb800 20 remove_watcher() i=3 2024-09-14T10:56:52.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.296+0000 7f3c98ebb800 20 remove_watcher() i=4 2024-09-14T10:56:52.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.297+0000 7f3c98ebb800 20 remove_watcher() i=5 2024-09-14T10:56:52.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.298+0000 7f3c98ebb800 20 remove_watcher() i=6 2024-09-14T10:56:52.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.299+0000 7f3c98ebb800 20 remove_watcher() i=7 2024-09-14T10:56:52.309 INFO:teuthology.orchestra.run.smithi029.stdout:[] 2024-09-14T10:56:52.309 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:52.309 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T10:56:52.309 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:56:52.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:56:52.310 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T10:56:52.373 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:52.373 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:52.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.404+0000 7fdb33f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:52.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.404+0000 7fdb33f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:52.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.408+0000 7fd9edffb640 20 reqs_thread_entry: start 2024-09-14T10:56:52.421 INFO:teuthology.orchestra.run.smithi029.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T10:56:52.421 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T10:56:52.422 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:56:52.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:56:52.422 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T10:56:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:52.488 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:52.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.517+0000 7f9c59040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:52.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.517+0000 7f9c59040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:52.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.521+0000 7f9b197e2640 20 reqs_thread_entry: start 2024-09-14T10:56:52.535 INFO:teuthology.orchestra.run.smithi029.stdout:{"id":"11989569-703c-4397-b0f1-7ddb0279a491","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:52.536 DEBUG:tasks.util.rgw: json result: {'id': '11989569-703c-4397-b0f1-7ddb0279a491', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:52.536 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T10:56:52.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:56:52.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:56:52.536 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T10:56:52.599 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:52.600 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:52.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.628+0000 7f18f3723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:52.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.628+0000 7f18f3723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:52.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.633+0000 7f1735ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:52.646 INFO:teuthology.orchestra.run.smithi029.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T10:56:52.646 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T10:56:52.646 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:56:52.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:56:52.647 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T10:56:52.713 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:52.713 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.742+0000 7fd20e739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:52.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.742+0000 7fd20e739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:52.745 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T10:56:52.748+0000 7fd0cd7e2640 20 reqs_thread_entry: start 2024-09-14T10:56:52.762 INFO:teuthology.orchestra.run.smithi029.stdout:{"id":"11989569-703c-4397-b0f1-7ddb0279a491","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:52.762 DEBUG:tasks.util.rgw: json result: {'id': '11989569-703c-4397-b0f1-7ddb0279a491', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:52.763 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:56:52.763 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T10:56:52.763 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:56:52.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo echo -n http://smithi029.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:56:52.804 INFO:teuthology.orchestra.run.smithi029.stdout:http://smithi029.front.sepia.ceph.com:80 2024-09-14T10:56:52.805 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:56:52.885 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T10:56:52.885 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:56:52.885 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:56:52.927 INFO:tasks.rgw.client.0:Started 2024-09-14T10:56:52.927 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:56:52.927 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:56:52.971 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:56:52.971 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:56:52.971 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:56:52.972 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:56:52.972 INFO:teuthology.orchestra.run.smithi029.stderr:curl: (7) Failed to connect to smithi029.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:56:53.972 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:56:54.005 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:56:54.006 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:56:54.007 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:56:54.007 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:56:54.007 INFO:teuthology.orchestra.run.smithi029.stderr:curl: (7) Failed to connect to smithi029.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:56:56.009 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:56:56.043 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:56:56.043 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:56:56.043 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:56:56.043 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:56:56.043 INFO:teuthology.orchestra.run.smithi029.stderr:curl: (7) Failed to connect to smithi029.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:57:00.048 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:57:00.082 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:57:00.083 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:57:00.083 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:57:00.084 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:57:00.084 INFO:teuthology.orchestra.run.smithi029.stderr:curl: (7) Failed to connect to smithi029.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:57:08.085 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:57:08.119 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:57:08.120 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:57:08.120 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:57:08.120 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:57:08.120 INFO:teuthology.orchestra.run.smithi029.stderr:curl: (7) Failed to connect to smithi029.front.sepia.ceph.com port 80: Connection refused 2024-09-14T10:57:24.122 DEBUG:teuthology.orchestra.run.smithi029:> curl http://smithi029.front.sepia.ceph.com:80/ 2024-09-14T10:57:24.162 INFO:teuthology.orchestra.run.smithi029.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:57:24.162 INFO:teuthology.orchestra.run.smithi029.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:57:24.486 INFO:teuthology.orchestra.run.smithi029.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 577 0 --:--:-- --:--:-- --:--:-- 575 2024-09-14T10:57:24.487 INFO:teuthology.orchestra.run.smithi029.stdout:anonymous 2024-09-14T10:57:24.488 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T10:57:24.499 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T10:57:24.499 DEBUG:teuthology.orchestra.run.smithi029:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T10:57:27.017 DEBUG:teuthology.orchestra.run.smithi029:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T10:57:27.564 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting tox==3.15.0 2024-09-14T10:57:27.616 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T10:57:27.753 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting toml>=0.9.4 2024-09-14T10:57:27.767 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T10:57:27.866 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting packaging>=14 2024-09-14T10:57:27.881 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T10:57:27.973 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting six<2,>=1.14.0 2024-09-14T10:57:27.987 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:57:28.070 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T10:57:28.085 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T10:57:28.179 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting py<2,>=1.4.17 2024-09-14T10:57:28.195 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T10:57:28.322 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T10:57:28.336 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T10:57:28.615 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T10:57:28.629 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T10:57:28.951 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T10:57:28.965 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T10:57:29.053 INFO:teuthology.orchestra.run.smithi029.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T10:57:29.068 INFO:teuthology.orchestra.run.smithi029.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T10:57:29.203 INFO:teuthology.orchestra.run.smithi029.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T10:57:30.071 INFO:teuthology.orchestra.run.smithi029.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T10:57:30.278 INFO:teuthology.orchestra.run.smithi029.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T10:57:30.278 INFO:teuthology.orchestra.run.smithi029.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T10:57:30.339 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:57:30.353 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:57:30.354 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:57:30.354 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:30.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:57:30.384 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:57:30.385 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:30.454 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:30.454 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:57:30.523 INFO:tasks.workunit:timeout=3h 2024-09-14T10:57:30.523 INFO:tasks.workunit:cleanup=True 2024-09-14T10:57:30.524 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:57:30.593 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:58:29.006 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 93% (12087/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:58:29.058 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T10:58:29.059 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.060 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T10:58:29.060 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.060 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:58:29.060 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:58:29.060 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:58:29.061 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:58:29.142 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:58:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:58:29.144 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:58:30.047 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:58:30.160 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:58:30.203 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:58:30.205 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:58:30.205 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:58:30.246 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:58:30.249 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:58:30.249 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:58:30.320 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-09-14T10:58:30.321 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-09-14T10:58:30.321 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:58:30.394 INFO:tasks.workunit.client.0.smithi029.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-09-14T10:58:30.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:58:30.395 INFO:tasks.workunit.client.0.smithi029.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ deactivate nondestructive 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:58:32.877 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:58:32.878 INFO:tasks.workunit.client.0.smithi029.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:58:32.878 INFO:tasks.workunit.client.0.smithi029.stderr:++ export VIRTUAL_ENV 2024-09-14T10:58:32.878 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:58:32.878 INFO:tasks.workunit.client.0.smithi029.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PATH 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ PS1='(rgw) ' 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PS1 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T10:58:32.879 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install pip --upgrade 2024-09-14T10:58:33.115 INFO:tasks.workunit.client.0.smithi029.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:58:33.302 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting pip 2024-09-14T10:58:33.352 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:58:33.531 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: pip 2024-09-14T10:58:33.531 INFO:tasks.workunit.client.0.smithi029.stdout: Attempting uninstall: pip 2024-09-14T10:58:33.531 INFO:tasks.workunit.client.0.smithi029.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:58:33.699 INFO:tasks.workunit.client.0.smithi029.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:58:33.705 INFO:tasks.workunit.client.0.smithi029.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:58:34.481 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed pip-24.2 2024-09-14T10:58:34.729 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install configobj 2024-09-14T10:58:35.133 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting configobj 2024-09-14T10:58:35.178 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-09-14T10:58:35.325 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting six (from configobj) 2024-09-14T10:58:35.339 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:58:35.402 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-09-14T10:58:35.476 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:58:35.543 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: six, configobj 2024-09-14T10:58:35.702 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-09-14T10:58:35.751 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-09-14T10:58:35.783 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-09-14T10:58:35.784 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(pwd) 2024-09-14T10:58:35.785 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:35.785 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-09-14T10:58:35.785 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:58:35.786 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-09-14T10:58:35.831 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:35.831 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'tcp 0 0 0.0.0.0:80 0.0.0.0:* LISTEN 44569/valgrind \ntcp6 0 0 :::80 :::* LISTEN 44569/valgrind \n' 2024-09-14T10:58:35.831 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:radosgw port: 80 2024-09-14T10:58:35.831 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-09-14T10:58:35.831 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-09-14T10:58:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'' 2024-09-14T10:58:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-09-14T10:58:35.965030Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-09-14T10:58:35.965014Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:Creating s3cmd config... 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:proto for s3cmd config is http 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:s3cmd config written 2024-09-14T10:58:36.015 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-09-14T10:58:36.598 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:36.598 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-09-14T10:58:36.598 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-09-14T10:58:41.050 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:41.050 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 4.2 seconds, 1704.59 KB/s) [1 of 1]\n" 2024-09-14T10:58:41.050 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-09-14T10:58:41.613 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:41.613 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.3 seconds, 22.43 MB/s)\n" 2024-09-14T10:58:41.614 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-09-14T10:58:42.146 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:42.146 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7342274,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zlib",\n "orig_size": 7340032,\n "compressor_message": -15,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4195585\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4195585,\n "len": 3146689\n }\n ]\n },\n "etag": "0c40507f84f836272fd71f56b1d6c1a4",\n "tag": "11989569-703c-4397-b0f1-7ddb0279a491.4517.11689580184650091906",\n "manifest": {\n "objs": [],\n "obj_size": 7342274,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".2OXvpxaPHLH4l51ml12csRK5DOPiOyr_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 4190208,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "bucket_id": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 4190208,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "bucket_id": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".2OXvpxaPHLH4l51ml12csRK5DOPiOyr_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 4190208,\n "ofs": 7342274,\n "stripe_size": 3152066,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "bucket_id": "11989569-703c-4397-b0f1-7ddb0279a491.4517.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".2OXvpxaPHLH4l51ml12csRK5DOPiOyr_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "mtime": "2024-09-14T10:58:40.950026Z",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "11989569-703c-4397-b0f1-7ddb0279a491.4517.11689580184650091906",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1726311515/ctime:1726311515/gid:1333/gname:ubuntu/md5:0c40507f84f836272fd71f56b1d6c1a4/mode:33188/mtime:1726311515/uid:1000/uname:ubuntu"\n }\n}\n' 2024-09-14T10:58:42.147 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:Cached object name is: .2OXvpxaPHLH4l51ml12csRK5DOPiOyr_ 2024-09-14T10:58:42.147 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-09-14T10:58:42.159 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:command succeeded 2024-09-14T10:58:42.159 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:b'0\n' 2024-09-14T10:58:42.159 INFO:tasks.workunit.client.0.smithi029.stderr:DEBUG:root:Check cache dir content: 0 2024-09-14T10:58:42.159 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-09-14T10:58:42.159 INFO:tasks.workunit.client.0.smithi029.stderr:INFO:root:Completed Datacache tests 2024-09-14T10:58:42.165 INFO:tasks.workunit.client.0.smithi029.stderr:+ deactivate 2024-09-14T10:58:42.165 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T10:58:42.165 INFO:tasks.workunit.client.0.smithi029.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ hash -r 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset -f deactivate 2024-09-14T10:58:42.166 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK. 2024-09-14T10:58:42.167 INFO:tasks.workunit.client.0.smithi029.stdout:OK. 2024-09-14T10:58:42.167 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:58:42.167 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:58:42.252 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-09-14T10:58:42.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:58:42.570 DEBUG:teuthology.parallel:result is None 2024-09-14T10:58:42.570 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:58:42.611 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:58:42.611 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:58:42.689 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:58:42.691 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:58:43.022 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:58:43.022 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:58:43.022 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:58:43.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:58:43.054 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:58:43.054 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:58:43.127 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:58:43.127 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:58:43.199 INFO:tasks.workunit:timeout=3h 2024-09-14T10:58:43.199 INFO:tasks.workunit:cleanup=True 2024-09-14T10:58:43.199 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:58:43.271 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:59:42.813 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 93% (12005/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T10:59:43.427 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.428 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T10:59:43.428 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.428 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:59:43.428 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:43.428 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:59:43.429 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:59:43.500 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:59:43.502 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:59:43.502 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:59:43.552 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:59:43.601 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:59:43.642 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:59:43.643 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:59:43.644 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:59:43.682 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:59:43.686 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T10:59:43.686 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:59:43.757 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T10:59:43.758 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T10:59:43.759 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:59:43.833 INFO:tasks.workunit.client.0.smithi029.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:59:43.833 INFO:tasks.workunit.client.0.smithi029.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:59:43.834 INFO:tasks.workunit.client.0.smithi029.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:59:46.292 INFO:tasks.workunit.client.0.smithi029.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:59:46.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ deactivate nondestructive 2024-09-14T10:59:46.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:59:46.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:59:46.292 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ export VIRTUAL_ENV 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:59:46.293 INFO:tasks.workunit.client.0.smithi029.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PATH 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ PS1='(rgw) ' 2024-09-14T10:59:46.295 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PS1 2024-09-14T10:59:46.296 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:59:46.296 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T10:59:46.296 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install pip --upgrade 2024-09-14T10:59:46.531 INFO:tasks.workunit.client.0.smithi029.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:59:46.727 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting pip 2024-09-14T10:59:46.732 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:59:46.779 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: pip 2024-09-14T10:59:46.779 INFO:tasks.workunit.client.0.smithi029.stdout: Attempting uninstall: pip 2024-09-14T10:59:46.779 INFO:tasks.workunit.client.0.smithi029.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:59:46.951 INFO:tasks.workunit.client.0.smithi029.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:59:46.956 INFO:tasks.workunit.client.0.smithi029.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:59:47.746 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed pip-24.2 2024-09-14T10:59:47.795 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install boto3 2024-09-14T10:59:48.693 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting boto3 2024-09-14T10:59:48.735 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T10:59:49.441 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T10:59:49.455 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T10:59:49.588 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T10:59:49.602 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T10:59:49.754 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T10:59:49.769 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T10:59:49.909 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:59:49.922 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T10:59:50.081 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:59:50.095 INFO:tasks.workunit.client.0.smithi029.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T10:59:50.392 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:59:50.393 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:59:50.411 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T10:59:50.501 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T10:59:50.809 INFO:tasks.workunit.client.0.smithi029.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 41.8 MB/s eta 0:00:00 2024-09-14T10:59:50.823 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T10:59:50.888 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T10:59:50.955 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T10:59:51.024 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T10:59:51.079 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:59:51.158 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T10:59:52.314 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T10:59:52.432 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T10:59:52.571 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T10:59:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:52.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.648+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 realm 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:52.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.650+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:52.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.651+0000 7f98eea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:52.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.651+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:52.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.652+0000 7f98eea13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:52.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.652+0000 7f98eea13800 20 searching for the correct realm 2024-09-14T10:59:52.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.654+0000 7f98ea949640 0 -- 172.21.15.29:0/1594117008 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f98e4087040 msgr2=0x7f98e4087930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:52.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:52.859+0000 7f98e9947640 0 -- 172.21.15.29:0/1594117008 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f98e4055a90 msgr2=0x7f98e40973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:59:53.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.066+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:53.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:53.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.067+0000 7f98eea13800 20 zone default found 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 4 Realm: () 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 zonegroup default 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 started sync module instance, tier type = 2024-09-14T10:59:53.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.068+0000 7f98eea13800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=0 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=1 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=2 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=3 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=4 2024-09-14T10:59:53.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=5 2024-09-14T10:59:53.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.079+0000 7f98eea13800 20 add_watcher() i=6 2024-09-14T10:59:53.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.080+0000 7f98eea13800 20 add_watcher() i=7 2024-09-14T10:59:53.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.080+0000 7f98eea13800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:53.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.082+0000 7f97a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.082+0000 7f98eea13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.082+0000 7f98eea13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.082+0000 7f98eea13800 5 note: GC not initialized 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f971b7fe640 20 reqs_thread_entry: start 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f98eea13800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f98eea13800 20 Filter name: none 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f97197fa640 20 reqs_thread_entry: start 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f98eea13800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T10:59:53.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.083+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 20 rados->read ofs=0 len=0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T10:59:53.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:59:53.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:59:53.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.084+0000 7f98eea13800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:59:53.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.085+0000 7f98eea13800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:59:53.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.085+0000 7f98eea13800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:59:53.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.085+0000 7f98eea13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T10:59:53.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.086+0000 7f97cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724545 cookie 93946880346688 notifier 4568 bl.length()=593 2024-09-14T10:59:53.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.086+0000 7f97cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:59:53.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.086+0000 7f97cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:59:53.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f98eea13800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:59:53.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f98eea13800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:59:53.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f98eea13800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T10:59:53.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f97cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724545 cookie 93946880339424 notifier 4568 bl.length()=186 2024-09-14T10:59:53.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f97cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:59:53.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.089+0000 7f97cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:59:53.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.092+0000 7f97a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:53.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.095+0000 7f98eea13800 20 remove_watcher() i=0 2024-09-14T10:59:53.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.095+0000 7f98eea13800 2 removed watcher, disabling cache 2024-09-14T10:59:53.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.096+0000 7f98eea13800 20 remove_watcher() i=1 2024-09-14T10:59:53.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.097+0000 7f98eea13800 20 remove_watcher() i=2 2024-09-14T10:59:53.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.099+0000 7f98eea13800 20 remove_watcher() i=3 2024-09-14T10:59:53.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.100+0000 7f98eea13800 20 remove_watcher() i=4 2024-09-14T10:59:53.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.101+0000 7f98eea13800 20 remove_watcher() i=5 2024-09-14T10:59:53.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.102+0000 7f98eea13800 20 remove_watcher() i=6 2024-09-14T10:59:53.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:53.103+0000 7f98eea13800 20 remove_watcher() i=7 2024-09-14T10:59:54.043 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T10:59:54.043 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:54.044 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:59:54.075 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:54.075 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:54.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.116+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 20 realm 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:54.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.118+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.119+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.119+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.119+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:54.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.119+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.120+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:54.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.120+0000 7fca26a14800 20 searching for the correct realm 2024-09-14T10:59:54.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.122+0000 7fca228cc640 0 -- 172.21.15.29:0/3180020356 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fca1c0b99b0 msgr2=0x7fca1c0b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:59:54.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.328+0000 7fca218ca640 0 -- 172.21.15.29:0/3180020356 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fca1c07b8a0 msgr2=0x7fca1c0d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:54.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:54.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.534+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 zone default found 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 4 Realm: () 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:54.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 zonegroup default 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.535+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 started sync module instance, tier type = 2024-09-14T10:59:54.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.536+0000 7fca26a14800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=0 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=1 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=2 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=3 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=4 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=5 2024-09-14T10:59:54.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.548+0000 7fca26a14800 20 add_watcher() i=6 2024-09-14T10:59:54.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.549+0000 7fca26a14800 20 add_watcher() i=7 2024-09-14T10:59:54.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.549+0000 7fca26a14800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:54.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.554+0000 7fc8d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:54.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.554+0000 7fca26a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:54.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.554+0000 7fca26a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:54.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.554+0000 7fca26a14800 5 note: GC not initialized 2024-09-14T10:59:54.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fc8537fe640 20 reqs_thread_entry: start 2024-09-14T10:59:54.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:54.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 20 Filter name: none 2024-09-14T10:59:54.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fc8517fa640 20 reqs_thread_entry: start 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.555+0000 7fca26a14800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:59:54.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.556+0000 7fca26a14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.557+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.557+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.558+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.558+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.559+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.559+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:54.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.560+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:54.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.560+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:54.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.561+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:54.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.562+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:54.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.562+0000 7fca26a14800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:54.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.575+0000 7fc8d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:54.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.577+0000 7fca26a14800 20 remove_watcher() i=0 2024-09-14T10:59:54.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.577+0000 7fca26a14800 2 removed watcher, disabling cache 2024-09-14T10:59:54.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.579+0000 7fca26a14800 20 remove_watcher() i=1 2024-09-14T10:59:54.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.580+0000 7fca26a14800 20 remove_watcher() i=2 2024-09-14T10:59:54.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.582+0000 7fca26a14800 20 remove_watcher() i=3 2024-09-14T10:59:54.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.583+0000 7fca26a14800 20 remove_watcher() i=4 2024-09-14T10:59:54.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.584+0000 7fca26a14800 20 remove_watcher() i=5 2024-09-14T10:59:54.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.585+0000 7fca26a14800 20 remove_watcher() i=6 2024-09-14T10:59:54.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.586+0000 7fca26a14800 20 remove_watcher() i=7 2024-09-14T10:59:54.597 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:59:54.627 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:54.627 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:54.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.668+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 realm 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:54.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.670+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.671+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:54.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.671+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.672+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:54.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.672+0000 7f2b2a52e800 20 searching for the correct realm 2024-09-14T10:59:54.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.674+0000 7f2b26ade640 0 -- 172.21.15.29:0/586667149 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55769cbe0240 msgr2=0x55769cbe2630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:54.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.677+0000 7f2b26ade640 0 -- 172.21.15.29:0/586667149 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f29f0084da0 msgr2=0x7f29f00871d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:54.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.683+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 zone default found 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 4 Realm: () 2024-09-14T10:59:54.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 zonegroup default 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.684+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.685+0000 7f2b2a52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.685+0000 7f2b2a52e800 20 started sync module instance, tier type = 2024-09-14T10:59:54.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.685+0000 7f2b2a52e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:54.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.696+0000 7f2b2a52e800 20 add_watcher() i=0 2024-09-14T10:59:54.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.696+0000 7f2b2a52e800 20 add_watcher() i=1 2024-09-14T10:59:54.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.696+0000 7f2b2a52e800 20 add_watcher() i=2 2024-09-14T10:59:54.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.696+0000 7f2b2a52e800 20 add_watcher() i=3 2024-09-14T10:59:54.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.696+0000 7f2b2a52e800 20 add_watcher() i=4 2024-09-14T10:59:54.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.697+0000 7f2b2a52e800 20 add_watcher() i=5 2024-09-14T10:59:54.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.697+0000 7f2b2a52e800 20 add_watcher() i=6 2024-09-14T10:59:54.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.697+0000 7f2b2a52e800 20 add_watcher() i=7 2024-09-14T10:59:54.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.697+0000 7f2b2a52e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:54.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.699+0000 7f29dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:54.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.699+0000 7f2b2a52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.699+0000 7f2b2a52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.699+0000 7f2b2a52e800 5 note: GC not initialized 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f29577fe640 20 reqs_thread_entry: start 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f2b2a52e800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f2b2a52e800 20 Filter name: none 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f29557fa640 20 reqs_thread_entry: start 2024-09-14T10:59:54.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.700+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:54.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:54.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.701+0000 7f2b2a52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:54.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.703+0000 7f29dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:54.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.705+0000 7f2b2a52e800 20 remove_watcher() i=0 2024-09-14T10:59:54.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.705+0000 7f2b2a52e800 2 removed watcher, disabling cache 2024-09-14T10:59:54.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.707+0000 7f2b2a52e800 20 remove_watcher() i=1 2024-09-14T10:59:54.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.708+0000 7f2b2a52e800 20 remove_watcher() i=2 2024-09-14T10:59:54.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.709+0000 7f2b2a52e800 20 remove_watcher() i=3 2024-09-14T10:59:54.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.710+0000 7f2b2a52e800 20 remove_watcher() i=4 2024-09-14T10:59:54.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.711+0000 7f2b2a52e800 20 remove_watcher() i=5 2024-09-14T10:59:54.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.712+0000 7f2b2a52e800 20 remove_watcher() i=6 2024-09-14T10:59:54.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.713+0000 7f2b2a52e800 20 remove_watcher() i=7 2024-09-14T10:59:54.722 INFO:tasks.workunit.client.0.smithi029.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 91, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T10:59:54.722 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T10:59:54.722 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:54.723 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:59:54.761 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:54.761 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:54.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.799+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 realm 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:54.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.801+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.802+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:54.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.802+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:54.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.803+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:54.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.803+0000 7f96ed325800 20 searching for the correct realm 2024-09-14T10:59:54.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:54.805+0000 7f96e97af640 0 -- 172.21.15.29:0/4103577910 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f96e0067c30 msgr2=0x7f96e00666a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:55.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.011+0000 7f96e87ad640 0 -- 172.21.15.29:0/4103577910 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f96e007d040 msgr2=0x7f96e0028730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:55.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.218+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:55.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:55.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 zone default found 2024-09-14T10:59:55.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 4 Realm: () 2024-09-14T10:59:55.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 zonegroup default 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.219+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.220+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.220+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.220+0000 7f96ed325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.220+0000 7f96ed325800 20 started sync module instance, tier type = 2024-09-14T10:59:55.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.220+0000 7f96ed325800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:55.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=0 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=1 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=2 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=3 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=4 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=5 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.230+0000 7f96ed325800 20 add_watcher() i=6 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.231+0000 7f96ed325800 20 add_watcher() i=7 2024-09-14T10:59:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.231+0000 7f96ed325800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:55.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.232+0000 7f959efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f96ed325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f96ed325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f96ed325800 5 note: GC not initialized 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f959dfe3640 20 reqs_thread_entry: start 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f96ed325800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.233+0000 7f96ed325800 20 Filter name: none 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f950f7fe640 20 reqs_thread_entry: start 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:59:55.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:55.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:59:55.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:59:55.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T10:59:55.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 20 rados->read ofs=0 len=0 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.234+0000 7f96ed325800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.235+0000 7f96ed325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T10:59:55.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.235+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.235+0000 7f96ed325800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.235+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.236+0000 7f96ed325800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.236+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.236+0000 7f96ed325800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T10:59:55.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.236+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.237+0000 7f96ed325800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.237+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.237+0000 7f96ed325800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.237+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.238+0000 7f96ed325800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T10:59:55.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.238+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:55.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.238+0000 7f96ed325800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T10:59:55.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.238+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:55.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.239+0000 7f96ed325800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T10:59:55.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.239+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:55.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.239+0000 7f96ed325800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T10:59:55.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.239+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:55.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.240+0000 7f96ed325800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T10:59:55.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.240+0000 7f96ed325800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:55.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.240+0000 7f96ed325800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T10:59:55.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.240+0000 7f96ed325800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:59:55.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.241+0000 7f959efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:55.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.244+0000 7f96ed325800 20 remove_watcher() i=0 2024-09-14T10:59:55.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.244+0000 7f96ed325800 2 removed watcher, disabling cache 2024-09-14T10:59:55.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.245+0000 7f96ed325800 20 remove_watcher() i=1 2024-09-14T10:59:55.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.246+0000 7f96ed325800 20 remove_watcher() i=2 2024-09-14T10:59:55.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.247+0000 7f96ed325800 20 remove_watcher() i=3 2024-09-14T10:59:55.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.248+0000 7f96ed325800 20 remove_watcher() i=4 2024-09-14T10:59:55.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.249+0000 7f96ed325800 20 remove_watcher() i=5 2024-09-14T10:59:55.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.250+0000 7f96ed325800 20 remove_watcher() i=6 2024-09-14T10:59:55.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:55.251+0000 7f96ed325800 20 remove_watcher() i=7 2024-09-14T10:59:55.262 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:59:55.676 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:59:57.192 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:59:57.194 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:59:57.228 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:57.228 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:57.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.273+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 realm 2024-09-14T10:59:57.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:57.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.275+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.276+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.276+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:57.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.276+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.277+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:57.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.277+0000 7f7a86146800 20 searching for the correct realm 2024-09-14T10:59:57.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.280+0000 7f7a84438640 0 -- 172.21.15.29:0/928159745 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f7a7c08b720 msgr2=0x7f7a7c070990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:57.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.487+0000 7f7a83436640 0 -- 172.21.15.29:0/928159745 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f7a7c0178b0 msgr2=0x7f7a7c077880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:59:57.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:57.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:57.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:57.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:57.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:57.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:57.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.694+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 zone default found 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 4 Realm: () 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 zonegroup default 2024-09-14T10:59:57.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.695+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.696+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.696+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.696+0000 7f7a86146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.696+0000 7f7a86146800 20 started sync module instance, tier type = 2024-09-14T10:59:57.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.696+0000 7f7a86146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=0 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=1 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=2 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=3 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=4 2024-09-14T10:59:57.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=5 2024-09-14T10:59:57.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.708+0000 7f7a86146800 20 add_watcher() i=6 2024-09-14T10:59:57.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.709+0000 7f7a86146800 20 add_watcher() i=7 2024-09-14T10:59:57.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.709+0000 7f7a86146800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:57.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.711+0000 7f7939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:57.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7a86146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:57.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7a86146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:57.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7a86146800 5 note: GC not initialized 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7938fe1640 20 reqs_thread_entry: start 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7a86146800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.712+0000 7f7a86146800 20 Filter name: none 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.713+0000 7f78b27fc640 20 reqs_thread_entry: start 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.713+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.713+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.713+0000 7f7a86146800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 INFO: main: starting shard=0 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 INFO: main: starting shard=1 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.714+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 INFO: main: starting shard=2 2024-09-14T10:59:57.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:57.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 INFO: main: starting shard=3 2024-09-14T10:59:57.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.715+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:57.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.716+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.716+0000 7f7a86146800 20 INFO: main: starting shard=4 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.716+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 INFO: main: starting shard=5 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 INFO: main: starting shard=6 2024-09-14T10:59:57.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.717+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:57.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 INFO: main: starting shard=7 2024-09-14T10:59:57.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 INFO: main: starting shard=8 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.718+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 INFO: main: starting shard=9 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 INFO: main: starting shard=10 2024-09-14T10:59:57.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.719+0000 7f7a86146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:57.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.720+0000 7f7a86146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:57.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.720+0000 7f7a86146800 20 INFO: main: done 2024-09-14T10:59:57.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.721+0000 7f7939fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:57.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.723+0000 7f7a86146800 20 remove_watcher() i=0 2024-09-14T10:59:57.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.723+0000 7f7a86146800 2 removed watcher, disabling cache 2024-09-14T10:59:57.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.724+0000 7f7a86146800 20 remove_watcher() i=1 2024-09-14T10:59:57.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.726+0000 7f7a86146800 20 remove_watcher() i=2 2024-09-14T10:59:57.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.727+0000 7f7a86146800 20 remove_watcher() i=3 2024-09-14T10:59:57.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.728+0000 7f7a86146800 20 remove_watcher() i=4 2024-09-14T10:59:57.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.729+0000 7f7a86146800 20 remove_watcher() i=5 2024-09-14T10:59:57.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.730+0000 7f7a86146800 20 remove_watcher() i=6 2024-09-14T10:59:57.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.732+0000 7f7a86146800 20 remove_watcher() i=7 2024-09-14T10:59:57.892 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:59:57.893 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:57.926 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:57.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.967+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 20 realm 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.969+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.970+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.970+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.970+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:57.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.971+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.971+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:57.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.971+0000 7f76ad498800 20 searching for the correct realm 2024-09-14T10:59:57.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.974+0000 7f76ab783640 0 -- 172.21.15.29:0/2222231709 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f76a4049060 msgr2=0x7f76a4076790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:57.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:57.978+0000 7f76aa781640 0 -- 172.21.15.29:0/2222231709 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f76a4083370 msgr2=0x7f76a406bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:58.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:58.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.185+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 zone default found 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 4 Realm: () 2024-09-14T10:59:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 zonegroup default 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.186+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 started sync module instance, tier type = 2024-09-14T10:59:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.187+0000 7f76ad498800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=0 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=1 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=2 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=3 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=4 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=5 2024-09-14T10:59:58.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.197+0000 7f76ad498800 20 add_watcher() i=6 2024-09-14T10:59:58.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.198+0000 7f76ad498800 20 add_watcher() i=7 2024-09-14T10:59:58.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.198+0000 7f76ad498800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:58.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.200+0000 7f75617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.200+0000 7f76ad498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.200+0000 7f76ad498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.200+0000 7f76ad498800 5 note: GC not initialized 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f74dbfff640 20 reqs_thread_entry: start 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f76ad498800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f76ad498800 20 Filter name: none 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f74d9ffb640 20 reqs_thread_entry: start 2024-09-14T10:59:58.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.201+0000 7f76ad498800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 INFO: main: starting shard=0 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:58.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 INFO: main: starting shard=1 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.202+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 INFO: main: starting shard=2 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 INFO: main: starting shard=3 2024-09-14T10:59:58.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.203+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 INFO: main: starting shard=4 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 INFO: main: starting shard=5 2024-09-14T10:59:58.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.204+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 INFO: main: starting shard=6 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 INFO: main: starting shard=7 2024-09-14T10:59:58.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.205+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 INFO: main: starting shard=8 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 INFO: main: starting shard=9 2024-09-14T10:59:58.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.206+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:58.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.207+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.207+0000 7f76ad498800 20 INFO: main: starting shard=10 2024-09-14T10:59:58.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.207+0000 7f76ad498800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:58.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.207+0000 7f76ad498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.207+0000 7f76ad498800 20 INFO: main: done 2024-09-14T10:59:58.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.208+0000 7f75617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.211+0000 7f76ad498800 20 remove_watcher() i=0 2024-09-14T10:59:58.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.211+0000 7f76ad498800 2 removed watcher, disabling cache 2024-09-14T10:59:58.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.212+0000 7f76ad498800 20 remove_watcher() i=1 2024-09-14T10:59:58.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.213+0000 7f76ad498800 20 remove_watcher() i=2 2024-09-14T10:59:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.214+0000 7f76ad498800 20 remove_watcher() i=3 2024-09-14T10:59:58.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.215+0000 7f76ad498800 20 remove_watcher() i=4 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.216+0000 7f76ad498800 20 remove_watcher() i=5 2024-09-14T10:59:58.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.217+0000 7f76ad498800 20 remove_watcher() i=6 2024-09-14T10:59:58.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.218+0000 7f76ad498800 20 remove_watcher() i=7 2024-09-14T10:59:58.344 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:59:58.345 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:59:58.376 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:58.377 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:58.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.418+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 realm 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.420+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.421+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:58.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.421+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.422+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:58.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.422+0000 7f39dbb40800 20 searching for the correct realm 2024-09-14T10:59:58.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.424+0000 7f39d80c1640 0 -- 172.21.15.29:0/2368553954 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f39d0043bf0 msgr2=0x7f39d0022410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:58.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.629+0000 7f39cf0bf640 0 -- 172.21.15.29:0/2368553954 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f39d0052900 msgr2=0x7f39d003a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.835+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 zone default found 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 4 Realm: () 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 zonegroup default 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.836+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.837+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.837+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.837+0000 7f39dbb40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:58.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.837+0000 7f39dbb40800 20 started sync module instance, tier type = 2024-09-14T10:59:58.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.837+0000 7f39dbb40800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:58.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=0 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=1 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=2 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=3 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=4 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=5 2024-09-14T10:59:58.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=6 2024-09-14T10:59:58.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 20 add_watcher() i=7 2024-09-14T10:59:58.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.848+0000 7f39dbb40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:58.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.850+0000 7f388dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 5 note: GC not initialized 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f388cfe1640 20 reqs_thread_entry: start 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 20 Filter name: none 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f38067fc640 20 reqs_thread_entry: start 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.851+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 rados->read ofs=0 len=0 2024-09-14T10:59:58.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:58.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 INFO: main: starting shard=0 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.852+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 INFO: main: starting shard=1 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 INFO: main: starting shard=2 2024-09-14T10:59:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.853+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.854+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.854+0000 7f39dbb40800 20 INFO: main: starting shard=3 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.854+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 INFO: main: starting shard=4 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 INFO: main: starting shard=5 2024-09-14T10:59:58.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.855+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:58.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 INFO: main: starting shard=6 2024-09-14T10:59:58.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:58.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 INFO: main: starting shard=7 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.856+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 INFO: main: starting shard=8 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 INFO: main: starting shard=9 2024-09-14T10:59:58.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.857+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.858+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.858+0000 7f39dbb40800 20 INFO: main: starting shard=10 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.858+0000 7f39dbb40800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.858+0000 7f39dbb40800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.858+0000 7f39dbb40800 20 INFO: main: done 2024-09-14T10:59:58.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.859+0000 7f388dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:58.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.862+0000 7f39dbb40800 20 remove_watcher() i=0 2024-09-14T10:59:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.862+0000 7f39dbb40800 2 removed watcher, disabling cache 2024-09-14T10:59:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.863+0000 7f39dbb40800 20 remove_watcher() i=1 2024-09-14T10:59:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.864+0000 7f39dbb40800 20 remove_watcher() i=2 2024-09-14T10:59:58.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.865+0000 7f39dbb40800 20 remove_watcher() i=3 2024-09-14T10:59:58.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.866+0000 7f39dbb40800 20 remove_watcher() i=4 2024-09-14T10:59:58.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.867+0000 7f39dbb40800 20 remove_watcher() i=5 2024-09-14T10:59:58.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.868+0000 7f39dbb40800 20 remove_watcher() i=6 2024-09-14T10:59:58.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:58.869+0000 7f39dbb40800 20 remove_watcher() i=7 2024-09-14T10:59:58.994 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:59:58.995 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:59:59.028 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:59:59.029 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:59:59.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.070+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 realm 2024-09-14T10:59:59.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:59:59.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.072+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.073+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:59.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.073+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.074+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:59:59.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.074+0000 7efcf0d24800 20 searching for the correct realm 2024-09-14T10:59:59.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.076+0000 7efced103640 0 -- 172.21.15.29:0/2233871087 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55db30d6d9c0 msgr2=0x55db30d6fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:59.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.079+0000 7efced103640 0 -- 172.21.15.29:0/2233871087 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7efbb8084da0 msgr2=0x7efbb80871d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:59:59.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T10:59:59.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:59:59.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.084+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:59:59.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 zone default found 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 4 Realm: () 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 zonegroup default 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.085+0000 7efcf0d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:59:59.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.086+0000 7efcf0d24800 20 started sync module instance, tier type = 2024-09-14T10:59:59.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.086+0000 7efcf0d24800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T10:59:59.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=0 2024-09-14T10:59:59.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=1 2024-09-14T10:59:59.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=2 2024-09-14T10:59:59.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=3 2024-09-14T10:59:59.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=4 2024-09-14T10:59:59.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=5 2024-09-14T10:59:59.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.096+0000 7efcf0d24800 20 add_watcher() i=6 2024-09-14T10:59:59.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.097+0000 7efcf0d24800 20 add_watcher() i=7 2024-09-14T10:59:59.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.097+0000 7efcf0d24800 2 all 8 watchers are set, enabling cache 2024-09-14T10:59:59.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.099+0000 7efba2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.099+0000 7efcf0d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.099+0000 7efcf0d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.099+0000 7efcf0d24800 5 note: GC not initialized 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efba1fe3640 20 reqs_thread_entry: start 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efcf0d24800 20 init_complete bucket index max shards: 11 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efcf0d24800 20 Filter name: none 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efb137fe640 20 reqs_thread_entry: start 2024-09-14T10:59:59.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:59:59.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.100+0000 7efcf0d24800 20 rados->read ofs=0 len=0 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 INFO: main: starting shard=0 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 INFO: main: starting shard=1 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.101+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 INFO: main: starting shard=2 2024-09-14T10:59:59.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T10:59:59.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 INFO: main: starting shard=3 2024-09-14T10:59:59.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.102+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 INFO: main: starting shard=4 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 INFO: main: starting shard=5 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.103+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 INFO: main: starting shard=6 2024-09-14T10:59:59.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T10:59:59.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 INFO: main: starting shard=7 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.104+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: starting shard=8 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: starting shard=9 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 INFO: main: starting shard=10 2024-09-14T10:59:59.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.105+0000 7efcf0d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T10:59:59.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.106+0000 7efcf0d24800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:59:59.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.106+0000 7efcf0d24800 20 INFO: main: done 2024-09-14T10:59:59.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.107+0000 7efba2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:59:59.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.109+0000 7efcf0d24800 20 remove_watcher() i=0 2024-09-14T10:59:59.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.109+0000 7efcf0d24800 2 removed watcher, disabling cache 2024-09-14T10:59:59.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.111+0000 7efcf0d24800 20 remove_watcher() i=1 2024-09-14T10:59:59.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.112+0000 7efcf0d24800 20 remove_watcher() i=2 2024-09-14T10:59:59.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.114+0000 7efcf0d24800 20 remove_watcher() i=3 2024-09-14T10:59:59.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.115+0000 7efcf0d24800 20 remove_watcher() i=4 2024-09-14T10:59:59.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.116+0000 7efcf0d24800 20 remove_watcher() i=5 2024-09-14T10:59:59.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.117+0000 7efcf0d24800 20 remove_watcher() i=6 2024-09-14T10:59:59.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T10:59:59.118+0000 7efcf0d24800 20 remove_watcher() i=7 2024-09-14T10:59:59.153 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:59:59.562 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:59:59.979 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T10:59:59.980 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T10:59:59.981 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:00:00.015 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:00.015 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:00.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.058+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.059+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.059+0000 7f0dee71f800 20 realm 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.059+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.060+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.060+0000 7f0dee71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.060+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.060+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.060+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.061+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.061+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.061+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.061+0000 7f0dee71f800 20 searching for the correct realm 2024-09-14T11:00:00.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.063+0000 7f0deaca3640 0 -- 172.21.15.29:0/3886473197 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0de401d060 msgr2=0x7f0de4069c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:00.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.269+0000 7f0de9ca1640 0 -- 172.21.15.29:0/3886473197 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0de40763c0 msgr2=0x7f0de405f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:00.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:00.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.477+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 zone default found 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 4 Realm: () 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:00.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 zonegroup default 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.478+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.479+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.479+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.479+0000 7f0dee71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.479+0000 7f0dee71f800 20 started sync module instance, tier type = 2024-09-14T11:00:00.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.479+0000 7f0dee71f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:00.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=0 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=1 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=2 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=3 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=4 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=5 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.492+0000 7f0dee71f800 20 add_watcher() i=6 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.493+0000 7f0dee71f800 20 add_watcher() i=7 2024-09-14T11:00:00.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.493+0000 7f0dee71f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:00.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:00.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0dee71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:00.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0dee71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:00.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0dee71f800 5 note: GC not initialized 2024-09-14T11:00:00.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0c9bfff640 20 reqs_thread_entry: start 2024-09-14T11:00:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.495+0000 7f0dee71f800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 20 Filter name: none 2024-09-14T11:00:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0c99ffb640 20 reqs_thread_entry: start 2024-09-14T11:00:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.496+0000 7f0dee71f800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.497+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.498+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:00.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.499+0000 7f0dee71f800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:00:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.499+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.499+0000 7f0dee71f800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:00:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.499+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.500+0000 7f0dee71f800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:00:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.500+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.500+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.501+0000 7f0dee71f800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:00:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.501+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.502+0000 7f0dee71f800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:00:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.502+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.502+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.503+0000 7f0dee71f800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:00:00.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.503+0000 7f0dee71f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:00.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.504+0000 7f0dee71f800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:00:00.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.504+0000 7f0dee71f800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:00:00.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.504+0000 7f0dee71f800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:00:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.504+0000 7f0dee71f800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:00:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.504+0000 7f0dee71f800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:00:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.505+0000 7f0ca17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.507+0000 7f0dee71f800 20 remove_watcher() i=0 2024-09-14T11:00:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.507+0000 7f0dee71f800 2 removed watcher, disabling cache 2024-09-14T11:00:00.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.509+0000 7f0dee71f800 20 remove_watcher() i=1 2024-09-14T11:00:00.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.510+0000 7f0dee71f800 20 remove_watcher() i=2 2024-09-14T11:00:00.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.511+0000 7f0dee71f800 20 remove_watcher() i=3 2024-09-14T11:00:00.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.512+0000 7f0dee71f800 20 remove_watcher() i=4 2024-09-14T11:00:00.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.513+0000 7f0dee71f800 20 remove_watcher() i=5 2024-09-14T11:00:00.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.515+0000 7f0dee71f800 20 remove_watcher() i=6 2024-09-14T11:00:00.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.516+0000 7f0dee71f800 20 remove_watcher() i=7 2024-09-14T11:00:00.525 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: unlinked entries are not listable 2024-09-14T11:00:00.525 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:00.649 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:00:00.649 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:00.781 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:00:00.782 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:00.782 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:00:00.818 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:00.818 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.860+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 20 realm 2024-09-14T11:00:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.861+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.862+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.862+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.862+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:00.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.862+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:00.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.863+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:00.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.863+0000 7f3cd9c0e800 20 searching for the correct realm 2024-09-14T11:00:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:00.865+0000 7f3cd5b6c640 0 -- 172.21.15.29:0/1284673429 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f3cd00a7c20 msgr2=0x7f3cd00803c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:01.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.071+0000 7f3cd4b6a640 0 -- 172.21.15.29:0/1284673429 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f3cd0074be0 msgr2=0x7f3cd0072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.277+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.278+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.278+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.278+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:01.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.278+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 zone default found 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 4 Realm: () 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 zonegroup default 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.279+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.280+0000 7f3cd9c0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.280+0000 7f3cd9c0e800 20 started sync module instance, tier type = 2024-09-14T11:00:01.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.280+0000 7f3cd9c0e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:01.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=0 2024-09-14T11:00:01.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=1 2024-09-14T11:00:01.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=2 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=3 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=4 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.290+0000 7f3cd9c0e800 20 add_watcher() i=5 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.291+0000 7f3cd9c0e800 20 add_watcher() i=6 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.292+0000 7f3cd9c0e800 20 add_watcher() i=7 2024-09-14T11:00:01.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.292+0000 7f3cd9c0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:01.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.293+0000 7f3b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:01.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:01.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:01.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 5 note: GC not initialized 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3b8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 20 Filter name: none 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3afbfff640 20 reqs_thread_entry: start 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.294+0000 7f3cd9c0e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:01.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:01.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:01.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:01.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.295+0000 7f3cd9c0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.296+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.296+0000 7f3cd9c0e800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.296+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.297+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:00:01.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.298+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.299+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:01.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.299+0000 7f3cd9c0e800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:00:01.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.299+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:01.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.300+0000 7f3cd9c0e800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:00:01.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.300+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.300+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:01.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.301+0000 7f3cd9c0e800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:00:01.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.301+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.302+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.302+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9b1380 obj=check-bucket:e state=0x5567ccc814c8 s->prefetch_data=0 2024-09-14T11:00:01.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.302+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.303+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9d9a00 obj=check-bucket:d state=0x5567ccc7e3f8 s->prefetch_data=0 2024-09-14T11:00:01.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.303+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.303+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7f150 obj=check-bucket:c state=0x5567ccc7af78 s->prefetch_data=0 2024-09-14T11:00:01.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.303+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.303+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7b9e0 obj=check-bucket:f state=0x5567ccd1b9f8 s->prefetch_data=0 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to 4j8moyx5qm4zq4namq9vaje4a400njkv 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state_impl: setting s->olh_tag to lohe1jfv0itre9mpf6oa1bjj5ohmfkqx 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lohe1jfv0itre9mpf6oa1bjj5ohmfkqx 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to kfzwsyu4efitfab2vnund5ucj99ypyh1 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state_impl: setting s->olh_tag to f7n4m4p17t7blm45fc0daicssvr3xfc0 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=f7n4m4p17t7blm45fc0daicssvr3xfc0 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to g70n8qm0i0pppxpfw4ze4j4o87j1a623 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state_impl: setting s->olh_tag to l2cclp5r9u1nxof1fx0zy01kkw0i791b 2024-09-14T11:00:01.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l2cclp5r9u1nxof1fx0zy01kkw0i791b 2024-09-14T11:00:01.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to cfrbqcwlnizovkdbf31lopnlmlku82g5 2024-09-14T11:00:01.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 get_obj_state_impl: setting s->olh_tag to v0bctgpngdm3dlyimi1da70l3a7upvgx 2024-09-14T11:00:01.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.304+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v0bctgpngdm3dlyimi1da70l3a7upvgx 2024-09-14T11:00:01.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.306+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.308+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.309+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.309+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.309+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.310+0000 7f3cd9c0e800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:00:01.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.310+0000 7f3cd9c0e800 20 olh_log_entry: epoch=2 op=3 key=e[cQY7FmB3T2Cmgte8jFtDNFiWdOuBBFW] 2024-09-14T11:00:01.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.310+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9b1380 obj=check-bucket:_:cQY7FmB3T2Cmgte8jFtDNFiWdOuBBFW_e state=0x5567ccd36c98 s->prefetch_data=0 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 10 manifest: total_size = 11 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.5408790477759812710 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9b1380 obj=check-bucket:_:cQY7FmB3T2Cmgte8jFtDNFiWdOuBBFW_e state=0x5567ccd36c98 s->prefetch_data=0 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 prepare_atomic_modification: state is not atomic. state=0x5567ccd36c98 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 olh_log_entry: epoch=3 op=3 key=c[DVBYmWBJWKKuyPJmxzO0RuJlexjDrQC] 2024-09-14T11:00:01.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7f150 obj=check-bucket:_:DVBYmWBJWKKuyPJmxzO0RuJlexjDrQC_c state=0x5567ccd3f798 s->prefetch_data=0 2024-09-14T11:00:01.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 10 manifest: total_size = 11 2024-09-14T11:00:01.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.12814554380891829855 2024-09-14T11:00:01.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7f150 obj=check-bucket:_:DVBYmWBJWKKuyPJmxzO0RuJlexjDrQC_c state=0x5567ccd3f798 s->prefetch_data=0 2024-09-14T11:00:01.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 prepare_atomic_modification: state is not atomic. state=0x5567ccd3f798 2024-09-14T11:00:01.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.311+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.314+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 olh_log_entry: epoch=3 op=3 key=d[DqIj2q4lOLcwHUlQm4KH2CnLPXlWcdB] 2024-09-14T11:00:01.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9d9a00 obj=check-bucket:_:DqIj2q4lOLcwHUlQm4KH2CnLPXlWcdB_d state=0x5567ccd41cb8 s->prefetch_data=0 2024-09-14T11:00:01.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:01.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:00:01.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:01.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:DVBYmWBJWKKuyPJmxzO0RuJlexjDrQC_.iaiEYLA6nZfEZoSLcLAP0uG_cSW_hRv_0 2024-09-14T11:00:01.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 10 manifest: total_size = 22 2024-09-14T11:00:01.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.13304652027266970266 2024-09-14T11:00:01.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9d9a00 obj=check-bucket:_:DqIj2q4lOLcwHUlQm4KH2CnLPXlWcdB_d state=0x5567ccd41cb8 s->prefetch_data=0 2024-09-14T11:00:01.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 prepare_atomic_modification: state is not atomic. state=0x5567ccd41cb8 2024-09-14T11:00:01.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.315+0000 7f3cd9c0e800 20 olh_log_entry: epoch=2 op=3 key=f[ZMmL3pxVITvBowabb0Zq6bYbYTYte6H] 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7b9e0 obj=check-bucket:_:ZMmL3pxVITvBowabb0Zq6bYbYTYte6H_f state=0x5567ccd52508 s->prefetch_data=0 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 10 manifest: total_size = 12 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.6262182193141530051 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7b9e0 obj=check-bucket:_:ZMmL3pxVITvBowabb0Zq6bYbYTYte6H_f state=0x5567ccd52508 s->prefetch_data=0 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 20 prepare_atomic_modification: state is not atomic. state=0x5567ccd52508 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.316+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.317+0000 7f3bb8ff9640 20 handle_completion(): completion ok for obj=c[DVBYmWBJWKKuyPJmxzO0RuJlexjDrQC] 2024-09-14T11:00:01.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.317+0000 7f3cd9c0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:01.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.318+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:01.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.318+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T11:00:01.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.318+0000 7f3cd9c0e800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:01.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.318+0000 7f3cd9c0e800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:cQY7FmB3T2Cmgte8jFtDNFiWdOuBBFW_.70T-7JGSmYGN_w0L1r8ihuuVheSDBlE_0 2024-09-14T11:00:01.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.321+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:01.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.321+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:00:01.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.321+0000 7f3cd9c0e800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:01.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.321+0000 7f3cd9c0e800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:DqIj2q4lOLcwHUlQm4KH2CnLPXlWcdB_.fg2gVLLxxv6DPZCFV0FEj2LXWoOP_CD_0 2024-09-14T11:00:01.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.321+0000 7f3bb8ff9640 20 handle_completion(): completion ok for obj=e[cQY7FmB3T2Cmgte8jFtDNFiWdOuBBFW] 2024-09-14T11:00:01.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.323+0000 7f3cd9c0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:01.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.323+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.323+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.325+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:01.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.325+0000 7f3cd9c0e800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:00:01.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:01.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3cd9c0e800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3cd9c0e800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3cd9c0e800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:ZMmL3pxVITvBowabb0Zq6bYbYTYte6H_.IzO74hfZ7qthfMMQOElFAzachKvO1tm_0 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3ba7fff640 20 handle_completion(): completion ok for obj=d[DqIj2q4lOLcwHUlQm4KH2CnLPXlWcdB] 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.326+0000 7f3cd9c0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.327+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567cc9b1380 obj=check-bucket:e state=0x5567ccc814c8 s->prefetch_data=0 2024-09-14T11:00:01.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.327+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lohe1jfv0itre9mpf6oa1bjj5ohmfkqx 2024-09-14T11:00:01.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.328+0000 7f3cd9c0e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:01.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.329+0000 7f3bb8ff9640 20 handle_completion(): completion ok for obj=f[ZMmL3pxVITvBowabb0Zq6bYbYTYte6H] 2024-09-14T11:00:01.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.330+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.330+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.331+0000 7f3cd9c0e800 20 get_obj_state: octx=0x5567ccc7b9e0 obj=check-bucket:f state=0x5567ccd1b9f8 s->prefetch_data=0 2024-09-14T11:00:01.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.331+0000 7f3cd9c0e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=v0bctgpngdm3dlyimi1da70l3a7upvgx 2024-09-14T11:00:01.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.332+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:01.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.332+0000 7f3cd9c0e800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:00:01.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.332+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.334+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:01.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.334+0000 7f3cd9c0e800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:00:01.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.336+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.338+0000 7f3cd9c0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:01.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.338+0000 7f3cd9c0e800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:00:01.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.338+0000 7f3cd9c0e800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:00:01.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.339+0000 7f3b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:01.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.341+0000 7f3cd9c0e800 20 remove_watcher() i=0 2024-09-14T11:00:01.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.341+0000 7f3cd9c0e800 2 removed watcher, disabling cache 2024-09-14T11:00:01.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.342+0000 7f3cd9c0e800 20 remove_watcher() i=1 2024-09-14T11:00:01.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.344+0000 7f3cd9c0e800 20 remove_watcher() i=2 2024-09-14T11:00:01.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.345+0000 7f3cd9c0e800 20 remove_watcher() i=3 2024-09-14T11:00:01.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.346+0000 7f3cd9c0e800 20 remove_watcher() i=4 2024-09-14T11:00:01.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.347+0000 7f3cd9c0e800 20 remove_watcher() i=5 2024-09-14T11:00:01.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.348+0000 7f3cd9c0e800 20 remove_watcher() i=6 2024-09-14T11:00:01.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.349+0000 7f3cd9c0e800 20 remove_watcher() i=7 2024-09-14T11:00:01.445 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:00:01.445 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:01.618 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:00:01.618 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:01.620 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:00:01.653 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:01.653 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:01.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.695+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.696+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.696+0000 7f899153c800 20 realm 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.696+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.697+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.697+0000 7f899153c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.697+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.697+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.697+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.698+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:01.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.698+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:01.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.698+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:01.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.698+0000 7f899153c800 20 searching for the correct realm 2024-09-14T11:00:01.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.700+0000 7f898da82640 0 -- 172.21.15.29:0/1625916008 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f898808ab60 msgr2=0x7f8988084480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:01.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:01.906+0000 7f898ca80640 0 -- 172.21.15.29:0/1625916008 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f8988082940 msgr2=0x7f8988060430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:02.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:02.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:02.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.114+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 zone default found 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 4 Realm: () 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:02.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 zonegroup default 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.115+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.116+0000 7f899153c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.116+0000 7f899153c800 20 started sync module instance, tier type = 2024-09-14T11:00:02.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.116+0000 7f899153c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:02.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=0 2024-09-14T11:00:02.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=1 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=2 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=3 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=4 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=5 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.127+0000 7f899153c800 20 add_watcher() i=6 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.128+0000 7f899153c800 20 add_watcher() i=7 2024-09-14T11:00:02.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.128+0000 7f899153c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:02.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.129+0000 7f8843fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f899153c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f899153c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f899153c800 5 note: GC not initialized 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f8842fe5640 20 reqs_thread_entry: start 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f899153c800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:02.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f899153c800 20 Filter name: none 2024-09-14T11:00:02.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.130+0000 7f8840fe1640 20 reqs_thread_entry: start 2024-09-14T11:00:02.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:02.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.131+0000 7f899153c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.132+0000 7f899153c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.132+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:02.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.132+0000 7f899153c800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.132+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:00:02.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.133+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:02.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.134+0000 7f899153c800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:00:02.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.134+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:02.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.134+0000 7f899153c800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:00:02.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.134+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:02.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.135+0000 7f899153c800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:00:02.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.135+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:02.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.135+0000 7f899153c800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:00:02.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.135+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.136+0000 7f899153c800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.136+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.136+0000 7f899153c800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.136+0000 7f899153c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.137+0000 7f899153c800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:00:02.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.137+0000 7f899153c800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:00:02.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.138+0000 7f8843fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:02.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.140+0000 7f899153c800 20 remove_watcher() i=0 2024-09-14T11:00:02.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.140+0000 7f899153c800 2 removed watcher, disabling cache 2024-09-14T11:00:02.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.141+0000 7f899153c800 20 remove_watcher() i=1 2024-09-14T11:00:02.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.143+0000 7f899153c800 20 remove_watcher() i=2 2024-09-14T11:00:02.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.144+0000 7f899153c800 20 remove_watcher() i=3 2024-09-14T11:00:02.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.145+0000 7f899153c800 20 remove_watcher() i=4 2024-09-14T11:00:02.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.146+0000 7f899153c800 20 remove_watcher() i=5 2024-09-14T11:00:02.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.147+0000 7f899153c800 20 remove_watcher() i=6 2024-09-14T11:00:02.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.148+0000 7f899153c800 20 remove_watcher() i=7 2024-09-14T11:00:02.360 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:00:02.393 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:02.393 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:02.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.435+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 realm 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.437+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.438+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:02.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.438+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.439+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:02.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.439+0000 7fca9350c800 20 searching for the correct realm 2024-09-14T11:00:02.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.441+0000 7fca917f7640 0 -- 172.21.15.29:0/213854801 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fca880273e0 msgr2=0x7fca88027840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:02.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.647+0000 7fca907f5640 0 -- 172.21.15.29:0/213854801 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fca880493c0 msgr2=0x7fca88049840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.854+0000 7fca9350c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.855+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.855+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.855+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.855+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.855+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 zone default found 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 4 Realm: () 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 zonegroup default 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.856+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.857+0000 7fca9350c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.857+0000 7fca9350c800 20 started sync module instance, tier type = 2024-09-14T11:00:02.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.857+0000 7fca9350c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=0 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=1 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=2 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=3 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=4 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=5 2024-09-14T11:00:02.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.869+0000 7fca9350c800 20 add_watcher() i=6 2024-09-14T11:00:02.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.870+0000 7fca9350c800 20 add_watcher() i=7 2024-09-14T11:00:02.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.870+0000 7fca9350c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:02.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.872+0000 7fc946fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:02.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.872+0000 7fca9350c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:02.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.872+0000 7fca9350c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.872+0000 7fca9350c800 5 note: GC not initialized 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.872+0000 7fc945fe3640 20 reqs_thread_entry: start 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fca9350c800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fca9350c800 20 Filter name: none 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fc8b77fe640 20 reqs_thread_entry: start 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.873+0000 7fca9350c800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 INFO: main: starting shard=0 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:02.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 INFO: main: starting shard=1 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.874+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.875+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.875+0000 7fca9350c800 20 INFO: main: starting shard=2 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.875+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.875+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 INFO: main: starting shard=3 2024-09-14T11:00:02.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 INFO: main: starting shard=4 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 INFO: main: starting shard=5 2024-09-14T11:00:02.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.876+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.877+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.877+0000 7fca9350c800 20 INFO: main: starting shard=6 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.877+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 INFO: main: starting shard=7 2024-09-14T11:00:02.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:02.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 INFO: main: starting shard=8 2024-09-14T11:00:02.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.878+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:02.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:00:02.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 INFO: main: starting shard=9 2024-09-14T11:00:02.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:02.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 INFO: main: starting shard=10 2024-09-14T11:00:02.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.879+0000 7fca9350c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:02.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.880+0000 7fca9350c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:02.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.880+0000 7fca9350c800 20 INFO: main: done 2024-09-14T11:00:02.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.881+0000 7fc946fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:02.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.884+0000 7fca9350c800 20 remove_watcher() i=0 2024-09-14T11:00:02.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.884+0000 7fca9350c800 2 removed watcher, disabling cache 2024-09-14T11:00:02.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.885+0000 7fca9350c800 20 remove_watcher() i=1 2024-09-14T11:00:02.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.887+0000 7fca9350c800 20 remove_watcher() i=2 2024-09-14T11:00:02.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.888+0000 7fca9350c800 20 remove_watcher() i=3 2024-09-14T11:00:02.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.889+0000 7fca9350c800 20 remove_watcher() i=4 2024-09-14T11:00:02.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.890+0000 7fca9350c800 20 remove_watcher() i=5 2024-09-14T11:00:02.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.891+0000 7fca9350c800 20 remove_watcher() i=6 2024-09-14T11:00:02.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.892+0000 7fca9350c800 20 remove_watcher() i=7 2024-09-14T11:00:02.904 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:00:02.938 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:02.938 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:02.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.979+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 20 realm 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:02.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.981+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.982+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:02.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.982+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.982+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:02.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.982+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:02.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.983+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:02.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.983+0000 7f25cdf36800 20 searching for the correct realm 2024-09-14T11:00:02.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.985+0000 7f25ca4b8640 0 -- 172.21.15.29:0/3980661733 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f25c4061040 msgr2=0x7f25c40ba960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:02.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:02.990+0000 7f25c94b6640 0 -- 172.21.15.29:0/3980661733 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f25c407f730 msgr2=0x7f25c40b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:03.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:03.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.197+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 zone default found 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 4 Realm: () 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 zonegroup default 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.198+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 started sync module instance, tier type = 2024-09-14T11:00:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.199+0000 7f25cdf36800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:03.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=0 2024-09-14T11:00:03.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=1 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=2 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=3 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=4 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=5 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.213+0000 7f25cdf36800 20 add_watcher() i=6 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.214+0000 7f25cdf36800 20 add_watcher() i=7 2024-09-14T11:00:03.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.214+0000 7f25cdf36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:03.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.215+0000 7f246b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 5 note: GC not initialized 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f246a7fc640 20 reqs_thread_entry: start 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 20 Filter name: none 2024-09-14T11:00:03.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f23ebfff640 20 reqs_thread_entry: start 2024-09-14T11:00:03.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.216+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:03.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 INFO: main: starting shard=0 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.217+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 INFO: main: starting shard=1 2024-09-14T11:00:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 INFO: main: starting shard=2 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.218+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 INFO: main: starting shard=3 2024-09-14T11:00:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:03.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 INFO: main: starting shard=4 2024-09-14T11:00:03.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.219+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:03.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 INFO: main: starting shard=5 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 INFO: main: starting shard=6 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.220+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 INFO: main: starting shard=7 2024-09-14T11:00:03.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 INFO: main: starting shard=8 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.221+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 INFO: main: starting shard=9 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 INFO: main: starting shard=10 2024-09-14T11:00:03.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.222+0000 7f25cdf36800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:03.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.223+0000 7f25cdf36800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:03.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.223+0000 7f25cdf36800 20 INFO: main: done 2024-09-14T11:00:03.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.224+0000 7f246b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:03.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.226+0000 7f25cdf36800 20 remove_watcher() i=0 2024-09-14T11:00:03.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.226+0000 7f25cdf36800 2 removed watcher, disabling cache 2024-09-14T11:00:03.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.227+0000 7f25cdf36800 20 remove_watcher() i=1 2024-09-14T11:00:03.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.229+0000 7f25cdf36800 20 remove_watcher() i=2 2024-09-14T11:00:03.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.230+0000 7f25cdf36800 20 remove_watcher() i=3 2024-09-14T11:00:03.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.231+0000 7f25cdf36800 20 remove_watcher() i=4 2024-09-14T11:00:03.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.232+0000 7f25cdf36800 20 remove_watcher() i=5 2024-09-14T11:00:03.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.233+0000 7f25cdf36800 20 remove_watcher() i=6 2024-09-14T11:00:03.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.234+0000 7f25cdf36800 20 remove_watcher() i=7 2024-09-14T11:00:03.244 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:00:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:00:03.277 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:03.277 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:03.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.318+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 realm 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.321+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.322+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.322+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.322+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.322+0000 7f525e946800 20 searching for the correct realm 2024-09-14T11:00:03.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.524+0000 7f525c437640 0 -- 172.21.15.29:0/68757732 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55a466b4ccf0 msgr2=0x55a466b4f1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:03.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:03.930+0000 7f525c437640 0 -- 172.21.15.29:0/68757732 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f5254078070 msgr2=0x7f52540a2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.142+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 zone default found 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 4 Realm: () 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 zonegroup default 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.143+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.144+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.144+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.144+0000 7f525e946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.144+0000 7f525e946800 20 started sync module instance, tier type = 2024-09-14T11:00:04.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.144+0000 7f525e946800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:04.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=0 2024-09-14T11:00:04.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=1 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=2 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=3 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=4 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=5 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.158+0000 7f525e946800 20 add_watcher() i=6 2024-09-14T11:00:04.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.159+0000 7f525e946800 20 add_watcher() i=7 2024-09-14T11:00:04.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.159+0000 7f525e946800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:04.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.161+0000 7f510dffb640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.161+0000 7f525e946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.161+0000 7f525e946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.161+0000 7f525e946800 5 note: GC not initialized 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f510cff9640 20 reqs_thread_entry: start 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f525e946800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f525e946800 20 Filter name: none 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f50867fc640 20 reqs_thread_entry: start 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f525e946800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:04.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.162+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:04.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:04.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.163+0000 7f525e946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:04.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.164+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:04.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.164+0000 7f525e946800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:00:04.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.164+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:04.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.165+0000 7f525e946800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:00:04.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.165+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:04.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.165+0000 7f525e946800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:00:04.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.165+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:04.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.166+0000 7f525e946800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:00:04.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.166+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:04.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.166+0000 7f525e946800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:00:04.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.166+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:04.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.167+0000 7f525e946800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:00:04.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.167+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:04.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.168+0000 7f525e946800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:00:04.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.168+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:04.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.168+0000 7f525e946800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:00:04.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.168+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:04.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.169+0000 7f525e946800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:00:04.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.169+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:04.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.169+0000 7f525e946800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:00:04.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.169+0000 7f525e946800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:04.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.170+0000 7f525e946800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:00:04.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.170+0000 7f525e946800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:00:04.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.171+0000 7f510dffb640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:04.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.173+0000 7f525e946800 20 remove_watcher() i=0 2024-09-14T11:00:04.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.173+0000 7f525e946800 2 removed watcher, disabling cache 2024-09-14T11:00:04.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.174+0000 7f525e946800 20 remove_watcher() i=1 2024-09-14T11:00:04.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.176+0000 7f525e946800 20 remove_watcher() i=2 2024-09-14T11:00:04.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.177+0000 7f525e946800 20 remove_watcher() i=3 2024-09-14T11:00:04.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.178+0000 7f525e946800 20 remove_watcher() i=4 2024-09-14T11:00:04.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.179+0000 7f525e946800 20 remove_watcher() i=5 2024-09-14T11:00:04.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.181+0000 7f525e946800 20 remove_watcher() i=6 2024-09-14T11:00:04.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.182+0000 7f525e946800 20 remove_watcher() i=7 2024-09-14T11:00:04.193 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:00:04.193 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:04.197 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:00:04.230 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:04.230 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:04.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.275+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 20 realm 2024-09-14T11:00:04.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.277+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.278+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.278+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.278+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:04.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.278+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.279+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:04.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.279+0000 7fedd8d2a800 20 searching for the correct realm 2024-09-14T11:00:04.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.280+0000 7fedd4ada640 0 -- 172.21.15.29:0/3477055183 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55ca300825f0 msgr2=0x55ca30084ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:04.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.485+0000 7fedd4ada640 0 -- 172.21.15.29:0/3477055183 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7fedcc05f040 msgr2=0x7fedcc05f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.694+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 zone default found 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 4 Realm: () 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 zonegroup default 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.695+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.696+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.696+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.696+0000 7fedd8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.696+0000 7fedd8d2a800 20 started sync module instance, tier type = 2024-09-14T11:00:04.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.696+0000 7fedd8d2a800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.708+0000 7fedd8d2a800 20 add_watcher() i=0 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=1 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=2 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=3 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=4 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=5 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.709+0000 7fedd8d2a800 20 add_watcher() i=6 2024-09-14T11:00:04.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.710+0000 7fedd8d2a800 20 add_watcher() i=7 2024-09-14T11:00:04.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.710+0000 7fedd8d2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:04.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.711+0000 7fec8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:04.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fedd8d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:04.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fedd8d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:04.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fedd8d2a800 5 note: GC not initialized 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fec8a7e4640 20 reqs_thread_entry: start 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fedd8d2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fedd8d2a800 20 Filter name: none 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.712+0000 7fec83fff640 20 reqs_thread_entry: start 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:04.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:04.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:04.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:04.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:04.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.713+0000 7fedd8d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:04.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.714+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:04.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.714+0000 7fedd8d2a800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:00:04.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.714+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:04.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.715+0000 7fedd8d2a800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:00:04.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.715+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:04.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.715+0000 7fedd8d2a800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:00:04.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.715+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:04.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.716+0000 7fedd8d2a800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:00:04.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.716+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:04.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.716+0000 7fedd8d2a800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:00:04.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.716+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:04.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.717+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca2fde8360 obj=check-bucket:d state=0x55ca300b7398 s->prefetch_data=0 2024-09-14T11:00:04.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.717+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:04.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.717+0000 7fedd8d2a800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:00:04.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.717+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:04.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.718+0000 7fedd8d2a800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:00:04.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.718+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:04.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.718+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca2fe109e0 obj=check-bucket:c state=0x55ca300b8408 s->prefetch_data=0 2024-09-14T11:00:04.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.718+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:04.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.719+0000 7fedd8d2a800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:00:04.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.719+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state: setting s->obj_tag to kfzwsyu4efitfab2vnund5ucj99ypyh1 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state_impl: setting s->olh_tag to f7n4m4p17t7blm45fc0daicssvr3xfc0 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state: setting s->obj_tag to g70n8qm0i0pppxpfw4ze4j4o87j1a623 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state_impl: setting s->olh_tag to l2cclp5r9u1nxof1fx0zy01kkw0i791b 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:04.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:00:04.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 olh_log_entry: epoch=4 op=3 key=d[UiknfgRuAfLok8b1oY-rLYKTW2gWJb6] 2024-09-14T11:00:04.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca300f0eb0 obj=check-bucket:_:UiknfgRuAfLok8b1oY-rLYKTW2gWJb6_d state=0x55ca300b6248 s->prefetch_data=0 2024-09-14T11:00:04.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:00:04.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 olh_log_entry: epoch=4 op=3 key=c[-96bxVh-GvoO7invnLjPBUgFJGzTMuG] 2024-09-14T11:00:04.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.720+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca30110eb0 obj=check-bucket:_:-96bxVh-GvoO7invnLjPBUgFJGzTMuG_c state=0x55ca3011eda8 s->prefetch_data=0 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.725+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca30110eb0 obj=check-bucket:c state=0x55ca301174f8 s->prefetch_data=0 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.725+0000 7fedd8d2a800 20 get_obj_state: octx=0x55ca300f0eb0 obj=check-bucket:d state=0x55ca300b2178 s->prefetch_data=0 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 get_obj_state: setting s->obj_tag to g70n8qm0i0pppxpfw4ze4j4o87j1a623 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 get_obj_state_impl: setting s->olh_tag to l2cclp5r9u1nxof1fx0zy01kkw0i791b 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l2cclp5r9u1nxof1fx0zy01kkw0i791b 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 get_obj_state: setting s->obj_tag to kfzwsyu4efitfab2vnund5ucj99ypyh1 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 get_obj_state_impl: setting s->olh_tag to f7n4m4p17t7blm45fc0daicssvr3xfc0 2024-09-14T11:00:04.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.726+0000 7fedd8d2a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=f7n4m4p17t7blm45fc0daicssvr3xfc0 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.737+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.737+0000 7fedd8d2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.739+0000 7fedd8d2a800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.739+0000 7fedd8d2a800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.739+0000 7fedd8d2a800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:00:04.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.740+0000 7fec8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:04.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.743+0000 7fedd8d2a800 20 remove_watcher() i=0 2024-09-14T11:00:04.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.743+0000 7fedd8d2a800 2 removed watcher, disabling cache 2024-09-14T11:00:04.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.744+0000 7fedd8d2a800 20 remove_watcher() i=1 2024-09-14T11:00:04.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.745+0000 7fedd8d2a800 20 remove_watcher() i=2 2024-09-14T11:00:04.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.746+0000 7fedd8d2a800 20 remove_watcher() i=3 2024-09-14T11:00:04.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.747+0000 7fedd8d2a800 20 remove_watcher() i=4 2024-09-14T11:00:04.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.748+0000 7fedd8d2a800 20 remove_watcher() i=5 2024-09-14T11:00:04.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.749+0000 7fedd8d2a800 20 remove_watcher() i=6 2024-09-14T11:00:04.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.751+0000 7fedd8d2a800 20 remove_watcher() i=7 2024-09-14T11:00:04.761 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:00:04.794 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:04.794 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:04.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.836+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.837+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.837+0000 7fb230a10800 20 realm 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.837+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.838+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.838+0000 7fb230a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.838+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.838+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.838+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.839+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:04.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.839+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:04.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.839+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:04.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.839+0000 7fb230a10800 20 searching for the correct realm 2024-09-14T11:00:04.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:04.840+0000 7fb22c1bc640 0 -- 172.21.15.29:0/1705842650 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x5624e3075970 msgr2=0x5624e3077e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:05.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.045+0000 7fb22c1bc640 0 -- 172.21.15.29:0/1705842650 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x5624e2e28a90 msgr2=0x7fb224062270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:05.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:05.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:05.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.255+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:05.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 zone default found 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 4 Realm: () 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:05.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 zonegroup default 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.256+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.257+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.257+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.257+0000 7fb230a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.257+0000 7fb230a10800 20 started sync module instance, tier type = 2024-09-14T11:00:05.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.257+0000 7fb230a10800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=0 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=1 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=2 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=3 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=4 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=5 2024-09-14T11:00:05.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.268+0000 7fb230a10800 20 add_watcher() i=6 2024-09-14T11:00:05.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.269+0000 7fb230a10800 20 add_watcher() i=7 2024-09-14T11:00:05.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.269+0000 7fb230a10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:05.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.271+0000 7fb0e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:05.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.271+0000 7fb230a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:05.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.271+0000 7fb230a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:05.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.271+0000 7fb230a10800 5 note: GC not initialized 2024-09-14T11:00:05.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.271+0000 7fb0e1fdb640 20 reqs_thread_entry: start 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb230a10800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb230a10800 20 Filter name: none 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb0537fe640 20 reqs_thread_entry: start 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:05.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.272+0000 7fb230a10800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.273+0000 7fb230a10800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:05.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.273+0000 7fb230a10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:05.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.273+0000 7fb230a10800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:05.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.273+0000 7fb230a10800 20 INFO: main: starting shard=0 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.273+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 INFO: main: starting shard=1 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 INFO: main: starting shard=2 2024-09-14T11:00:05.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.274+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:05.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.275+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.275+0000 7fb230a10800 20 INFO: main: starting shard=3 2024-09-14T11:00:05.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.275+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: starting shard=4 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: starting shard=5 2024-09-14T11:00:05.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 INFO: main: starting shard=6 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.276+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.277+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.277+0000 7fb230a10800 20 INFO: main: starting shard=7 2024-09-14T11:00:05.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.277+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 INFO: main: starting shard=8 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 INFO: main: starting shard=9 2024-09-14T11:00:05.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.278+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:05.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.279+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.279+0000 7fb230a10800 20 INFO: main: starting shard=10 2024-09-14T11:00:05.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.279+0000 7fb230a10800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:05.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.280+0000 7fb230a10800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.280+0000 7fb230a10800 20 INFO: main: done 2024-09-14T11:00:05.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.280+0000 7fb0e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:05.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.283+0000 7fb230a10800 20 remove_watcher() i=0 2024-09-14T11:00:05.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.283+0000 7fb230a10800 2 removed watcher, disabling cache 2024-09-14T11:00:05.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.285+0000 7fb230a10800 20 remove_watcher() i=1 2024-09-14T11:00:05.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.286+0000 7fb230a10800 20 remove_watcher() i=2 2024-09-14T11:00:05.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.287+0000 7fb230a10800 20 remove_watcher() i=3 2024-09-14T11:00:05.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.288+0000 7fb230a10800 20 remove_watcher() i=4 2024-09-14T11:00:05.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.289+0000 7fb230a10800 20 remove_watcher() i=5 2024-09-14T11:00:05.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.290+0000 7fb230a10800 20 remove_watcher() i=6 2024-09-14T11:00:05.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.292+0000 7fb230a10800 20 remove_watcher() i=7 2024-09-14T11:00:05.303 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:00:05.335 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:05.335 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:05.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.376+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 realm 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.378+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.379+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:05.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.379+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.380+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:05.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.380+0000 7f0be4f25800 20 searching for the correct realm 2024-09-14T11:00:05.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.382+0000 7f0be13af640 0 -- 172.21.15.29:0/4145259761 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0bd8028070 msgr2=0x7f0bd8085a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:05.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.588+0000 7f0be03ad640 0 -- 172.21.15.29:0/4145259761 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0bd80890c0 msgr2=0x7f0bd807d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:05.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:05.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:05.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.794+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:05.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 zone default found 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 4 Realm: () 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:05.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 zonegroup default 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.795+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.796+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.796+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.796+0000 7f0be4f25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.796+0000 7f0be4f25800 20 started sync module instance, tier type = 2024-09-14T11:00:05.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.796+0000 7f0be4f25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=0 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=1 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=2 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=3 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=4 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=5 2024-09-14T11:00:05.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.807+0000 7f0be4f25800 20 add_watcher() i=6 2024-09-14T11:00:05.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.808+0000 7f0be4f25800 20 add_watcher() i=7 2024-09-14T11:00:05.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.808+0000 7f0be4f25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:05.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0a96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:05.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0be4f25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:05.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0be4f25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:05.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0be4f25800 5 note: GC not initialized 2024-09-14T11:00:05.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0a95fe3640 20 reqs_thread_entry: start 2024-09-14T11:00:05.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.811+0000 7f0be4f25800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:05.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.812+0000 7f0be4f25800 20 Filter name: none 2024-09-14T11:00:05.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.812+0000 7f0a077fe640 20 reqs_thread_entry: start 2024-09-14T11:00:05.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.812+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.812+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.812+0000 7f0be4f25800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 INFO: main: starting shard=0 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 INFO: main: starting shard=1 2024-09-14T11:00:05.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.813+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 INFO: main: starting shard=2 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 INFO: main: starting shard=3 2024-09-14T11:00:05.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.814+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 INFO: main: starting shard=4 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 INFO: main: starting shard=5 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.815+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 INFO: main: starting shard=6 2024-09-14T11:00:05.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 INFO: main: starting shard=7 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.816+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 INFO: main: starting shard=8 2024-09-14T11:00:05.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 INFO: main: starting shard=9 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.817+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.818+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.818+0000 7f0be4f25800 20 INFO: main: starting shard=10 2024-09-14T11:00:05.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.818+0000 7f0be4f25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:05.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.819+0000 7f0be4f25800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:05.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.819+0000 7f0be4f25800 20 INFO: main: done 2024-09-14T11:00:05.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.820+0000 7f0a96fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:05.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.822+0000 7f0be4f25800 20 remove_watcher() i=0 2024-09-14T11:00:05.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.822+0000 7f0be4f25800 2 removed watcher, disabling cache 2024-09-14T11:00:05.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.824+0000 7f0be4f25800 20 remove_watcher() i=1 2024-09-14T11:00:05.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.825+0000 7f0be4f25800 20 remove_watcher() i=2 2024-09-14T11:00:05.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.826+0000 7f0be4f25800 20 remove_watcher() i=3 2024-09-14T11:00:05.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.827+0000 7f0be4f25800 20 remove_watcher() i=4 2024-09-14T11:00:05.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.828+0000 7f0be4f25800 20 remove_watcher() i=5 2024-09-14T11:00:05.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.829+0000 7f0be4f25800 20 remove_watcher() i=6 2024-09-14T11:00:05.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.831+0000 7f0be4f25800 20 remove_watcher() i=7 2024-09-14T11:00:05.841 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:00:05.841 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:05.842 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:00:05.875 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:05.875 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:05.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.917+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 realm 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:05.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:05.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.919+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.920+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:05.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.920+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:05.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.921+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:05.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.921+0000 7ff10c319800 20 searching for the correct realm 2024-09-14T11:00:05.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:05.923+0000 7ff10a604640 0 -- 172.21.15.29:0/1409387365 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ff104035ae0 msgr2=0x7ff104026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:06.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.131+0000 7ff109602640 0 -- 172.21.15.29:0/1409387365 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ff104031910 msgr2=0x7ff104016410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:06.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:06.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:06.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.339+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 zone default found 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 4 Realm: () 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:06.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 zonegroup default 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.340+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.341+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.341+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.341+0000 7ff10c319800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.341+0000 7ff10c319800 20 started sync module instance, tier type = 2024-09-14T11:00:06.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.341+0000 7ff10c319800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:06.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=0 2024-09-14T11:00:06.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=1 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=2 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=3 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=4 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=5 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.352+0000 7ff10c319800 20 add_watcher() i=6 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.354+0000 7ff10c319800 20 add_watcher() i=7 2024-09-14T11:00:06.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.354+0000 7ff10c319800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:06.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.355+0000 7fefbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 5 note: GC not initialized 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7fefba7fc640 20 reqs_thread_entry: start 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 20 Filter name: none 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7fef2bfff640 20 reqs_thread_entry: start 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:06.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.356+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.357+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:06.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.357+0000 7ff10c319800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:06.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.357+0000 7ff10c319800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:06.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.357+0000 7ff10c319800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:06.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.357+0000 7ff10c319800 20 rados->read ofs=0 len=0 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:00:06.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.358+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:06.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.359+0000 7ff10c319800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:00:06.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.359+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:06.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.359+0000 7ff10c319800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:00:06.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.359+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:06.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.360+0000 7ff10c319800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:00:06.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.360+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:06.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.360+0000 7ff10c319800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:00:06.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.360+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:06.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.361+0000 7ff10c319800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:00:06.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.361+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:06.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.361+0000 7ff10c319800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:00:06.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.361+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:06.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.362+0000 7ff10c319800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:00:06.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.362+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:06.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.362+0000 7ff10c319800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:00:06.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.362+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:06.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.363+0000 7ff10c319800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:00:06.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.363+0000 7ff10c319800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:06.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.364+0000 7ff10c319800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:00:06.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.364+0000 7ff10c319800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:00:06.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.365+0000 7fefbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:06.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.368+0000 7ff10c319800 20 remove_watcher() i=0 2024-09-14T11:00:06.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.368+0000 7ff10c319800 2 removed watcher, disabling cache 2024-09-14T11:00:06.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.369+0000 7ff10c319800 20 remove_watcher() i=1 2024-09-14T11:00:06.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.370+0000 7ff10c319800 20 remove_watcher() i=2 2024-09-14T11:00:06.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.371+0000 7ff10c319800 20 remove_watcher() i=3 2024-09-14T11:00:06.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.372+0000 7ff10c319800 20 remove_watcher() i=4 2024-09-14T11:00:06.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.374+0000 7ff10c319800 20 remove_watcher() i=5 2024-09-14T11:00:06.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.375+0000 7ff10c319800 20 remove_watcher() i=6 2024-09-14T11:00:06.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:06.376+0000 7ff10c319800 20 remove_watcher() i=7 2024-09-14T11:00:06.387 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:00:06.387 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:06.513 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:00:06.513 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:00:07.309 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:00:07.728 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:00:09.264 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:00:09.265 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:00:09.300 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:09.300 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:09.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.342+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 realm 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.344+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.345+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:09.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.345+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.346+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:09.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.346+0000 7f76fe610800 20 searching for the correct realm 2024-09-14T11:00:09.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.348+0000 7f76fa61b640 0 -- 172.21.15.29:0/488247222 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5615a45b62e0 msgr2=0x5615a45b86d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:09.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.351+0000 7f76fa61b640 0 -- 172.21.15.29:0/488247222 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f75c4084dd0 msgr2=0x7f75c4087200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.559+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 zone default found 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 4 Realm: () 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 zonegroup default 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.560+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.561+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.561+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.561+0000 7f76fe610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.561+0000 7f76fe610800 20 started sync module instance, tier type = 2024-09-14T11:00:09.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.561+0000 7f76fe610800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=0 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=1 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=2 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=3 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=4 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=5 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.573+0000 7f76fe610800 20 add_watcher() i=6 2024-09-14T11:00:09.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.574+0000 7f76fe610800 20 add_watcher() i=7 2024-09-14T11:00:09.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.574+0000 7f76fe610800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:09.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.576+0000 7f75ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:09.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.576+0000 7f76fe610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:09.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.576+0000 7f76fe610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.576+0000 7f76fe610800 5 note: GC not initialized 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.576+0000 7f75aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f76fe610800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f76fe610800 20 Filter name: none 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f751bfff640 20 reqs_thread_entry: start 2024-09-14T11:00:09.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.577+0000 7f76fe610800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 INFO: main: starting shard=0 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 INFO: main: starting shard=1 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.578+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.579+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.579+0000 7f76fe610800 20 INFO: main: starting shard=2 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.579+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 INFO: main: starting shard=3 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 INFO: main: starting shard=4 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.580+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 INFO: main: starting shard=5 2024-09-14T11:00:09.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:09.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 INFO: main: starting shard=6 2024-09-14T11:00:09.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.581+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:09.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 INFO: main: starting shard=7 2024-09-14T11:00:09.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:09.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 INFO: main: starting shard=8 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.582+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 INFO: main: starting shard=9 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 INFO: main: starting shard=10 2024-09-14T11:00:09.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.583+0000 7f76fe610800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:09.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.584+0000 7f76fe610800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:09.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.584+0000 7f76fe610800 20 INFO: main: done 2024-09-14T11:00:09.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.585+0000 7f75ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:09.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.588+0000 7f76fe610800 20 remove_watcher() i=0 2024-09-14T11:00:09.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.588+0000 7f76fe610800 2 removed watcher, disabling cache 2024-09-14T11:00:09.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.589+0000 7f76fe610800 20 remove_watcher() i=1 2024-09-14T11:00:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.590+0000 7f76fe610800 20 remove_watcher() i=2 2024-09-14T11:00:09.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.592+0000 7f76fe610800 20 remove_watcher() i=3 2024-09-14T11:00:09.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.594+0000 7f76fe610800 20 remove_watcher() i=4 2024-09-14T11:00:09.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.595+0000 7f76fe610800 20 remove_watcher() i=5 2024-09-14T11:00:09.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.597+0000 7f76fe610800 20 remove_watcher() i=6 2024-09-14T11:00:09.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.598+0000 7f76fe610800 20 remove_watcher() i=7 2024-09-14T11:00:09.719 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:00:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:00:09.752 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:09.752 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:09.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.792+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 realm 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:09.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.794+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.795+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:09.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.795+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:09.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.796+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:09.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.796+0000 7f35b3e13800 20 searching for the correct realm 2024-09-14T11:00:09.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:09.798+0000 7f35afd49640 0 -- 172.21.15.29:0/2185957581 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f35a8035070 msgr2=0x7f35a80354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:10.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.004+0000 7f35aed47640 0 -- 172.21.15.29:0/2185957581 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f35a801aac0 msgr2=0x7f35a803f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.212+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 zone default found 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 4 Realm: () 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 zonegroup default 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.213+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.214+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.214+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.214+0000 7f35b3e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.214+0000 7f35b3e13800 20 started sync module instance, tier type = 2024-09-14T11:00:10.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.214+0000 7f35b3e13800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=0 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=1 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=2 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=3 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=4 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=5 2024-09-14T11:00:10.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.225+0000 7f35b3e13800 20 add_watcher() i=6 2024-09-14T11:00:10.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.226+0000 7f35b3e13800 20 add_watcher() i=7 2024-09-14T11:00:10.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.226+0000 7f35b3e13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:10.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f3465fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:10.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f35b3e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f35b3e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f35b3e13800 5 note: GC not initialized 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f3464fe1640 20 reqs_thread_entry: start 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.228+0000 7f35b3e13800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.229+0000 7f35b3e13800 20 Filter name: none 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.229+0000 7f33de7fc640 20 reqs_thread_entry: start 2024-09-14T11:00:10.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.229+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.229+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.229+0000 7f35b3e13800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 INFO: main: starting shard=0 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:10.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 INFO: main: starting shard=1 2024-09-14T11:00:10.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.230+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:10.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 INFO: main: starting shard=2 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 INFO: main: starting shard=3 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.231+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 INFO: main: starting shard=4 2024-09-14T11:00:10.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 INFO: main: starting shard=5 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.232+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 INFO: main: starting shard=6 2024-09-14T11:00:10.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 INFO: main: starting shard=7 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.233+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 INFO: main: starting shard=8 2024-09-14T11:00:10.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 INFO: main: starting shard=9 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.234+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.235+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.235+0000 7f35b3e13800 20 INFO: main: starting shard=10 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.235+0000 7f35b3e13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.236+0000 7f35b3e13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.236+0000 7f35b3e13800 20 INFO: main: done 2024-09-14T11:00:10.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.236+0000 7f3465fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:10.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.239+0000 7f35b3e13800 20 remove_watcher() i=0 2024-09-14T11:00:10.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.239+0000 7f35b3e13800 2 removed watcher, disabling cache 2024-09-14T11:00:10.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.241+0000 7f35b3e13800 20 remove_watcher() i=1 2024-09-14T11:00:10.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.242+0000 7f35b3e13800 20 remove_watcher() i=2 2024-09-14T11:00:10.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.243+0000 7f35b3e13800 20 remove_watcher() i=3 2024-09-14T11:00:10.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.244+0000 7f35b3e13800 20 remove_watcher() i=4 2024-09-14T11:00:10.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.245+0000 7f35b3e13800 20 remove_watcher() i=5 2024-09-14T11:00:10.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.246+0000 7f35b3e13800 20 remove_watcher() i=6 2024-09-14T11:00:10.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.247+0000 7f35b3e13800 20 remove_watcher() i=7 2024-09-14T11:00:10.373 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:00:10.374 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:00:10.407 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:10.407 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:10.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.448+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.449+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.449+0000 7f5132f2a800 20 realm 2024-09-14T11:00:10.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.449+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.450+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.450+0000 7f5132f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.450+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.450+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.450+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.451+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:10.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.451+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.451+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:10.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.451+0000 7f5132f2a800 20 searching for the correct realm 2024-09-14T11:00:10.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.454+0000 7f512f418640 0 -- 172.21.15.29:0/2157192427 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f512800e040 msgr2=0x7f512802c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:10.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.660+0000 7f512e416640 0 -- 172.21.15.29:0/2157192427 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f5128044900 msgr2=0x7f512805c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:10.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.866+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 zone default found 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 4 Realm: () 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:10.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 zonegroup default 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.867+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.868+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.868+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.868+0000 7f5132f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.868+0000 7f5132f2a800 20 started sync module instance, tier type = 2024-09-14T11:00:10.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.868+0000 7f5132f2a800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:10.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=0 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=1 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=2 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=3 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=4 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=5 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.879+0000 7f5132f2a800 20 add_watcher() i=6 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.880+0000 7f5132f2a800 20 add_watcher() i=7 2024-09-14T11:00:10.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.880+0000 7f5132f2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:10.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f4fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:10.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f5132f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:10.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f5132f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:10.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f5132f2a800 5 note: GC not initialized 2024-09-14T11:00:10.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f4f5ffff640 20 reqs_thread_entry: start 2024-09-14T11:00:10.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f5132f2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:10.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.882+0000 7f5132f2a800 20 Filter name: none 2024-09-14T11:00:10.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.883+0000 7f4f5dffb640 20 reqs_thread_entry: start 2024-09-14T11:00:10.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.883+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.883+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.883+0000 7f5132f2a800 20 rados->read ofs=0 len=0 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 INFO: main: starting shard=0 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 INFO: main: starting shard=1 2024-09-14T11:00:10.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.884+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:10.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.885+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:00:10.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.885+0000 7f5132f2a800 20 INFO: main: starting shard=2 2024-09-14T11:00:10.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.885+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:10.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 INFO: main: starting shard=3 2024-09-14T11:00:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 INFO: main: starting shard=4 2024-09-14T11:00:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.886+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:10.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 INFO: main: starting shard=5 2024-09-14T11:00:10.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:10.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 INFO: main: starting shard=6 2024-09-14T11:00:10.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.887+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 INFO: main: starting shard=7 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 INFO: main: starting shard=8 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.888+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 INFO: main: starting shard=9 2024-09-14T11:00:10.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:10.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 INFO: main: starting shard=10 2024-09-14T11:00:10.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.889+0000 7f5132f2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:10.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.890+0000 7f5132f2a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:10.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.890+0000 7f5132f2a800 20 INFO: main: done 2024-09-14T11:00:10.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.891+0000 7f4fe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:10.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.894+0000 7f5132f2a800 20 remove_watcher() i=0 2024-09-14T11:00:10.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.894+0000 7f5132f2a800 2 removed watcher, disabling cache 2024-09-14T11:00:10.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.895+0000 7f5132f2a800 20 remove_watcher() i=1 2024-09-14T11:00:10.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.896+0000 7f5132f2a800 20 remove_watcher() i=2 2024-09-14T11:00:10.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.897+0000 7f5132f2a800 20 remove_watcher() i=3 2024-09-14T11:00:10.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.899+0000 7f5132f2a800 20 remove_watcher() i=4 2024-09-14T11:00:10.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.900+0000 7f5132f2a800 20 remove_watcher() i=5 2024-09-14T11:00:10.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.901+0000 7f5132f2a800 20 remove_watcher() i=6 2024-09-14T11:00:10.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:10.902+0000 7f5132f2a800 20 remove_watcher() i=7 2024-09-14T11:00:11.028 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:00:11.029 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:00:11.061 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:11.061 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:11.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.101+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 realm 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.103+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.104+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:11.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.104+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.105+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:11.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.105+0000 7fc93b33d800 20 searching for the correct realm 2024-09-14T11:00:11.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.107+0000 7fc93782b640 0 -- 172.21.15.29:0/1750444909 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc930074060 msgr2=0x7fc930096030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:11.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.111+0000 7fc936829640 0 -- 172.21.15.29:0/1750444909 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc930088a00 msgr2=0x7fc93007c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:00:11.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:11.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.318+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 zone default found 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 4 Realm: () 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 zonegroup default 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.319+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.320+0000 7fc93b33d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:11.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.320+0000 7fc93b33d800 20 started sync module instance, tier type = 2024-09-14T11:00:11.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.320+0000 7fc93b33d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=0 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=1 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=2 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=3 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=4 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=5 2024-09-14T11:00:11.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.330+0000 7fc93b33d800 20 add_watcher() i=6 2024-09-14T11:00:11.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.331+0000 7fc93b33d800 20 add_watcher() i=7 2024-09-14T11:00:11.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.331+0000 7fc93b33d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:11.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.333+0000 7fc7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.333+0000 7fc93b33d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.333+0000 7fc93b33d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.333+0000 7fc93b33d800 5 note: GC not initialized 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc7ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc93b33d800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc93b33d800 20 Filter name: none 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc7667fc640 20 reqs_thread_entry: start 2024-09-14T11:00:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.334+0000 7fc93b33d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:00:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 INFO: main: starting shard=0 2024-09-14T11:00:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 INFO: main: starting shard=1 2024-09-14T11:00:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.335+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.336+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.336+0000 7fc93b33d800 20 INFO: main: starting shard=2 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.336+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 INFO: main: starting shard=3 2024-09-14T11:00:11.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 INFO: main: starting shard=4 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.337+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 INFO: main: starting shard=5 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 INFO: main: starting shard=6 2024-09-14T11:00:11.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.338+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:11.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 INFO: main: starting shard=7 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 INFO: main: starting shard=8 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.339+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 INFO: main: starting shard=9 2024-09-14T11:00:11.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:11.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:00:11.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 INFO: main: starting shard=10 2024-09-14T11:00:11.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.340+0000 7fc93b33d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:11.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.341+0000 7fc93b33d800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:00:11.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.341+0000 7fc93b33d800 20 INFO: main: done 2024-09-14T11:00:11.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.342+0000 7fc7edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:11.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.345+0000 7fc93b33d800 20 remove_watcher() i=0 2024-09-14T11:00:11.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.345+0000 7fc93b33d800 2 removed watcher, disabling cache 2024-09-14T11:00:11.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.346+0000 7fc93b33d800 20 remove_watcher() i=1 2024-09-14T11:00:11.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.347+0000 7fc93b33d800 20 remove_watcher() i=2 2024-09-14T11:00:11.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.348+0000 7fc93b33d800 20 remove_watcher() i=3 2024-09-14T11:00:11.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.349+0000 7fc93b33d800 20 remove_watcher() i=4 2024-09-14T11:00:11.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.350+0000 7fc93b33d800 20 remove_watcher() i=5 2024-09-14T11:00:11.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.351+0000 7fc93b33d800 20 remove_watcher() i=6 2024-09-14T11:00:11.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:11.352+0000 7fc93b33d800 20 remove_watcher() i=7 2024-09-14T11:00:11.388 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:00:11.817 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:00:12.235 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:00:12.265 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:12.265 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:12.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.306+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.307+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.307+0000 7f71f342d800 20 realm 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.307+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.308+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.308+0000 7f71f342d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.308+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.308+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.308+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.309+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:12.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.309+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.309+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:12.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.310+0000 7f71f342d800 20 searching for the correct realm 2024-09-14T11:00:12.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.311+0000 7f71f1718640 0 -- 172.21.15.29:0/1367639573 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55ca131d2210 msgr2=0x55ca131d4600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:12.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.315+0000 7f71f0716640 0 -- 172.21.15.29:0/1367639573 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f71e00acfe0 msgr2=0x7f71e00b4aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:12.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.320+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:12.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:12.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 zone default found 2024-09-14T11:00:12.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 4 Realm: () 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 zonegroup default 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.321+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 started sync module instance, tier type = 2024-09-14T11:00:12.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.322+0000 7f71f342d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=0 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=1 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=2 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=3 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=4 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=5 2024-09-14T11:00:12.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.332+0000 7f71f342d800 20 add_watcher() i=6 2024-09-14T11:00:12.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.333+0000 7f71f342d800 20 add_watcher() i=7 2024-09-14T11:00:12.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.333+0000 7f71f342d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:12.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f70a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:12.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f71f342d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:12.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f71f342d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:12.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f71f342d800 5 note: GC not initialized 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f70a5fe3640 20 reqs_thread_entry: start 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f71f342d800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.335+0000 7f71f342d800 20 Filter name: none 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f70177fe640 20 reqs_thread_entry: start 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:12.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:12.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:12.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:12.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.336+0000 7f71f342d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:12.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.337+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:12.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.337+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.338+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:12.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.339+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:12.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.339+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:12.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.339+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.340+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:12.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.340+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:12.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.341+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.341+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:12.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.342+0000 7f71f342d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.352+0000 7f70a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:12.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.354+0000 7f71f342d800 20 remove_watcher() i=0 2024-09-14T11:00:12.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.354+0000 7f71f342d800 2 removed watcher, disabling cache 2024-09-14T11:00:12.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.355+0000 7f71f342d800 20 remove_watcher() i=1 2024-09-14T11:00:12.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.357+0000 7f71f342d800 20 remove_watcher() i=2 2024-09-14T11:00:12.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.358+0000 7f71f342d800 20 remove_watcher() i=3 2024-09-14T11:00:12.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.359+0000 7f71f342d800 20 remove_watcher() i=4 2024-09-14T11:00:12.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.360+0000 7f71f342d800 20 remove_watcher() i=5 2024-09-14T11:00:12.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.361+0000 7f71f342d800 20 remove_watcher() i=6 2024-09-14T11:00:12.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.362+0000 7f71f342d800 20 remove_watcher() i=7 2024-09-14T11:00:12.373 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:00:12.408 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:12.408 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:12.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.449+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 20 realm 2024-09-14T11:00:12.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.450+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.451+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.451+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.451+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:12.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.452+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.452+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:12.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.452+0000 7f6ffa535800 20 searching for the correct realm 2024-09-14T11:00:12.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.454+0000 7f6ff6a7e640 0 -- 172.21.15.29:0/3629301541 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6ff006b940 msgr2=0x7f6ff0099410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:12.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.660+0000 7f6ff5a7c640 0 -- 172.21.15.29:0/3629301541 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6ff007f910 msgr2=0x7f6ff00aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:12.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:12.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.867+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:12.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 zone default found 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 4 Realm: () 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 zonegroup default 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.868+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:12.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 started sync module instance, tier type = 2024-09-14T11:00:12.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.869+0000 7f6ffa535800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=0 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=1 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=2 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=3 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=4 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=5 2024-09-14T11:00:12.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.880+0000 7f6ffa535800 20 add_watcher() i=6 2024-09-14T11:00:12.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.881+0000 7f6ffa535800 20 add_watcher() i=7 2024-09-14T11:00:12.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.881+0000 7f6ffa535800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:12.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.883+0000 7f6eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:12.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.883+0000 7f6ffa535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:12.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.883+0000 7f6ffa535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:12.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.883+0000 7f6ffa535800 5 note: GC not initialized 2024-09-14T11:00:12.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6e277fe640 20 reqs_thread_entry: start 2024-09-14T11:00:12.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:12.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 20 Filter name: none 2024-09-14T11:00:12.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6e257fa640 20 reqs_thread_entry: start 2024-09-14T11:00:12.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:00:12.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:12.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:00:12.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.884+0000 7f6ffa535800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:00:12.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 : miss 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 20 rados->read ofs=0 len=0 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 info.flags=0x17 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 to cache LRU end 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.2 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.885+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.0 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.886+0000 7f6ffa535800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.886+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.887+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.2 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.887+0000 7f6ffa535800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.887+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.3 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.888+0000 7f6ffa535800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.888+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.4 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.888+0000 7f6ffa535800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:00:12.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.888+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.888+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.6 2024-09-14T11:00:12.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.889+0000 7f6ffa535800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:00:12.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.889+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.7 2024-09-14T11:00:12.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.890+0000 7f6ffa535800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:00:12.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.890+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.890+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.9 2024-09-14T11:00:12.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.891+0000 7f6ffa535800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:00:12.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.891+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.891+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.892+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b2f6380 obj=check-bucket:e state=0x55a18b5c1bd8 s->prefetch_data=0 2024-09-14T11:00:12.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.892+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.892+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b31ea00 obj=check-bucket:d state=0x55a18b5c6758 s->prefetch_data=0 2024-09-14T11:00:12.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.892+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b5c6040 obj=check-bucket:c state=0x55a18b65fd88 s->prefetch_data=0 2024-09-14T11:00:12.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b661c20 obj=check-bucket:f state=0x55a18b6608e8 s->prefetch_data=0 2024-09-14T11:00:12.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to e5frt1q8as847t7i71kk3kigwpmz7n37 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state_impl: setting s->olh_tag to y7oz9i7ia8ojg00zba1bgv0885hq27kj 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y7oz9i7ia8ojg00zba1bgv0885hq27kj 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to 5mwm698n66hzc4wrw3fj8l7h7celttmw 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state_impl: setting s->olh_tag to p4d6p70n5p2c78l01o04ivmtimadf5wl 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=p4d6p70n5p2c78l01o04ivmtimadf5wl 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to d5u8xr4i1nso3kssefx07j5z0agsygnl 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 get_obj_state_impl: setting s->olh_tag to lyoxaf4pwm8un9n8hsxb19hv5mfkc9tb 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.893+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lyoxaf4pwm8un9n8hsxb19hv5mfkc9tb 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.894+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to euwqbyq6pgj6vwgluc354uhc86p5qg6g 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.894+0000 7f6ffa535800 20 get_obj_state_impl: setting s->olh_tag to 45o0tfl3wwt7ttod6e0syqp8wk2r5rs3 2024-09-14T11:00:12.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.894+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=45o0tfl3wwt7ttod6e0syqp8wk2r5rs3 2024-09-14T11:00:12.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.895+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.895+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.896+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.897+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.898+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.898+0000 7f6ffa535800 20 olh_log_entry: epoch=3 op=3 key=d[2GCPTGSfKF.vjxk1DV2NMkrUgAzFOeT] 2024-09-14T11:00:12.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.898+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b31ea00 obj=check-bucket:_:2GCPTGSfKF.vjxk1DV2NMkrUgAzFOeT_d state=0x55a18b67c0e8 s->prefetch_data=0 2024-09-14T11:00:12.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.898+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.898+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 olh_log_entry: epoch=3 op=3 key=c[YHA00TOTOVGQMKOL2DfVgSpxVok0SP1] 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b5c6040 obj=check-bucket:_:YHA00TOTOVGQMKOL2DfVgSpxVok0SP1_c state=0x55a18b67cc48 s->prefetch_data=0 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 10 manifest: total_size = 9 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.16026845151823565254 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b31ea00 obj=check-bucket:_:2GCPTGSfKF.vjxk1DV2NMkrUgAzFOeT_d state=0x55a18b67c0e8 s->prefetch_data=0 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 prepare_atomic_modification: state is not atomic. state=0x55a18b67c0e8 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 olh_log_entry: epoch=2 op=3 key=e[zjIEEULzOl.t.ogH.yizfyPCcTgnnJT] 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b2f6380 obj=check-bucket:_:zjIEEULzOl.t.ogH.yizfyPCcTgnnJT_e state=0x55a18b68a228 s->prefetch_data=0 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 10 manifest: total_size = 22 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.16540482663070718635 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b5c6040 obj=check-bucket:_:YHA00TOTOVGQMKOL2DfVgSpxVok0SP1_c state=0x55a18b67cc48 s->prefetch_data=0 2024-09-14T11:00:12.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 prepare_atomic_modification: state is not atomic. state=0x55a18b67cc48 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 10 manifest: total_size = 22 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.8750070139701239267 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b2f6380 obj=check-bucket:_:zjIEEULzOl.t.ogH.yizfyPCcTgnnJT_e state=0x55a18b68a228 s->prefetch_data=0 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 prepare_atomic_modification: state is not atomic. state=0x55a18b68a228 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 olh_log_entry: epoch=2 op=3 key=f[ZL9yr84tGQaDZ289XK.dgt1C56yDejg] 2024-09-14T11:00:12.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.899+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b661c20 obj=check-bucket:_:ZL9yr84tGQaDZ289XK.dgt1C56yDejg_f state=0x55a18b6975e8 s->prefetch_data=0 2024-09-14T11:00:12.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.900+0000 7f6ffa535800 10 manifest: total_size = 22 2024-09-14T11:00:12.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.900+0000 7f6ffa535800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.5284508093840728372 2024-09-14T11:00:12.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.900+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b661c20 obj=check-bucket:_:ZL9yr84tGQaDZ289XK.dgt1C56yDejg_f state=0x55a18b6975e8 s->prefetch_data=0 2024-09-14T11:00:12.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.900+0000 7f6ffa535800 20 prepare_atomic_modification: state is not atomic. state=0x55a18b6975e8 2024-09-14T11:00:12.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.900+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.902+0000 7f6ffa535800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:12.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.902+0000 7f6ffa535800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:00:12.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.902+0000 7f6ffa535800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:12.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.902+0000 7f6ffa535800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:2GCPTGSfKF.vjxk1DV2NMkrUgAzFOeT_.8y_Xz4_qel8ZbERyiwUYlReiUUaLRz7_0 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:zjIEEULzOl.t.ogH.yizfyPCcTgnnJT_.Q-Ls-dDvJFRC4Xwz71fIaCPywrfpWtA_0 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:12.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:00:12.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:12.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.903+0000 7f6ffa535800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:YHA00TOTOVGQMKOL2DfVgSpxVok0SP1_.dhp9Wjz2TrVJ99e3Dn9yU1TJt_DU9OD_0 2024-09-14T11:00:12.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.904+0000 7f6ed97fa640 20 handle_completion(): completion ok for obj=d[2GCPTGSfKF.vjxk1DV2NMkrUgAzFOeT] 2024-09-14T11:00:12.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.905+0000 7f6ed9ffb640 20 handle_completion(): completion ok for obj=c[YHA00TOTOVGQMKOL2DfVgSpxVok0SP1] 2024-09-14T11:00:12.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.905+0000 7f6ffa535800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:12.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.906+0000 7f6ffa535800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:00:12.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.906+0000 7f6ffa535800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:00:12.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.906+0000 7f6ffa535800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:00:12.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.906+0000 7f6ffa535800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.2__shadow:ZL9yr84tGQaDZ289XK.dgt1C56yDejg_.QrXm844qDuFAo8TPDVg_zjqfmZqJ45s_0 2024-09-14T11:00:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.907+0000 7f6ffa535800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.907+0000 7f6ed9ffb640 20 handle_completion(): completion ok for obj=e[zjIEEULzOl.t.ogH.yizfyPCcTgnnJT] 2024-09-14T11:00:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.907+0000 7f6ffa535800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.908+0000 7f6ed9ffb640 20 handle_completion(): completion ok for obj=f[ZL9yr84tGQaDZ289XK.dgt1C56yDejg] 2024-09-14T11:00:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.908+0000 7f6ffa535800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:00:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.908+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.908+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.911+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.5 2024-09-14T11:00:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.911+0000 7f6ffa535800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:00:12.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.911+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b2f6380 obj=check-bucket:e state=0x55a18b5c1bd8 s->prefetch_data=0 2024-09-14T11:00:12.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.911+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y7oz9i7ia8ojg00zba1bgv0885hq27kj 2024-09-14T11:00:12.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.914+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.914+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.914+0000 7f6ffa535800 20 get_obj_state: octx=0x55a18b661c20 obj=check-bucket:f state=0x55a18b6608e8 s->prefetch_data=0 2024-09-14T11:00:12.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.914+0000 7f6ffa535800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=45o0tfl3wwt7ttod6e0syqp8wk2r5rs3 2024-09-14T11:00:12.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.916+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.8 2024-09-14T11:00:12.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.916+0000 7f6ffa535800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:00:12.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.916+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.918+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.1 2024-09-14T11:00:12.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.918+0000 7f6ffa535800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:00:12.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.918+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.919+0000 7f6ffa535800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.2.10 2024-09-14T11:00:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.919+0000 7f6ffa535800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:00:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.920+0000 7f6ffa535800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:00:12.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.920+0000 7f6eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.923+0000 7f6ffa535800 20 remove_watcher() i=0 2024-09-14T11:00:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.923+0000 7f6ffa535800 2 removed watcher, disabling cache 2024-09-14T11:00:12.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.926+0000 7f6ffa535800 20 remove_watcher() i=1 2024-09-14T11:00:12.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.927+0000 7f6ffa535800 20 remove_watcher() i=2 2024-09-14T11:00:12.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.928+0000 7f6ffa535800 20 remove_watcher() i=3 2024-09-14T11:00:12.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.929+0000 7f6ffa535800 20 remove_watcher() i=4 2024-09-14T11:00:12.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.930+0000 7f6ffa535800 20 remove_watcher() i=5 2024-09-14T11:00:12.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.931+0000 7f6ffa535800 20 remove_watcher() i=6 2024-09-14T11:00:12.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:12.932+0000 7f6ffa535800 20 remove_watcher() i=7 2024-09-14T11:00:13.173 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:00:13.202 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:00:13.203 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:00:13.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.244+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.246+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.246+0000 7ffb46040800 20 realm 2024-09-14T11:00:13.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.246+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.247+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.247+0000 7ffb46040800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.247+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.247+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.247+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.248+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:13.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.248+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.248+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:00:13.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.248+0000 7ffb46040800 20 searching for the correct realm 2024-09-14T11:00:13.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.250+0000 7ffb4432b640 0 -- 172.21.15.29:0/1056837497 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ffb3c097b10 msgr2=0x7ffb3c08f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:13.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.457+0000 7ffb43329640 0 -- 172.21.15.29:0/1056837497 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ffb3c0a6b00 msgr2=0x7ffb3c081900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:00:13.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.663+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 zone default found 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 4 Realm: () 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 zonegroup default 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:00:13.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 started sync module instance, tier type = 2024-09-14T11:00:13.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.664+0000 7ffb46040800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:00:13.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=0 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=1 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=2 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=3 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=4 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=5 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.674+0000 7ffb46040800 20 add_watcher() i=6 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.675+0000 7ffb46040800 20 add_watcher() i=7 2024-09-14T11:00:13.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.675+0000 7ffb46040800 2 all 8 watchers are set, enabling cache 2024-09-14T11:00:13.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:13.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:00:13.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:00:13.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 5 note: GC not initialized 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ff9f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 20 init_complete bucket index max shards: 11 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 20 Filter name: none 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ff9727fc640 20 reqs_thread_entry: start 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.677+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.678+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:13.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.678+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.678+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.678+0000 7ffb46040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.678+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.679+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.679+0000 7ffb46040800 20 rados->read ofs=0 len=0 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.679+0000 7ffb46040800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:00:13.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.679+0000 7ffb46040800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:00:13.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.681+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:00:13.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.683+0000 7ffb46040800 20 remove_watcher() i=0 2024-09-14T11:00:13.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.683+0000 7ffb46040800 2 removed watcher, disabling cache 2024-09-14T11:00:13.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.684+0000 7ffb46040800 20 remove_watcher() i=1 2024-09-14T11:00:13.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.685+0000 7ffb46040800 20 remove_watcher() i=2 2024-09-14T11:00:13.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.686+0000 7ffb46040800 20 remove_watcher() i=3 2024-09-14T11:00:13.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.687+0000 7ffb46040800 20 remove_watcher() i=4 2024-09-14T11:00:13.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.688+0000 7ffb46040800 20 remove_watcher() i=5 2024-09-14T11:00:13.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.689+0000 7ffb46040800 20 remove_watcher() i=6 2024-09-14T11:00:13.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:00:13.690+0000 7ffb46040800 20 remove_watcher() i=7 2024-09-14T11:00:13.701 INFO:tasks.workunit.client.0.smithi029.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:00:13.701 INFO:tasks.workunit.client.0.smithi029.stderr:Deleting bucket check-bucket 2024-09-14T11:00:13.948 INFO:tasks.workunit.client.0.smithi029.stderr:Completed bucket check tests 2024-09-14T11:00:13.948 INFO:tasks.workunit.client.0.smithi029.stdout:connected to http://localhost:80 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ deactivate 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ hash -r 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:00:14.009 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:00:14.010 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset -f deactivate 2024-09-14T11:00:14.010 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK. 2024-09-14T11:00:14.010 INFO:tasks.workunit.client.0.smithi029.stdout:OK. 2024-09-14T11:00:14.011 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:00:14.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:00:14.091 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:00:14.091 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:00:15.215 DEBUG:teuthology.parallel:result is None 2024-09-14T11:00:15.954 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:00:16.003 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:00:16.003 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:00:16.036 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:00:16.037 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:00:16.845 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:00:16.845 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:00:16.846 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:00:16.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:00:16.882 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:00:16.882 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:00:16.957 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:00:16.957 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:00:17.029 INFO:tasks.workunit:timeout=3h 2024-09-14T11:00:17.029 INFO:tasks.workunit:cleanup=True 2024-09-14T11:00:17.029 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:00:17.102 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:01:17.297 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 94% (12145/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:01:17.602 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T11:01:17.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.604 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T11:01:17.604 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.604 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:01:17.604 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:01:17.604 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:01:17.605 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:01:17.676 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:01:17.678 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:01:17.678 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:01:17.729 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:01:17.779 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:01:17.819 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:01:17.821 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:01:17.821 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:01:17.861 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:01:17.865 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:01:17.865 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:01:17.935 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:01:17.936 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:01:17.936 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:01:18.019 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:01:18.020 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:01:18.020 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:18.020 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:01:18.020 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:01:19.643 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:19.644 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: exclusive 2024-09-14T11:01:19.644 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:19.644 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:19.644 INFO:tasks.workunit.client.0.smithi029.stdout: client.5009 expiration=2024-09-14T11:03:19.642553+0000 addr=v1:172.21.15.29:0/2551328119 cookie= 2024-09-14T11:01:19.648 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:19.648 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: shared 2024-09-14T11:01:19.649 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:19.649 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:19.649 INFO:tasks.workunit.client.0.smithi029.stdout: client.5009 expiration=2024-09-14T11:03:19.650591+0000 addr=v1:172.21.15.29:0/2551328119 cookie= 2024-09-14T11:01:19.649 INFO:tasks.workunit.client.0.smithi029.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.29:0/3871108581 cookie= 2024-09-14T11:01:19.650 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:19.650 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: shared 2024-09-14T11:01:19.650 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:19.650 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:19.650 INFO:tasks.workunit.client.0.smithi029.stdout: client.5178 expiration=0.000000 addr=v1:172.21.15.29:0/3871108581 cookie= 2024-09-14T11:01:20.616 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestMultiLocking (2596 ms) 2024-09-14T11:01:20.616 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:01:22.652 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:22.652 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: shared 2024-09-14T11:01:22.652 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:22.652 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:22.652 INFO:tasks.workunit.client.0.smithi029.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.29:0/965421809 cookie= 2024-09-14T11:01:22.654 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:22.654 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: exclusive 2024-09-14T11:01:22.654 INFO:tasks.workunit.client.0.smithi029.stdout: tag: new_tag 2024-09-14T11:01:22.654 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:22.654 INFO:tasks.workunit.client.0.smithi029.stdout: client.5187 expiration=0.000000 addr=v1:172.21.15.29:0/2955296569 cookie= 2024-09-14T11:01:23.638 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestMeta (3022 ms) 2024-09-14T11:01:23.638 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:01:25.670 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:25.670 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: exclusive 2024-09-14T11:01:25.670 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:25.670 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout:lock: mylock 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout: lock_type: shared 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout: tag: 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout: lockers: 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.29:0/3643430301 cookie= 2024-09-14T11:01:25.672 INFO:tasks.workunit.client.0.smithi029.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.29:0/3643430301 cookie=new cookie 2024-09-14T11:01:26.658 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestCookie (3021 ms) 2024-09-14T11:01:26.658 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:01:29.677 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestMultipleLocks (3016 ms) 2024-09-14T11:01:29.677 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:01:37.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestLockDuration (8024 ms) 2024-09-14T11:01:37.700 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:01:40.730 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestAssertLocked (3031 ms) 2024-09-14T11:01:40.731 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:01:43.745 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestSetCookie (3015 ms) 2024-09-14T11:01:43.745 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:02:04.591 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestRenew (20845 ms) 2024-09-14T11:02:04.591 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:02:10.668 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6077 ms) 2024-09-14T11:02:10.668 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:02:17.750 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7083 ms) 2024-09-14T11:02:17.750 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:02:25.778 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8028 ms) 2024-09-14T11:02:25.779 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from ClsLock (67759 ms total) 2024-09-14T11:02:25.779 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:02:25.779 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:25.779 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 11 tests from 1 test suite ran. (67759 ms total) 2024-09-14T11:02:25.779 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 11 tests. 2024-09-14T11:02:25.783 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:02:25.783 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:02:25.830 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:02:25.831 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:02:25.831 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from cls_log 2024-09-14T11:02:25.919 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:02:28.805 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_log.test_log_add_same_time (2886 ms) 2024-09-14T11:02:28.805 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:02:31.818 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_log.test_log_add_different_time (3014 ms) 2024-09-14T11:02:31.818 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:02:34.831 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_log.trim_by_time (3013 ms) 2024-09-14T11:02:34.832 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:02:37.844 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_log.trim_by_marker (3013 ms) 2024-09-14T11:02:37.845 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from cls_log (11926 ms total) 2024-09-14T11:02:37.845 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:02:37.845 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:37.845 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 4 tests from 1 test suite ran. (11926 ms total) 2024-09-14T11:02:37.845 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 4 tests. 2024-09-14T11:02:37.848 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:02:37.848 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:02:37.892 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:02:37.893 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:02:37.894 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:02:37.942 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:02:37.942 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:02:37.942 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:37.943 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:02:37.943 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:02:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_implicit (2923 ms) 2024-09-14T11:02:40.865 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:02:43.876 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3011 ms) 2024-09-14T11:02:43.877 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:02:52.921 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_put_snap (9045 ms) 2024-09-14T11:02:52.921 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:02:55.941 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_explicit (3019 ms) 2024-09-14T11:02:55.941 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:02:58.963 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.set (3023 ms) 2024-09-14T11:02:58.964 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:03:05.988 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_implicit_ec (7025 ms) 2024-09-14T11:03:05.988 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:03:13.004 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7016 ms) 2024-09-14T11:03:13.004 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:03:26.053 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_put_snap_ec (13048 ms) 2024-09-14T11:03:26.053 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:03:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.test_explicit_ec (7016 ms) 2024-09-14T11:03:33.069 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:03:40.109 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_refcount.set_ec (7041 ms) 2024-09-14T11:03:40.110 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 10 tests from cls_refcount (62167 ms total) 2024-09-14T11:03:40.110 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:03:40.110 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:40.110 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 10 tests from 1 test suite ran. (62167 ms total) 2024-09-14T11:03:40.110 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 10 tests. 2024-09-14T11:03:40.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:03:40.113 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:03:40.159 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:03:40.160 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:03:40.160 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:03:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:03:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:03:40.207 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:40.208 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:03:42.127 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:03:42.167 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_basic (40 ms) 2024-09-14T11:03:42.167 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:03:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (31 ms) 2024-09-14T11:03:42.199 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:03:42.243 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_remove_object (44 ms) 2024-09-14T11:03:42.243 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:03:43.728 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_suggest (1486 ms) 2024-09-14T11:03:43.728 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:03:43.735 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-14T11:03:43.736 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:03:43.759 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_list (23 ms) 2024-09-14T11:03:43.759 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:04:03.059 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_list_delimited (19300 ms) 2024-09-14T11:04:03.059 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:04:03.133 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.bi_list (75 ms) 2024-09-14T11:04:03.134 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:04:03.144 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-14T11:04:03.144 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:04:03.154 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-14T11:04:03.154 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:04:11.238 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.gc_defer (8084 ms) 2024-09-14T11:04:11.239 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:04:11.351 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.usage_basic (112 ms) 2024-09-14T11:04:11.351 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:04:11.352 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-14T11:04:11.352 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:04:11.445 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.usage_clear (93 ms) 2024-09-14T11:04:11.445 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:04:11.488 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.bi_log_trim (43 ms) 2024-09-14T11:04:11.488 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:04:11.503 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-14T11:04:11.503 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:04:11.517 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.reshardlog_list (14 ms) 2024-09-14T11:04:11.517 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:04:11.527 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-14T11:04:12.241 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 18 tests from cls_rgw (29399 ms total) 2024-09-14T11:04:12.242 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:04:12.242 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:12.242 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 18 tests from 1 test suite ran. (32034 ms total) 2024-09-14T11:04:12.242 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 18 tests. 2024-09-14T11:04:12.245 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:04:12.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:04:12.290 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:04:12.291 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:04:12.291 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:04:12.381 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:04:12.381 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:04:12.381 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:12.381 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:04:12.381 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:04:14.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.init (1874 ms) 2024-09-14T11:04:14.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:04:14.280 INFO:tasks.workunit.client.0.smithi029.stderr:[ ] list info tag = chain-0 2024-09-14T11:04:14.281 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (26 ms) 2024-09-14T11:04:14.281 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:04:14.289 INFO:tasks.workunit.client.0.smithi029.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:04:14.290 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (10 ms) 2024-09-14T11:04:14.290 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:04:14.300 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (10 ms) 2024-09-14T11:04:14.300 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:04:14.581 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (280 ms) 2024-09-14T11:04:14.581 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:04:14.591 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (10 ms) 2024-09-14T11:04:14.591 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:04:14.599 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (9 ms) 2024-09-14T11:04:14.600 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:04:14.608 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (8 ms) 2024-09-14T11:04:14.608 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:04:15.261 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_gc.finalize (654 ms) 2024-09-14T11:04:15.261 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from cls_rgw_gc (2881 ms total) 2024-09-14T11:04:15.261 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:04:15.261 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:15.261 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 9 tests from 1 test suite ran. (2881 ms total) 2024-09-14T11:04:15.262 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 9 tests. 2024-09-14T11:04:15.265 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:04:15.265 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:04:15.311 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:04:15.313 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:04:15.313 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:04:15.370 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:15.370 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:15.370 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:04:15.370 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:17.264 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:04:17.264 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:04:17.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.289+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~K2T3KXMPWK4F.0 size=631548 2024-09-14T11:04:17.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.289+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=K2T3KXMPWK4F tag=XPXEAG8EHCE8 type=write size=1680124 2024-09-14T11:04:17.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.290+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=WP2D72ZSCPI0 type=del size=2576542 2024-09-14T11:04:17.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.291+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=1MGFQ6YHKEGD type=del size=2155481 2024-09-14T11:04:17.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.293+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=AKMVVGSKOHO1 type=del size=2061054 2024-09-14T11:04:17.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.296+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~H0UXQHZZMRE9.0 size=843648 2024-09-14T11:04:17.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.296+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=H0UXQHZZMRE9 tag=TZMALKBPRV3W type=write size=1892224 2024-09-14T11:04:17.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.297+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=H1F9JKY8ORL4 type=del size=2731228 2024-09-14T11:04:17.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.298+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=DN0ZM6673IA4 type=del size=3852016 2024-09-14T11:04:17.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.300+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=X8TFAHAITVHI type=del size=778416 2024-09-14T11:04:17.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.301+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=94R4AFKQMR4N type=write size=539365 2024-09-14T11:04:17.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.303+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=CHE98FK8Y5VH type=del size=2035691 2024-09-14T11:04:17.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.304+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=HXC3VUC0E32B type=del size=2692013 2024-09-14T11:04:17.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.306+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=UMEF0Y7BO13Y type=del size=3475511 2024-09-14T11:04:17.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.307+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=7SNMNC982NUF type=del size=3606656 2024-09-14T11:04:17.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.308+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=0UYT2L7HH49P type=del size=3036009 2024-09-14T11:04:17.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.311+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.0 size=1048576 2024-09-14T11:04:17.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.312+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.1 size=1048576 2024-09-14T11:04:17.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.313+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.2 size=91921 2024-09-14T11:04:17.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.313+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=5WOCDIWCDQRN tag=GR9WT8K8V7PB type=write size=3237649 2024-09-14T11:04:17.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.314+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=BEZYRT9QTZ2G type=del size=3049102 2024-09-14T11:04:17.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.316+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~K2T3KXMPWK4F.0 size=631548 2024-09-14T11:04:17.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.318+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=K2T3KXMPWK4F tag=XPXEAG8EHCE8 type=write size=1680124 2024-09-14T11:04:17.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.319+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=C580BZ0678ZP type=del size=4164919 2024-09-14T11:04:17.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.321+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=WP2D72ZSCPI0 type=del 2024-09-14T11:04:17.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.322+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=YBUBO852TBP4 type=del size=1623787 2024-09-14T11:04:17.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.324+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=1MGFQ6YHKEGD type=del 2024-09-14T11:04:17.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.325+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=3BKHKVBDG10J type=write size=17055 2024-09-14T11:04:17.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.328+0000 7f907bbdf780 1 < suggested remove operation key=AGMKZ7PGPUAM tag=AKMVVGSKOHO1 type=del 2024-09-14T11:04:17.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.330+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~58CFYVXFXGJT.0 size=1048576 2024-09-14T11:04:17.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.331+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~58CFYVXFXGJT.1 size=769072 2024-09-14T11:04:17.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.331+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=58CFYVXFXGJT tag=GCH6NGC0ZT2P type=write size=2866224 2024-09-14T11:04:17.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.333+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~H0UXQHZZMRE9.0 size=843648 2024-09-14T11:04:17.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.335+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=H0UXQHZZMRE9 tag=TZMALKBPRV3W type=write size=1892224 2024-09-14T11:04:17.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.336+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=Q7MQLSE9T1S8 type=del size=1057809 2024-09-14T11:04:17.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.338+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=H1F9JKY8ORL4 type=del 2024-09-14T11:04:17.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.339+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=QBQNBRL5TQBG type=del size=2786443 2024-09-14T11:04:17.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.340+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=DN0ZM6673IA4 type=del 2024-09-14T11:04:17.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.342+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=MN0OFH5WBEQP type=del size=900749 2024-09-14T11:04:17.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.343+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=X8TFAHAITVHI type=del 2024-09-14T11:04:17.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.344+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=8NZSCHJ40TQ7 type=del size=3857413 2024-09-14T11:04:17.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.346+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=94R4AFKQMR4N type=write size=539365 2024-09-14T11:04:17.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.347+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=EWP87DZMFUO3 type=del size=4017919 2024-09-14T11:04:17.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.348+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=CHE98FK8Y5VH type=del 2024-09-14T11:04:17.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.350+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~BKHDK3E5WK86.0 size=868479 2024-09-14T11:04:17.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.350+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=BKHDK3E5WK86 tag=1YWCA9A7NXL2 type=write size=1917055 2024-09-14T11:04:17.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.352+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=HXC3VUC0E32B type=del 2024-09-14T11:04:17.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.354+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=E9PZW3PE846K type=del size=2773906 2024-09-14T11:04:17.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.355+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=UMEF0Y7BO13Y type=del 2024-09-14T11:04:17.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.356+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=PZYE7M4MIWYD type=del size=3196492 2024-09-14T11:04:17.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.357+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=7SNMNC982NUF type=del 2024-09-14T11:04:17.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.359+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=GK65WIVB9SK8 type=del size=3277616 2024-09-14T11:04:17.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.360+0000 7f907bbdf780 1 < canceled operation key=T79IR10S3HAB tag=0UYT2L7HH49P type=del size=3036009 2024-09-14T11:04:17.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.362+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.0 size=1048576 2024-09-14T11:04:17.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.363+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.1 size=1048576 2024-09-14T11:04:17.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.364+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.2 size=822200 2024-09-14T11:04:17.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.364+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=CQFKPF9SZBYN tag=A33F02ZWQHXK type=write size=3967928 2024-09-14T11:04:17.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.366+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.0 size=1048576 2024-09-14T11:04:17.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.367+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.1 size=1048576 2024-09-14T11:04:17.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.368+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~5WOCDIWCDQRN.2 size=91921 2024-09-14T11:04:17.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.370+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=5WOCDIWCDQRN tag=GR9WT8K8V7PB type=write size=3237649 2024-09-14T11:04:17.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.372+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.0 size=1048576 2024-09-14T11:04:17.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.373+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.1 size=1048576 2024-09-14T11:04:17.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.374+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.2 size=696262 2024-09-14T11:04:17.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.374+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=BNX1MEO92RUY tag=JEQ4Q1KQ5WLG type=write size=3841990 2024-09-14T11:04:17.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.377+0000 7f907bbdf780 1 < suggested update operation key=YH0YMRDQERBF tag=BEZYRT9QTZ2G type=del size=3049102 2024-09-14T11:04:17.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.378+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=YL8973QGR75C type=write size=646103 2024-09-14T11:04:17.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.379+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=C580BZ0678ZP type=del 2024-09-14T11:04:17.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.380+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=135V9OZXR857 type=del size=412912 2024-09-14T11:04:17.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.382+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=YBUBO852TBP4 type=del 2024-09-14T11:04:17.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.383+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=NKUR2WPXRFBU type=del size=2055154 2024-09-14T11:04:17.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.385+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=3BKHKVBDG10J type=write size=17055 2024-09-14T11:04:17.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.387+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=MD1Y5LOJJFPL type=del size=820531 2024-09-14T11:04:17.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.388+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~58CFYVXFXGJT.0 size=1048576 2024-09-14T11:04:17.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.389+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~58CFYVXFXGJT.1 size=769072 2024-09-14T11:04:17.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.391+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=58CFYVXFXGJT tag=GCH6NGC0ZT2P type=write size=2866224 2024-09-14T11:04:17.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.392+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=Y3X359ZA8DHS type=del size=1694558 2024-09-14T11:04:17.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.393+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=Q7MQLSE9T1S8 type=del size=1057809 2024-09-14T11:04:17.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.396+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~L0TIGNXKBG4H.0 size=1048576 2024-09-14T11:04:17.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.397+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~L0TIGNXKBG4H.1 size=299468 2024-09-14T11:04:17.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.397+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=L0TIGNXKBG4H tag=CF383T9U2K0P type=write size=2396620 2024-09-14T11:04:17.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.398+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=QBQNBRL5TQBG type=del 2024-09-14T11:04:17.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.400+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~9CADFP0Q7IBF.0 size=924079 2024-09-14T11:04:17.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.400+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=9CADFP0Q7IBF tag=3ZK6E80TJ50O type=write size=1972655 2024-09-14T11:04:17.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.403+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=MN0OFH5WBEQP type=del size=900749 2024-09-14T11:04:17.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.405+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~T7WWJ5UWXSHP.0 size=1048576 2024-09-14T11:04:17.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.406+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~T7WWJ5UWXSHP.1 size=571876 2024-09-14T11:04:17.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.406+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=T7WWJ5UWXSHP tag=DHW435RJ0EXB type=write size=2669028 2024-09-14T11:04:17.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.409+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=8NZSCHJ40TQ7 type=del size=3857413 2024-09-14T11:04:17.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.412+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~JBIZREC1Z3D9.0 size=1048576 2024-09-14T11:04:17.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.413+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~JBIZREC1Z3D9.1 size=1000550 2024-09-14T11:04:17.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.413+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=JBIZREC1Z3D9 tag=JX5D55TZ1POO type=write size=3097702 2024-09-14T11:04:17.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.414+0000 7f907bbdf780 -1 < failed to complete operation key=YH0YMRDQERBF tag=EWP87DZMFUO3 type=del size=4017919: (22) Invalid argument 2024-09-14T11:04:17.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.416+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=K1CUT99RM5JL type=write size=636367 2024-09-14T11:04:17.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.416+0000 7f907bbdf780 1 < canceled part key=_multipart_WZ064RU647Y7.2~BKHDK3E5WK86.0 size=868479 2024-09-14T11:04:17.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.418+0000 7f907bbdf780 1 < canceled multipart upload key=WZ064RU647Y7 upload=BKHDK3E5WK86 tag=1YWCA9A7NXL2 type=write size=1917055 2024-09-14T11:04:17.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.420+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=7XAO72E10N5X type=del size=694773 2024-09-14T11:04:17.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.421+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=E9PZW3PE846K type=del 2024-09-14T11:04:17.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.423+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~EI5588V6LNLO.0 size=1044165 2024-09-14T11:04:17.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.423+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=EI5588V6LNLO tag=ICZXHIYE331O type=write size=2092741 2024-09-14T11:04:17.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.426+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=PZYE7M4MIWYD type=del 2024-09-14T11:04:17.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.427+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=J6D4CO6UZCQ0 type=del size=475869 2024-09-14T11:04:17.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.429+0000 7f907bbdf780 1 < suggested update operation key=Y3KOCA4072NM tag=GK65WIVB9SK8 type=del size=3277616 2024-09-14T11:04:17.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.431+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=SQ0BS5WFLUT1 type=del size=3178037 2024-09-14T11:04:17.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.432+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.0 size=1048576 2024-09-14T11:04:17.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.433+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.1 size=1048576 2024-09-14T11:04:17.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.433+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~CQFKPF9SZBYN.2 size=822200 2024-09-14T11:04:17.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.435+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=CQFKPF9SZBYN tag=A33F02ZWQHXK type=write size=3967928 2024-09-14T11:04:17.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.436+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=C457D8GRNWRB type=del size=3383115 2024-09-14T11:04:17.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.437+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.0 size=1048576 2024-09-14T11:04:17.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.438+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.1 size=1048576 2024-09-14T11:04:17.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.439+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~BNX1MEO92RUY.2 size=696262 2024-09-14T11:04:17.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.441+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=BNX1MEO92RUY tag=JEQ4Q1KQ5WLG type=write size=3841990 2024-09-14T11:04:17.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.443+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~CZ09NM207OKU.0 size=81852 2024-09-14T11:04:17.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.443+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=CZ09NM207OKU tag=JD6M7E1HQEFQ type=write size=1130428 2024-09-14T11:04:17.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.445+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=YL8973QGR75C type=write size=646103 2024-09-14T11:04:17.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.446+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=JNNZ60DWJSEH type=del size=3480894 2024-09-14T11:04:17.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.447+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=135V9OZXR857 type=del size=412912 2024-09-14T11:04:17.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.449+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~K2MYDF50MLQ6.0 size=1048576 2024-09-14T11:04:17.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.450+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~K2MYDF50MLQ6.1 size=549112 2024-09-14T11:04:17.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.450+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=K2MYDF50MLQ6 tag=4IJUQMXNCU5E type=write size=2646264 2024-09-14T11:04:17.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.452+0000 7f907bbdf780 1 < suggested update operation key=GC52N456IYD7 tag=NKUR2WPXRFBU type=del size=2055154 2024-09-14T11:04:17.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.454+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=GNCD20S2SU63 type=write size=393561 2024-09-14T11:04:17.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.455+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=MD1Y5LOJJFPL type=del 2024-09-14T11:04:17.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.456+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=EATXDBQO7XYL type=del size=2084344 2024-09-14T11:04:17.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.457+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=Y3X359ZA8DHS type=del 2024-09-14T11:04:17.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.460+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~1BA78REM2WZ5.0 size=270944 2024-09-14T11:04:17.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.460+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=1BA78REM2WZ5 tag=7SNFGDIMAXYN type=write size=1319520 2024-09-14T11:04:17.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.461+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~L0TIGNXKBG4H.0 size=1048576 2024-09-14T11:04:17.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.462+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~L0TIGNXKBG4H.1 size=299468 2024-09-14T11:04:17.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.464+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=L0TIGNXKBG4H tag=CF383T9U2K0P type=write size=2396620 2024-09-14T11:04:17.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.466+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.0 size=1048576 2024-09-14T11:04:17.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.467+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.1 size=1048576 2024-09-14T11:04:17.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.468+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.2 size=954321 2024-09-14T11:04:17.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.468+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=XM54WI68W8VN tag=ESO5OF1A18LZ type=write size=4100049 2024-09-14T11:04:17.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.469+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~9CADFP0Q7IBF.0 size=924079 2024-09-14T11:04:17.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.471+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=9CADFP0Q7IBF tag=3ZK6E80TJ50O type=write size=1972655 2024-09-14T11:04:17.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.473+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=W8KTYCM3QWIB type=del size=2613562 2024-09-14T11:04:17.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.474+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~T7WWJ5UWXSHP.0 size=1048576 2024-09-14T11:04:17.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.475+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~T7WWJ5UWXSHP.1 size=571876 2024-09-14T11:04:17.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.477+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=T7WWJ5UWXSHP tag=DHW435RJ0EXB type=write size=2669028 2024-09-14T11:04:17.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.479+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~1XOWN2P90KQC.0 size=337518 2024-09-14T11:04:17.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.479+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=1XOWN2P90KQC tag=K2TO2HLW5NGN type=write size=1386094 2024-09-14T11:04:17.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.480+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~JBIZREC1Z3D9.0 size=1048576 2024-09-14T11:04:17.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.481+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~JBIZREC1Z3D9.1 size=1000550 2024-09-14T11:04:17.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.483+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=JBIZREC1Z3D9 tag=JX5D55TZ1POO type=write size=3097702 2024-09-14T11:04:17.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.485+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.0 size=1048576 2024-09-14T11:04:17.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.486+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.1 size=1048576 2024-09-14T11:04:17.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.487+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.2 size=154857 2024-09-14T11:04:17.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.487+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=KOKUHARWLU5H tag=GHC17VCZHKK4 type=write size=3300585 2024-09-14T11:04:17.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.488+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=K1CUT99RM5JL type=write size=636367 2024-09-14T11:04:17.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.490+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.0 size=1048576 2024-09-14T11:04:17.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.491+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.1 size=1048576 2024-09-14T11:04:17.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.492+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.2 size=47276 2024-09-14T11:04:17.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.492+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=NO4XCZOPMRMU tag=DQRK7NQWSS52 type=write size=3193004 2024-09-14T11:04:17.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.494+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=7XAO72E10N5X type=del 2024-09-14T11:04:17.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.495+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=E7BOF8QU7DUQ type=del size=2161507 2024-09-14T11:04:17.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.496+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~EI5588V6LNLO.0 size=1044165 2024-09-14T11:04:17.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.498+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=EI5588V6LNLO tag=ICZXHIYE331O type=write size=2092741 2024-09-14T11:04:17.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.499+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=C4ST0B3QLWI5 type=del size=4020838 2024-09-14T11:04:17.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.501+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=J6D4CO6UZCQ0 type=del 2024-09-14T11:04:17.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.502+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=E4GKW3UC64UY type=del size=3887260 2024-09-14T11:04:17.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.504+0000 7f907bbdf780 1 < suggested remove operation key=E3OIUTR3JCQY tag=SQ0BS5WFLUT1 type=del 2024-09-14T11:04:17.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.506+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=6UH7FA0M0HQN type=del size=3891393 2024-09-14T11:04:17.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.507+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=C457D8GRNWRB type=del 2024-09-14T11:04:17.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.508+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=QHTAS6A4OHWW type=del size=460731 2024-09-14T11:04:17.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.509+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~CZ09NM207OKU.0 size=81852 2024-09-14T11:04:17.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.511+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=CZ09NM207OKU tag=JD6M7E1HQEFQ type=write size=1130428 2024-09-14T11:04:17.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.513+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=L6TGI46A07F3 type=del size=2618926 2024-09-14T11:04:17.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.514+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=JNNZ60DWJSEH type=del 2024-09-14T11:04:17.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.516+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~UTPQRQ709YLW.0 size=118702 2024-09-14T11:04:17.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.516+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=UTPQRQ709YLW tag=4RTZCB8MIB78 type=write size=1167278 2024-09-14T11:04:17.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.517+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~K2MYDF50MLQ6.0 size=1048576 2024-09-14T11:04:17.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.517+0000 7f907bbdf780 1 < canceled part key=_multipart_5C8LLJF5MSVP.2~K2MYDF50MLQ6.1 size=549112 2024-09-14T11:04:17.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.519+0000 7f907bbdf780 1 < canceled multipart upload key=5C8LLJF5MSVP upload=K2MYDF50MLQ6 tag=4IJUQMXNCU5E type=write size=2646264 2024-09-14T11:04:17.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.520+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=I0GC0VZBSNBH type=del size=2012151 2024-09-14T11:04:17.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.523+0000 7f907bbdf780 1 < suggested update operation key=GC52N456IYD7 tag=GNCD20S2SU63 type=write size=393561 2024-09-14T11:04:17.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.525+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~UR4Z6KXSX6L1.0 size=1048576 2024-09-14T11:04:17.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.526+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~UR4Z6KXSX6L1.1 size=236233 2024-09-14T11:04:17.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.526+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=UR4Z6KXSX6L1 tag=0QHOEKJM9KYG type=write size=2333385 2024-09-14T11:04:17.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.527+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=EATXDBQO7XYL type=del 2024-09-14T11:04:17.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.528+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=IIVZM8EJCXGF type=del size=3023606 2024-09-14T11:04:17.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.529+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~1BA78REM2WZ5.0 size=270944 2024-09-14T11:04:17.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.531+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=1BA78REM2WZ5 tag=7SNFGDIMAXYN type=write size=1319520 2024-09-14T11:04:17.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.533+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=V1A0KEGSLMCT type=write size=643764 2024-09-14T11:04:17.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.534+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.0 size=1048576 2024-09-14T11:04:17.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.535+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.1 size=1048576 2024-09-14T11:04:17.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.536+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XM54WI68W8VN.2 size=954321 2024-09-14T11:04:17.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.538+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=XM54WI68W8VN tag=ESO5OF1A18LZ type=write size=4100049 2024-09-14T11:04:17.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.540+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=EVI2G1HWXQ81 type=del size=3362727 2024-09-14T11:04:17.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.541+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=W8KTYCM3QWIB type=del 2024-09-14T11:04:17.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.542+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=0PFT4UFO8K64 type=del size=1357678 2024-09-14T11:04:17.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.543+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~1XOWN2P90KQC.0 size=337518 2024-09-14T11:04:17.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.545+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=1XOWN2P90KQC tag=K2TO2HLW5NGN type=write size=1386094 2024-09-14T11:04:17.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.547+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~8RHRP6F0YW2V.0 size=1048576 2024-09-14T11:04:17.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.548+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~8RHRP6F0YW2V.1 size=264223 2024-09-14T11:04:17.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.548+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=8RHRP6F0YW2V tag=83ZJGKFXO6L2 type=write size=2361375 2024-09-14T11:04:17.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.549+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.0 size=1048576 2024-09-14T11:04:17.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.550+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.1 size=1048576 2024-09-14T11:04:17.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.551+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~KOKUHARWLU5H.2 size=154857 2024-09-14T11:04:17.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.553+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=KOKUHARWLU5H tag=GHC17VCZHKK4 type=write size=3300585 2024-09-14T11:04:17.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.554+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=SGFVJRW01R5O type=del size=658282 2024-09-14T11:04:17.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.556+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.0 size=1048576 2024-09-14T11:04:17.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.557+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.1 size=1048576 2024-09-14T11:04:17.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.558+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~NO4XCZOPMRMU.2 size=47276 2024-09-14T11:04:17.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.559+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=NO4XCZOPMRMU tag=DQRK7NQWSS52 type=write size=3193004 2024-09-14T11:04:17.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.561+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=KZ97QURQ0DV8 type=del size=4109399 2024-09-14T11:04:17.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.562+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=E7BOF8QU7DUQ type=del 2024-09-14T11:04:17.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.563+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=N3GBRJZRI7ZO type=write size=875824 2024-09-14T11:04:17.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.564+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=C4ST0B3QLWI5 type=del 2024-09-14T11:04:17.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.566+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=A316FKFW0MSN type=del size=1299519 2024-09-14T11:04:17.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.568+0000 7f907bbdf780 1 < suggested update operation key=HM2GVOA72HHR tag=E4GKW3UC64UY type=del size=3887260 2024-09-14T11:04:17.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.570+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~B8XG6HWORZMH.0 size=1048576 2024-09-14T11:04:17.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.571+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~B8XG6HWORZMH.1 size=1018486 2024-09-14T11:04:17.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.571+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=B8XG6HWORZMH tag=F2JN1ONZ8P7Z type=write size=3115638 2024-09-14T11:04:17.571 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.574+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=6UH7FA0M0HQN type=del 2024-09-14T11:04:17.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.575+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=KQ7LYUCDPF16 type=del size=2441769 2024-09-14T11:04:17.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.576+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=QHTAS6A4OHWW type=del 2024-09-14T11:04:17.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.577+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=1PN4CU0H9V3H type=del size=2951942 2024-09-14T11:04:17.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.579+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=L6TGI46A07F3 type=del 2024-09-14T11:04:17.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.580+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=4F06S0ZS09S6 type=del size=3566924 2024-09-14T11:04:17.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.581+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~UTPQRQ709YLW.0 size=118702 2024-09-14T11:04:17.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.583+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=UTPQRQ709YLW tag=4RTZCB8MIB78 type=write size=1167278 2024-09-14T11:04:17.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.584+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=KC6POXJTO4T1 type=del size=1824664 2024-09-14T11:04:17.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.586+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=I0GC0VZBSNBH type=del 2024-09-14T11:04:17.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.587+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=6AFXJL7NVB8A type=del size=950865 2024-09-14T11:04:17.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.588+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~UR4Z6KXSX6L1.0 size=1048576 2024-09-14T11:04:17.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.589+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~UR4Z6KXSX6L1.1 size=236233 2024-09-14T11:04:17.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.591+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=UR4Z6KXSX6L1 tag=0QHOEKJM9KYG type=write size=2333385 2024-09-14T11:04:17.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.592+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=VSEBA0WIMR8Y type=write size=749794 2024-09-14T11:04:17.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.593+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=IIVZM8EJCXGF type=del 2024-09-14T11:04:17.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.595+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=NKA27F46IA54 type=del size=3935778 2024-09-14T11:04:17.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.597+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=V1A0KEGSLMCT type=write 2024-09-14T11:04:17.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.598+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=N1JNWK3K0JGF type=del size=818499 2024-09-14T11:04:17.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.600+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=EVI2G1HWXQ81 type=del 2024-09-14T11:04:17.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.601+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=22X5DHUXCQJ9 type=write size=297632 2024-09-14T11:04:17.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.602+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=0PFT4UFO8K64 type=del 2024-09-14T11:04:17.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.603+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=M956YK16MTL9 type=del size=2175571 2024-09-14T11:04:17.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.605+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~8RHRP6F0YW2V.0 size=1048576 2024-09-14T11:04:17.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.606+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~8RHRP6F0YW2V.1 size=264223 2024-09-14T11:04:17.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.607+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=8RHRP6F0YW2V tag=83ZJGKFXO6L2 type=write size=2361375 2024-09-14T11:04:17.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.610+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.0 size=1048576 2024-09-14T11:04:17.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.611+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.1 size=1048576 2024-09-14T11:04:17.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.611+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.2 size=435502 2024-09-14T11:04:17.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.611+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=Z1MP4AQYMFJ2 tag=KOH7UH7ERDTX type=write size=3581230 2024-09-14T11:04:17.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.613+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=SGFVJRW01R5O type=del 2024-09-14T11:04:17.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.615+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.0 size=1048576 2024-09-14T11:04:17.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.616+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.1 size=1048576 2024-09-14T11:04:17.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.616+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.2 size=192907 2024-09-14T11:04:17.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.616+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=B1EMR90ZYM1Q tag=T6A45LZEIRRI type=write size=3338635 2024-09-14T11:04:17.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.619+0000 7f907bbdf780 1 < suggested update operation key=LQNZKMX52SWO tag=KZ97QURQ0DV8 type=del size=4109399 2024-09-14T11:04:17.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.621+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~F7CAEAZG7KO7.0 size=1048576 2024-09-14T11:04:17.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.622+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~F7CAEAZG7KO7.1 size=647342 2024-09-14T11:04:17.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.622+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=F7CAEAZG7KO7 tag=3Q43AGBEVF6V type=write size=2744494 2024-09-14T11:04:17.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.623+0000 7f907bbdf780 1 < completed write operation key=8FRZW4YC3ATE tag=N3GBRJZRI7ZO type=write size=875824 2024-09-14T11:04:17.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.625+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~1857CMSOAQZJ.0 size=1048576 2024-09-14T11:04:17.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.626+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~1857CMSOAQZJ.1 size=785933 2024-09-14T11:04:17.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.626+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=1857CMSOAQZJ tag=89OBF65OX3O7 type=write size=2883085 2024-09-14T11:04:17.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.629+0000 7f907bbdf780 1 < suggested remove operation key=S8RIEED24PUM tag=A316FKFW0MSN type=del 2024-09-14T11:04:17.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.631+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~QA1TESPLY1DO.0 size=838452 2024-09-14T11:04:17.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.631+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=QA1TESPLY1DO tag=SQC10GO9QXAN type=write size=1887028 2024-09-14T11:04:17.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.632+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~B8XG6HWORZMH.0 size=1048576 2024-09-14T11:04:17.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.633+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~B8XG6HWORZMH.1 size=1018486 2024-09-14T11:04:17.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.635+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=B8XG6HWORZMH tag=F2JN1ONZ8P7Z type=write size=3115638 2024-09-14T11:04:17.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.637+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=AOIHJ5VNDUG8 type=del size=87986 2024-09-14T11:04:17.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.638+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=KQ7LYUCDPF16 type=del 2024-09-14T11:04:17.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.640+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~ECN7M4Z49ACG.0 size=755760 2024-09-14T11:04:17.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.640+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=ECN7M4Z49ACG tag=2QML1LPLULVG type=write size=1804336 2024-09-14T11:04:17.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.642+0000 7f907bbdf780 1 < canceled operation key=P546JCSFB00N tag=1PN4CU0H9V3H type=del size=2951942 2024-09-14T11:04:17.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.644+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~L9DGRTTI5VMG.0 size=1048576 2024-09-14T11:04:17.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.645+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~L9DGRTTI5VMG.1 size=760777 2024-09-14T11:04:17.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.645+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=L9DGRTTI5VMG tag=WL0QGFXPUUAE type=write size=2857929 2024-09-14T11:04:17.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.646+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=4F06S0ZS09S6 type=del 2024-09-14T11:04:17.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.647+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=PCO4CP0OK8M1 type=del size=776157 2024-09-14T11:04:17.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.648+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=KC6POXJTO4T1 type=del size=1824664 2024-09-14T11:04:17.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.650+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=9YZ7PFRHUZIM type=del size=573431 2024-09-14T11:04:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.652+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=6AFXJL7NVB8A type=del 2024-09-14T11:04:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.654+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.0 size=1048576 2024-09-14T11:04:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.655+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.1 size=1048576 2024-09-14T11:04:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.656+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.2 size=34725 2024-09-14T11:04:17.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.656+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=JRLHZD0DV7RN tag=VYJLBUCDFI1X type=write size=3180453 2024-09-14T11:04:17.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.657+0000 7f907bbdf780 1 < completed write operation key=8C398XZ7XKU7 tag=VSEBA0WIMR8Y type=write size=749794 2024-09-14T11:04:17.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.659+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~6F9MRQ13SFJM.0 size=1048576 2024-09-14T11:04:17.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.660+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~6F9MRQ13SFJM.1 size=550180 2024-09-14T11:04:17.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.660+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=6F9MRQ13SFJM tag=3UEQ5CV82EGA type=write size=2647332 2024-09-14T11:04:17.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.661+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=NKA27F46IA54 type=del 2024-09-14T11:04:17.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.663+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~1ATWDIKPIBZH.0 size=1048576 2024-09-14T11:04:17.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.664+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~1ATWDIKPIBZH.1 size=352144 2024-09-14T11:04:17.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.664+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=1ATWDIKPIBZH tag=B3YMSST1T9XB type=write size=2449296 2024-09-14T11:04:17.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.665+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=N1JNWK3K0JGF type=del 2024-09-14T11:04:17.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.667+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=VC8A4UXCSNXE type=del size=870926 2024-09-14T11:04:17.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.668+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=22X5DHUXCQJ9 type=write size=297632 2024-09-14T11:04:17.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.670+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~8XLSDI3HJ59Q.0 size=1004793 2024-09-14T11:04:17.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.670+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=8XLSDI3HJ59Q tag=4VE0UKH9UC0A type=write size=2053369 2024-09-14T11:04:17.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.671+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=M956YK16MTL9 type=del 2024-09-14T11:04:17.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.673+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~YZTL95IUT5K3.0 size=1048576 2024-09-14T11:04:17.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.674+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~YZTL95IUT5K3.1 size=474504 2024-09-14T11:04:17.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.674+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=YZTL95IUT5K3 tag=3FYC2644O4S9 type=write size=2571656 2024-09-14T11:04:17.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.675+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.0 size=1048576 2024-09-14T11:04:17.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.676+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.1 size=1048576 2024-09-14T11:04:17.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.677+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~Z1MP4AQYMFJ2.2 size=435502 2024-09-14T11:04:17.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.679+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=Z1MP4AQYMFJ2 tag=KOH7UH7ERDTX type=write size=3581230 2024-09-14T11:04:17.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.681+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=W3UICIA5JARM type=del size=395166 2024-09-14T11:04:17.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.682+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.0 size=1048576 2024-09-14T11:04:17.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.683+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.1 size=1048576 2024-09-14T11:04:17.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.684+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~B1EMR90ZYM1Q.2 size=192907 2024-09-14T11:04:17.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.686+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=B1EMR90ZYM1Q tag=T6A45LZEIRRI type=write size=3338635 2024-09-14T11:04:17.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.687+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=KF9XN64ETER1 type=del size=2416984 2024-09-14T11:04:17.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.689+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~F7CAEAZG7KO7.0 size=1048576 2024-09-14T11:04:17.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.689+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~F7CAEAZG7KO7.1 size=647342 2024-09-14T11:04:17.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.691+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=F7CAEAZG7KO7 tag=3Q43AGBEVF6V type=write size=2744494 2024-09-14T11:04:17.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.694+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~4KR292Z9W7H4.0 size=1048576 2024-09-14T11:04:17.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.695+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~4KR292Z9W7H4.1 size=127108 2024-09-14T11:04:17.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.695+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=4KR292Z9W7H4 tag=1500UXOEHORP type=write size=2224260 2024-09-14T11:04:17.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.696+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~1857CMSOAQZJ.0 size=1048576 2024-09-14T11:04:17.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.696+0000 7f907bbdf780 1 < canceled part key=_multipart_KQBX4UP53FV1.2~1857CMSOAQZJ.1 size=785933 2024-09-14T11:04:17.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.698+0000 7f907bbdf780 1 < canceled multipart upload key=KQBX4UP53FV1 upload=1857CMSOAQZJ tag=89OBF65OX3O7 type=write size=2883085 2024-09-14T11:04:17.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.700+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~ICBKU9O5AUX5.0 size=1048576 2024-09-14T11:04:17.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.701+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~ICBKU9O5AUX5.1 size=842921 2024-09-14T11:04:17.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.701+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=ICBKU9O5AUX5 tag=HYJ0A29KF8LS type=write size=2940073 2024-09-14T11:04:17.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.702+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~QA1TESPLY1DO.0 size=838452 2024-09-14T11:04:17.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.704+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=QA1TESPLY1DO tag=SQC10GO9QXAN type=write size=1887028 2024-09-14T11:04:17.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.707+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~3Q2BBYHQI1H9.0 size=1048576 2024-09-14T11:04:17.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.708+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~3Q2BBYHQI1H9.1 size=528185 2024-09-14T11:04:17.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.708+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=3Q2BBYHQI1H9 tag=YBLIJ6M2X7RW type=write size=2625337 2024-09-14T11:04:17.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.709+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=AOIHJ5VNDUG8 type=del 2024-09-14T11:04:17.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.710+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=D8PWK80QKZU6 type=del size=3240425 2024-09-14T11:04:17.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.711+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~ECN7M4Z49ACG.0 size=755760 2024-09-14T11:04:17.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.713+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=ECN7M4Z49ACG tag=2QML1LPLULVG type=write size=1804336 2024-09-14T11:04:17.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.715+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=NOGAW2UDORSH type=del size=1582610 2024-09-14T11:04:17.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.716+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~L9DGRTTI5VMG.0 size=1048576 2024-09-14T11:04:17.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.717+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~L9DGRTTI5VMG.1 size=760777 2024-09-14T11:04:17.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.719+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=L9DGRTTI5VMG tag=WL0QGFXPUUAE type=write size=2857929 2024-09-14T11:04:17.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.720+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=7I5L98ESHJ36 type=del size=904647 2024-09-14T11:04:17.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.721+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=PCO4CP0OK8M1 type=del 2024-09-14T11:04:17.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.722+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=RWITV9J2A7VF type=write size=422162 2024-09-14T11:04:17.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.723+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=9YZ7PFRHUZIM type=del 2024-09-14T11:04:17.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.724+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=6UHH9OMEZNR4 type=write size=417 2024-09-14T11:04:17.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.726+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.0 size=1048576 2024-09-14T11:04:17.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.727+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.1 size=1048576 2024-09-14T11:04:17.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.728+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~JRLHZD0DV7RN.2 size=34725 2024-09-14T11:04:17.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.730+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=JRLHZD0DV7RN tag=VYJLBUCDFI1X type=write size=3180453 2024-09-14T11:04:17.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.731+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=MC5RBCK4Q06C type=del size=334200 2024-09-14T11:04:17.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.732+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~6F9MRQ13SFJM.0 size=1048576 2024-09-14T11:04:17.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.732+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~6F9MRQ13SFJM.1 size=550180 2024-09-14T11:04:17.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.734+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=6F9MRQ13SFJM tag=3UEQ5CV82EGA type=write size=2647332 2024-09-14T11:04:17.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.735+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=N1PNLXLZ7UD1 type=del size=3930615 2024-09-14T11:04:17.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.736+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~1ATWDIKPIBZH.0 size=1048576 2024-09-14T11:04:17.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.737+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~1ATWDIKPIBZH.1 size=352144 2024-09-14T11:04:17.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.739+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=1ATWDIKPIBZH tag=B3YMSST1T9XB type=write size=2449296 2024-09-14T11:04:17.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.741+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~UT5UTVH8R7LF.0 size=1048576 2024-09-14T11:04:17.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.742+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~UT5UTVH8R7LF.1 size=310110 2024-09-14T11:04:17.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.742+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=UT5UTVH8R7LF tag=K8KVEXR0IKSC type=write size=2407262 2024-09-14T11:04:17.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.745+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=VC8A4UXCSNXE type=del 2024-09-14T11:04:17.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.746+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=EERF87ZLCRJ3 type=del size=3097558 2024-09-14T11:04:17.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.747+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~8XLSDI3HJ59Q.0 size=1004793 2024-09-14T11:04:17.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.750+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=8XLSDI3HJ59Q tag=4VE0UKH9UC0A type=write size=2053369 2024-09-14T11:04:17.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.752+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~OFK2OXRBM5G1.0 size=1048576 2024-09-14T11:04:17.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.753+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~OFK2OXRBM5G1.1 size=236946 2024-09-14T11:04:17.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.753+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=OFK2OXRBM5G1 tag=P5TJFOYVBS57 type=write size=2334098 2024-09-14T11:04:17.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.754+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~YZTL95IUT5K3.0 size=1048576 2024-09-14T11:04:17.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.755+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~YZTL95IUT5K3.1 size=474504 2024-09-14T11:04:17.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.757+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=YZTL95IUT5K3 tag=3FYC2644O4S9 type=write size=2571656 2024-09-14T11:04:17.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.760+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.0 size=1048576 2024-09-14T11:04:17.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.761+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.1 size=1048576 2024-09-14T11:04:17.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.762+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.2 size=381135 2024-09-14T11:04:17.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.762+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=DFOA065PLWE7 tag=HX6922L5XOFN type=write size=3526863 2024-09-14T11:04:17.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.763+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=W3UICIA5JARM type=del 2024-09-14T11:04:17.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.765+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=8MXYP8X8ZVSZ type=del size=2168857 2024-09-14T11:04:17.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.766+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=KF9XN64ETER1 type=del size=2416984: (22) Invalid argument 2024-09-14T11:04:17.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.767+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=0SZG2Q1A20HG type=del size=2313423 2024-09-14T11:04:17.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.767+0000 7f907bbdf780 1 < canceled part key=_multipart_GC52N456IYD7.2~4KR292Z9W7H4.0 size=1048576 2024-09-14T11:04:17.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.767+0000 7f907bbdf780 1 < canceled part key=_multipart_GC52N456IYD7.2~4KR292Z9W7H4.1 size=127108 2024-09-14T11:04:17.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.769+0000 7f907bbdf780 1 < canceled multipart upload key=GC52N456IYD7 upload=4KR292Z9W7H4 tag=1500UXOEHORP type=write size=2224260 2024-09-14T11:04:17.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.770+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=2HDI3V3PJCGK type=del size=531268 2024-09-14T11:04:17.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.771+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~ICBKU9O5AUX5.0 size=1048576 2024-09-14T11:04:17.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.772+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~ICBKU9O5AUX5.1 size=842921 2024-09-14T11:04:17.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.774+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=ICBKU9O5AUX5 tag=HYJ0A29KF8LS type=write size=2940073 2024-09-14T11:04:17.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.775+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=ZQX02UN3WQE3 type=write size=297480 2024-09-14T11:04:17.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.777+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~3Q2BBYHQI1H9.0 size=1048576 2024-09-14T11:04:17.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.778+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~3Q2BBYHQI1H9.1 size=528185 2024-09-14T11:04:17.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.780+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=3Q2BBYHQI1H9 tag=YBLIJ6M2X7RW type=write size=2625337 2024-09-14T11:04:17.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.781+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=HKGTAQJ6OAHX type=del size=3844785 2024-09-14T11:04:17.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.782+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=D8PWK80QKZU6 type=del 2024-09-14T11:04:17.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.783+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=DQY1BZP2GOGM type=del size=2470017 2024-09-14T11:04:17.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.786+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=NOGAW2UDORSH type=del 2024-09-14T11:04:17.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.788+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~KYE5VOKFS9YP.0 size=1048576 2024-09-14T11:04:17.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.789+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~KYE5VOKFS9YP.1 size=720467 2024-09-14T11:04:17.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.789+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=KYE5VOKFS9YP tag=A8T6ARZ0L8DE type=write size=2817619 2024-09-14T11:04:17.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.790+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=7I5L98ESHJ36 type=del 2024-09-14T11:04:17.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.792+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.0 size=1048576 2024-09-14T11:04:17.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.793+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.1 size=1048576 2024-09-14T11:04:17.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.794+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.2 size=486506 2024-09-14T11:04:17.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.794+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=2G1YJDO0MMVJ tag=02B57BYPWXOL type=write size=3632234 2024-09-14T11:04:17.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.797+0000 7f907bbdf780 1 < suggested remove operation key=GC52N456IYD7 tag=RWITV9J2A7VF type=write 2024-09-14T11:04:17.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.798+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=QZHG93KPHUQN type=del size=1463139 2024-09-14T11:04:17.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.799+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=6UHH9OMEZNR4 type=write size=417 2024-09-14T11:04:17.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.800+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=033ZHGK91IHX type=del size=224164 2024-09-14T11:04:17.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.801+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=MC5RBCK4Q06C type=del 2024-09-14T11:04:17.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.802+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=TWY4QRCR6PCM type=del size=2158326 2024-09-14T11:04:17.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.803+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=N1PNLXLZ7UD1 type=del 2024-09-14T11:04:17.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.805+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~664M9D3N9QCI.0 size=922896 2024-09-14T11:04:17.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.805+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=664M9D3N9QCI tag=LT66XNVYJ2UZ type=write size=1971472 2024-09-14T11:04:17.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.807+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~UT5UTVH8R7LF.0 size=1048576 2024-09-14T11:04:17.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.808+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~UT5UTVH8R7LF.1 size=310110 2024-09-14T11:04:17.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.809+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=UT5UTVH8R7LF tag=K8KVEXR0IKSC type=write size=2407262 2024-09-14T11:04:17.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.811+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=0E1MVHAKHM83 type=del size=1274565 2024-09-14T11:04:17.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.812+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=EERF87ZLCRJ3 type=del 2024-09-14T11:04:17.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.813+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=YU7HJEZVXOCE type=del size=2992207 2024-09-14T11:04:17.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.814+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~OFK2OXRBM5G1.0 size=1048576 2024-09-14T11:04:17.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.815+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~OFK2OXRBM5G1.1 size=236946 2024-09-14T11:04:17.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.817+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=OFK2OXRBM5G1 tag=P5TJFOYVBS57 type=write size=2334098 2024-09-14T11:04:17.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.819+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~7L5GZIO0N15U.0 size=207104 2024-09-14T11:04:17.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.819+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=7L5GZIO0N15U tag=OE1CDFY6MKQX type=write size=1255680 2024-09-14T11:04:17.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.820+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.0 size=1048576 2024-09-14T11:04:17.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.821+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.1 size=1048576 2024-09-14T11:04:17.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.822+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~DFOA065PLWE7.2 size=381135 2024-09-14T11:04:17.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.824+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=DFOA065PLWE7 tag=HX6922L5XOFN type=write size=3526863 2024-09-14T11:04:17.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.825+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=2034KG975H8V type=write size=984829 2024-09-14T11:04:17.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.826+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=8MXYP8X8ZVSZ type=del size=2168857: (22) Invalid argument 2024-09-14T11:04:17.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.828+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=RM5VPBX3QHHH type=del size=1461827 2024-09-14T11:04:17.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.830+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=0SZG2Q1A20HG type=del 2024-09-14T11:04:17.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.831+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=MXBDNRO1V47U type=write size=1027346 2024-09-14T11:04:17.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.832+0000 7f907bbdf780 -1 < failed to complete operation key=GC52N456IYD7 tag=2HDI3V3PJCGK type=del size=531268: (22) Invalid argument 2024-09-14T11:04:17.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.833+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=S8RLVKC8LJTC type=del size=2788095 2024-09-14T11:04:17.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.835+0000 7f907bbdf780 1 < completed write operation key=LJ720PV3SQ8L tag=ZQX02UN3WQE3 type=write size=297480 2024-09-14T11:04:17.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.837+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.0 size=1048576 2024-09-14T11:04:17.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.838+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.1 size=1048576 2024-09-14T11:04:17.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.839+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.2 size=998104 2024-09-14T11:04:17.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.839+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=7DI7LXFMMMLM tag=VLWOTDW1BMVL type=write size=4143832 2024-09-14T11:04:17.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.840+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=HKGTAQJ6OAHX type=del 2024-09-14T11:04:17.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.841+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=JE8IULQK489Y type=del size=3328128 2024-09-14T11:04:17.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.842+0000 7f907bbdf780 1 < canceled operation key=ZFF333CYOK5P tag=DQY1BZP2GOGM type=del size=2470017 2024-09-14T11:04:17.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.843+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=4SMO74V4LJZK type=del size=82650 2024-09-14T11:04:17.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.845+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~KYE5VOKFS9YP.0 size=1048576 2024-09-14T11:04:17.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.846+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~KYE5VOKFS9YP.1 size=720467 2024-09-14T11:04:17.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.848+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=KYE5VOKFS9YP tag=A8T6ARZ0L8DE type=write size=2817619 2024-09-14T11:04:17.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.849+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=5ODT0UIFRT6R type=del size=2121704 2024-09-14T11:04:17.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.850+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.0 size=1048576 2024-09-14T11:04:17.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.851+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.1 size=1048576 2024-09-14T11:04:17.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.852+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2G1YJDO0MMVJ.2 size=486506 2024-09-14T11:04:17.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.854+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=2G1YJDO0MMVJ tag=02B57BYPWXOL type=write size=3632234 2024-09-14T11:04:17.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.856+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=6T8FXSOSC4HJ type=del size=3112829 2024-09-14T11:04:17.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.857+0000 7f907bbdf780 1 < canceled operation key=LJ720PV3SQ8L tag=QZHG93KPHUQN type=del size=1463139 2024-09-14T11:04:17.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.858+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=RQHI8TX5TMGA type=del size=2918521 2024-09-14T11:04:17.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.859+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=033ZHGK91IHX type=del 2024-09-14T11:04:17.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.861+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~RDF8IDOW1863.0 size=1048576 2024-09-14T11:04:17.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.862+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~RDF8IDOW1863.1 size=399066 2024-09-14T11:04:17.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.862+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=RDF8IDOW1863 tag=SLEGWXIEW2JX type=write size=2496218 2024-09-14T11:04:17.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.864+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=TWY4QRCR6PCM type=del size=2158326 2024-09-14T11:04:17.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.865+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=AT7KE874QAI3 type=del size=2245887 2024-09-14T11:04:17.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.866+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~664M9D3N9QCI.0 size=922896 2024-09-14T11:04:17.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.868+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=664M9D3N9QCI tag=LT66XNVYJ2UZ type=write size=1971472 2024-09-14T11:04:17.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.869+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=RTG51KZ137U2 type=del size=824763 2024-09-14T11:04:17.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.870+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=0E1MVHAKHM83 type=del 2024-09-14T11:04:17.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.872+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=NMD332GZ13AC type=del size=4012980 2024-09-14T11:04:17.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.873+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=YU7HJEZVXOCE type=del size=2992207 2024-09-14T11:04:17.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.876+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~UWRKX67QWSXQ.0 size=269240 2024-09-14T11:04:17.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.876+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=UWRKX67QWSXQ tag=UMA72VZM84VT type=write size=1317816 2024-09-14T11:04:17.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.877+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~7L5GZIO0N15U.0 size=207104 2024-09-14T11:04:17.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.879+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=7L5GZIO0N15U tag=OE1CDFY6MKQX type=write size=1255680 2024-09-14T11:04:17.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.881+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.0 size=1048576 2024-09-14T11:04:17.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.882+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.1 size=1048576 2024-09-14T11:04:17.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.883+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.2 size=807344 2024-09-14T11:04:17.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.883+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=QELUKW1XIX5A tag=RA16N6SCXYHW type=write size=3953072 2024-09-14T11:04:17.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.884+0000 7f907bbdf780 1 < completed write operation key=T81OF13I2JVH tag=2034KG975H8V type=write size=984829 2024-09-14T11:04:17.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.885+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=OKM58ZWIZPWK type=del size=1539613 2024-09-14T11:04:17.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.886+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=RM5VPBX3QHHH type=del 2024-09-14T11:04:17.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.888+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=3Y3NLW1X54FS type=del size=2875739 2024-09-14T11:04:17.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.889+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=MXBDNRO1V47U type=write size=1027346 2024-09-14T11:04:17.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.891+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~XKM7M0PFSMTX.0 size=837607 2024-09-14T11:04:17.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.891+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=XKM7M0PFSMTX tag=P9Z0CBLZEBEA type=write size=1886183 2024-09-14T11:04:17.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.892+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=S8RLVKC8LJTC type=del 2024-09-14T11:04:17.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.893+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=79KPWKYHVB4V type=write size=571630 2024-09-14T11:04:17.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.894+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.0 size=1048576 2024-09-14T11:04:17.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.895+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.1 size=1048576 2024-09-14T11:04:17.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.896+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~7DI7LXFMMMLM.2 size=998104 2024-09-14T11:04:17.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.898+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=7DI7LXFMMMLM tag=VLWOTDW1BMVL type=write size=4143832 2024-09-14T11:04:17.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.899+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=M288WULF18WN type=del size=2949019 2024-09-14T11:04:17.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.901+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=JE8IULQK489Y type=del 2024-09-14T11:04:17.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.903+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.0 size=1048576 2024-09-14T11:04:17.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.904+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.1 size=1048576 2024-09-14T11:04:17.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.904+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.2 size=884332 2024-09-14T11:04:17.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.904+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=20MWJLP9Z6MA tag=B8ICCAY6T4IN type=write size=4030060 2024-09-14T11:04:17.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.906+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=4SMO74V4LJZK type=del 2024-09-14T11:04:17.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.908+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~CX1RUUMEETNB.0 size=350039 2024-09-14T11:04:17.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.908+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=CX1RUUMEETNB tag=81AUG254WP0C type=write size=1398615 2024-09-14T11:04:17.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.909+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=5ODT0UIFRT6R type=del 2024-09-14T11:04:17.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.911+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.0 size=1048576 2024-09-14T11:04:17.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.912+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.1 size=1048576 2024-09-14T11:04:17.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.913+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.2 size=20308 2024-09-14T11:04:17.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.913+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=8D50R9MKDD72 tag=TRR9MBNMF32K type=write size=3166036 2024-09-14T11:04:17.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.914+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=6T8FXSOSC4HJ type=del 2024-09-14T11:04:17.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.915+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=8SUYKL5F9W1Q type=del size=1554774 2024-09-14T11:04:17.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.916+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=RQHI8TX5TMGA type=del 2024-09-14T11:04:17.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.917+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=N9CL7OPA5WGT type=del size=3609723 2024-09-14T11:04:17.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.919+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~RDF8IDOW1863.0 size=1048576 2024-09-14T11:04:17.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.920+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~RDF8IDOW1863.1 size=399066 2024-09-14T11:04:17.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.921+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=RDF8IDOW1863 tag=SLEGWXIEW2JX type=write size=2496218 2024-09-14T11:04:17.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.924+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~7KWU4XDM7T2F.0 size=1048576 2024-09-14T11:04:17.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.924+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~7KWU4XDM7T2F.1 size=891925 2024-09-14T11:04:17.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.924+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=7KWU4XDM7T2F tag=EHNXMSYCIUZU type=write size=2989077 2024-09-14T11:04:17.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.927+0000 7f907bbdf780 1 < suggested update operation key=AI0W2MEG08HF tag=AT7KE874QAI3 type=del size=2245887 2024-09-14T11:04:17.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.929+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.0 size=1048576 2024-09-14T11:04:17.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.930+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.1 size=1048576 2024-09-14T11:04:17.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.930+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.2 size=516561 2024-09-14T11:04:17.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.930+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=WJ986PGUS2JF tag=KEX10L11M8H7 type=write size=3662289 2024-09-14T11:04:17.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.932+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=RTG51KZ137U2 type=del 2024-09-14T11:04:17.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.933+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=NTOH6MPYHMAG type=del size=2271423 2024-09-14T11:04:17.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.934+0000 7f907bbdf780 1 < canceled operation key=8FRZW4YC3ATE tag=NMD332GZ13AC type=del size=4012980 2024-09-14T11:04:17.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.936+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~4EZQBXCHJIAL.0 size=408108 2024-09-14T11:04:17.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.936+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=4EZQBXCHJIAL tag=J4BGKSHBOV6E type=write size=1456684 2024-09-14T11:04:17.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.937+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~UWRKX67QWSXQ.0 size=269240 2024-09-14T11:04:17.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.939+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=UWRKX67QWSXQ tag=UMA72VZM84VT type=write size=1317816 2024-09-14T11:04:17.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.941+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=KO324DY105XS type=write size=593433 2024-09-14T11:04:17.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.942+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.0 size=1048576 2024-09-14T11:04:17.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.943+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.1 size=1048576 2024-09-14T11:04:17.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.944+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~QELUKW1XIX5A.2 size=807344 2024-09-14T11:04:17.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.946+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=QELUKW1XIX5A tag=RA16N6SCXYHW type=write size=3953072 2024-09-14T11:04:17.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.948+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~C9YODGCGV96M.0 size=54272 2024-09-14T11:04:17.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.948+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=C9YODGCGV96M tag=OIL3042T20KT type=write size=1102848 2024-09-14T11:04:17.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.950+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=OKM58ZWIZPWK type=del 2024-09-14T11:04:17.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.952+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.0 size=1048576 2024-09-14T11:04:17.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.953+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.1 size=1048576 2024-09-14T11:04:17.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.954+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.2 size=294208 2024-09-14T11:04:17.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.954+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=EPD6U8M8ACT1 tag=YZPQ36CPAGEV type=write size=3439936 2024-09-14T11:04:17.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.956+0000 7f907bbdf780 1 < suggested remove operation key=T81OF13I2JVH tag=3Y3NLW1X54FS type=del 2024-09-14T11:04:17.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.957+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=X6FAON875VU0 type=del size=4181146 2024-09-14T11:04:17.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.959+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~XKM7M0PFSMTX.0 size=837607 2024-09-14T11:04:17.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.961+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=XKM7M0PFSMTX tag=P9Z0CBLZEBEA type=write size=1886183 2024-09-14T11:04:17.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.962+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=4V1XWOOIGQ1N type=del size=4110215 2024-09-14T11:04:17.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.963+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=79KPWKYHVB4V type=write size=571630 2024-09-14T11:04:17.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.965+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~UO37OJMI2JH1.0 size=1048576 2024-09-14T11:04:17.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.966+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~UO37OJMI2JH1.1 size=769935 2024-09-14T11:04:17.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.966+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=UO37OJMI2JH1 tag=AS25EBBISVCU type=write size=2867087 2024-09-14T11:04:17.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.969+0000 7f907bbdf780 1 < suggested remove operation key=ZFF333CYOK5P tag=M288WULF18WN type=del 2024-09-14T11:04:17.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.970+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=2VPHFK51FR6E type=del size=3904162 2024-09-14T11:04:17.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.971+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.0 size=1048576 2024-09-14T11:04:17.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.972+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.1 size=1048576 2024-09-14T11:04:17.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.973+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~20MWJLP9Z6MA.2 size=884332 2024-09-14T11:04:17.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.975+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=20MWJLP9Z6MA tag=B8ICCAY6T4IN type=write size=4030060 2024-09-14T11:04:17.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.977+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=SXG0TON37H1I type=del size=4169056 2024-09-14T11:04:17.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.978+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~CX1RUUMEETNB.0 size=350039 2024-09-14T11:04:17.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.980+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=CX1RUUMEETNB tag=81AUG254WP0C type=write size=1398615 2024-09-14T11:04:17.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.982+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=7QS7UTSCBGDL type=del size=3621618 2024-09-14T11:04:17.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.983+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.0 size=1048576 2024-09-14T11:04:17.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.984+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.1 size=1048576 2024-09-14T11:04:17.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.984+0000 7f907bbdf780 1 < canceled part key=_multipart_P0701O36E1JI.2~8D50R9MKDD72.2 size=20308 2024-09-14T11:04:17.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.986+0000 7f907bbdf780 1 < canceled multipart upload key=P0701O36E1JI upload=8D50R9MKDD72 tag=TRR9MBNMF32K type=write size=3166036 2024-09-14T11:04:17.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.988+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=5CWZUFZE1BM5 type=write size=319176 2024-09-14T11:04:17.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.989+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=8SUYKL5F9W1Q type=del 2024-09-14T11:04:17.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.991+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.0 size=1048576 2024-09-14T11:04:17.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.992+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.1 size=1048576 2024-09-14T11:04:17.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.993+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.2 size=554107 2024-09-14T11:04:17.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.993+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=O93B375TWX7G tag=BB8Q22MBP76P type=write size=3699835 2024-09-14T11:04:17.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.994+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=N9CL7OPA5WGT type=del 2024-09-14T11:04:17.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.995+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=YY41FK3LNO0H type=write size=735399 2024-09-14T11:04:17.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.996+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~7KWU4XDM7T2F.0 size=1048576 2024-09-14T11:04:17.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.997+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~7KWU4XDM7T2F.1 size=891925 2024-09-14T11:04:17.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:17.999+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=7KWU4XDM7T2F tag=EHNXMSYCIUZU type=write size=2989077 2024-09-14T11:04:17.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.000+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=JJYJG8ZUXU4G type=del size=1331122 2024-09-14T11:04:17.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.001+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.0 size=1048576 2024-09-14T11:04:18.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.002+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.1 size=1048576 2024-09-14T11:04:18.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.003+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~WJ986PGUS2JF.2 size=516561 2024-09-14T11:04:18.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.005+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=WJ986PGUS2JF tag=KEX10L11M8H7 type=write size=3662289 2024-09-14T11:04:18.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.006+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=QPDGJHCQQ563 type=del size=2704650 2024-09-14T11:04:18.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.007+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=NTOH6MPYHMAG type=del 2024-09-14T11:04:18.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.008+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=PNCIT1WCJ6DQ type=del size=3120384 2024-09-14T11:04:18.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.009+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~4EZQBXCHJIAL.0 size=408108 2024-09-14T11:04:18.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.011+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=4EZQBXCHJIAL tag=J4BGKSHBOV6E type=write size=1456684 2024-09-14T11:04:18.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.012+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=BCEPO8NRHOFX type=del size=1840661 2024-09-14T11:04:18.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.013+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=KO324DY105XS type=write size=593433 2024-09-14T11:04:18.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.015+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=AYI7CU77MBRQ type=del size=2561101 2024-09-14T11:04:18.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.016+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~C9YODGCGV96M.0 size=54272 2024-09-14T11:04:18.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.018+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=C9YODGCGV96M tag=OIL3042T20KT type=write size=1102848 2024-09-14T11:04:18.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.020+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.0 size=1048576 2024-09-14T11:04:18.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.021+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.1 size=1048576 2024-09-14T11:04:18.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.022+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.2 size=759440 2024-09-14T11:04:18.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.022+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=Q72UX0Q3AFGA tag=7DHWU66E8J1G type=write size=3905168 2024-09-14T11:04:18.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.023+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.0 size=1048576 2024-09-14T11:04:18.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.024+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.1 size=1048576 2024-09-14T11:04:18.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.025+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~EPD6U8M8ACT1.2 size=294208 2024-09-14T11:04:18.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.027+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=EPD6U8M8ACT1 tag=YZPQ36CPAGEV type=write size=3439936 2024-09-14T11:04:18.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.028+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=MFS8NC0LZ17V type=del size=2067189 2024-09-14T11:04:18.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.030+0000 7f907bbdf780 1 < suggested remove operation key=77H37YF6MJEO tag=X6FAON875VU0 type=del 2024-09-14T11:04:18.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.031+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=6NVCARH88LV3 type=del size=1431838 2024-09-14T11:04:18.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.033+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=4V1XWOOIGQ1N type=del 2024-09-14T11:04:18.032 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.034+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=71SAE5G3LJHY type=write size=622281 2024-09-14T11:04:18.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.035+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~UO37OJMI2JH1.0 size=1048576 2024-09-14T11:04:18.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.036+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~UO37OJMI2JH1.1 size=769935 2024-09-14T11:04:18.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.038+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=UO37OJMI2JH1 tag=AS25EBBISVCU type=write size=2867087 2024-09-14T11:04:18.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.039+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=GGAL097TF2P7 type=del size=1068884 2024-09-14T11:04:18.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.041+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=2VPHFK51FR6E type=del 2024-09-14T11:04:18.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.042+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=P0EZ5ZHLHS9P type=del size=2534970 2024-09-14T11:04:18.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.043+0000 7f907bbdf780 1 < canceled operation key=Y3KOCA4072NM tag=SXG0TON37H1I type=del size=4169056 2024-09-14T11:04:18.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.045+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~GVAL4D2QCHLB.0 size=1048576 2024-09-14T11:04:18.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.046+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~GVAL4D2QCHLB.1 size=97936 2024-09-14T11:04:18.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.046+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=GVAL4D2QCHLB tag=E6S1CZXXIW75 type=write size=2195088 2024-09-14T11:04:18.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.048+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=7QS7UTSCBGDL type=del 2024-09-14T11:04:18.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.049+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=JHWG6U131I61 type=del size=4026872 2024-09-14T11:04:18.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.050+0000 7f907bbdf780 1 < completed write operation key=8NO5BA4HL03L tag=5CWZUFZE1BM5 type=write size=319176 2024-09-14T11:04:18.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.051+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=DTV83MW9LM6B type=del size=2236332 2024-09-14T11:04:18.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.053+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.0 size=1048576 2024-09-14T11:04:18.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.054+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.1 size=1048576 2024-09-14T11:04:18.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.055+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~O93B375TWX7G.2 size=554107 2024-09-14T11:04:18.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.057+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=O93B375TWX7G tag=BB8Q22MBP76P type=write size=3699835 2024-09-14T11:04:18.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.059+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~PJEX2E83FSYZ.0 size=1048576 2024-09-14T11:04:18.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.060+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~PJEX2E83FSYZ.1 size=353844 2024-09-14T11:04:18.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.060+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=PJEX2E83FSYZ tag=5BQDVRWML707 type=write size=2450996 2024-09-14T11:04:18.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.062+0000 7f907bbdf780 1 < suggested remove operation key=T81OF13I2JVH tag=YY41FK3LNO0H type=write 2024-09-14T11:04:18.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.063+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=C9OUV2SJMURN type=write size=123095 2024-09-14T11:04:18.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.066+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=JJYJG8ZUXU4G type=del 2024-09-14T11:04:18.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.067+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=L73AHKSXF6A5 type=del size=2190695 2024-09-14T11:04:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.069+0000 7f907bbdf780 1 < suggested update operation key=8FRZW4YC3ATE tag=QPDGJHCQQ563 type=del size=2704650 2024-09-14T11:04:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.070+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=KUPCL3TDEES6 type=del size=3844897 2024-09-14T11:04:18.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.072+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=PNCIT1WCJ6DQ type=del 2024-09-14T11:04:18.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.073+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=ECM0W4L7ZKQ8 type=del size=3408802 2024-09-14T11:04:18.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.074+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=BCEPO8NRHOFX type=del 2024-09-14T11:04:18.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.075+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=WH37GBW80FXU type=del size=2239395 2024-09-14T11:04:18.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.077+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=AYI7CU77MBRQ type=del 2024-09-14T11:04:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.079+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~5QYP8UMINIAH.0 size=1048576 2024-09-14T11:04:18.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.080+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~5QYP8UMINIAH.1 size=433687 2024-09-14T11:04:18.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.080+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=5QYP8UMINIAH tag=0JDFYMCIZXD7 type=write size=2530839 2024-09-14T11:04:18.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.081+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.0 size=1048576 2024-09-14T11:04:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.082+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.1 size=1048576 2024-09-14T11:04:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.083+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~Q72UX0Q3AFGA.2 size=759440 2024-09-14T11:04:18.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.086+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=Q72UX0Q3AFGA tag=7DHWU66E8J1G type=write size=3905168 2024-09-14T11:04:18.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.087+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=3JAOGIW6HSYK type=del size=1436267 2024-09-14T11:04:18.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.088+0000 7f907bbdf780 1 < canceled operation key=6AWG2GM1ZP31 tag=MFS8NC0LZ17V type=del size=2067189 2024-09-14T11:04:18.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.091+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.0 size=1048576 2024-09-14T11:04:18.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.092+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.1 size=1048576 2024-09-14T11:04:18.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.093+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.2 size=927825 2024-09-14T11:04:18.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.093+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=QL1IZ9MVIG68 tag=0CNK7Q1RODIB type=write size=4073553 2024-09-14T11:04:18.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.096+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=6NVCARH88LV3 type=del 2024-09-14T11:04:18.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.098+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.0 size=1048576 2024-09-14T11:04:18.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.099+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.1 size=1048576 2024-09-14T11:04:18.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.100+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.2 size=317962 2024-09-14T11:04:18.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.100+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=VZ6WUC39THY7 tag=F4XDPJ8NZPDQ type=write size=3463690 2024-09-14T11:04:18.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.102+0000 7f907bbdf780 1 < suggested remove operation key=S8RIEED24PUM tag=71SAE5G3LJHY type=write 2024-09-14T11:04:18.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.105+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~5OQBGFPTHW01.0 size=1048576 2024-09-14T11:04:18.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.106+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~5OQBGFPTHW01.1 size=607629 2024-09-14T11:04:18.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.106+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=5OQBGFPTHW01 tag=AWF4L1PJCOCV type=write size=2704781 2024-09-14T11:04:18.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.108+0000 7f907bbdf780 1 < suggested update operation key=P0701O36E1JI tag=GGAL097TF2P7 type=del size=1068884 2024-09-14T11:04:18.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.109+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=MP5OFZGJPKFZ type=del size=3920927 2024-09-14T11:04:18.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.110+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=P0EZ5ZHLHS9P type=del 2024-09-14T11:04:18.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.112+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=9Z8ABW7ZGZES type=del size=2648338 2024-09-14T11:04:18.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.113+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~GVAL4D2QCHLB.0 size=1048576 2024-09-14T11:04:18.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.114+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~GVAL4D2QCHLB.1 size=97936 2024-09-14T11:04:18.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.116+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=GVAL4D2QCHLB tag=E6S1CZXXIW75 type=write size=2195088 2024-09-14T11:04:18.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.118+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~LTN62NFYV87Z.0 size=1048576 2024-09-14T11:04:18.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.119+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~LTN62NFYV87Z.1 size=725298 2024-09-14T11:04:18.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.119+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=LTN62NFYV87Z tag=5JIEYFXXCJPO type=write size=2822450 2024-09-14T11:04:18.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.120+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=JHWG6U131I61 type=del 2024-09-14T11:04:18.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.121+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=54LXZ85IRVFB type=del size=3951384 2024-09-14T11:04:18.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.123+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=DTV83MW9LM6B type=del 2024-09-14T11:04:18.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.124+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=RY8AYPVQCANS type=del size=3993646 2024-09-14T11:04:18.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.125+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~PJEX2E83FSYZ.0 size=1048576 2024-09-14T11:04:18.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.125+0000 7f907bbdf780 1 < canceled part key=_multipart_YH0YMRDQERBF.2~PJEX2E83FSYZ.1 size=353844 2024-09-14T11:04:18.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.128+0000 7f907bbdf780 1 < canceled multipart upload key=YH0YMRDQERBF upload=PJEX2E83FSYZ tag=5BQDVRWML707 type=write size=2450996 2024-09-14T11:04:18.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.129+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=Z1MO7GJN0E8A type=del size=2665706 2024-09-14T11:04:18.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.130+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=C9OUV2SJMURN type=write size=123095 2024-09-14T11:04:18.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.133+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~57JEXA3CIWKP.0 size=1048576 2024-09-14T11:04:18.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.134+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~57JEXA3CIWKP.1 size=604659 2024-09-14T11:04:18.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.134+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=57JEXA3CIWKP tag=3TBGUML28LQ6 type=write size=2701811 2024-09-14T11:04:18.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.136+0000 7f907bbdf780 1 < suggested remove operation key=8NO5BA4HL03L tag=L73AHKSXF6A5 type=del 2024-09-14T11:04:18.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.137+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=TWV1MY8W69LD type=write size=79565 2024-09-14T11:04:18.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.140+0000 7f907bbdf780 1 < suggested update operation key=ZFF333CYOK5P tag=KUPCL3TDEES6 type=del size=3844897 2024-09-14T11:04:18.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.141+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=QISQ4Z2BNBK9 type=del size=1140937 2024-09-14T11:04:18.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.143+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=ECM0W4L7ZKQ8 type=del 2024-09-14T11:04:18.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.144+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=EVNY7KSQTJEA type=del size=2842752 2024-09-14T11:04:18.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.145+0000 7f907bbdf780 -1 < failed to complete operation key=8NO5BA4HL03L tag=WH37GBW80FXU type=del size=2239395: (22) Invalid argument 2024-09-14T11:04:18.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.148+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.0 size=1048576 2024-09-14T11:04:18.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.149+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.1 size=1048576 2024-09-14T11:04:18.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.150+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.2 size=1044970 2024-09-14T11:04:18.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.150+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=AH2A37SMD589 tag=AFDWZM3057U6 type=write size=4190698 2024-09-14T11:04:18.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.151+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~5QYP8UMINIAH.0 size=1048576 2024-09-14T11:04:18.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.152+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~5QYP8UMINIAH.1 size=433687 2024-09-14T11:04:18.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.154+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=5QYP8UMINIAH tag=0JDFYMCIZXD7 type=write size=2530839 2024-09-14T11:04:18.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.157+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.0 size=1048576 2024-09-14T11:04:18.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.158+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.1 size=1048576 2024-09-14T11:04:18.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.159+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.2 size=126557 2024-09-14T11:04:18.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.159+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=VDG983IQ7ZOT tag=ZDSP1YJDO0BH type=write size=3272285 2024-09-14T11:04:18.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.160+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=3JAOGIW6HSYK type=del 2024-09-14T11:04:18.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.161+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=Q59YVNW7YAQH type=del size=2177321 2024-09-14T11:04:18.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.163+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.0 size=1048576 2024-09-14T11:04:18.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.164+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.1 size=1048576 2024-09-14T11:04:18.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.164+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~QL1IZ9MVIG68.2 size=927825 2024-09-14T11:04:18.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.166+0000 7f907bbdf780 1 < canceled multipart upload key=59WHXDR0S8DM upload=QL1IZ9MVIG68 tag=0CNK7Q1RODIB type=write size=4073553 2024-09-14T11:04:18.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.169+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.0 size=1048576 2024-09-14T11:04:18.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.170+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.1 size=1048576 2024-09-14T11:04:18.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.171+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.2 size=149850 2024-09-14T11:04:18.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.171+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=3ECSUZBNJT6U tag=9R4IO2EHLBFC type=write size=3295578 2024-09-14T11:04:18.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.172+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.0 size=1048576 2024-09-14T11:04:18.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.173+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.1 size=1048576 2024-09-14T11:04:18.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.174+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~VZ6WUC39THY7.2 size=317962 2024-09-14T11:04:18.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.176+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=VZ6WUC39THY7 tag=F4XDPJ8NZPDQ type=write size=3463690 2024-09-14T11:04:18.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.178+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=1MWW96X6E911 type=del size=908079 2024-09-14T11:04:18.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.179+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~5OQBGFPTHW01.0 size=1048576 2024-09-14T11:04:18.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.179+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~5OQBGFPTHW01.1 size=607629 2024-09-14T11:04:18.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.181+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=5OQBGFPTHW01 tag=AWF4L1PJCOCV type=write size=2704781 2024-09-14T11:04:18.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.182+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=18FGQ54S0CZJ type=write size=912444 2024-09-14T11:04:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.184+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=MP5OFZGJPKFZ type=del size=3920927 2024-09-14T11:04:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.186+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=0MNXICXJ9GFW type=del size=1427247 2024-09-14T11:04:18.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.187+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=9Z8ABW7ZGZES type=del 2024-09-14T11:04:18.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.188+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=LFXA2MV3G7GQ type=del size=564789 2024-09-14T11:04:18.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.189+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~LTN62NFYV87Z.0 size=1048576 2024-09-14T11:04:18.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.190+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~LTN62NFYV87Z.1 size=725298 2024-09-14T11:04:18.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.192+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=LTN62NFYV87Z tag=5JIEYFXXCJPO type=write size=2822450 2024-09-14T11:04:18.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.193+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=J4SL1XTHMNLZ type=del size=1603345 2024-09-14T11:04:18.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.195+0000 7f907bbdf780 1 < suggested remove operation key=KQBX4UP53FV1 tag=54LXZ85IRVFB type=del 2024-09-14T11:04:18.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.196+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=LYCOGO8QBENU type=del size=1471029 2024-09-14T11:04:18.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.197+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=RY8AYPVQCANS type=del size=3993646 2024-09-14T11:04:18.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.200+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.0 size=1048576 2024-09-14T11:04:18.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.200+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.1 size=1048576 2024-09-14T11:04:18.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.201+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.2 size=271023 2024-09-14T11:04:18.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.201+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=B69BLXNXMIKK tag=Y4K14HYP1T6M type=write size=3416751 2024-09-14T11:04:18.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.202+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=Z1MO7GJN0E8A type=del 2024-09-14T11:04:18.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.204+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=BS01HMUG7REH type=del size=1138199 2024-09-14T11:04:18.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.205+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~57JEXA3CIWKP.0 size=1048576 2024-09-14T11:04:18.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.206+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~57JEXA3CIWKP.1 size=604659 2024-09-14T11:04:18.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.208+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=57JEXA3CIWKP tag=3TBGUML28LQ6 type=write size=2701811 2024-09-14T11:04:18.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.210+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=KR002M03MCY1 type=del size=1136005 2024-09-14T11:04:18.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.212+0000 7f907bbdf780 1 < suggested update operation key=T79IR10S3HAB tag=TWV1MY8W69LD type=write size=79565 2024-09-14T11:04:18.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.214+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~JNRJX8ZBZ934.0 size=1048576 2024-09-14T11:04:18.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.215+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~JNRJX8ZBZ934.1 size=415220 2024-09-14T11:04:18.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.215+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=JNRJX8ZBZ934 tag=5NE2X94K5TOP type=write size=2512372 2024-09-14T11:04:18.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.216+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=QISQ4Z2BNBK9 type=del 2024-09-14T11:04:18.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.217+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=C1JWLSFCSJKT type=del size=4094155 2024-09-14T11:04:18.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.218+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=EVNY7KSQTJEA type=del 2024-09-14T11:04:18.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.219+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=6RU1185L1JO0 type=del size=967173 2024-09-14T11:04:18.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.221+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.0 size=1048576 2024-09-14T11:04:18.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.222+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.1 size=1048576 2024-09-14T11:04:18.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.222+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~AH2A37SMD589.2 size=1044970 2024-09-14T11:04:18.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.224+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=AH2A37SMD589 tag=AFDWZM3057U6 type=write size=4190698 2024-09-14T11:04:18.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.226+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~7D18Y30LWK5Y.0 size=278652 2024-09-14T11:04:18.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.226+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=7D18Y30LWK5Y tag=KRBG2IWED0R8 type=write size=1327228 2024-09-14T11:04:18.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.228+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.0 size=1048576 2024-09-14T11:04:18.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.229+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.1 size=1048576 2024-09-14T11:04:18.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.230+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~VDG983IQ7ZOT.2 size=126557 2024-09-14T11:04:18.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.232+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=VDG983IQ7ZOT tag=ZDSP1YJDO0BH type=write size=3272285 2024-09-14T11:04:18.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.233+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=38FP886NTEUD type=del size=2976116 2024-09-14T11:04:18.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.234+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=Q59YVNW7YAQH type=del 2024-09-14T11:04:18.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.235+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=CY1NFTC68M0L type=write size=418330 2024-09-14T11:04:18.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.236+0000 7f907bbdf780 1 < canceled part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.0 size=1048576 2024-09-14T11:04:18.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.237+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.1 size=1048576 2024-09-14T11:04:18.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.238+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~3ECSUZBNJT6U.2 size=149850 2024-09-14T11:04:18.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.240+0000 7f907bbdf780 1 < canceled multipart upload key=KQBX4UP53FV1 upload=3ECSUZBNJT6U tag=9R4IO2EHLBFC type=write size=3295578 2024-09-14T11:04:18.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.241+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=U1QOLTVA1HS2 type=write size=1033042 2024-09-14T11:04:18.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.242+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=1MWW96X6E911 type=del 2024-09-14T11:04:18.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.243+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=6M8646OXA556 type=write size=504428 2024-09-14T11:04:18.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.245+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=18FGQ54S0CZJ type=write size=912444 2024-09-14T11:04:18.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.246+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=VSO06NL1XQAW type=del size=1606564 2024-09-14T11:04:18.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.247+0000 7f907bbdf780 1 < canceled operation key=6AWG2GM1ZP31 tag=0MNXICXJ9GFW type=del size=1427247 2024-09-14T11:04:18.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.250+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.0 size=1048576 2024-09-14T11:04:18.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.251+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.1 size=1048576 2024-09-14T11:04:18.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.251+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.2 size=821300 2024-09-14T11:04:18.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.251+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=LXBC7N6U086N tag=IU0N74CKMBQE type=write size=3967028 2024-09-14T11:04:18.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.254+0000 7f907bbdf780 1 < suggested remove operation key=AI0W2MEG08HF tag=LFXA2MV3G7GQ type=del 2024-09-14T11:04:18.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.255+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=AA6MIT5K5J0J type=del size=3378996 2024-09-14T11:04:18.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.257+0000 7f907bbdf780 -1 < failed to complete operation key=KQBX4UP53FV1 tag=J4SL1XTHMNLZ type=del size=1603345: (22) Invalid argument 2024-09-14T11:04:18.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.259+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~PFOAMWOFHSWM.0 size=1048576 2024-09-14T11:04:18.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.260+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~PFOAMWOFHSWM.1 size=898742 2024-09-14T11:04:18.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.260+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=PFOAMWOFHSWM tag=47S1HUSB7DT1 type=write size=2995894 2024-09-14T11:04:18.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.261+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=LYCOGO8QBENU type=del 2024-09-14T11:04:18.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.263+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=JSQ905XGHTV4 type=del size=2267042 2024-09-14T11:04:18.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.264+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.0 size=1048576 2024-09-14T11:04:18.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.265+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.1 size=1048576 2024-09-14T11:04:18.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.266+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~B69BLXNXMIKK.2 size=271023 2024-09-14T11:04:18.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.268+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=B69BLXNXMIKK tag=Y4K14HYP1T6M type=write size=3416751 2024-09-14T11:04:18.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.269+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=B8250EUXQLY7 type=del size=1158445 2024-09-14T11:04:18.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.270+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=BS01HMUG7REH type=del 2024-09-14T11:04:18.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.272+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=6IJETGGRN5VP type=write size=277452 2024-09-14T11:04:18.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.282+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=KR002M03MCY1 type=del 2024-09-14T11:04:18.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.284+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~523PQ3ZVLXQN.0 size=263185 2024-09-14T11:04:18.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.284+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=523PQ3ZVLXQN tag=FM243PW05G4I type=write size=1311761 2024-09-14T11:04:18.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.284+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~JNRJX8ZBZ934.0 size=1048576 2024-09-14T11:04:18.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.285+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~JNRJX8ZBZ934.1 size=415220 2024-09-14T11:04:18.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.287+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=JNRJX8ZBZ934 tag=5NE2X94K5TOP type=write size=2512372 2024-09-14T11:04:18.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.289+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.0 size=1048576 2024-09-14T11:04:18.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.290+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.1 size=1048576 2024-09-14T11:04:18.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.291+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.2 size=396639 2024-09-14T11:04:18.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.291+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=W3F569ZKWGB3 tag=TBFUIHIF43LY type=write size=3542367 2024-09-14T11:04:18.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.292+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=C1JWLSFCSJKT type=del 2024-09-14T11:04:18.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.293+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=HACIC81R920A type=del size=19787 2024-09-14T11:04:18.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.296+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=6RU1185L1JO0 type=del size=967173 2024-09-14T11:04:18.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.298+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.0 size=1048576 2024-09-14T11:04:18.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.299+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.1 size=1048576 2024-09-14T11:04:18.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.300+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.2 size=307950 2024-09-14T11:04:18.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.300+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=4V1U4TP21E2C tag=CR55PK3QC4NW type=write size=3453678 2024-09-14T11:04:18.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.301+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~7D18Y30LWK5Y.0 size=278652 2024-09-14T11:04:18.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.303+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=7D18Y30LWK5Y tag=KRBG2IWED0R8 type=write size=1327228 2024-09-14T11:04:18.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.304+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=3IO5Q4WYK9XB type=del size=3047173 2024-09-14T11:04:18.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.305+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=38FP886NTEUD type=del 2024-09-14T11:04:18.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.306+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=EXNIH8NQ7H38 type=del size=698725 2024-09-14T11:04:18.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.308+0000 7f907bbdf780 1 < completed write operation key=S8RIEED24PUM tag=CY1NFTC68M0L type=write size=418330 2024-09-14T11:04:18.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.310+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~BOWH07W568JD.0 size=1048576 2024-09-14T11:04:18.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.311+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~BOWH07W568JD.1 size=760091 2024-09-14T11:04:18.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.311+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=BOWH07W568JD tag=J1OZI6V4WVMG type=write size=2857243 2024-09-14T11:04:18.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.312+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=U1QOLTVA1HS2 type=write size=1033042 2024-09-14T11:04:18.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.313+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=P5I3TY5P0UT0 type=del size=180744 2024-09-14T11:04:18.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.314+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=6M8646OXA556 type=write size=504428 2024-09-14T11:04:18.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.315+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=1AFF3WPC85ES type=del size=2257267 2024-09-14T11:04:18.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.317+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=VSO06NL1XQAW type=del 2024-09-14T11:04:18.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.318+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=G81O3EUXW5X3 type=write size=501298 2024-09-14T11:04:18.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.319+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.0 size=1048576 2024-09-14T11:04:18.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.319+0000 7f907bbdf780 1 < canceled part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.1 size=1048576 2024-09-14T11:04:18.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.320+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~LXBC7N6U086N.2 size=821300 2024-09-14T11:04:18.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.322+0000 7f907bbdf780 1 < canceled multipart upload key=6AWG2GM1ZP31 upload=LXBC7N6U086N tag=IU0N74CKMBQE type=write size=3967028 2024-09-14T11:04:18.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.324+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=2DGHI52M87Y8 type=del size=608314 2024-09-14T11:04:18.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.325+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=AA6MIT5K5J0J type=del 2024-09-14T11:04:18.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.326+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=8VWUAF19DLNT type=del size=3880718 2024-09-14T11:04:18.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.326+0000 7f907bbdf780 1 < canceled part key=_multipart_P0701O36E1JI.2~PFOAMWOFHSWM.0 size=1048576 2024-09-14T11:04:18.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.328+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~PFOAMWOFHSWM.1 size=898742 2024-09-14T11:04:18.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.330+0000 7f907bbdf780 1 < canceled multipart upload key=P0701O36E1JI upload=PFOAMWOFHSWM tag=47S1HUSB7DT1 type=write size=2995894 2024-09-14T11:04:18.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.332+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=IANWLXGR5KBR type=del size=3198007 2024-09-14T11:04:18.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.333+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=JSQ905XGHTV4 type=del 2024-09-14T11:04:18.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.335+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~PTKXOYOPXLC0.0 size=1048576 2024-09-14T11:04:18.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.336+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~PTKXOYOPXLC0.1 size=985224 2024-09-14T11:04:18.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.336+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=PTKXOYOPXLC0 tag=FTJ4A26B1K88 type=write size=3082376 2024-09-14T11:04:18.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.338+0000 7f907bbdf780 1 < suggested remove operation key=GC52N456IYD7 tag=B8250EUXQLY7 type=del 2024-09-14T11:04:18.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.339+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=MLYRT1MV5UBI type=del size=80760 2024-09-14T11:04:18.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.341+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=6IJETGGRN5VP type=write size=277452 2024-09-14T11:04:18.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.342+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=R67BAOR56G6R type=del size=721837 2024-09-14T11:04:18.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.343+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~523PQ3ZVLXQN.0 size=263185 2024-09-14T11:04:18.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.345+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=523PQ3ZVLXQN tag=FM243PW05G4I type=write size=1311761 2024-09-14T11:04:18.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.346+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=3AAZ0ILP5C8U type=del size=3103021 2024-09-14T11:04:18.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.347+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.0 size=1048576 2024-09-14T11:04:18.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.348+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.1 size=1048576 2024-09-14T11:04:18.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.349+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~W3F569ZKWGB3.2 size=396639 2024-09-14T11:04:18.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.351+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=W3F569ZKWGB3 tag=TBFUIHIF43LY type=write size=3542367 2024-09-14T11:04:18.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.352+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=FP3YMPYQ5UBE type=del size=4023847 2024-09-14T11:04:18.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.353+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=HACIC81R920A type=del 2024-09-14T11:04:18.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.354+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=XBTBYNF6GT18 type=del size=1861406 2024-09-14T11:04:18.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.355+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.0 size=1048576 2024-09-14T11:04:18.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.356+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.1 size=1048576 2024-09-14T11:04:18.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.357+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~4V1U4TP21E2C.2 size=307950 2024-09-14T11:04:18.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.359+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=4V1U4TP21E2C tag=CR55PK3QC4NW type=write size=3453678 2024-09-14T11:04:18.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.362+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.0 size=1048576 2024-09-14T11:04:18.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.363+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.1 size=1048576 2024-09-14T11:04:18.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.363+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.2 size=708820 2024-09-14T11:04:18.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.363+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=NUFOSSKL2XDE tag=UTNUILN2117Z type=write size=3854548 2024-09-14T11:04:18.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.365+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=3IO5Q4WYK9XB type=del 2024-09-14T11:04:18.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.367+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~2HWHQGP1FBL2.0 size=1048576 2024-09-14T11:04:18.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.368+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~2HWHQGP1FBL2.1 size=457076 2024-09-14T11:04:18.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.368+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=2HWHQGP1FBL2 tag=NOA3A204PXYG type=write size=2554228 2024-09-14T11:04:18.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.369+0000 7f907bbdf780 1 < canceled operation key=WAFH5BKM2P23 tag=EXNIH8NQ7H38 type=del size=698725 2024-09-14T11:04:18.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.371+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=JZNFBLEM3M60 type=del size=1979610 2024-09-14T11:04:18.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.371+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~BOWH07W568JD.0 size=1048576 2024-09-14T11:04:18.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.372+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~BOWH07W568JD.1 size=760091 2024-09-14T11:04:18.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.374+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=BOWH07W568JD tag=J1OZI6V4WVMG type=write size=2857243 2024-09-14T11:04:18.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.375+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=5599HBZMQL9S type=del size=3543062 2024-09-14T11:04:18.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.376+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=P5I3TY5P0UT0 type=del 2024-09-14T11:04:18.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.377+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=8RK4I49OX67I type=write size=817675 2024-09-14T11:04:18.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.379+0000 7f907bbdf780 1 < suggested update operation key=Y3KOCA4072NM tag=1AFF3WPC85ES type=del size=2257267 2024-09-14T11:04:18.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.382+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~JH8COWBV92EB.0 size=1048576 2024-09-14T11:04:18.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.383+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~JH8COWBV92EB.1 size=316901 2024-09-14T11:04:18.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.383+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=JH8COWBV92EB tag=I2LB74LJ96GE type=write size=2414053 2024-09-14T11:04:18.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.384+0000 7f907bbdf780 1 < completed write operation key=YH0YMRDQERBF tag=G81O3EUXW5X3 type=write size=501298 2024-09-14T11:04:18.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.386+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~9644RAETNZCC.0 size=451355 2024-09-14T11:04:18.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.386+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=9644RAETNZCC tag=Z4OC890EFO7X type=write size=1499931 2024-09-14T11:04:18.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.387+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=2DGHI52M87Y8 type=del 2024-09-14T11:04:18.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.388+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=J00UG0P3MK01 type=del size=2311845 2024-09-14T11:04:18.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.389+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=8VWUAF19DLNT type=del 2024-09-14T11:04:18.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.391+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~2HIMOM6IEJ45.0 size=1048576 2024-09-14T11:04:18.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.392+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~2HIMOM6IEJ45.1 size=606042 2024-09-14T11:04:18.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.392+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=2HIMOM6IEJ45 tag=FOPXUS97GO7Z type=write size=2703194 2024-09-14T11:04:18.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.394+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=IANWLXGR5KBR type=del 2024-09-14T11:04:18.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.395+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=O5O023MFQGVB type=del size=1862189 2024-09-14T11:04:18.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.396+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~PTKXOYOPXLC0.0 size=1048576 2024-09-14T11:04:18.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.397+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~PTKXOYOPXLC0.1 size=985224 2024-09-14T11:04:18.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.399+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=PTKXOYOPXLC0 tag=FTJ4A26B1K88 type=write size=3082376 2024-09-14T11:04:18.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.401+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~6IK33ORD9NKJ.0 size=1048576 2024-09-14T11:04:18.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.402+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~6IK33ORD9NKJ.1 size=961072 2024-09-14T11:04:18.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.402+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=6IK33ORD9NKJ tag=YCH9DZVJ933J type=write size=3058224 2024-09-14T11:04:18.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.403+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=MLYRT1MV5UBI type=del 2024-09-14T11:04:18.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.404+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=IAEW1BV8BO1X type=del size=2723403 2024-09-14T11:04:18.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.406+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=R67BAOR56G6R type=del 2024-09-14T11:04:18.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.407+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=01QYH5B159U3 type=del size=133738 2024-09-14T11:04:18.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.408+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=3AAZ0ILP5C8U type=del 2024-09-14T11:04:18.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.410+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~XNLBM82PIZ7A.0 size=503231 2024-09-14T11:04:18.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.410+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=XNLBM82PIZ7A tag=G5B8FDK0A4TC type=write size=1551807 2024-09-14T11:04:18.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.413+0000 7f907bbdf780 1 < suggested update operation key=AI0W2MEG08HF tag=FP3YMPYQ5UBE type=del size=4023847 2024-09-14T11:04:18.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.414+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=CWO1PSIFIXC9 type=write size=832614 2024-09-14T11:04:18.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.415+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=XBTBYNF6GT18 type=del 2024-09-14T11:04:18.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.416+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=O3DQEI3BFJ7I type=del size=461318 2024-09-14T11:04:18.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.417+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.0 size=1048576 2024-09-14T11:04:18.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.418+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.1 size=1048576 2024-09-14T11:04:18.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.419+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~NUFOSSKL2XDE.2 size=708820 2024-09-14T11:04:18.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.421+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=NUFOSSKL2XDE tag=UTNUILN2117Z type=write size=3854548 2024-09-14T11:04:18.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.422+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=M92C4WW2LC99 type=del size=2262439 2024-09-14T11:04:18.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.424+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~2HWHQGP1FBL2.0 size=1048576 2024-09-14T11:04:18.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.425+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~2HWHQGP1FBL2.1 size=457076 2024-09-14T11:04:18.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.427+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=2HWHQGP1FBL2 tag=NOA3A204PXYG type=write size=2554228 2024-09-14T11:04:18.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.429+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~R9LOOZW0GKHU.0 size=915430 2024-09-14T11:04:18.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.429+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=R9LOOZW0GKHU tag=U9784EP0GUAS type=write size=1964006 2024-09-14T11:04:18.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.430+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=JZNFBLEM3M60 type=del 2024-09-14T11:04:18.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.432+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~EAFGAPL6XCY9.0 size=1048576 2024-09-14T11:04:18.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.433+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~EAFGAPL6XCY9.1 size=88678 2024-09-14T11:04:18.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.433+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=EAFGAPL6XCY9 tag=8VWVAJCQTH1Z type=write size=2185830 2024-09-14T11:04:18.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.434+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=5599HBZMQL9S type=del 2024-09-14T11:04:18.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.436+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.0 size=1048576 2024-09-14T11:04:18.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.437+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.1 size=1048576 2024-09-14T11:04:18.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.438+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.2 size=284348 2024-09-14T11:04:18.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.438+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=6SHOMK5Z7OI0 tag=D3E6HMF6TABN type=write size=3430076 2024-09-14T11:04:18.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.439+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=8RK4I49OX67I type=write size=817675 2024-09-14T11:04:18.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.441+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=ND0II1W40BNU type=del size=427833 2024-09-14T11:04:18.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.441+0000 7f907bbdf780 1 < canceled part key=_multipart_AGMKZ7PGPUAM.2~JH8COWBV92EB.0 size=1048576 2024-09-14T11:04:18.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.442+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~JH8COWBV92EB.1 size=316901 2024-09-14T11:04:18.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.444+0000 7f907bbdf780 1 < canceled multipart upload key=AGMKZ7PGPUAM upload=JH8COWBV92EB tag=I2LB74LJ96GE type=write size=2414053 2024-09-14T11:04:18.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.446+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=MXMCE7FA1IQU type=write size=584420 2024-09-14T11:04:18.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.447+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~9644RAETNZCC.0 size=451355 2024-09-14T11:04:18.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.449+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=9644RAETNZCC tag=Z4OC890EFO7X type=write size=1499931 2024-09-14T11:04:18.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.451+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.0 size=1048576 2024-09-14T11:04:18.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.452+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.1 size=1048576 2024-09-14T11:04:18.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.453+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.2 size=962541 2024-09-14T11:04:18.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.453+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=2ZENP568MPR2 tag=NCD30E5BRWH5 type=write size=4108269 2024-09-14T11:04:18.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.454+0000 7f907bbdf780 1 < canceled operation key=LQNZKMX52SWO tag=J00UG0P3MK01 type=del size=2311845 2024-09-14T11:04:18.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.456+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.0 size=1048576 2024-09-14T11:04:18.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.457+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.1 size=1048576 2024-09-14T11:04:18.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.458+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.2 size=166269 2024-09-14T11:04:18.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.458+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=A19RZ07CYQ7N tag=UI6UIQUXBKER type=write size=3311997 2024-09-14T11:04:18.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.459+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~2HIMOM6IEJ45.0 size=1048576 2024-09-14T11:04:18.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.460+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~2HIMOM6IEJ45.1 size=606042 2024-09-14T11:04:18.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.462+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=2HIMOM6IEJ45 tag=FOPXUS97GO7Z type=write size=2703194 2024-09-14T11:04:18.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.463+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=4C21BWB6HJ0C type=write size=63777 2024-09-14T11:04:18.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.464+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=O5O023MFQGVB type=del size=1862189 2024-09-14T11:04:18.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.465+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=U8385ZINMYVF type=del size=387339 2024-09-14T11:04:18.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.465+0000 7f907bbdf780 1 < canceled part key=_multipart_VRQ0ZNN9FG4C.2~6IK33ORD9NKJ.0 size=1048576 2024-09-14T11:04:18.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.466+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~6IK33ORD9NKJ.1 size=961072 2024-09-14T11:04:18.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.468+0000 7f907bbdf780 1 < canceled multipart upload key=VRQ0ZNN9FG4C upload=6IK33ORD9NKJ tag=YCH9DZVJ933J type=write size=3058224 2024-09-14T11:04:18.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.470+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.0 size=1048576 2024-09-14T11:04:18.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.471+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.1 size=1048576 2024-09-14T11:04:18.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.472+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.2 size=704930 2024-09-14T11:04:18.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.472+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=IRSXOQ9796SJ tag=M295KM65S1U2 type=write size=3850658 2024-09-14T11:04:18.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.473+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=IAEW1BV8BO1X type=del 2024-09-14T11:04:18.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.476+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~00S117QTVSJ4.0 size=70292 2024-09-14T11:04:18.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.476+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=00S117QTVSJ4 tag=13JCHQX4R3UO type=write size=1118868 2024-09-14T11:04:18.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.477+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=01QYH5B159U3 type=del 2024-09-14T11:04:18.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.479+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~FC36YN64WG8U.0 size=1048576 2024-09-14T11:04:18.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.480+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~FC36YN64WG8U.1 size=87971 2024-09-14T11:04:18.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.480+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=FC36YN64WG8U tag=8Y0IBJSA5JMR type=write size=2185123 2024-09-14T11:04:18.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.481+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~XNLBM82PIZ7A.0 size=503231 2024-09-14T11:04:18.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.483+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=XNLBM82PIZ7A tag=G5B8FDK0A4TC type=write size=1551807 2024-09-14T11:04:18.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.484+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=307MBYB4T6TK type=del size=1972555 2024-09-14T11:04:18.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.485+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=CWO1PSIFIXC9 type=write size=832614 2024-09-14T11:04:18.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.488+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~3DHW5LWO5S0V.0 size=1048576 2024-09-14T11:04:18.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.488+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~3DHW5LWO5S0V.1 size=644199 2024-09-14T11:04:18.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.488+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=3DHW5LWO5S0V tag=3XJEAO0H5H0G type=write size=2741351 2024-09-14T11:04:18.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.490+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=O3DQEI3BFJ7I type=del 2024-09-14T11:04:18.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.492+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.0 size=1048576 2024-09-14T11:04:18.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.493+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.1 size=1048576 2024-09-14T11:04:18.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.494+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.2 size=182056 2024-09-14T11:04:18.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.494+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=XG12P11CB1II tag=X7E5SJ5MR5I9 type=write size=3327784 2024-09-14T11:04:18.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.495+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=M92C4WW2LC99 type=del 2024-09-14T11:04:18.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.496+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=KRB3JMT8G3G9 type=del size=1973215 2024-09-14T11:04:18.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.497+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~R9LOOZW0GKHU.0 size=915430 2024-09-14T11:04:18.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.499+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=R9LOOZW0GKHU tag=U9784EP0GUAS type=write size=1964006 2024-09-14T11:04:18.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.501+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.0 size=1048576 2024-09-14T11:04:18.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.502+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.1 size=1048576 2024-09-14T11:04:18.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.503+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.2 size=845475 2024-09-14T11:04:18.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.503+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=8DIWEQ2IHVSI tag=86ZEK2WB8948 type=write size=3991203 2024-09-14T11:04:18.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.504+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~EAFGAPL6XCY9.0 size=1048576 2024-09-14T11:04:18.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.505+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~EAFGAPL6XCY9.1 size=88678 2024-09-14T11:04:18.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.507+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=EAFGAPL6XCY9 tag=8VWVAJCQTH1Z type=write size=2185830 2024-09-14T11:04:18.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.508+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=5M61PD35RWTL type=del size=257537 2024-09-14T11:04:18.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.510+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.0 size=1048576 2024-09-14T11:04:18.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.510+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.1 size=1048576 2024-09-14T11:04:18.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.511+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~6SHOMK5Z7OI0.2 size=284348 2024-09-14T11:04:18.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.513+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=6SHOMK5Z7OI0 tag=D3E6HMF6TABN type=write size=3430076 2024-09-14T11:04:18.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.515+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=2GPBMUHAD73J type=del size=326787 2024-09-14T11:04:18.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.516+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=ND0II1W40BNU type=del 2024-09-14T11:04:18.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.517+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=L3OVYCKSZYY5 type=del size=301895 2024-09-14T11:04:18.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.518+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=MXMCE7FA1IQU type=write size=584420 2024-09-14T11:04:18.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.519+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=ZKMSP3G9ZH40 type=del size=1465076 2024-09-14T11:04:18.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.520+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.0 size=1048576 2024-09-14T11:04:18.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.521+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.1 size=1048576 2024-09-14T11:04:18.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.522+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~2ZENP568MPR2.2 size=962541 2024-09-14T11:04:18.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.524+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=2ZENP568MPR2 tag=NCD30E5BRWH5 type=write size=4108269 2024-09-14T11:04:18.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.527+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~SMAGS8KLMSWZ.0 size=1048576 2024-09-14T11:04:18.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.527+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~SMAGS8KLMSWZ.1 size=259528 2024-09-14T11:04:18.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.527+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=SMAGS8KLMSWZ tag=LWNJT3DZ8806 type=write size=2356680 2024-09-14T11:04:18.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.528+0000 7f907bbdf780 1 < canceled part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.0 size=1048576 2024-09-14T11:04:18.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.529+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.1 size=1048576 2024-09-14T11:04:18.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.530+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~A19RZ07CYQ7N.2 size=166269 2024-09-14T11:04:18.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.532+0000 7f907bbdf780 1 < canceled multipart upload key=HM2GVOA72HHR upload=A19RZ07CYQ7N tag=UI6UIQUXBKER type=write size=3311997 2024-09-14T11:04:18.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.534+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~YYOYD0UE87TV.0 size=759901 2024-09-14T11:04:18.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.534+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=YYOYD0UE87TV tag=TFOPPFO5CP0O type=write size=1808477 2024-09-14T11:04:18.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.535+0000 7f907bbdf780 1 < completed write operation key=S8RIEED24PUM tag=4C21BWB6HJ0C type=write size=63777 2024-09-14T11:04:18.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.537+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~QG14RCJVRE6O.0 size=774606 2024-09-14T11:04:18.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.537+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=QG14RCJVRE6O tag=OF6PM7T3MOUR type=write size=1823182 2024-09-14T11:04:18.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.538+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=U8385ZINMYVF type=del 2024-09-14T11:04:18.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.539+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=7IMOEWEFOP6A type=del size=4144064 2024-09-14T11:04:18.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.541+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.0 size=1048576 2024-09-14T11:04:18.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.542+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.1 size=1048576 2024-09-14T11:04:18.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.543+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~IRSXOQ9796SJ.2 size=704930 2024-09-14T11:04:18.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.545+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=IRSXOQ9796SJ tag=M295KM65S1U2 type=write size=3850658 2024-09-14T11:04:18.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.546+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=S2IYLDJ8C1ZO type=del size=2286253 2024-09-14T11:04:18.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.548+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~00S117QTVSJ4.0 size=70292 2024-09-14T11:04:18.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.550+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=00S117QTVSJ4 tag=13JCHQX4R3UO type=write size=1118868 2024-09-14T11:04:18.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.551+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=D0X1Y18I4PR6 type=del size=1712732 2024-09-14T11:04:18.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.552+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~FC36YN64WG8U.0 size=1048576 2024-09-14T11:04:18.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.553+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~FC36YN64WG8U.1 size=87971 2024-09-14T11:04:18.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.555+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=FC36YN64WG8U tag=8Y0IBJSA5JMR type=write size=2185123 2024-09-14T11:04:18.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.557+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=99TLGTCLRPJ7 type=del size=1005249 2024-09-14T11:04:18.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.559+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=307MBYB4T6TK type=del 2024-09-14T11:04:18.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.561+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.0 size=1048576 2024-09-14T11:04:18.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.562+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.1 size=1048576 2024-09-14T11:04:18.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.563+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.2 size=1023468 2024-09-14T11:04:18.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.563+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=DHQKYUHFTATM tag=YCHYPVYUXLKJ type=write size=4169196 2024-09-14T11:04:18.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.564+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~3DHW5LWO5S0V.0 size=1048576 2024-09-14T11:04:18.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.565+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~3DHW5LWO5S0V.1 size=644199 2024-09-14T11:04:18.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.567+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=3DHW5LWO5S0V tag=3XJEAO0H5H0G type=write size=2741351 2024-09-14T11:04:18.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.570+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~O6OVTO79CXRY.0 size=426889 2024-09-14T11:04:18.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.570+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=O6OVTO79CXRY tag=EOS89TA6ZZKX type=write size=1475465 2024-09-14T11:04:18.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.571+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.0 size=1048576 2024-09-14T11:04:18.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.572+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.1 size=1048576 2024-09-14T11:04:18.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.573+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XG12P11CB1II.2 size=182056 2024-09-14T11:04:18.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.575+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=XG12P11CB1II tag=X7E5SJ5MR5I9 type=write size=3327784 2024-09-14T11:04:18.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.576+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=HTKX1REZSR2Z type=write size=476321 2024-09-14T11:04:18.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.577+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=KRB3JMT8G3G9 type=del 2024-09-14T11:04:18.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.578+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=RUQQNQ9WLIHX type=del size=1152180 2024-09-14T11:04:18.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.580+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.0 size=1048576 2024-09-14T11:04:18.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.581+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.1 size=1048576 2024-09-14T11:04:18.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.582+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~8DIWEQ2IHVSI.2 size=845475 2024-09-14T11:04:18.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.583+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=8DIWEQ2IHVSI tag=86ZEK2WB8948 type=write size=3991203 2024-09-14T11:04:18.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.585+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=ZXSCU2LCXQMM type=write size=801673 2024-09-14T11:04:18.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.587+0000 7f907bbdf780 1 < suggested update operation key=WAFH5BKM2P23 tag=5M61PD35RWTL type=del size=257537 2024-09-14T11:04:18.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.589+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.0 size=1048576 2024-09-14T11:04:18.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.590+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.1 size=1048576 2024-09-14T11:04:18.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.591+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.2 size=89465 2024-09-14T11:04:18.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.591+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=NZR41Y2JLEM1 tag=7AMQEKL3CEK7 type=write size=3235193 2024-09-14T11:04:18.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.592+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=2GPBMUHAD73J type=del 2024-09-14T11:04:18.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.593+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=YSSW3K5EK5D2 type=del size=1771041 2024-09-14T11:04:18.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.595+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=L3OVYCKSZYY5 type=del 2024-09-14T11:04:18.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.596+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=LMCM6ASMPOR2 type=del size=1761448 2024-09-14T11:04:18.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.597+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=ZKMSP3G9ZH40 type=del 2024-09-14T11:04:18.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.598+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=9XXN1OXQIKO0 type=write size=471423 2024-09-14T11:04:18.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.599+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~SMAGS8KLMSWZ.0 size=1048576 2024-09-14T11:04:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.600+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~SMAGS8KLMSWZ.1 size=259528 2024-09-14T11:04:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.602+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=SMAGS8KLMSWZ tag=LWNJT3DZ8806 type=write size=2356680 2024-09-14T11:04:18.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.604+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~LWLX1BJFVVUV.0 size=136063 2024-09-14T11:04:18.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.604+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=LWLX1BJFVVUV tag=381DM9WCZQJL type=write size=1184639 2024-09-14T11:04:18.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.606+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~YYOYD0UE87TV.0 size=759901 2024-09-14T11:04:18.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.608+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=YYOYD0UE87TV tag=TFOPPFO5CP0O type=write size=1808477 2024-09-14T11:04:18.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.609+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=UMXIKDPDLROV type=del size=281892 2024-09-14T11:04:18.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.610+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~QG14RCJVRE6O.0 size=774606 2024-09-14T11:04:18.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.612+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=QG14RCJVRE6O tag=OF6PM7T3MOUR type=write size=1823182 2024-09-14T11:04:18.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.614+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~IMMIA0W4IL77.0 size=5921 2024-09-14T11:04:18.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.614+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=IMMIA0W4IL77 tag=3VND4U9743VS type=write size=1054497 2024-09-14T11:04:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.616+0000 7f907bbdf780 1 < suggested remove operation key=P0701O36E1JI tag=7IMOEWEFOP6A type=del 2024-09-14T11:04:18.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.617+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=1CEB35KBYUOJ type=del size=1330650 2024-09-14T11:04:18.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.619+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=S2IYLDJ8C1ZO type=del 2024-09-14T11:04:18.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.620+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=9ZSAPDD1ECCM type=del size=3517778 2024-09-14T11:04:18.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.621+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=D0X1Y18I4PR6 type=del 2024-09-14T11:04:18.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.622+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=K1L73MXRBWKN type=write size=158298 2024-09-14T11:04:18.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.623+0000 7f907bbdf780 1 < canceled operation key=AGMKZ7PGPUAM tag=99TLGTCLRPJ7 type=del size=1005249 2024-09-14T11:04:18.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.624+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=SQ0CATQFNS3T type=write size=753757 2024-09-14T11:04:18.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.626+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.0 size=1048576 2024-09-14T11:04:18.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.627+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.1 size=1048576 2024-09-14T11:04:18.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.628+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~DHQKYUHFTATM.2 size=1023468 2024-09-14T11:04:18.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.630+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=DHQKYUHFTATM tag=YCHYPVYUXLKJ type=write size=4169196 2024-09-14T11:04:18.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.631+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=LWBC9XN9061Q type=del size=417891 2024-09-14T11:04:18.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.632+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~O6OVTO79CXRY.0 size=426889 2024-09-14T11:04:18.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.634+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=O6OVTO79CXRY tag=EOS89TA6ZZKX type=write size=1475465 2024-09-14T11:04:18.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.636+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~BWKLI1Y4U53K.0 size=835779 2024-09-14T11:04:18.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.636+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=BWKLI1Y4U53K tag=3PT06HZ6KZMJ type=write size=1884355 2024-09-14T11:04:18.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.637+0000 7f907bbdf780 1 < canceled operation key=WZ064RU647Y7 tag=HTKX1REZSR2Z type=write size=476321 2024-09-14T11:04:18.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.640+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~S1JV5Y399QTE.0 size=1015845 2024-09-14T11:04:18.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.640+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=S1JV5Y399QTE tag=TH07RPBHHPJP type=write size=2064421 2024-09-14T11:04:18.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.642+0000 7f907bbdf780 1 < suggested update operation key=5C8LLJF5MSVP tag=RUQQNQ9WLIHX type=del size=1152180 2024-09-14T11:04:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.644+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~01JL9M0N1ZHX.0 size=1048576 2024-09-14T11:04:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.645+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~01JL9M0N1ZHX.1 size=114027 2024-09-14T11:04:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.645+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=01JL9M0N1ZHX tag=PTL4A9SXLLIA type=write size=2211179 2024-09-14T11:04:18.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.647+0000 7f907bbdf780 1 < suggested update operation key=WAFH5BKM2P23 tag=ZXSCU2LCXQMM type=write size=801673 2024-09-14T11:04:18.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.648+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=BIMVX6PUP62N type=del size=2297780 2024-09-14T11:04:18.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.649+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.0 size=1048576 2024-09-14T11:04:18.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.650+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.1 size=1048576 2024-09-14T11:04:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.651+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~NZR41Y2JLEM1.2 size=89465 2024-09-14T11:04:18.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.653+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=NZR41Y2JLEM1 tag=7AMQEKL3CEK7 type=write size=3235193 2024-09-14T11:04:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.654+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=O0QFWM8LFS7O type=del size=400289 2024-09-14T11:04:18.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.656+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=YSSW3K5EK5D2 type=del 2024-09-14T11:04:18.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.658+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=OQR67NEHXZLU type=write size=354835 2024-09-14T11:04:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.659+0000 7f907bbdf780 1 < canceled operation key=59WHXDR0S8DM tag=LMCM6ASMPOR2 type=del size=1761448 2024-09-14T11:04:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.660+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=I3JAXBNQ6Q1J type=del size=1820391 2024-09-14T11:04:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.662+0000 7f907bbdf780 1 < suggested remove operation key=P546JCSFB00N tag=9XXN1OXQIKO0 type=write 2024-09-14T11:04:18.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.664+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.0 size=1048576 2024-09-14T11:04:18.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.665+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.1 size=1048576 2024-09-14T11:04:18.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.666+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.2 size=84808 2024-09-14T11:04:18.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.666+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=DBS71EG2C1Q6 tag=E3EC7034EEDT type=write size=3230536 2024-09-14T11:04:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.668+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~LWLX1BJFVVUV.0 size=136063 2024-09-14T11:04:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.670+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=LWLX1BJFVVUV tag=381DM9WCZQJL type=write size=1184639 2024-09-14T11:04:18.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.672+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=ZEGWP7TGREBY type=del size=2225161 2024-09-14T11:04:18.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.673+0000 7f907bbdf780 1 < canceled operation key=HM2GVOA72HHR tag=UMXIKDPDLROV type=del size=281892 2024-09-14T11:04:18.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.675+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=K419V31I32KF type=del size=1996680 2024-09-14T11:04:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.676+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~IMMIA0W4IL77.0 size=5921 2024-09-14T11:04:18.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.678+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=IMMIA0W4IL77 tag=3VND4U9743VS type=write size=1054497 2024-09-14T11:04:18.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.679+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=F42YLVIP84GB type=del size=2451069 2024-09-14T11:04:18.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.680+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=1CEB35KBYUOJ type=del 2024-09-14T11:04:18.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.682+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.0 size=1048576 2024-09-14T11:04:18.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.683+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.1 size=1048576 2024-09-14T11:04:18.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.684+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.2 size=905174 2024-09-14T11:04:18.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.684+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=IHCNDKNJ8JKA tag=93MU8RGA7VA5 type=write size=4050902 2024-09-14T11:04:18.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.686+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=9ZSAPDD1ECCM type=del 2024-09-14T11:04:18.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.687+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=727WDVFE03FQ type=del size=2936619 2024-09-14T11:04:18.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.688+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=K1L73MXRBWKN type=write size=158298 2024-09-14T11:04:18.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.689+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=2QF2IDLQIB70 type=del size=470330 2024-09-14T11:04:18.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.690+0000 7f907bbdf780 1 < completed write operation key=JEXUT5F7AKZ1 tag=SQ0CATQFNS3T type=write size=753757 2024-09-14T11:04:18.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.691+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=D1Q6RMQRR97F type=del size=2789588 2024-09-14T11:04:18.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.692+0000 7f907bbdf780 -1 < failed to complete operation key=WAFH5BKM2P23 tag=LWBC9XN9061Q type=del size=417891: (22) Invalid argument 2024-09-14T11:04:18.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.694+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=YOZDK0IJ3JRA type=del size=2934582 2024-09-14T11:04:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.695+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~BWKLI1Y4U53K.0 size=835779 2024-09-14T11:04:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.697+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=BWKLI1Y4U53K tag=3PT06HZ6KZMJ type=write size=1884355 2024-09-14T11:04:18.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.699+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~PEMX4FRE7SC8.0 size=1048576 2024-09-14T11:04:18.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.700+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~PEMX4FRE7SC8.1 size=882735 2024-09-14T11:04:18.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.700+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=PEMX4FRE7SC8 tag=3BFDKI6K8GM4 type=write size=2979887 2024-09-14T11:04:18.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.701+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~S1JV5Y399QTE.0 size=1015845 2024-09-14T11:04:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.703+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=S1JV5Y399QTE tag=TH07RPBHHPJP type=write size=2064421 2024-09-14T11:04:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.704+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=V6HQJZFFDSG1 type=del size=1684757 2024-09-14T11:04:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.705+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~01JL9M0N1ZHX.0 size=1048576 2024-09-14T11:04:18.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.706+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~01JL9M0N1ZHX.1 size=114027 2024-09-14T11:04:18.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.708+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=01JL9M0N1ZHX tag=PTL4A9SXLLIA type=write size=2211179 2024-09-14T11:04:18.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.710+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~0TP8A300PJEU.0 size=1048576 2024-09-14T11:04:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.711+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~0TP8A300PJEU.1 size=1040134 2024-09-14T11:04:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.711+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=0TP8A300PJEU tag=PWLM7VNM0CYG type=write size=3137286 2024-09-14T11:04:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.712+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=BIMVX6PUP62N type=del 2024-09-14T11:04:18.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.715+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~6TPTNAH6IZCU.0 size=1048576 2024-09-14T11:04:18.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.716+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~6TPTNAH6IZCU.1 size=100087 2024-09-14T11:04:18.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.716+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=6TPTNAH6IZCU tag=CDFADP142QYQ type=write size=2197239 2024-09-14T11:04:18.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.717+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=O0QFWM8LFS7O type=del 2024-09-14T11:04:18.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.718+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=6B9V9U8MYEMY type=write size=951859 2024-09-14T11:04:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.719+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=OQR67NEHXZLU type=write size=354835 2024-09-14T11:04:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.720+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=9N86FO6HIPK2 type=del size=3952067 2024-09-14T11:04:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.722+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=I3JAXBNQ6Q1J type=del 2024-09-14T11:04:18.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.723+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=BQS40L5XDRVO type=del size=336911 2024-09-14T11:04:18.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.724+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.0 size=1048576 2024-09-14T11:04:18.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.725+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.1 size=1048576 2024-09-14T11:04:18.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.727+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~DBS71EG2C1Q6.2 size=84808 2024-09-14T11:04:18.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.729+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=DBS71EG2C1Q6 tag=E3EC7034EEDT type=write size=3230536 2024-09-14T11:04:18.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.731+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.0 size=1048576 2024-09-14T11:04:18.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.732+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.1 size=1048576 2024-09-14T11:04:18.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.733+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.2 size=488685 2024-09-14T11:04:18.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.733+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=F8YDKWYQ2GBU tag=DBE81WMJ6QUO type=write size=3634413 2024-09-14T11:04:18.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.735+0000 7f907bbdf780 1 < canceled operation key=T81OF13I2JVH tag=ZEGWP7TGREBY type=del size=2225161 2024-09-14T11:04:18.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.736+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=007NLBK8E249 type=del size=1168827 2024-09-14T11:04:18.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.737+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=K419V31I32KF type=del 2024-09-14T11:04:18.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.739+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~M8VDLM80Q23F.0 size=1041476 2024-09-14T11:04:18.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.739+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=M8VDLM80Q23F tag=WBD717OAQ0ZN type=write size=2090052 2024-09-14T11:04:18.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.740+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=F42YLVIP84GB type=del 2024-09-14T11:04:18.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.742+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=BYHH0TX91V3I type=write size=807925 2024-09-14T11:04:18.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.743+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.0 size=1048576 2024-09-14T11:04:18.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.744+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.1 size=1048576 2024-09-14T11:04:18.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.745+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IHCNDKNJ8JKA.2 size=905174 2024-09-14T11:04:18.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.747+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=IHCNDKNJ8JKA tag=93MU8RGA7VA5 type=write size=4050902 2024-09-14T11:04:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.748+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=WIW16FV68EVM type=del size=1954596 2024-09-14T11:04:18.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.749+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=727WDVFE03FQ type=del 2024-09-14T11:04:18.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.751+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~AW0YA4SNCZ7K.0 size=1048576 2024-09-14T11:04:18.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.752+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~AW0YA4SNCZ7K.1 size=303835 2024-09-14T11:04:18.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.752+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=AW0YA4SNCZ7K tag=1EZ4G0V5L5AB type=write size=2400987 2024-09-14T11:04:18.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.755+0000 7f907bbdf780 1 < suggested remove operation key=5C8LLJF5MSVP tag=2QF2IDLQIB70 type=del 2024-09-14T11:04:18.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.757+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NLI9M1NMMC23.0 size=1048576 2024-09-14T11:04:18.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.758+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NLI9M1NMMC23.1 size=328488 2024-09-14T11:04:18.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.758+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=NLI9M1NMMC23 tag=C39ZF74U1PLQ type=write size=2425640 2024-09-14T11:04:18.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.760+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=D1Q6RMQRR97F type=del 2024-09-14T11:04:18.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.761+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=LSMQ61PBGTXM type=del size=473329 2024-09-14T11:04:18.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.762+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=YOZDK0IJ3JRA type=del 2024-09-14T11:04:18.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.764+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~FYCPCJ5MF6EL.0 size=1048576 2024-09-14T11:04:18.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.765+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~FYCPCJ5MF6EL.1 size=769124 2024-09-14T11:04:18.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.765+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=FYCPCJ5MF6EL tag=885B2CERNRT4 type=write size=2866276 2024-09-14T11:04:18.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.765+0000 7f907bbdf780 1 < canceled part key=_multipart_GC52N456IYD7.2~PEMX4FRE7SC8.0 size=1048576 2024-09-14T11:04:18.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.766+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~PEMX4FRE7SC8.1 size=882735 2024-09-14T11:04:18.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.769+0000 7f907bbdf780 1 < canceled multipart upload key=GC52N456IYD7 upload=PEMX4FRE7SC8 tag=3BFDKI6K8GM4 type=write size=2979887 2024-09-14T11:04:18.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.770+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=YSRATWBC7HTF type=del size=2487030 2024-09-14T11:04:18.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.773+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=V6HQJZFFDSG1 type=del 2024-09-14T11:04:18.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.774+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=XZLT6MNM6U31 type=del size=917228 2024-09-14T11:04:18.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.775+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~0TP8A300PJEU.0 size=1048576 2024-09-14T11:04:18.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.777+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~0TP8A300PJEU.1 size=1040134 2024-09-14T11:04:18.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.779+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=0TP8A300PJEU tag=PWLM7VNM0CYG type=write size=3137286 2024-09-14T11:04:18.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.781+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.0 size=1048576 2024-09-14T11:04:18.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.782+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.1 size=1048576 2024-09-14T11:04:18.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.784+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.2 size=847176 2024-09-14T11:04:18.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.784+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=J385KLCGG76U tag=33C5C16XPPOU type=write size=3992904 2024-09-14T11:04:18.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.785+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~6TPTNAH6IZCU.0 size=1048576 2024-09-14T11:04:18.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.786+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~6TPTNAH6IZCU.1 size=100087 2024-09-14T11:04:18.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.788+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=6TPTNAH6IZCU tag=CDFADP142QYQ type=write size=2197239 2024-09-14T11:04:18.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.790+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~YSN6CTGYKWE2.0 size=983762 2024-09-14T11:04:18.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.790+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=YSN6CTGYKWE2 tag=M3IN9IGBC8Z6 type=write size=2032338 2024-09-14T11:04:18.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.791+0000 7f907bbdf780 1 < completed write operation key=T81OF13I2JVH tag=6B9V9U8MYEMY type=write size=951859 2024-09-14T11:04:18.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.792+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=L5KUB8SDBMPC type=del size=2459296 2024-09-14T11:04:18.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.794+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=9N86FO6HIPK2 type=del 2024-09-14T11:04:18.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.795+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=IJ1XP3KLBMUL type=del size=3310450 2024-09-14T11:04:18.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.796+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=BQS40L5XDRVO type=del 2024-09-14T11:04:18.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.797+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=XU06A6H3BT86 type=del size=1678522 2024-09-14T11:04:18.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.798+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.0 size=1048576 2024-09-14T11:04:18.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.798+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.1 size=1048576 2024-09-14T11:04:18.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.799+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~F8YDKWYQ2GBU.2 size=488685 2024-09-14T11:04:18.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.801+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=F8YDKWYQ2GBU tag=DBE81WMJ6QUO type=write size=3634413 2024-09-14T11:04:18.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.803+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=QS793UA0IGAA type=del size=2949198 2024-09-14T11:04:18.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.804+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=007NLBK8E249 type=del 2024-09-14T11:04:18.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.805+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=0WCODJ30FELA type=del size=2469776 2024-09-14T11:04:18.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.806+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~M8VDLM80Q23F.0 size=1041476 2024-09-14T11:04:18.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.808+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=M8VDLM80Q23F tag=WBD717OAQ0ZN type=write size=2090052 2024-09-14T11:04:18.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.809+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=MDCQDMSGUSUA type=del size=1187902 2024-09-14T11:04:18.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.810+0000 7f907bbdf780 -1 < failed to complete operation key=5C8LLJF5MSVP tag=BYHH0TX91V3I type=write size=807925: (22) Invalid argument 2024-09-14T11:04:18.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.812+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=KUAE8FX4278X type=del size=2988038 2024-09-14T11:04:18.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.813+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=WIW16FV68EVM type=del 2024-09-14T11:04:18.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.815+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.0 size=1048576 2024-09-14T11:04:18.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.816+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.1 size=1048576 2024-09-14T11:04:18.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.817+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.2 size=133018 2024-09-14T11:04:18.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.817+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=2PT7OVAV3Y9A tag=A293H5ON3NAP type=write size=3278746 2024-09-14T11:04:18.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.818+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~AW0YA4SNCZ7K.0 size=1048576 2024-09-14T11:04:18.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.819+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~AW0YA4SNCZ7K.1 size=303835 2024-09-14T11:04:18.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.820+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=AW0YA4SNCZ7K tag=1EZ4G0V5L5AB type=write size=2400987 2024-09-14T11:04:18.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.823+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~CAWPSNWFU4GL.0 size=882605 2024-09-14T11:04:18.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.823+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=CAWPSNWFU4GL tag=HJJKWPFGHW6P type=write size=1931181 2024-09-14T11:04:18.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.824+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NLI9M1NMMC23.0 size=1048576 2024-09-14T11:04:18.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.825+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NLI9M1NMMC23.1 size=328488 2024-09-14T11:04:18.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.827+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=NLI9M1NMMC23 tag=C39ZF74U1PLQ type=write size=2425640 2024-09-14T11:04:18.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.828+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=QW6KZ15ZEJV8 type=del size=3827864 2024-09-14T11:04:18.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.829+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=LSMQ61PBGTXM type=del 2024-09-14T11:04:18.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.830+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=KJ6ZR1Q3O9DZ type=del size=2639039 2024-09-14T11:04:18.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.831+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~FYCPCJ5MF6EL.0 size=1048576 2024-09-14T11:04:18.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.832+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~FYCPCJ5MF6EL.1 size=769124 2024-09-14T11:04:18.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.834+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=FYCPCJ5MF6EL tag=885B2CERNRT4 type=write size=2866276 2024-09-14T11:04:18.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.835+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=RSPRE0SG72TY type=del size=4043343 2024-09-14T11:04:18.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.836+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=YSRATWBC7HTF type=del 2024-09-14T11:04:18.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.837+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=R504D1WZOKFI type=del size=757299 2024-09-14T11:04:18.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.838+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=XZLT6MNM6U31 type=del 2024-09-14T11:04:18.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.840+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=WB4S0HTX8Q0B type=del size=2204881 2024-09-14T11:04:18.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.841+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.0 size=1048576 2024-09-14T11:04:18.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.842+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.1 size=1048576 2024-09-14T11:04:18.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.842+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~J385KLCGG76U.2 size=847176 2024-09-14T11:04:18.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.844+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=J385KLCGG76U tag=33C5C16XPPOU type=write size=3992904 2024-09-14T11:04:18.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.845+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=HCCE20EVMJSV type=del size=179965 2024-09-14T11:04:18.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.847+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~YSN6CTGYKWE2.0 size=983762 2024-09-14T11:04:18.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.848+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=YSN6CTGYKWE2 tag=M3IN9IGBC8Z6 type=write size=2032338 2024-09-14T11:04:18.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.850+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.0 size=1048576 2024-09-14T11:04:18.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.851+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.1 size=1048576 2024-09-14T11:04:18.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.852+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.2 size=341387 2024-09-14T11:04:18.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.852+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=ZC2QD50638W9 tag=XQ59T42XGP5T type=write size=3487115 2024-09-14T11:04:18.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.853+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=L5KUB8SDBMPC type=del 2024-09-14T11:04:18.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.855+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~F3EMFZLPGXZE.0 size=756334 2024-09-14T11:04:18.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.855+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=F3EMFZLPGXZE tag=8HV2VIWG57XB type=write size=1804910 2024-09-14T11:04:18.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.857+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=IJ1XP3KLBMUL type=del 2024-09-14T11:04:18.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.858+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=X716YD1B1JO2 type=del size=838764 2024-09-14T11:04:18.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.859+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=XU06A6H3BT86 type=del 2024-09-14T11:04:18.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.860+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=70XVPFBU24P9 type=del size=28373 2024-09-14T11:04:18.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.861+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=QS793UA0IGAA type=del 2024-09-14T11:04:18.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.862+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=R1EFX3QVQT1A type=del size=335422 2024-09-14T11:04:18.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.863+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=0WCODJ30FELA type=del 2024-09-14T11:04:18.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.865+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=D38LUBNJE0ME type=del size=902656 2024-09-14T11:04:18.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.866+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=MDCQDMSGUSUA type=del 2024-09-14T11:04:18.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.867+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=1UHJ58G7L71Z type=del size=2993893 2024-09-14T11:04:18.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.868+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=KUAE8FX4278X type=del 2024-09-14T11:04:18.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.870+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~XN2K66ZM3YP9.0 size=1048576 2024-09-14T11:04:18.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.871+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~XN2K66ZM3YP9.1 size=196283 2024-09-14T11:04:18.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.871+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=XN2K66ZM3YP9 tag=T0YE1ZMWG04G type=write size=2293435 2024-09-14T11:04:18.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.871+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.0 size=1048576 2024-09-14T11:04:18.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.872+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.1 size=1048576 2024-09-14T11:04:18.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.873+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~2PT7OVAV3Y9A.2 size=133018 2024-09-14T11:04:18.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.875+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=2PT7OVAV3Y9A tag=A293H5ON3NAP type=write size=3278746 2024-09-14T11:04:18.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.877+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~H53VR8633LRT.0 size=1048576 2024-09-14T11:04:18.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.878+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~H53VR8633LRT.1 size=570022 2024-09-14T11:04:18.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.878+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=H53VR8633LRT tag=FJW9F73J7MHL type=write size=2667174 2024-09-14T11:04:18.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.879+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~CAWPSNWFU4GL.0 size=882605 2024-09-14T11:04:18.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.882+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=CAWPSNWFU4GL tag=HJJKWPFGHW6P type=write size=1931181 2024-09-14T11:04:18.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.883+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=G19YQ30UL27H type=del size=3167512 2024-09-14T11:04:18.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.884+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=QW6KZ15ZEJV8 type=del 2024-09-14T11:04:18.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.885+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=L6L6KH5BPHD4 type=del size=1196543 2024-09-14T11:04:18.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.887+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=KJ6ZR1Q3O9DZ type=del 2024-09-14T11:04:18.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.888+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=VJ1DVFB4AXSL type=del size=1394844 2024-09-14T11:04:18.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.889+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=RSPRE0SG72TY type=del 2024-09-14T11:04:18.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.891+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~PGZK0YDOA41J.0 size=383536 2024-09-14T11:04:18.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.891+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=PGZK0YDOA41J tag=8MN43ZLN3M0K type=write size=1432112 2024-09-14T11:04:18.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.892+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=R504D1WZOKFI type=del 2024-09-14T11:04:18.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.893+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=4O7Z3TQFA59J type=del size=4083437 2024-09-14T11:04:18.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.895+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=WB4S0HTX8Q0B type=del 2024-09-14T11:04:18.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.896+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=MNV4YKVKOWHO type=del size=347051 2024-09-14T11:04:18.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.897+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=HCCE20EVMJSV type=del 2024-09-14T11:04:18.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.899+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~7A0KX5UP38FB.0 size=1048576 2024-09-14T11:04:18.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.900+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~7A0KX5UP38FB.1 size=234606 2024-09-14T11:04:18.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.900+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=7A0KX5UP38FB tag=N50HGEVA8LAH type=write size=2331758 2024-09-14T11:04:18.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.901+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.0 size=1048576 2024-09-14T11:04:18.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.903+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.1 size=1048576 2024-09-14T11:04:18.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.904+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~ZC2QD50638W9.2 size=341387 2024-09-14T11:04:18.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.906+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=ZC2QD50638W9 tag=XQ59T42XGP5T type=write size=3487115 2024-09-14T11:04:18.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.908+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.0 size=1048576 2024-09-14T11:04:18.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.909+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.1 size=1048576 2024-09-14T11:04:18.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.910+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.2 size=406315 2024-09-14T11:04:18.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.910+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=FWBRB4FH9TQ8 tag=T4XUKB30H58A type=write size=3552043 2024-09-14T11:04:18.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.911+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~F3EMFZLPGXZE.0 size=756334 2024-09-14T11:04:18.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.913+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=F3EMFZLPGXZE tag=8HV2VIWG57XB type=write size=1804910 2024-09-14T11:04:18.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.914+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=2HEWYX9VDVBG type=del size=1029634 2024-09-14T11:04:18.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.915+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=X716YD1B1JO2 type=del 2024-09-14T11:04:18.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.918+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~DNBZH9BVXNA7.0 size=714607 2024-09-14T11:04:18.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.918+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=DNBZH9BVXNA7 tag=L0X2ABN1AOFE type=write size=1763183 2024-09-14T11:04:18.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.919+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=70XVPFBU24P9 type=del 2024-09-14T11:04:18.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.920+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=WIU8FLAUI31G type=del size=3837920 2024-09-14T11:04:18.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.921+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=R1EFX3QVQT1A type=del 2024-09-14T11:04:18.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.924+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~VO28V544AK5A.0 size=1048576 2024-09-14T11:04:18.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.924+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~VO28V544AK5A.1 size=623485 2024-09-14T11:04:18.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.924+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=VO28V544AK5A tag=SRFAQ536AKR9 type=write size=2720637 2024-09-14T11:04:18.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.926+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=D38LUBNJE0ME type=del 2024-09-14T11:04:18.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.927+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=0V0R4LW6KGEH type=del size=3042101 2024-09-14T11:04:18.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.929+0000 7f907bbdf780 1 < suggested update operation key=5C8LLJF5MSVP tag=1UHJ58G7L71Z type=del size=2993893 2024-09-14T11:04:18.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.932+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~RLNBJSKX7Q9S.0 size=1048576 2024-09-14T11:04:18.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.933+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~RLNBJSKX7Q9S.1 size=627621 2024-09-14T11:04:18.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.933+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=RLNBJSKX7Q9S tag=DF6Z7GMY2IRT type=write size=2724773 2024-09-14T11:04:18.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.934+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~XN2K66ZM3YP9.0 size=1048576 2024-09-14T11:04:18.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.935+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~XN2K66ZM3YP9.1 size=196283 2024-09-14T11:04:18.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.937+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=XN2K66ZM3YP9 tag=T0YE1ZMWG04G type=write size=2293435 2024-09-14T11:04:18.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.940+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~NPHDNI5B2PL0.0 size=1048576 2024-09-14T11:04:18.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.941+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~NPHDNI5B2PL0.1 size=323955 2024-09-14T11:04:18.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.941+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=NPHDNI5B2PL0 tag=ZBUI6SZ3R57S type=write size=2421107 2024-09-14T11:04:18.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.942+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~H53VR8633LRT.0 size=1048576 2024-09-14T11:04:18.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.943+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~H53VR8633LRT.1 size=570022 2024-09-14T11:04:18.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.945+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=H53VR8633LRT tag=FJW9F73J7MHL type=write size=2667174 2024-09-14T11:04:18.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.948+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~9RDUWI43Y81L.0 size=1048576 2024-09-14T11:04:18.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.949+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~9RDUWI43Y81L.1 size=122053 2024-09-14T11:04:18.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.949+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=9RDUWI43Y81L tag=7NWGT13CV7A8 type=write size=2219205 2024-09-14T11:04:18.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.951+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=G19YQ30UL27H type=del 2024-09-14T11:04:18.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.953+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~SSYPPDGGLLDG.0 size=1043237 2024-09-14T11:04:18.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.953+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=SSYPPDGGLLDG tag=L72CM2LC6F1R type=write size=2091813 2024-09-14T11:04:18.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.955+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=L6L6KH5BPHD4 type=del 2024-09-14T11:04:18.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.956+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=OKF1DSH7TWPO type=del size=547896 2024-09-14T11:04:18.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.959+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=VJ1DVFB4AXSL type=del size=1394844 2024-09-14T11:04:18.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.960+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=U4ZUUHWDD2FH type=write size=724767 2024-09-14T11:04:18.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.961+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~PGZK0YDOA41J.0 size=383536 2024-09-14T11:04:18.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.963+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=PGZK0YDOA41J tag=8MN43ZLN3M0K type=write size=1432112 2024-09-14T11:04:18.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.965+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=KLF6YCUM5LC7 type=del size=3358042 2024-09-14T11:04:18.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.966+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=4O7Z3TQFA59J type=del 2024-09-14T11:04:18.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.969+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.0 size=1048576 2024-09-14T11:04:18.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.970+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.1 size=1048576 2024-09-14T11:04:18.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.971+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.2 size=315477 2024-09-14T11:04:18.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.971+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=LPANM3X03QA6 tag=O7JGUCCKN9KX type=write size=3461205 2024-09-14T11:04:18.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.972+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=MNV4YKVKOWHO type=del 2024-09-14T11:04:18.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.973+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=ZOSLZT7XBVNO type=write size=880124 2024-09-14T11:04:18.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.974+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~7A0KX5UP38FB.0 size=1048576 2024-09-14T11:04:18.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.975+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~7A0KX5UP38FB.1 size=234606 2024-09-14T11:04:18.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.977+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=7A0KX5UP38FB tag=N50HGEVA8LAH type=write size=2331758 2024-09-14T11:04:18.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.978+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=BZHJP037US5F type=write size=388420 2024-09-14T11:04:18.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.980+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.0 size=1048576 2024-09-14T11:04:18.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.981+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.1 size=1048576 2024-09-14T11:04:18.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.982+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~FWBRB4FH9TQ8.2 size=406315 2024-09-14T11:04:18.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.984+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=FWBRB4FH9TQ8 tag=T4XUKB30H58A type=write size=3552043 2024-09-14T11:04:18.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.986+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~T4WBBLEKQI2P.0 size=149645 2024-09-14T11:04:18.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.986+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=T4WBBLEKQI2P tag=1HXHCBBK0U4R type=write size=1198221 2024-09-14T11:04:18.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.987+0000 7f907bbdf780 -1 < failed to complete operation key=WZ064RU647Y7 tag=2HEWYX9VDVBG type=del size=1029634: (22) Invalid argument 2024-09-14T11:04:18.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.988+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=TPOLJ2U3B5WO type=del size=2213803 2024-09-14T11:04:18.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.989+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~DNBZH9BVXNA7.0 size=714607 2024-09-14T11:04:18.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.991+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=DNBZH9BVXNA7 tag=L0X2ABN1AOFE type=write size=1763183 2024-09-14T11:04:18.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.992+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=3H309MDVXO54 type=del size=1854006 2024-09-14T11:04:18.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.994+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=WIU8FLAUI31G type=del 2024-09-14T11:04:18.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.996+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=IRJYT17F7NG5 type=del size=3839550 2024-09-14T11:04:18.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.997+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~VO28V544AK5A.0 size=1048576 2024-09-14T11:04:18.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:18.998+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~VO28V544AK5A.1 size=623485 2024-09-14T11:04:18.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.000+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=VO28V544AK5A tag=SRFAQ536AKR9 type=write size=2720637 2024-09-14T11:04:18.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.001+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=OA8AG323NHAP type=write size=797784 2024-09-14T11:04:19.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.002+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=0V0R4LW6KGEH type=del 2024-09-14T11:04:19.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.004+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~1X0D4C2FSXV3.0 size=948866 2024-09-14T11:04:19.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.004+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=1X0D4C2FSXV3 tag=4R2RF9N9X4HO type=write size=1997442 2024-09-14T11:04:19.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.005+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~RLNBJSKX7Q9S.0 size=1048576 2024-09-14T11:04:19.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.006+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~RLNBJSKX7Q9S.1 size=627621 2024-09-14T11:04:19.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.008+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=RLNBJSKX7Q9S tag=DF6Z7GMY2IRT type=write size=2724773 2024-09-14T11:04:19.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.011+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~7UBCCI4TQTO6.0 size=1048576 2024-09-14T11:04:19.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.012+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~7UBCCI4TQTO6.1 size=581342 2024-09-14T11:04:19.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.012+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=7UBCCI4TQTO6 tag=13KPJYPDS78G type=write size=2678494 2024-09-14T11:04:19.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.012+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~NPHDNI5B2PL0.0 size=1048576 2024-09-14T11:04:19.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.013+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~NPHDNI5B2PL0.1 size=323955 2024-09-14T11:04:19.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.015+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=NPHDNI5B2PL0 tag=ZBUI6SZ3R57S type=write size=2421107 2024-09-14T11:04:19.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.016+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=QF52XTHUS5T2 type=del size=1459453 2024-09-14T11:04:19.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.017+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~9RDUWI43Y81L.0 size=1048576 2024-09-14T11:04:19.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.018+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~9RDUWI43Y81L.1 size=122053 2024-09-14T11:04:19.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.020+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=9RDUWI43Y81L tag=7NWGT13CV7A8 type=write size=2219205 2024-09-14T11:04:19.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.022+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=2C87HO980LCP type=del size=3924443 2024-09-14T11:04:19.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.023+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~SSYPPDGGLLDG.0 size=1043237 2024-09-14T11:04:19.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.025+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=SSYPPDGGLLDG tag=L72CM2LC6F1R type=write size=2091813 2024-09-14T11:04:19.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.027+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~UU0ZLT6V7JMM.0 size=1048576 2024-09-14T11:04:19.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.029+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~UU0ZLT6V7JMM.1 size=579278 2024-09-14T11:04:19.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.029+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=UU0ZLT6V7JMM tag=9UL16BJGGMCZ type=write size=2676430 2024-09-14T11:04:19.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.030+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=OKF1DSH7TWPO type=del 2024-09-14T11:04:19.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.031+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=TXMMSXC1J5ML type=write size=237241 2024-09-14T11:04:19.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.032+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=U4ZUUHWDD2FH type=write size=724767 2024-09-14T11:04:19.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.034+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=AITBE5JTLX0H type=del size=460286 2024-09-14T11:04:19.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.035+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=KLF6YCUM5LC7 type=del 2024-09-14T11:04:19.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.036+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=72YIQ5CGBQBL type=del size=1246461 2024-09-14T11:04:19.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.038+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.0 size=1048576 2024-09-14T11:04:19.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.039+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.1 size=1048576 2024-09-14T11:04:19.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.040+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~LPANM3X03QA6.2 size=315477 2024-09-14T11:04:19.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.042+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=LPANM3X03QA6 tag=O7JGUCCKN9KX type=write size=3461205 2024-09-14T11:04:19.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.043+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=EATU4CX2Y2IQ type=write size=108413 2024-09-14T11:04:19.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.044+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=ZOSLZT7XBVNO type=write size=880124 2024-09-14T11:04:19.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.045+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=HOW21OGH8BCL type=del size=3809688 2024-09-14T11:04:19.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.046+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=BZHJP037US5F type=write size=388420 2024-09-14T11:04:19.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.049+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~SQOFJ8S9EBV7.0 size=534089 2024-09-14T11:04:19.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.049+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=SQOFJ8S9EBV7 tag=W5XQKUI9JR7X type=write size=1582665 2024-09-14T11:04:19.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.050+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~T4WBBLEKQI2P.0 size=149645 2024-09-14T11:04:19.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.052+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=T4WBBLEKQI2P tag=1HXHCBBK0U4R type=write size=1198221 2024-09-14T11:04:19.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.054+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~592OGK286H0I.0 size=967346 2024-09-14T11:04:19.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.055+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=592OGK286H0I tag=QG0SRN6R5LYQ type=write size=2015922 2024-09-14T11:04:19.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.057+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=TPOLJ2U3B5WO type=del 2024-09-14T11:04:19.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.058+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=3P4O262QDW7X type=del size=3498060 2024-09-14T11:04:19.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.060+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=3H309MDVXO54 type=del 2024-09-14T11:04:19.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.062+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~4G17Z6NTX5OH.0 size=1048576 2024-09-14T11:04:19.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.063+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~4G17Z6NTX5OH.1 size=908642 2024-09-14T11:04:19.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.063+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=4G17Z6NTX5OH tag=Z4PUNQT31AYJ type=write size=3005794 2024-09-14T11:04:19.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.064+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=IRJYT17F7NG5 type=del 2024-09-14T11:04:19.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.066+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=OGRT5E8W8L9T type=del size=3314974 2024-09-14T11:04:19.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.067+0000 7f907bbdf780 -1 < failed to complete operation key=9OKQI3W8M5GA tag=OA8AG323NHAP type=write size=797784: (22) Invalid argument 2024-09-14T11:04:19.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.069+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~D2H9VHTRALPT.0 size=1048576 2024-09-14T11:04:19.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.070+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~D2H9VHTRALPT.1 size=713827 2024-09-14T11:04:19.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.070+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=D2H9VHTRALPT tag=4BXCE7U5AJ6L type=write size=2810979 2024-09-14T11:04:19.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.071+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~1X0D4C2FSXV3.0 size=948866 2024-09-14T11:04:19.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.074+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=1X0D4C2FSXV3 tag=4R2RF9N9X4HO type=write size=1997442 2024-09-14T11:04:19.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.076+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~C0MJDT7HSD1K.0 size=1048576 2024-09-14T11:04:19.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.077+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~C0MJDT7HSD1K.1 size=539282 2024-09-14T11:04:19.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.077+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=C0MJDT7HSD1K tag=XZIVIMKK5HM2 type=write size=2636434 2024-09-14T11:04:19.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.079+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~7UBCCI4TQTO6.0 size=1048576 2024-09-14T11:04:19.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.080+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~7UBCCI4TQTO6.1 size=581342 2024-09-14T11:04:19.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.081+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=7UBCCI4TQTO6 tag=13KPJYPDS78G type=write size=2678494 2024-09-14T11:04:19.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.083+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=XA2TQYOKOF7I type=del size=952166 2024-09-14T11:04:19.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.084+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=QF52XTHUS5T2 type=del 2024-09-14T11:04:19.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.085+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=5LALKSMLT3PH type=del size=3114668 2024-09-14T11:04:19.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.086+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=2C87HO980LCP type=del 2024-09-14T11:04:19.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.088+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~3LOWFMFRI29P.0 size=1048576 2024-09-14T11:04:19.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.090+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~3LOWFMFRI29P.1 size=481764 2024-09-14T11:04:19.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.090+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=3LOWFMFRI29P tag=CRM7DIB0VWVT type=write size=2578916 2024-09-14T11:04:19.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.091+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~UU0ZLT6V7JMM.0 size=1048576 2024-09-14T11:04:19.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.092+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~UU0ZLT6V7JMM.1 size=579278 2024-09-14T11:04:19.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.094+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=UU0ZLT6V7JMM tag=9UL16BJGGMCZ type=write size=2676430 2024-09-14T11:04:19.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.095+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=U84OZ05CR0YJ type=del size=3543543 2024-09-14T11:04:19.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.097+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=TXMMSXC1J5ML type=write size=237241 2024-09-14T11:04:19.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.099+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~2CSV8VNSMMAE.0 size=617835 2024-09-14T11:04:19.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.099+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=2CSV8VNSMMAE tag=QK75VDAEJ4V3 type=write size=1666411 2024-09-14T11:04:19.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.100+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=AITBE5JTLX0H type=del 2024-09-14T11:04:19.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.101+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=3FXN9AXSE5Y1 type=del size=978470 2024-09-14T11:04:19.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.104+0000 7f907bbdf780 1 < suggested update operation key=YH0YMRDQERBF tag=72YIQ5CGBQBL type=del size=1246461 2024-09-14T11:04:19.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.106+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.0 size=1048576 2024-09-14T11:04:19.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.107+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.1 size=1048576 2024-09-14T11:04:19.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.108+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.2 size=295245 2024-09-14T11:04:19.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.108+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=U3II95I3RWD4 tag=FVW1TMY0FRF0 type=write size=3440973 2024-09-14T11:04:19.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.109+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=EATU4CX2Y2IQ type=write size=108413 2024-09-14T11:04:19.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.112+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~1PKY4IZOIYWX.0 size=663975 2024-09-14T11:04:19.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.112+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=1PKY4IZOIYWX tag=TH9RJGC51VVI type=write size=1712551 2024-09-14T11:04:19.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.113+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=HOW21OGH8BCL type=del 2024-09-14T11:04:19.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.114+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=34W0Y705EIEB type=del size=2417274 2024-09-14T11:04:19.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.115+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~SQOFJ8S9EBV7.0 size=534089 2024-09-14T11:04:19.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.117+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=SQOFJ8S9EBV7 tag=W5XQKUI9JR7X type=write size=1582665 2024-09-14T11:04:19.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.119+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=NSKLKYXC32ZY type=del size=4141423 2024-09-14T11:04:19.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.120+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~592OGK286H0I.0 size=967346 2024-09-14T11:04:19.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.122+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=592OGK286H0I tag=QG0SRN6R5LYQ type=write size=2015922 2024-09-14T11:04:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.123+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=OTEX88J1HPDX type=del size=1316250 2024-09-14T11:04:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.124+0000 7f907bbdf780 1 < canceled operation key=8C398XZ7XKU7 tag=3P4O262QDW7X type=del size=3498060 2024-09-14T11:04:19.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.125+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=NKCOMNV90ERS type=del size=2902449 2024-09-14T11:04:19.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.127+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~4G17Z6NTX5OH.0 size=1048576 2024-09-14T11:04:19.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.127+0000 7f907bbdf780 1 < canceled part key=_multipart_LQNZKMX52SWO.2~4G17Z6NTX5OH.1 size=908642 2024-09-14T11:04:19.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.129+0000 7f907bbdf780 1 < canceled multipart upload key=LQNZKMX52SWO upload=4G17Z6NTX5OH tag=Z4PUNQT31AYJ type=write size=3005794 2024-09-14T11:04:19.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.131+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~57LNMM8OAO8R.0 size=846255 2024-09-14T11:04:19.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.131+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=57LNMM8OAO8R tag=CYJ26FQET7UQ type=write size=1894831 2024-09-14T11:04:19.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.132+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=OGRT5E8W8L9T type=del 2024-09-14T11:04:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.133+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=57HCYNQWVK3W type=del size=2820583 2024-09-14T11:04:19.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.134+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~D2H9VHTRALPT.0 size=1048576 2024-09-14T11:04:19.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.135+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~D2H9VHTRALPT.1 size=713827 2024-09-14T11:04:19.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.137+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=D2H9VHTRALPT tag=4BXCE7U5AJ6L type=write size=2810979 2024-09-14T11:04:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.138+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=LG52YAO8AYAE type=del size=1566068 2024-09-14T11:04:19.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.139+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~C0MJDT7HSD1K.0 size=1048576 2024-09-14T11:04:19.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.140+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~C0MJDT7HSD1K.1 size=539282 2024-09-14T11:04:19.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.142+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=C0MJDT7HSD1K tag=XZIVIMKK5HM2 type=write size=2636434 2024-09-14T11:04:19.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.143+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=3U5HJQG1HNH3 type=del size=3020171 2024-09-14T11:04:19.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.145+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=XA2TQYOKOF7I type=del 2024-09-14T11:04:19.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.146+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=9L73TWDS7AAZ type=write size=369926 2024-09-14T11:04:19.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.147+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=5LALKSMLT3PH type=del 2024-09-14T11:04:19.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.148+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=14RI7Y7Q3MNM type=del size=2281445 2024-09-14T11:04:19.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.149+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~3LOWFMFRI29P.0 size=1048576 2024-09-14T11:04:19.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.149+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~3LOWFMFRI29P.1 size=481764 2024-09-14T11:04:19.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.151+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=3LOWFMFRI29P tag=CRM7DIB0VWVT type=write size=2578916 2024-09-14T11:04:19.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.153+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~FT4121IMPD2K.0 size=572254 2024-09-14T11:04:19.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.153+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=FT4121IMPD2K tag=IMVWZLIH35U9 type=write size=1620830 2024-09-14T11:04:19.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.156+0000 7f907bbdf780 1 < suggested update operation key=5MFLA6XFV3Y5 tag=U84OZ05CR0YJ type=del size=3543543 2024-09-14T11:04:19.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.158+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.0 size=1048576 2024-09-14T11:04:19.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.159+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.1 size=1048576 2024-09-14T11:04:19.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.160+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.2 size=612507 2024-09-14T11:04:19.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.160+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=79P4E34Z8ZNZ tag=EZLLLOGCIZ4E type=write size=3758235 2024-09-14T11:04:19.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.161+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~2CSV8VNSMMAE.0 size=617835 2024-09-14T11:04:19.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.163+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=2CSV8VNSMMAE tag=QK75VDAEJ4V3 type=write size=1666411 2024-09-14T11:04:19.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.164+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=BXC6DXUQ4ZOQ type=write size=634084 2024-09-14T11:04:19.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.165+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=3FXN9AXSE5Y1 type=del 2024-09-14T11:04:19.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.167+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~VZCISYKALCC1.0 size=490669 2024-09-14T11:04:19.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.167+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=VZCISYKALCC1 tag=G7B0KHJBPZAY type=write size=1539245 2024-09-14T11:04:19.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.169+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.0 size=1048576 2024-09-14T11:04:19.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.169+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.1 size=1048576 2024-09-14T11:04:19.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.170+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~U3II95I3RWD4.2 size=295245 2024-09-14T11:04:19.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.172+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=U3II95I3RWD4 tag=FVW1TMY0FRF0 type=write size=3440973 2024-09-14T11:04:19.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.173+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=4JZFH3O7EDBU type=write size=973193 2024-09-14T11:04:19.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.174+0000 7f907bbdf780 1 < canceled part key=_multipart_9OKQI3W8M5GA.2~1PKY4IZOIYWX.0 size=663975 2024-09-14T11:04:19.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.175+0000 7f907bbdf780 1 < canceled multipart upload key=9OKQI3W8M5GA upload=1PKY4IZOIYWX tag=TH9RJGC51VVI type=write size=1712551 2024-09-14T11:04:19.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.177+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~1I62VMKZB9XO.0 size=1048576 2024-09-14T11:04:19.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.178+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~1I62VMKZB9XO.1 size=529190 2024-09-14T11:04:19.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.178+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=1I62VMKZB9XO tag=57GIVLBSHDBX type=write size=2626342 2024-09-14T11:04:19.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.180+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=34W0Y705EIEB type=del 2024-09-14T11:04:19.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.182+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.0 size=1048576 2024-09-14T11:04:19.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.183+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.1 size=1048576 2024-09-14T11:04:19.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.183+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.2 size=574284 2024-09-14T11:04:19.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.183+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=636G1NBPDPPP tag=AXRTF0WAHMTU type=write size=3720012 2024-09-14T11:04:19.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.185+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=NSKLKYXC32ZY type=del 2024-09-14T11:04:19.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.186+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=WJ9SWP2ML9M0 type=del size=2112927 2024-09-14T11:04:19.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.188+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=OTEX88J1HPDX type=del size=1316250 2024-09-14T11:04:19.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.189+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=HB93X7799V33 type=del size=2615295 2024-09-14T11:04:19.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.192+0000 7f907bbdf780 1 < suggested remove operation key=VRQ0ZNN9FG4C tag=NKCOMNV90ERS type=del 2024-09-14T11:04:19.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.194+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.0 size=1048576 2024-09-14T11:04:19.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.195+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.1 size=1048576 2024-09-14T11:04:19.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.196+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.2 size=790203 2024-09-14T11:04:19.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.196+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=W2U4TIXGUDJV tag=GO99KBB5T4U9 type=write size=3935931 2024-09-14T11:04:19.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.197+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~57LNMM8OAO8R.0 size=846255 2024-09-14T11:04:19.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.199+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=57LNMM8OAO8R tag=CYJ26FQET7UQ type=write size=1894831 2024-09-14T11:04:19.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.200+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=85UI94THFB70 type=del size=931201 2024-09-14T11:04:19.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.202+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=57HCYNQWVK3W type=del size=2820583 2024-09-14T11:04:19.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.203+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=5R9VQ4RP4WV8 type=del size=337582 2024-09-14T11:04:19.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.205+0000 7f907bbdf780 1 < canceled operation key=LQNZKMX52SWO tag=LG52YAO8AYAE type=del size=1566068 2024-09-14T11:04:19.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.206+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=CKX1JZLHCNWD type=write size=303181 2024-09-14T11:04:19.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.207+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=3U5HJQG1HNH3 type=del 2024-09-14T11:04:19.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.208+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=4385GIH1SZ2P type=del size=1286345 2024-09-14T11:04:19.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.210+0000 7f907bbdf780 1 < completed write operation key=P0701O36E1JI tag=9L73TWDS7AAZ type=write size=369926 2024-09-14T11:04:19.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.211+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=VJIYBBE1WSCZ type=del size=3355702 2024-09-14T11:04:19.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.212+0000 7f907bbdf780 -1 < failed to complete operation key=WZ064RU647Y7 tag=14RI7Y7Q3MNM type=del size=2281445: (22) Invalid argument 2024-09-14T11:04:19.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.214+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~LKLVRFQP0RRN.0 size=1048576 2024-09-14T11:04:19.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.215+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~LKLVRFQP0RRN.1 size=699697 2024-09-14T11:04:19.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.215+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=LKLVRFQP0RRN tag=5L16O3SPMUYL type=write size=2796849 2024-09-14T11:04:19.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.216+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~FT4121IMPD2K.0 size=572254 2024-09-14T11:04:19.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.218+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=FT4121IMPD2K tag=IMVWZLIH35U9 type=write size=1620830 2024-09-14T11:04:19.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.220+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=JTO7PIH93ICI type=del size=2105131 2024-09-14T11:04:19.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.221+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.0 size=1048576 2024-09-14T11:04:19.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.222+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.1 size=1048576 2024-09-14T11:04:19.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.223+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~79P4E34Z8ZNZ.2 size=612507 2024-09-14T11:04:19.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.225+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=79P4E34Z8ZNZ tag=EZLLLOGCIZ4E type=write size=3758235 2024-09-14T11:04:19.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.226+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=5H12A10YCUWA type=del size=3958342 2024-09-14T11:04:19.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.228+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=BXC6DXUQ4ZOQ type=write size=634084 2024-09-14T11:04:19.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.230+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.0 size=1048576 2024-09-14T11:04:19.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.231+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.1 size=1048576 2024-09-14T11:04:19.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.232+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.2 size=573675 2024-09-14T11:04:19.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.232+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=EO83V4J1LH5T tag=W9BDHO5L9BJN type=write size=3719403 2024-09-14T11:04:19.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.234+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~VZCISYKALCC1.0 size=490669 2024-09-14T11:04:19.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.236+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=VZCISYKALCC1 tag=G7B0KHJBPZAY type=write size=1539245 2024-09-14T11:04:19.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.238+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~SSQNBLMSOWJL.0 size=1048576 2024-09-14T11:04:19.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.239+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~SSQNBLMSOWJL.1 size=790948 2024-09-14T11:04:19.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.239+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=SSQNBLMSOWJL tag=CQLFX8YWJU60 type=write size=2888100 2024-09-14T11:04:19.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.240+0000 7f907bbdf780 1 < completed write operation key=HM2GVOA72HHR tag=4JZFH3O7EDBU type=write size=973193 2024-09-14T11:04:19.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.241+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=Q5BTH0WBBDPZ type=del size=1861536 2024-09-14T11:04:19.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.242+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~1I62VMKZB9XO.0 size=1048576 2024-09-14T11:04:19.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.243+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~1I62VMKZB9XO.1 size=529190 2024-09-14T11:04:19.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.245+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=1I62VMKZB9XO tag=57GIVLBSHDBX type=write size=2626342 2024-09-14T11:04:19.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.246+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=AJVLBJ69AO25 type=del size=2604590 2024-09-14T11:04:19.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.248+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.0 size=1048576 2024-09-14T11:04:19.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.249+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.1 size=1048576 2024-09-14T11:04:19.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.250+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~636G1NBPDPPP.2 size=574284 2024-09-14T11:04:19.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.252+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=636G1NBPDPPP tag=AXRTF0WAHMTU type=write size=3720012 2024-09-14T11:04:19.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.253+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=TJV58KG1AX5J type=del size=2347540 2024-09-14T11:04:19.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.255+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=WJ9SWP2ML9M0 type=del 2024-09-14T11:04:19.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.256+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=D83H0EEWEKUK type=write size=206129 2024-09-14T11:04:19.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.257+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=HB93X7799V33 type=del 2024-09-14T11:04:19.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.259+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~CN7KVP4850BK.0 size=1048576 2024-09-14T11:04:19.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.260+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~CN7KVP4850BK.1 size=381423 2024-09-14T11:04:19.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.260+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=CN7KVP4850BK tag=FDNSGZ7D4M6T type=write size=2478575 2024-09-14T11:04:19.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.261+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.0 size=1048576 2024-09-14T11:04:19.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.262+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.1 size=1048576 2024-09-14T11:04:19.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.263+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~W2U4TIXGUDJV.2 size=790203 2024-09-14T11:04:19.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.265+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=W2U4TIXGUDJV tag=GO99KBB5T4U9 type=write size=3935931 2024-09-14T11:04:19.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.268+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~G3LQKWSHPM27.0 size=517202 2024-09-14T11:04:19.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.268+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=G3LQKWSHPM27 tag=4XVJLC59F8VU type=write size=1565778 2024-09-14T11:04:19.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.269+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=85UI94THFB70 type=del 2024-09-14T11:04:19.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.271+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~E3OWC6ODKCJF.0 size=1048576 2024-09-14T11:04:19.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.272+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~E3OWC6ODKCJF.1 size=121523 2024-09-14T11:04:19.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.272+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=E3OWC6ODKCJF tag=39VS0JF59Y4C type=write size=2218675 2024-09-14T11:04:19.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.273+0000 7f907bbdf780 1 < canceled operation key=KQBX4UP53FV1 tag=5R9VQ4RP4WV8 type=del size=337582 2024-09-14T11:04:19.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.275+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=6XTS8KBXW352 type=del size=3308473 2024-09-14T11:04:19.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.276+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=CKX1JZLHCNWD type=write size=303181 2024-09-14T11:04:19.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.277+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=PDGY1GDG1VW5 type=del size=3881000 2024-09-14T11:04:19.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.280+0000 7f907bbdf780 1 < suggested update operation key=LQNZKMX52SWO tag=4385GIH1SZ2P type=del size=1286345 2024-09-14T11:04:19.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.281+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=5LH2976CJGYV type=write size=143578 2024-09-14T11:04:19.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.284+0000 7f907bbdf780 1 < suggested remove operation key=8NO5BA4HL03L tag=VJIYBBE1WSCZ type=del 2024-09-14T11:04:19.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.286+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=N9T051RL2GG2 type=del size=1480750 2024-09-14T11:04:19.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.287+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~LKLVRFQP0RRN.0 size=1048576 2024-09-14T11:04:19.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.288+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~LKLVRFQP0RRN.1 size=699697 2024-09-14T11:04:19.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.290+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=LKLVRFQP0RRN tag=5L16O3SPMUYL type=write size=2796849 2024-09-14T11:04:19.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.291+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=WCO0SU448SDI type=del size=2700209 2024-09-14T11:04:19.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.292+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=JTO7PIH93ICI type=del 2024-09-14T11:04:19.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.293+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=H7Z72HQ7BLW5 type=del size=2994219 2024-09-14T11:04:19.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.295+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=5H12A10YCUWA type=del 2024-09-14T11:04:19.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.297+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~QYMCN0SYUQN7.0 size=1048576 2024-09-14T11:04:19.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.298+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~QYMCN0SYUQN7.1 size=569052 2024-09-14T11:04:19.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.298+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=QYMCN0SYUQN7 tag=PO9O1ZOJ3JQ9 type=write size=2666204 2024-09-14T11:04:19.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.299+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.0 size=1048576 2024-09-14T11:04:19.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.300+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.1 size=1048576 2024-09-14T11:04:19.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.301+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~EO83V4J1LH5T.2 size=573675 2024-09-14T11:04:19.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.303+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=EO83V4J1LH5T tag=W9BDHO5L9BJN type=write size=3719403 2024-09-14T11:04:19.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.304+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=2LJ0AUXQRPX0 type=del size=3610302 2024-09-14T11:04:19.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.305+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~SSQNBLMSOWJL.0 size=1048576 2024-09-14T11:04:19.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.306+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~SSQNBLMSOWJL.1 size=790948 2024-09-14T11:04:19.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.308+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=SSQNBLMSOWJL tag=CQLFX8YWJU60 type=write size=2888100 2024-09-14T11:04:19.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.310+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~GIS1PAIJKUTW.0 size=1039020 2024-09-14T11:04:19.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.310+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=GIS1PAIJKUTW tag=QL96PRPMDRIM type=write size=2087596 2024-09-14T11:04:19.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.312+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=Q5BTH0WBBDPZ type=del 2024-09-14T11:04:19.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.314+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.0 size=1048576 2024-09-14T11:04:19.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.315+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.1 size=1048576 2024-09-14T11:04:19.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.316+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.2 size=10393 2024-09-14T11:04:19.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.316+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=C33C73JO89TZ tag=8RFW8M64V1O9 type=write size=3156121 2024-09-14T11:04:19.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.318+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=AJVLBJ69AO25 type=del size=2604590 2024-09-14T11:04:19.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.319+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=QCY0WKXJMINM type=del size=550677 2024-09-14T11:04:19.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.321+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=TJV58KG1AX5J type=del 2024-09-14T11:04:19.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.322+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=IFCCLEBXFN8W type=del size=3804742 2024-09-14T11:04:19.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.324+0000 7f907bbdf780 1 < suggested remove operation key=59WHXDR0S8DM tag=D83H0EEWEKUK type=write 2024-09-14T11:04:19.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.325+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=FYDS6IPDRBEP type=del size=2602239 2024-09-14T11:04:19.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.326+0000 7f907bbdf780 1 < canceled part key=_multipart_5C8LLJF5MSVP.2~CN7KVP4850BK.0 size=1048576 2024-09-14T11:04:19.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.327+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~CN7KVP4850BK.1 size=381423 2024-09-14T11:04:19.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.329+0000 7f907bbdf780 1 < canceled multipart upload key=5C8LLJF5MSVP upload=CN7KVP4850BK tag=FDNSGZ7D4M6T type=write size=2478575 2024-09-14T11:04:19.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.331+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.0 size=1048576 2024-09-14T11:04:19.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.332+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.1 size=1048576 2024-09-14T11:04:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.334+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.2 size=779072 2024-09-14T11:04:19.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.334+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=D63T1XVBWE12 tag=Q7W7NUPLLOBK type=write size=3924800 2024-09-14T11:04:19.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.335+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~G3LQKWSHPM27.0 size=517202 2024-09-14T11:04:19.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.337+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=G3LQKWSHPM27 tag=4XVJLC59F8VU type=write size=1565778 2024-09-14T11:04:19.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.339+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~0PDSTPRIQ4QX.0 size=1048576 2024-09-14T11:04:19.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.339+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~0PDSTPRIQ4QX.1 size=748356 2024-09-14T11:04:19.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.339+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=0PDSTPRIQ4QX tag=IXRIQ7X9IGV2 type=write size=2845508 2024-09-14T11:04:19.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.341+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~E3OWC6ODKCJF.0 size=1048576 2024-09-14T11:04:19.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.341+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~E3OWC6ODKCJF.1 size=121523 2024-09-14T11:04:19.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.344+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=E3OWC6ODKCJF tag=39VS0JF59Y4C type=write size=2218675 2024-09-14T11:04:19.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.345+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=B3W0BEJF6JQU type=write size=120679 2024-09-14T11:04:19.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.346+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=6XTS8KBXW352 type=del 2024-09-14T11:04:19.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.348+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~9B0WAVC25TBY.0 size=471305 2024-09-14T11:04:19.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.348+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=9B0WAVC25TBY tag=JCUKLHGPIMBI type=write size=1519881 2024-09-14T11:04:19.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.349+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=PDGY1GDG1VW5 type=del 2024-09-14T11:04:19.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.351+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=ADPUXLEJF2YT type=del size=3907421 2024-09-14T11:04:19.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.352+0000 7f907bbdf780 1 < completed write operation key=9OKQI3W8M5GA tag=5LH2976CJGYV type=write size=143578 2024-09-14T11:04:19.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.353+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=MTAJ8KGHRC65 type=del size=4014496 2024-09-14T11:04:19.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.354+0000 7f907bbdf780 1 < canceled operation key=8NO5BA4HL03L tag=N9T051RL2GG2 type=del size=1480750 2024-09-14T11:04:19.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.356+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~GYSIOM1N0ABW.0 size=307491 2024-09-14T11:04:19.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.356+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=GYSIOM1N0ABW tag=YFQK975JWWGP type=write size=1356067 2024-09-14T11:04:19.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.359+0000 7f907bbdf780 1 < suggested remove operation key=P0701O36E1JI tag=WCO0SU448SDI type=del 2024-09-14T11:04:19.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.361+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~LFIH3G67OFUB.0 size=1048576 2024-09-14T11:04:19.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.362+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~LFIH3G67OFUB.1 size=46092 2024-09-14T11:04:19.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.362+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=LFIH3G67OFUB tag=7FSVUWS8FAGG type=write size=2143244 2024-09-14T11:04:19.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.363+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=H7Z72HQ7BLW5 type=del 2024-09-14T11:04:19.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.365+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~D4M665Y7JKEJ.0 size=406732 2024-09-14T11:04:19.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.365+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=D4M665Y7JKEJ tag=YWTOVVN9M8OB type=write size=1455308 2024-09-14T11:04:19.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.366+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~QYMCN0SYUQN7.0 size=1048576 2024-09-14T11:04:19.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.367+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~QYMCN0SYUQN7.1 size=569052 2024-09-14T11:04:19.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.369+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=QYMCN0SYUQN7 tag=PO9O1ZOJ3JQ9 type=write size=2666204 2024-09-14T11:04:19.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.370+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=7LMPTMJ159HU type=del size=1357388 2024-09-14T11:04:19.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.371+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=2LJ0AUXQRPX0 type=del 2024-09-14T11:04:19.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.373+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=J3C5BP28X64H type=del size=1061286 2024-09-14T11:04:19.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.374+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~GIS1PAIJKUTW.0 size=1039020 2024-09-14T11:04:19.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.376+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=GIS1PAIJKUTW tag=QL96PRPMDRIM type=write size=2087596 2024-09-14T11:04:19.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.377+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=17WT340KP2E7 type=del size=2813271 2024-09-14T11:04:19.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.377+0000 7f907bbdf780 1 < canceled part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.0 size=1048576 2024-09-14T11:04:19.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.378+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.1 size=1048576 2024-09-14T11:04:19.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.379+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~C33C73JO89TZ.2 size=10393 2024-09-14T11:04:19.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.381+0000 7f907bbdf780 1 < canceled multipart upload key=AI0W2MEG08HF upload=C33C73JO89TZ tag=8RFW8M64V1O9 type=write size=3156121 2024-09-14T11:04:19.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.383+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.0 size=1048576 2024-09-14T11:04:19.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.384+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.1 size=1048576 2024-09-14T11:04:19.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.385+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.2 size=829540 2024-09-14T11:04:19.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.385+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=HPENHBH3QO2U tag=MOTKEC5ZD846 type=write size=3975268 2024-09-14T11:04:19.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.385+0000 7f907bbdf780 -1 < no bi entry to suggest for operation key=P0701O36E1JI tag=QCY0WKXJMINM type=del size=550677: (2) No such file or directory 2024-09-14T11:04:19.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.388+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~JW0L08M0CX6O.0 size=489739 2024-09-14T11:04:19.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.388+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=JW0L08M0CX6O tag=L6WYWD7MIE2N type=write size=1538315 2024-09-14T11:04:19.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.390+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=IFCCLEBXFN8W type=del size=3804742 2024-09-14T11:04:19.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.391+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=84UZRUSEIXQB type=write size=215665 2024-09-14T11:04:19.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.392+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=FYDS6IPDRBEP type=del 2024-09-14T11:04:19.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.393+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=EXV4JXNKATUZ type=write size=811575 2024-09-14T11:04:19.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.395+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.0 size=1048576 2024-09-14T11:04:19.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.396+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.1 size=1048576 2024-09-14T11:04:19.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.397+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~D63T1XVBWE12.2 size=779072 2024-09-14T11:04:19.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.399+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=D63T1XVBWE12 tag=Q7W7NUPLLOBK type=write size=3924800 2024-09-14T11:04:19.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.401+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.0 size=1048576 2024-09-14T11:04:19.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.402+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.1 size=1048576 2024-09-14T11:04:19.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.403+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.2 size=532038 2024-09-14T11:04:19.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.403+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=RDQTW22FLETZ tag=TEZYJH4C55NR type=write size=3677766 2024-09-14T11:04:19.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.404+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~0PDSTPRIQ4QX.0 size=1048576 2024-09-14T11:04:19.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.405+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~0PDSTPRIQ4QX.1 size=748356 2024-09-14T11:04:19.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.407+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=0PDSTPRIQ4QX tag=IXRIQ7X9IGV2 type=write size=2845508 2024-09-14T11:04:19.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.409+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~01VGH3GZH23I.0 size=385296 2024-09-14T11:04:19.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.409+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=01VGH3GZH23I tag=VT2K571S3HG5 type=write size=1433872 2024-09-14T11:04:19.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.411+0000 7f907bbdf780 1 < completed write operation key=GC52N456IYD7 tag=B3W0BEJF6JQU type=write size=120679 2024-09-14T11:04:19.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.414+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.0 size=1048576 2024-09-14T11:04:19.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.415+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.1 size=1048576 2024-09-14T11:04:19.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.416+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.2 size=100572 2024-09-14T11:04:19.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.416+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=KMQUNVC9UN62 tag=GJBXJ1BRACGA type=write size=3246300 2024-09-14T11:04:19.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.417+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~9B0WAVC25TBY.0 size=471305 2024-09-14T11:04:19.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.419+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=9B0WAVC25TBY tag=JCUKLHGPIMBI type=write size=1519881 2024-09-14T11:04:19.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.422+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.0 size=1048576 2024-09-14T11:04:19.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.423+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.1 size=1048576 2024-09-14T11:04:19.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.424+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.2 size=632963 2024-09-14T11:04:19.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.424+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=25U5IZ60STB3 tag=FHHZN6LI3LZ7 type=write size=3778691 2024-09-14T11:04:19.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.425+0000 7f907bbdf780 1 < canceled operation key=T79IR10S3HAB tag=ADPUXLEJF2YT type=del size=3907421 2024-09-14T11:04:19.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.427+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=87H1N9A37OSN type=del size=4056009 2024-09-14T11:04:19.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.428+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=MTAJ8KGHRC65 type=del size=4014496 2024-09-14T11:04:19.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.429+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=T1LEZ8G8F8H3 type=del size=4014211 2024-09-14T11:04:19.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.431+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~GYSIOM1N0ABW.0 size=307491 2024-09-14T11:04:19.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.433+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=GYSIOM1N0ABW tag=YFQK975JWWGP type=write size=1356067 2024-09-14T11:04:19.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.435+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~OCNHIWBVVDI4.0 size=494896 2024-09-14T11:04:19.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.435+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=OCNHIWBVVDI4 tag=X1ZQNS3KL4CT type=write size=1543472 2024-09-14T11:04:19.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.437+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~LFIH3G67OFUB.0 size=1048576 2024-09-14T11:04:19.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.438+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~LFIH3G67OFUB.1 size=46092 2024-09-14T11:04:19.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.440+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=LFIH3G67OFUB tag=7FSVUWS8FAGG type=write size=2143244 2024-09-14T11:04:19.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.441+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=ZA6FJ44Q1SUQ type=del size=65867 2024-09-14T11:04:19.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.442+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~D4M665Y7JKEJ.0 size=406732 2024-09-14T11:04:19.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.444+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=D4M665Y7JKEJ tag=YWTOVVN9M8OB type=write size=1455308 2024-09-14T11:04:19.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.446+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=ZB5PM3AB1YTN type=del size=2485057 2024-09-14T11:04:19.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.447+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=7LMPTMJ159HU type=del 2024-09-14T11:04:19.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.449+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=SPSRF5CQZ27X type=del size=111222 2024-09-14T11:04:19.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.450+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=J3C5BP28X64H type=del 2024-09-14T11:04:19.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.452+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~9QBHWFDKTPR5.0 size=231033 2024-09-14T11:04:19.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.452+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=9QBHWFDKTPR5 tag=RVRG334NM7CW type=write size=1279609 2024-09-14T11:04:19.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.453+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=17WT340KP2E7 type=del 2024-09-14T11:04:19.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.455+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.0 size=1048576 2024-09-14T11:04:19.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.456+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.1 size=1048576 2024-09-14T11:04:19.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.457+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.2 size=738110 2024-09-14T11:04:19.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.457+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=D9V40YQ9IT02 tag=MRVZA0Q56SJ3 type=write size=3883838 2024-09-14T11:04:19.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.459+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.0 size=1048576 2024-09-14T11:04:19.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.460+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.1 size=1048576 2024-09-14T11:04:19.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.460+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~HPENHBH3QO2U.2 size=829540 2024-09-14T11:04:19.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.462+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=HPENHBH3QO2U tag=MOTKEC5ZD846 type=write size=3975268 2024-09-14T11:04:19.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.464+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=7LV5Q5BN6PPV type=write size=659195 2024-09-14T11:04:19.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.465+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~JW0L08M0CX6O.0 size=489739 2024-09-14T11:04:19.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.467+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=JW0L08M0CX6O tag=L6WYWD7MIE2N type=write size=1538315 2024-09-14T11:04:19.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.468+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=UFLLYBFNSZ74 type=del size=2843561 2024-09-14T11:04:19.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.470+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=84UZRUSEIXQB type=write size=215665 2024-09-14T11:04:19.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.472+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=S0VY1GNZ9BAJ type=del size=3784080 2024-09-14T11:04:19.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.473+0000 7f907bbdf780 -1 < failed to complete operation key=9OKQI3W8M5GA tag=EXV4JXNKATUZ type=write size=811575: (22) Invalid argument 2024-09-14T11:04:19.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.474+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=SY1EVYZA8K18 type=del size=2146175 2024-09-14T11:04:19.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.475+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.0 size=1048576 2024-09-14T11:04:19.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.475+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.1 size=1048576 2024-09-14T11:04:19.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.476+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~RDQTW22FLETZ.2 size=532038 2024-09-14T11:04:19.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.478+0000 7f907bbdf780 1 < canceled multipart upload key=S8RIEED24PUM upload=RDQTW22FLETZ tag=TEZYJH4C55NR type=write size=3677766 2024-09-14T11:04:19.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.479+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=V06TFBEXTR1Q type=del size=2422722 2024-09-14T11:04:19.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.480+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~01VGH3GZH23I.0 size=385296 2024-09-14T11:04:19.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.482+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=01VGH3GZH23I tag=VT2K571S3HG5 type=write size=1433872 2024-09-14T11:04:19.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.484+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~N2TCIJYOB86U.0 size=492505 2024-09-14T11:04:19.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.484+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=N2TCIJYOB86U tag=8Z7MR63KVEJ3 type=write size=1541081 2024-09-14T11:04:19.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.486+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.0 size=1048576 2024-09-14T11:04:19.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.487+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.1 size=1048576 2024-09-14T11:04:19.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.488+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~KMQUNVC9UN62.2 size=100572 2024-09-14T11:04:19.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.490+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=KMQUNVC9UN62 tag=GJBXJ1BRACGA type=write size=3246300 2024-09-14T11:04:19.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.491+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=X9PIQGO20XO7 type=del size=226693 2024-09-14T11:04:19.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.492+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.0 size=1048576 2024-09-14T11:04:19.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.493+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.1 size=1048576 2024-09-14T11:04:19.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.494+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~25U5IZ60STB3.2 size=632963 2024-09-14T11:04:19.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.496+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=25U5IZ60STB3 tag=FHHZN6LI3LZ7 type=write size=3778691 2024-09-14T11:04:19.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.498+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~LW38KI6H2AFX.0 size=1048576 2024-09-14T11:04:19.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.499+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~LW38KI6H2AFX.1 size=96218 2024-09-14T11:04:19.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.499+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=LW38KI6H2AFX tag=HUVBQTI86DDE type=write size=2193370 2024-09-14T11:04:19.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.500+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=87H1N9A37OSN type=del 2024-09-14T11:04:19.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.502+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~BFYNOYSUDN0A.0 size=1048576 2024-09-14T11:04:19.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.503+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~BFYNOYSUDN0A.1 size=1027909 2024-09-14T11:04:19.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.503+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=BFYNOYSUDN0A tag=TSR5WNN3CL6Y type=write size=3125061 2024-09-14T11:04:19.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.504+0000 7f907bbdf780 -1 < failed to complete operation key=9OKQI3W8M5GA tag=T1LEZ8G8F8H3 type=del size=4014211: (22) Invalid argument 2024-09-14T11:04:19.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.506+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~TUOJLFJA2L4O.0 size=615105 2024-09-14T11:04:19.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.506+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=TUOJLFJA2L4O tag=2VEM3GZQ9V3T type=write size=1663681 2024-09-14T11:04:19.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.508+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~OCNHIWBVVDI4.0 size=494896 2024-09-14T11:04:19.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.509+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=OCNHIWBVVDI4 tag=X1ZQNS3KL4CT type=write size=1543472 2024-09-14T11:04:19.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.511+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=O7KHAG7LFKCW type=del size=2895607 2024-09-14T11:04:19.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.512+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=ZA6FJ44Q1SUQ type=del 2024-09-14T11:04:19.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.513+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=A05PFFOWQUWF type=del size=2449410 2024-09-14T11:04:19.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.514+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=ZB5PM3AB1YTN type=del 2024-09-14T11:04:19.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.515+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=5E81FFA3DYBW type=del size=3756843 2024-09-14T11:04:19.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.517+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=SPSRF5CQZ27X type=del 2024-09-14T11:04:19.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.518+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=89E4BOPFQS6H type=del size=3866115 2024-09-14T11:04:19.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.519+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~9QBHWFDKTPR5.0 size=231033 2024-09-14T11:04:19.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.521+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=9QBHWFDKTPR5 tag=RVRG334NM7CW type=write size=1279609 2024-09-14T11:04:19.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.522+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=IG53FTRM4VY2 type=del size=2912526 2024-09-14T11:04:19.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.523+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.0 size=1048576 2024-09-14T11:04:19.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.524+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.1 size=1048576 2024-09-14T11:04:19.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.526+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~D9V40YQ9IT02.2 size=738110 2024-09-14T11:04:19.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.528+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=D9V40YQ9IT02 tag=MRVZA0Q56SJ3 type=write size=3883838 2024-09-14T11:04:19.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.529+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=B0TIAR6U2LJU type=write size=546313 2024-09-14T11:04:19.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.530+0000 7f907bbdf780 1 < completed write operation key=T81OF13I2JVH tag=7LV5Q5BN6PPV type=write size=659195 2024-09-14T11:04:19.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.533+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~09IZ3APP1MVY.0 size=904620 2024-09-14T11:04:19.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.533+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=09IZ3APP1MVY tag=JLGQXH15OG50 type=write size=1953196 2024-09-14T11:04:19.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.534+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=UFLLYBFNSZ74 type=del 2024-09-14T11:04:19.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.536+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~YO2WGAGDO8AY.0 size=1048576 2024-09-14T11:04:19.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.537+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~YO2WGAGDO8AY.1 size=1046057 2024-09-14T11:04:19.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.537+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=YO2WGAGDO8AY tag=QBSNIKQ7IDMR type=write size=3143209 2024-09-14T11:04:19.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.539+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=S0VY1GNZ9BAJ type=del 2024-09-14T11:04:19.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.540+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=D3P02KI9R4V5 type=del size=112869 2024-09-14T11:04:19.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.542+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=SY1EVYZA8K18 type=del 2024-09-14T11:04:19.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.544+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~SO9U1MW04BQ6.0 size=947913 2024-09-14T11:04:19.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.544+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=SO9U1MW04BQ6 tag=KWBHL2QO9IHI type=write size=1996489 2024-09-14T11:04:19.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.546+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=V06TFBEXTR1Q type=del 2024-09-14T11:04:19.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.549+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~42EIQI5TR4SV.0 size=555587 2024-09-14T11:04:19.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.549+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=42EIQI5TR4SV tag=N9L13NEW7RC4 type=write size=1604163 2024-09-14T11:04:19.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.550+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~N2TCIJYOB86U.0 size=492505 2024-09-14T11:04:19.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.552+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=N2TCIJYOB86U tag=8Z7MR63KVEJ3 type=write size=1541081 2024-09-14T11:04:19.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.554+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~9V6BYL1E0I4J.0 size=1048576 2024-09-14T11:04:19.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.555+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~9V6BYL1E0I4J.1 size=679871 2024-09-14T11:04:19.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.555+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=9V6BYL1E0I4J tag=IKXUUDQ38EE8 type=write size=2777023 2024-09-14T11:04:19.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.556+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=X9PIQGO20XO7 type=del size=226693 2024-09-14T11:04:19.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.557+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=M7DU528QEJ0Z type=del size=2493366 2024-09-14T11:04:19.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.559+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~LW38KI6H2AFX.0 size=1048576 2024-09-14T11:04:19.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.560+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~LW38KI6H2AFX.1 size=96218 2024-09-14T11:04:19.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.562+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=LW38KI6H2AFX tag=HUVBQTI86DDE type=write size=2193370 2024-09-14T11:04:19.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.564+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=SWWJZSGIGSLC type=del size=2101163 2024-09-14T11:04:19.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.565+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~BFYNOYSUDN0A.0 size=1048576 2024-09-14T11:04:19.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.566+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~BFYNOYSUDN0A.1 size=1027909 2024-09-14T11:04:19.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.568+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=BFYNOYSUDN0A tag=TSR5WNN3CL6Y type=write size=3125061 2024-09-14T11:04:19.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.569+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=2I1E7LVN42M9 type=del size=1467851 2024-09-14T11:04:19.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.570+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~TUOJLFJA2L4O.0 size=615105 2024-09-14T11:04:19.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.572+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=TUOJLFJA2L4O tag=2VEM3GZQ9V3T type=write size=1663681 2024-09-14T11:04:19.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.575+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~WQMVQLH5ZYWU.0 size=22863 2024-09-14T11:04:19.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.575+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=WQMVQLH5ZYWU tag=XF1PRM05W5T4 type=write size=1071439 2024-09-14T11:04:19.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.576+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=O7KHAG7LFKCW type=del 2024-09-14T11:04:19.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.578+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~OENDXE1ANH6Y.0 size=965334 2024-09-14T11:04:19.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.578+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=OENDXE1ANH6Y tag=4C51HQS9EL68 type=write size=2013910 2024-09-14T11:04:19.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.580+0000 7f907bbdf780 1 < suggested update operation key=59WHXDR0S8DM tag=A05PFFOWQUWF type=del size=2449410 2024-09-14T11:04:19.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.582+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=2BQT60XJ2058 type=del size=411831 2024-09-14T11:04:19.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.583+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=5E81FFA3DYBW type=del size=3756843 2024-09-14T11:04:19.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.584+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=GYNURBF0QX5G type=del size=3662250 2024-09-14T11:04:19.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.585+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=89E4BOPFQS6H type=del 2024-09-14T11:04:19.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.586+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=39U16YXX112Y type=del size=3370810 2024-09-14T11:04:19.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.588+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=IG53FTRM4VY2 type=del 2024-09-14T11:04:19.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.589+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=A3Z8NBGHDT5U type=del size=599352 2024-09-14T11:04:19.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.590+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=B0TIAR6U2LJU type=write size=546313 2024-09-14T11:04:19.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.592+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.0 size=1048576 2024-09-14T11:04:19.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.593+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.1 size=1048576 2024-09-14T11:04:19.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.594+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.2 size=191110 2024-09-14T11:04:19.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.594+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=ELF9YUVYKLV0 tag=3XEOPPT85KKC type=write size=3336838 2024-09-14T11:04:19.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.596+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~09IZ3APP1MVY.0 size=904620 2024-09-14T11:04:19.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.600+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=09IZ3APP1MVY tag=JLGQXH15OG50 type=write size=1953196 2024-09-14T11:04:19.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.601+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=PMOV5FFX4F3T type=del size=1784624 2024-09-14T11:04:19.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.602+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~YO2WGAGDO8AY.0 size=1048576 2024-09-14T11:04:19.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.603+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~YO2WGAGDO8AY.1 size=1046057 2024-09-14T11:04:19.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.605+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=YO2WGAGDO8AY tag=QBSNIKQ7IDMR type=write size=3143209 2024-09-14T11:04:19.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.606+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=ODFBNT1SC8CO type=write size=850377 2024-09-14T11:04:19.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.608+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=D3P02KI9R4V5 type=del 2024-09-14T11:04:19.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.609+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=5122J8RV8QU4 type=del size=1059871 2024-09-14T11:04:19.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.610+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~SO9U1MW04BQ6.0 size=947913 2024-09-14T11:04:19.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.612+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=SO9U1MW04BQ6 tag=KWBHL2QO9IHI type=write size=1996489 2024-09-14T11:04:19.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.613+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=OC67JG3B23DM type=del size=3852982 2024-09-14T11:04:19.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.614+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~42EIQI5TR4SV.0 size=555587 2024-09-14T11:04:19.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.616+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=42EIQI5TR4SV tag=N9L13NEW7RC4 type=write size=1604163 2024-09-14T11:04:19.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.617+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=05W9KXLE9I64 type=del size=3876456 2024-09-14T11:04:19.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.617+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~9V6BYL1E0I4J.0 size=1048576 2024-09-14T11:04:19.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.618+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~9V6BYL1E0I4J.1 size=679871 2024-09-14T11:04:19.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.620+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=9V6BYL1E0I4J tag=IKXUUDQ38EE8 type=write size=2777023 2024-09-14T11:04:19.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.622+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=YS07F9DGR1AQ type=del size=2915355 2024-09-14T11:04:19.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.623+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=M7DU528QEJ0Z type=del 2024-09-14T11:04:19.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.624+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=STXG0QCCTIC7 type=del size=684694 2024-09-14T11:04:19.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.626+0000 7f907bbdf780 1 < suggested remove operation key=59WHXDR0S8DM tag=SWWJZSGIGSLC type=del 2024-09-14T11:04:19.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.628+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~4ER8WSSWC90X.0 size=1048576 2024-09-14T11:04:19.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.629+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~4ER8WSSWC90X.1 size=246427 2024-09-14T11:04:19.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.629+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=4ER8WSSWC90X tag=XGJ6QQUN8LE9 type=write size=2343579 2024-09-14T11:04:19.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.631+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=2I1E7LVN42M9 type=del 2024-09-14T11:04:19.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.632+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=826AIZK8ESO4 type=del size=2472754 2024-09-14T11:04:19.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.633+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~WQMVQLH5ZYWU.0 size=22863 2024-09-14T11:04:19.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.635+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=WQMVQLH5ZYWU tag=XF1PRM05W5T4 type=write size=1071439 2024-09-14T11:04:19.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.636+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=A2CC37ZPKDPP type=del size=2565422 2024-09-14T11:04:19.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.637+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~OENDXE1ANH6Y.0 size=965334 2024-09-14T11:04:19.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.639+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=OENDXE1ANH6Y tag=4C51HQS9EL68 type=write size=2013910 2024-09-14T11:04:19.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.640+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=J2DGMLS89GDC type=del size=978310 2024-09-14T11:04:19.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.641+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=2BQT60XJ2058 type=del 2024-09-14T11:04:19.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.642+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=Y9ZF312BZ2VK type=del size=462895 2024-09-14T11:04:19.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.645+0000 7f907bbdf780 1 < suggested remove operation key=GC52N456IYD7 tag=GYNURBF0QX5G type=del 2024-09-14T11:04:19.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.646+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=E19ZP6LI5KLT type=del size=688725 2024-09-14T11:04:19.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.647+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=39U16YXX112Y type=del 2024-09-14T11:04:19.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.649+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~9NHKXVQP0321.0 size=1048576 2024-09-14T11:04:19.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.650+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~9NHKXVQP0321.1 size=597561 2024-09-14T11:04:19.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.650+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=9NHKXVQP0321 tag=TCDPHN0LSE1V type=write size=2694713 2024-09-14T11:04:19.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.651+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=A3Z8NBGHDT5U type=del 2024-09-14T11:04:19.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.654+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~QVIB5MWOHC4Z.0 size=1048576 2024-09-14T11:04:19.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.654+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~QVIB5MWOHC4Z.1 size=1022570 2024-09-14T11:04:19.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.654+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=QVIB5MWOHC4Z tag=7SV911MYQZ45 type=write size=3119722 2024-09-14T11:04:19.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.656+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.0 size=1048576 2024-09-14T11:04:19.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.657+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.1 size=1048576 2024-09-14T11:04:19.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.657+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~ELF9YUVYKLV0.2 size=191110 2024-09-14T11:04:19.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.659+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=ELF9YUVYKLV0 tag=3XEOPPT85KKC type=write size=3336838 2024-09-14T11:04:19.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.661+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=NCGV7PV28ZUX type=del size=3679683 2024-09-14T11:04:19.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.662+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=PMOV5FFX4F3T type=del size=1784624 2024-09-14T11:04:19.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.663+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=JXZDG8EFJ5I3 type=del size=2452717 2024-09-14T11:04:19.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.664+0000 7f907bbdf780 1 < canceled operation key=AGMKZ7PGPUAM tag=ODFBNT1SC8CO type=write size=850377 2024-09-14T11:04:19.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.666+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=JW0XPQN68B4F type=del size=1042591 2024-09-14T11:04:19.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.667+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=5122J8RV8QU4 type=del 2024-09-14T11:04:19.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.668+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=T4SJK16N7F6B type=del size=1086822 2024-09-14T11:04:19.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.669+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=OC67JG3B23DM type=del 2024-09-14T11:04:19.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.670+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=WAST7J4HTKQJ type=write size=786733 2024-09-14T11:04:19.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.672+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=05W9KXLE9I64 type=del 2024-09-14T11:04:19.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.674+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=VV37F5JS3RTB type=del size=1510923 2024-09-14T11:04:19.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.675+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=YS07F9DGR1AQ type=del 2024-09-14T11:04:19.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.676+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=7DEEQ9FGR1S5 type=write size=171202 2024-09-14T11:04:19.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.677+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=STXG0QCCTIC7 type=del 2024-09-14T11:04:19.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.678+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=HFYM1O1XJCL1 type=del size=1512118 2024-09-14T11:04:19.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.680+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~4ER8WSSWC90X.0 size=1048576 2024-09-14T11:04:19.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.680+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~4ER8WSSWC90X.1 size=246427 2024-09-14T11:04:19.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.683+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=4ER8WSSWC90X tag=XGJ6QQUN8LE9 type=write size=2343579 2024-09-14T11:04:19.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.684+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=LQG7Q241N4OM type=write size=726282 2024-09-14T11:04:19.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.685+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=826AIZK8ESO4 type=del 2024-09-14T11:04:19.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.687+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~M78V3WSCRG9K.0 size=1048576 2024-09-14T11:04:19.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.688+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~M78V3WSCRG9K.1 size=498366 2024-09-14T11:04:19.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.688+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=M78V3WSCRG9K tag=CH23WF8YMMTB type=write size=2595518 2024-09-14T11:04:19.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.691+0000 7f907bbdf780 1 < suggested update operation key=HM2GVOA72HHR tag=A2CC37ZPKDPP type=del size=2565422 2024-09-14T11:04:19.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.692+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=KT3MK8CCAMJX type=del size=3299445 2024-09-14T11:04:19.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.693+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=J2DGMLS89GDC type=del 2024-09-14T11:04:19.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.695+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~FJ4CJRPHFY8Y.0 size=872673 2024-09-14T11:04:19.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.695+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=FJ4CJRPHFY8Y tag=XGUOVRHVNU19 type=write size=1921249 2024-09-14T11:04:19.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.696+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=Y9ZF312BZ2VK type=del 2024-09-14T11:04:19.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.697+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=EF263PMWHF72 type=del size=86665 2024-09-14T11:04:19.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.699+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=E19ZP6LI5KLT type=del 2024-09-14T11:04:19.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.700+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=K1B2Q6U17BN1 type=del size=4028721 2024-09-14T11:04:19.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.701+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~9NHKXVQP0321.0 size=1048576 2024-09-14T11:04:19.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.702+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~9NHKXVQP0321.1 size=597561 2024-09-14T11:04:19.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.704+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=9NHKXVQP0321 tag=TCDPHN0LSE1V type=write size=2694713 2024-09-14T11:04:19.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.705+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=111CDS0OU7GD type=del size=1266557 2024-09-14T11:04:19.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.706+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~QVIB5MWOHC4Z.0 size=1048576 2024-09-14T11:04:19.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.707+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~QVIB5MWOHC4Z.1 size=1022570 2024-09-14T11:04:19.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.709+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=QVIB5MWOHC4Z tag=7SV911MYQZ45 type=write size=3119722 2024-09-14T11:04:19.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.710+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=KNTI3AFND6PQ type=write size=698423 2024-09-14T11:04:19.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.712+0000 7f907bbdf780 1 < suggested update operation key=T79IR10S3HAB tag=NCGV7PV28ZUX type=del size=3679683 2024-09-14T11:04:19.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.714+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=U4EO2TJ2AKYC type=write size=74619 2024-09-14T11:04:19.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.715+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=JXZDG8EFJ5I3 type=del 2024-09-14T11:04:19.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.716+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=BUV3SGVOT1UI type=del size=1119836 2024-09-14T11:04:19.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.717+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=JW0XPQN68B4F type=del 2024-09-14T11:04:19.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.718+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=VY9OWAUPN7ZL type=del size=3584170 2024-09-14T11:04:19.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.720+0000 7f907bbdf780 1 < canceled operation key=VRQ0ZNN9FG4C tag=T4SJK16N7F6B type=del size=1086822 2024-09-14T11:04:19.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.722+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~KL7SQ60OYJB4.0 size=502513 2024-09-14T11:04:19.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.722+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=KL7SQ60OYJB4 tag=ZJVYCGVD6M80 type=write size=1551089 2024-09-14T11:04:19.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.724+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=WAST7J4HTKQJ type=write 2024-09-14T11:04:19.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.725+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=09SHHFN20F1D type=del size=2833905 2024-09-14T11:04:19.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.727+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=VV37F5JS3RTB type=del 2024-09-14T11:04:19.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.728+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=6N2X32M6Z1KM type=del size=3442661 2024-09-14T11:04:19.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.730+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=7DEEQ9FGR1S5 type=write size=171202 2024-09-14T11:04:19.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.732+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~JN36VY7C2GVM.0 size=1048576 2024-09-14T11:04:19.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.733+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~JN36VY7C2GVM.1 size=918509 2024-09-14T11:04:19.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.733+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=JN36VY7C2GVM tag=SM70CFQ4S769 type=write size=3015661 2024-09-14T11:04:19.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.735+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=HFYM1O1XJCL1 type=del 2024-09-14T11:04:19.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.737+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~2NR3UPY8HKC9.0 size=1048576 2024-09-14T11:04:19.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.738+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~2NR3UPY8HKC9.1 size=410222 2024-09-14T11:04:19.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.738+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=2NR3UPY8HKC9 tag=NPO2J2IBD0NG type=write size=2507374 2024-09-14T11:04:19.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.739+0000 7f907bbdf780 1 < completed write operation key=5MFLA6XFV3Y5 tag=LQG7Q241N4OM type=write size=726282 2024-09-14T11:04:19.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.740+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=G4YSJ2AHMWPT type=del size=3650092 2024-09-14T11:04:19.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.741+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~M78V3WSCRG9K.0 size=1048576 2024-09-14T11:04:19.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.742+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~M78V3WSCRG9K.1 size=498366 2024-09-14T11:04:19.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.744+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=M78V3WSCRG9K tag=CH23WF8YMMTB type=write size=2595518 2024-09-14T11:04:19.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.746+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=M5Y9XOECJKH6 type=del size=3705787 2024-09-14T11:04:19.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.747+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=KT3MK8CCAMJX type=del 2024-09-14T11:04:19.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.748+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=QC4C36DDXK8J type=del size=2000980 2024-09-14T11:04:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.749+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~FJ4CJRPHFY8Y.0 size=872673 2024-09-14T11:04:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.751+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=FJ4CJRPHFY8Y tag=XGUOVRHVNU19 type=write size=1921249 2024-09-14T11:04:19.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.752+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=GF9IA5HVSYSO type=write size=1006932 2024-09-14T11:04:19.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.753+0000 7f907bbdf780 -1 < failed to complete operation key=HHXUGVBHQ2US tag=EF263PMWHF72 type=del size=86665: (22) Invalid argument 2024-09-14T11:04:19.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.754+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=O2D70V5CZ1U1 type=del size=1296367 2024-09-14T11:04:19.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.756+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=K1B2Q6U17BN1 type=del 2024-09-14T11:04:19.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.757+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=K8IM6M4UO26N type=del size=2293094 2024-09-14T11:04:19.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.758+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=111CDS0OU7GD type=del 2024-09-14T11:04:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.760+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~H1DSHAZBBMLC.0 size=1048576 2024-09-14T11:04:19.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.761+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~H1DSHAZBBMLC.1 size=734141 2024-09-14T11:04:19.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.761+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=H1DSHAZBBMLC tag=PGR3AYRXKV1H type=write size=2831293 2024-09-14T11:04:19.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.762+0000 7f907bbdf780 -1 < no bi entry to suggest for operation key=YH0YMRDQERBF tag=KNTI3AFND6PQ type=write size=698423: (2) No such file or directory 2024-09-14T11:04:19.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.763+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=IELL0P0XQRHY type=write size=405495 2024-09-14T11:04:19.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.764+0000 7f907bbdf780 1 < completed write operation key=8NO5BA4HL03L tag=U4EO2TJ2AKYC type=write size=74619 2024-09-14T11:04:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.765+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=4ZUT9GB53BRK type=write size=289441 2024-09-14T11:04:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.767+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=BUV3SGVOT1UI type=del 2024-09-14T11:04:19.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.769+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.0 size=1048576 2024-09-14T11:04:19.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.770+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.1 size=1048576 2024-09-14T11:04:19.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.771+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.2 size=1024112 2024-09-14T11:04:19.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.771+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=ZS6XZDBTJPAN tag=3PL81D5M4MMJ type=write size=4169840 2024-09-14T11:04:19.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.772+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=VY9OWAUPN7ZL type=del 2024-09-14T11:04:19.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.774+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=EC6H2GMDOPLG type=del size=2335210 2024-09-14T11:04:19.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.775+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~KL7SQ60OYJB4.0 size=502513 2024-09-14T11:04:19.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.777+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=KL7SQ60OYJB4 tag=ZJVYCGVD6M80 type=write size=1551089 2024-09-14T11:04:19.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.780+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.0 size=1048576 2024-09-14T11:04:19.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.781+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.1 size=1048576 2024-09-14T11:04:19.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.782+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.2 size=922144 2024-09-14T11:04:19.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.782+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=N0IB9UJM2FZX tag=QVWZFORDDKPF type=write size=4067872 2024-09-14T11:04:19.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.783+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=09SHHFN20F1D type=del 2024-09-14T11:04:19.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.784+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=INJ9M8SSWNFR type=del size=3322811 2024-09-14T11:04:19.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.785+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=6N2X32M6Z1KM type=del 2024-09-14T11:04:19.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.787+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=6T4L482PFWG2 type=write size=800984 2024-09-14T11:04:19.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.789+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~JN36VY7C2GVM.0 size=1048576 2024-09-14T11:04:19.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.790+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~JN36VY7C2GVM.1 size=918509 2024-09-14T11:04:19.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.792+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=JN36VY7C2GVM tag=SM70CFQ4S769 type=write size=3015661 2024-09-14T11:04:19.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.794+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=B403H01MFVBG type=write size=27232 2024-09-14T11:04:19.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.795+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~2NR3UPY8HKC9.0 size=1048576 2024-09-14T11:04:19.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.796+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~2NR3UPY8HKC9.1 size=410222 2024-09-14T11:04:19.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.798+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=2NR3UPY8HKC9 tag=NPO2J2IBD0NG type=write size=2507374 2024-09-14T11:04:19.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.800+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~EURDIUBXACYK.0 size=871733 2024-09-14T11:04:19.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.800+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=EURDIUBXACYK tag=97DHB2RI22QR type=write size=1920309 2024-09-14T11:04:19.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.801+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=G4YSJ2AHMWPT type=del 2024-09-14T11:04:19.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.804+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~ZZW6AQ71MA0R.0 size=885275 2024-09-14T11:04:19.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.804+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=ZZW6AQ71MA0R tag=XS8MSA9ZL3ZU type=write size=1933851 2024-09-14T11:04:19.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.805+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=M5Y9XOECJKH6 type=del 2024-09-14T11:04:19.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.807+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~VRU3ISQ19CU4.0 size=896813 2024-09-14T11:04:19.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.807+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=VRU3ISQ19CU4 tag=XUQ2V2O0EUJ1 type=write size=1945389 2024-09-14T11:04:19.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.809+0000 7f907bbdf780 1 < suggested update operation key=VRQ0ZNN9FG4C tag=QC4C36DDXK8J type=del size=2000980 2024-09-14T11:04:19.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.811+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=104R0211PST0 type=del size=3990942 2024-09-14T11:04:19.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.812+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=GF9IA5HVSYSO type=write size=1006932 2024-09-14T11:04:19.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.813+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=BLOB2ECC70HE type=del size=2475906 2024-09-14T11:04:19.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.814+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=O2D70V5CZ1U1 type=del 2024-09-14T11:04:19.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.815+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=AAFV1QZK0DMW type=write size=547617 2024-09-14T11:04:19.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.816+0000 7f907bbdf780 1 < canceled operation key=91RL2KD0XCSI tag=K8IM6M4UO26N type=del size=2293094 2024-09-14T11:04:19.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.818+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.0 size=1048576 2024-09-14T11:04:19.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.819+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.1 size=1048576 2024-09-14T11:04:19.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.820+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.2 size=1033448 2024-09-14T11:04:19.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.820+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=3YYQ3BFO4N3S tag=0BJLL6ZQC10G type=write size=4179176 2024-09-14T11:04:19.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.821+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~H1DSHAZBBMLC.0 size=1048576 2024-09-14T11:04:19.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.822+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~H1DSHAZBBMLC.1 size=734141 2024-09-14T11:04:19.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.824+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=H1DSHAZBBMLC tag=PGR3AYRXKV1H type=write size=2831293 2024-09-14T11:04:19.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.826+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~WXZ8LR1Q0SQP.0 size=1048576 2024-09-14T11:04:19.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.827+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~WXZ8LR1Q0SQP.1 size=543394 2024-09-14T11:04:19.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.827+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=WXZ8LR1Q0SQP tag=ZRQ5IBGJPG16 type=write size=2640546 2024-09-14T11:04:19.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.829+0000 7f907bbdf780 1 < suggested remove operation key=77H37YF6MJEO tag=IELL0P0XQRHY type=write 2024-09-14T11:04:19.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.831+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=CMIP892OYQ02 type=del size=7589 2024-09-14T11:04:19.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.832+0000 7f907bbdf780 1 < completed write operation key=YH0YMRDQERBF tag=4ZUT9GB53BRK type=write size=289441 2024-09-14T11:04:19.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.833+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=EM3OCQ1XHDRP type=del size=2461325 2024-09-14T11:04:19.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.835+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.0 size=1048576 2024-09-14T11:04:19.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.836+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.1 size=1048576 2024-09-14T11:04:19.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.836+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~ZS6XZDBTJPAN.2 size=1024112 2024-09-14T11:04:19.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.838+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=ZS6XZDBTJPAN tag=3PL81D5M4MMJ type=write size=4169840 2024-09-14T11:04:19.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.841+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~NIMNAAL9N1CC.0 size=1048576 2024-09-14T11:04:19.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.842+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~NIMNAAL9N1CC.1 size=415600 2024-09-14T11:04:19.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.842+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=NIMNAAL9N1CC tag=RZXPNCEVYBZB type=write size=2512752 2024-09-14T11:04:19.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.844+0000 7f907bbdf780 1 < suggested update operation key=HM2GVOA72HHR tag=EC6H2GMDOPLG type=del size=2335210 2024-09-14T11:04:19.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.847+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~LS59EDRX0ES1.0 size=447431 2024-09-14T11:04:19.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.847+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=LS59EDRX0ES1 tag=M92403MBMD24 type=write size=1496007 2024-09-14T11:04:19.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.848+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.0 size=1048576 2024-09-14T11:04:19.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.849+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.1 size=1048576 2024-09-14T11:04:19.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.850+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~N0IB9UJM2FZX.2 size=922144 2024-09-14T11:04:19.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.852+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=N0IB9UJM2FZX tag=QVWZFORDDKPF type=write size=4067872 2024-09-14T11:04:19.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.855+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.0 size=1048576 2024-09-14T11:04:19.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.856+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.1 size=1048576 2024-09-14T11:04:19.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.857+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.2 size=374100 2024-09-14T11:04:19.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.857+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=LBQ6BEF5FMY2 tag=FWCS2TW745R9 type=write size=3519828 2024-09-14T11:04:19.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.858+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=INJ9M8SSWNFR type=del 2024-09-14T11:04:19.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.859+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=FVAJ3R59FI8C type=del size=2209046 2024-09-14T11:04:19.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.861+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=6T4L482PFWG2 type=write size=800984 2024-09-14T11:04:19.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.863+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.0 size=1048576 2024-09-14T11:04:19.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.864+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.1 size=1048576 2024-09-14T11:04:19.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.865+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.2 size=269502 2024-09-14T11:04:19.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.865+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=N8OSWTREL1CD tag=FW1B6DT5R0K5 type=write size=3415230 2024-09-14T11:04:19.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.866+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=B403H01MFVBG type=write size=27232 2024-09-14T11:04:19.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.868+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=QAXE9K0PNX27 type=del size=3341574 2024-09-14T11:04:19.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.869+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~EURDIUBXACYK.0 size=871733 2024-09-14T11:04:19.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.871+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=EURDIUBXACYK tag=97DHB2RI22QR type=write size=1920309 2024-09-14T11:04:19.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.873+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~2KIUIFM2VJ89.0 size=1048576 2024-09-14T11:04:19.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.874+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~2KIUIFM2VJ89.1 size=815302 2024-09-14T11:04:19.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.874+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=2KIUIFM2VJ89 tag=230MGCJ9XY0K type=write size=2912454 2024-09-14T11:04:19.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.875+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~ZZW6AQ71MA0R.0 size=885275 2024-09-14T11:04:19.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.877+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=ZZW6AQ71MA0R tag=XS8MSA9ZL3ZU type=write size=1933851 2024-09-14T11:04:19.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.879+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=TM8GHXFRP6Z3 type=del size=424106 2024-09-14T11:04:19.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.880+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~VRU3ISQ19CU4.0 size=896813 2024-09-14T11:04:19.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.882+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=VRU3ISQ19CU4 tag=XUQ2V2O0EUJ1 type=write size=1945389 2024-09-14T11:04:19.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.883+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=CN2T6IB208QV type=del size=1692902 2024-09-14T11:04:19.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.885+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=104R0211PST0 type=del 2024-09-14T11:04:19.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.886+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=JOFRCLB1OSQ0 type=write size=985676 2024-09-14T11:04:19.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.887+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=BLOB2ECC70HE type=del 2024-09-14T11:04:19.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.888+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=VUTSA9WH0UUZ type=write size=271417 2024-09-14T11:04:19.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.889+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=AAFV1QZK0DMW type=write size=547617 2024-09-14T11:04:19.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.890+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=L53JRNLZJC4Y type=del size=3533902 2024-09-14T11:04:19.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.891+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.0 size=1048576 2024-09-14T11:04:19.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.892+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.1 size=1048576 2024-09-14T11:04:19.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.892+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~3YYQ3BFO4N3S.2 size=1033448 2024-09-14T11:04:19.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.894+0000 7f907bbdf780 1 < canceled multipart upload key=59WHXDR0S8DM upload=3YYQ3BFO4N3S tag=0BJLL6ZQC10G type=write size=4179176 2024-09-14T11:04:19.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.896+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.0 size=1048576 2024-09-14T11:04:19.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.897+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.1 size=1048576 2024-09-14T11:04:19.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.898+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.2 size=607982 2024-09-14T11:04:19.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.898+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=4PDZLPCPW1QF tag=D5Y7U4CG4DTQ type=write size=3753710 2024-09-14T11:04:19.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.899+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~WXZ8LR1Q0SQP.0 size=1048576 2024-09-14T11:04:19.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.900+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~WXZ8LR1Q0SQP.1 size=543394 2024-09-14T11:04:19.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.903+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=WXZ8LR1Q0SQP tag=ZRQ5IBGJPG16 type=write size=2640546 2024-09-14T11:04:19.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.905+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~G91RBJ00BNSQ.0 size=1048576 2024-09-14T11:04:19.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.906+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~G91RBJ00BNSQ.1 size=460354 2024-09-14T11:04:19.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.906+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=G91RBJ00BNSQ tag=VETJN1M2TWZD type=write size=2557506 2024-09-14T11:04:19.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.909+0000 7f907bbdf780 1 < suggested update operation key=P546JCSFB00N tag=CMIP892OYQ02 type=del size=7589 2024-09-14T11:04:19.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.910+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=ZAVMNXGG9H2L type=del size=1006693 2024-09-14T11:04:19.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.911+0000 7f907bbdf780 1 < canceled operation key=ZFF333CYOK5P tag=EM3OCQ1XHDRP type=del size=2461325 2024-09-14T11:04:19.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.912+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=RPV6HNXR8M84 type=del size=657174 2024-09-14T11:04:19.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.914+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~NIMNAAL9N1CC.0 size=1048576 2024-09-14T11:04:19.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.915+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~NIMNAAL9N1CC.1 size=415600 2024-09-14T11:04:19.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.917+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=NIMNAAL9N1CC tag=RZXPNCEVYBZB type=write size=2512752 2024-09-14T11:04:19.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.919+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.0 size=1048576 2024-09-14T11:04:19.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.920+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.1 size=1048576 2024-09-14T11:04:19.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.921+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.2 size=191521 2024-09-14T11:04:19.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.921+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=UPBXFY67FJBB tag=B7SQK6ULZNAH type=write size=3337249 2024-09-14T11:04:19.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.922+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~LS59EDRX0ES1.0 size=447431 2024-09-14T11:04:19.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.924+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=LS59EDRX0ES1 tag=M92403MBMD24 type=write size=1496007 2024-09-14T11:04:19.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.925+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=AWYEMRGZ03V2 type=del size=1954874 2024-09-14T11:04:19.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.925+0000 7f907bbdf780 1 < canceled part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.0 size=1048576 2024-09-14T11:04:19.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.926+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.1 size=1048576 2024-09-14T11:04:19.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.927+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~LBQ6BEF5FMY2.2 size=374100 2024-09-14T11:04:19.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.929+0000 7f907bbdf780 1 < canceled multipart upload key=T81OF13I2JVH upload=LBQ6BEF5FMY2 tag=FWCS2TW745R9 type=write size=3519828 2024-09-14T11:04:19.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.931+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=4WYZR4CFLV93 type=del size=4159849 2024-09-14T11:04:19.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.932+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=FVAJ3R59FI8C type=del 2024-09-14T11:04:19.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.934+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.0 size=1048576 2024-09-14T11:04:19.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.935+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.1 size=1048576 2024-09-14T11:04:19.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.936+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.2 size=617648 2024-09-14T11:04:19.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.936+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=MS6HLM9J3ASL tag=9EZMSE3KXN4O type=write size=3763376 2024-09-14T11:04:19.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.937+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.0 size=1048576 2024-09-14T11:04:19.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.938+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.1 size=1048576 2024-09-14T11:04:19.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.939+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~N8OSWTREL1CD.2 size=269502 2024-09-14T11:04:19.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.941+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=N8OSWTREL1CD tag=FW1B6DT5R0K5 type=write size=3415230 2024-09-14T11:04:19.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.942+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=I0JZOB7CXYY7 type=del size=2418335 2024-09-14T11:04:19.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.943+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=QAXE9K0PNX27 type=del 2024-09-14T11:04:19.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.944+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=9UZHKDK36ME7 type=del size=2103320 2024-09-14T11:04:19.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.945+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~2KIUIFM2VJ89.0 size=1048576 2024-09-14T11:04:19.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.946+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~2KIUIFM2VJ89.1 size=815302 2024-09-14T11:04:19.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.948+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=2KIUIFM2VJ89 tag=230MGCJ9XY0K type=write size=2912454 2024-09-14T11:04:19.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.949+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=4BDNWHLEIW78 type=del size=3193881 2024-09-14T11:04:19.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.951+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=TM8GHXFRP6Z3 type=del 2024-09-14T11:04:19.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.953+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.0 size=1048576 2024-09-14T11:04:19.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.954+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.1 size=1048576 2024-09-14T11:04:19.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.955+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.2 size=168562 2024-09-14T11:04:19.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.955+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=1K3ZFBBDJ9B7 tag=WUG6UDTZM81C type=write size=3314290 2024-09-14T11:04:19.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.956+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=CN2T6IB208QV type=del 2024-09-14T11:04:19.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.958+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.0 size=1048576 2024-09-14T11:04:19.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.959+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.1 size=1048576 2024-09-14T11:04:19.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.960+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.2 size=785443 2024-09-14T11:04:19.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.960+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=1ABBQ25ET22O tag=S1YEXGV1TOFH type=write size=3931171 2024-09-14T11:04:19.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.961+0000 7f907bbdf780 1 < completed write operation key=8NO5BA4HL03L tag=JOFRCLB1OSQ0 type=write size=985676 2024-09-14T11:04:19.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.962+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=SO87K1U31TCW type=del size=1645944 2024-09-14T11:04:19.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.963+0000 7f907bbdf780 1 < completed write operation key=LJ720PV3SQ8L tag=VUTSA9WH0UUZ type=write size=271417 2024-09-14T11:04:19.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.964+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=ZS0SR23ZBL91 type=write size=160501 2024-09-14T11:04:19.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.965+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=L53JRNLZJC4Y type=del 2024-09-14T11:04:19.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.968+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~0YHTON07M8GB.0 size=1048576 2024-09-14T11:04:19.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.969+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~0YHTON07M8GB.1 size=594423 2024-09-14T11:04:19.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.969+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=0YHTON07M8GB tag=BZ33OGFSYL0S type=write size=2691575 2024-09-14T11:04:19.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.970+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.0 size=1048576 2024-09-14T11:04:19.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.971+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.1 size=1048576 2024-09-14T11:04:19.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.972+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~4PDZLPCPW1QF.2 size=607982 2024-09-14T11:04:19.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.974+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=4PDZLPCPW1QF tag=D5Y7U4CG4DTQ type=write size=3753710 2024-09-14T11:04:19.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.976+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~FFARKVKWG313.0 size=317360 2024-09-14T11:04:19.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.976+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=FFARKVKWG313 tag=NIRIZGTRUVGX type=write size=1365936 2024-09-14T11:04:19.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.978+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~G91RBJ00BNSQ.0 size=1048576 2024-09-14T11:04:19.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.978+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~G91RBJ00BNSQ.1 size=460354 2024-09-14T11:04:19.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.981+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=G91RBJ00BNSQ tag=VETJN1M2TWZD type=write size=2557506 2024-09-14T11:04:19.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.982+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=OVIGQT1KPPCP type=write size=411331 2024-09-14T11:04:19.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.983+0000 7f907bbdf780 1 < canceled operation key=8NO5BA4HL03L tag=ZAVMNXGG9H2L type=del size=1006693 2024-09-14T11:04:19.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.984+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=L2CCNUU1GGYC type=del size=1621544 2024-09-14T11:04:19.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.985+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=RPV6HNXR8M84 type=del 2024-09-14T11:04:19.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.988+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~1Q703RN9WKOC.0 size=11824 2024-09-14T11:04:19.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.988+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=1Q703RN9WKOC tag=N683J2JHMLHH type=write size=1060400 2024-09-14T11:04:19.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.989+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.0 size=1048576 2024-09-14T11:04:19.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.990+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.1 size=1048576 2024-09-14T11:04:19.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.991+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~UPBXFY67FJBB.2 size=191521 2024-09-14T11:04:19.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.993+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=UPBXFY67FJBB tag=B7SQK6ULZNAH type=write size=3337249 2024-09-14T11:04:19.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.994+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=3QFFI2YWLH7S type=del size=3141658 2024-09-14T11:04:19.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.995+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=AWYEMRGZ03V2 type=del 2024-09-14T11:04:19.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.996+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=120JFSI58J23 type=del size=2086356 2024-09-14T11:04:19.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:19.998+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=4WYZR4CFLV93 type=del 2024-09-14T11:04:19.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.000+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4DVCZJUQDL0S.0 size=1048576 2024-09-14T11:04:19.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.001+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4DVCZJUQDL0S.1 size=3580 2024-09-14T11:04:19.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.001+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=4DVCZJUQDL0S tag=YBD2GU6J192R type=write size=2100732 2024-09-14T11:04:20.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.002+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.0 size=1048576 2024-09-14T11:04:20.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.003+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.1 size=1048576 2024-09-14T11:04:20.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.004+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~MS6HLM9J3ASL.2 size=617648 2024-09-14T11:04:20.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.006+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=MS6HLM9J3ASL tag=9EZMSE3KXN4O type=write size=3763376 2024-09-14T11:04:20.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.008+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~PC8NT9GJG6RZ.0 size=772883 2024-09-14T11:04:20.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.008+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=PC8NT9GJG6RZ tag=8PHQ1NW87BQR type=write size=1821459 2024-09-14T11:04:20.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.010+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=I0JZOB7CXYY7 type=del 2024-09-14T11:04:20.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.011+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=DXAOHSNDBQCJ type=del size=3678312 2024-09-14T11:04:20.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.013+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=9UZHKDK36ME7 type=del 2024-09-14T11:04:20.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.014+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=9AYWXZN1OAGH type=del size=2056771 2024-09-14T11:04:20.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.015+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=4BDNWHLEIW78 type=del 2024-09-14T11:04:20.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.016+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=LG4VXPWOCNJJ type=del size=3321036 2024-09-14T11:04:20.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.017+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.0 size=1048576 2024-09-14T11:04:20.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.018+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.1 size=1048576 2024-09-14T11:04:20.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.019+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~1K3ZFBBDJ9B7.2 size=168562 2024-09-14T11:04:20.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.021+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=1K3ZFBBDJ9B7 tag=WUG6UDTZM81C type=write size=3314290 2024-09-14T11:04:20.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.023+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=PD3YOQ6K98XA type=del size=1543705 2024-09-14T11:04:20.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.024+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.0 size=1048576 2024-09-14T11:04:20.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.025+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.1 size=1048576 2024-09-14T11:04:20.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.026+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~1ABBQ25ET22O.2 size=785443 2024-09-14T11:04:20.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.028+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=1ABBQ25ET22O tag=S1YEXGV1TOFH type=write size=3931171 2024-09-14T11:04:20.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.029+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=R5AXPMVOBVAG type=write size=980006 2024-09-14T11:04:20.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.031+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=SO87K1U31TCW type=del 2024-09-14T11:04:20.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.033+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~PCPLPA3JF4AQ.0 size=1048576 2024-09-14T11:04:20.032 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.034+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~PCPLPA3JF4AQ.1 size=13406 2024-09-14T11:04:20.032 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.034+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=PCPLPA3JF4AQ tag=EILBBBZ8XH52 type=write size=2110558 2024-09-14T11:04:20.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.035+0000 7f907bbdf780 1 < completed write operation key=P546JCSFB00N tag=ZS0SR23ZBL91 type=write size=160501 2024-09-14T11:04:20.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.036+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=ZFL7753FIO8T type=del size=846031 2024-09-14T11:04:20.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.037+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~0YHTON07M8GB.0 size=1048576 2024-09-14T11:04:20.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.038+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~0YHTON07M8GB.1 size=594423 2024-09-14T11:04:20.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.040+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=0YHTON07M8GB tag=BZ33OGFSYL0S type=write size=2691575 2024-09-14T11:04:20.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.043+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~NZR9Y48862DL.0 size=852066 2024-09-14T11:04:20.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.043+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=NZR9Y48862DL tag=W83XPED1E9SO type=write size=1900642 2024-09-14T11:04:20.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.044+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~FFARKVKWG313.0 size=317360 2024-09-14T11:04:20.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.046+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=FFARKVKWG313 tag=NIRIZGTRUVGX type=write size=1365936 2024-09-14T11:04:20.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.047+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=LY08AUVDMG5N type=write size=236903 2024-09-14T11:04:20.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.048+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=OVIGQT1KPPCP type=write size=411331 2024-09-14T11:04:20.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.050+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=VEX3FYHAIJRG type=write size=590475 2024-09-14T11:04:20.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.051+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=L2CCNUU1GGYC type=del 2024-09-14T11:04:20.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.053+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.0 size=1048576 2024-09-14T11:04:20.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.054+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.1 size=1048576 2024-09-14T11:04:20.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.055+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.2 size=413621 2024-09-14T11:04:20.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.055+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=PK8742YUAPYM tag=SWTOX7SQP1ZO type=write size=3559349 2024-09-14T11:04:20.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.056+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~1Q703RN9WKOC.0 size=11824 2024-09-14T11:04:20.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.058+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=1Q703RN9WKOC tag=N683J2JHMLHH type=write size=1060400 2024-09-14T11:04:20.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.060+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.0 size=1048576 2024-09-14T11:04:20.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.061+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.1 size=1048576 2024-09-14T11:04:20.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.062+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.2 size=897866 2024-09-14T11:04:20.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.062+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=EOVGKM5ADBST tag=G8WG9UNNHE1J type=write size=4043594 2024-09-14T11:04:20.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.063+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=3QFFI2YWLH7S type=del 2024-09-14T11:04:20.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.066+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~B7ILYSD8NG95.0 size=460428 2024-09-14T11:04:20.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.066+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=B7ILYSD8NG95 tag=3QJOJLUDIPK1 type=write size=1509004 2024-09-14T11:04:20.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.067+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=120JFSI58J23 type=del 2024-09-14T11:04:20.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.068+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=XZOSYIXV4LT0 type=del size=3129405 2024-09-14T11:04:20.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.069+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4DVCZJUQDL0S.0 size=1048576 2024-09-14T11:04:20.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.070+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4DVCZJUQDL0S.1 size=3580 2024-09-14T11:04:20.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.072+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=4DVCZJUQDL0S tag=YBD2GU6J192R type=write size=2100732 2024-09-14T11:04:20.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.073+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=JK5Z692Y1C45 type=del size=2402967 2024-09-14T11:04:20.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.075+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~PC8NT9GJG6RZ.0 size=772883 2024-09-14T11:04:20.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.077+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=PC8NT9GJG6RZ tag=8PHQ1NW87BQR type=write size=1821459 2024-09-14T11:04:20.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.079+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.0 size=1048576 2024-09-14T11:04:20.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.080+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.1 size=1048576 2024-09-14T11:04:20.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.081+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.2 size=646279 2024-09-14T11:04:20.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.081+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=YH6C7TQCV8G1 tag=GD7GGY4JIU72 type=write size=3792007 2024-09-14T11:04:20.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.083+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=DXAOHSNDBQCJ type=del 2024-09-14T11:04:20.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.084+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=23XMJPI0369B type=del size=492571 2024-09-14T11:04:20.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.085+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=9AYWXZN1OAGH type=del 2024-09-14T11:04:20.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.087+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=D57CBESBMI41 type=del size=2618938 2024-09-14T11:04:20.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.088+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=LG4VXPWOCNJJ type=del 2024-09-14T11:04:20.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.089+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=5YXWSM4IEWCL type=del size=2809575 2024-09-14T11:04:20.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.091+0000 7f907bbdf780 1 < suggested remove operation key=P0701O36E1JI tag=PD3YOQ6K98XA type=del 2024-09-14T11:04:20.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.093+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~0VXVXK9I7YA1.0 size=343137 2024-09-14T11:04:20.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.093+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=0VXVXK9I7YA1 tag=J0J32CYK7N0I type=write size=1391713 2024-09-14T11:04:20.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.094+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=R5AXPMVOBVAG type=write size=980006 2024-09-14T11:04:20.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.096+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=L1Z9WUMYOI5T type=del size=1495769 2024-09-14T11:04:20.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.097+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~PCPLPA3JF4AQ.0 size=1048576 2024-09-14T11:04:20.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.098+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~PCPLPA3JF4AQ.1 size=13406 2024-09-14T11:04:20.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.100+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=PCPLPA3JF4AQ tag=EILBBBZ8XH52 type=write size=2110558 2024-09-14T11:04:20.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.101+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=YHWQ3DSFFBYC type=write size=1021238 2024-09-14T11:04:20.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.103+0000 7f907bbdf780 1 < suggested remove operation key=ZFF333CYOK5P tag=ZFL7753FIO8T type=del 2024-09-14T11:04:20.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.105+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=YOZLUJZ82J08 type=del size=2590601 2024-09-14T11:04:20.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.106+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~NZR9Y48862DL.0 size=852066 2024-09-14T11:04:20.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.108+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=NZR9Y48862DL tag=W83XPED1E9SO type=write size=1900642 2024-09-14T11:04:20.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.109+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=7AZP882BHC7X type=del size=2106257 2024-09-14T11:04:20.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.110+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=LY08AUVDMG5N type=write size=236903 2024-09-14T11:04:20.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.112+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=BTXZL40586LO type=write size=606515 2024-09-14T11:04:20.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.113+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=VEX3FYHAIJRG type=write size=590475 2024-09-14T11:04:20.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.114+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=26QURXRIFH5J type=del size=2907094 2024-09-14T11:04:20.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.115+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.0 size=1048576 2024-09-14T11:04:20.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.116+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.1 size=1048576 2024-09-14T11:04:20.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.117+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~PK8742YUAPYM.2 size=413621 2024-09-14T11:04:20.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.119+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=PK8742YUAPYM tag=SWTOX7SQP1ZO type=write size=3559349 2024-09-14T11:04:20.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.122+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~39NQ1XD20E7S.0 size=62665 2024-09-14T11:04:20.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.122+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=39NQ1XD20E7S tag=VK0WJAH3KYO8 type=write size=1111241 2024-09-14T11:04:20.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.123+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.0 size=1048576 2024-09-14T11:04:20.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.123+0000 7f907bbdf780 1 < canceled part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.1 size=1048576 2024-09-14T11:04:20.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.124+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~EOVGKM5ADBST.2 size=897866 2024-09-14T11:04:20.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.126+0000 7f907bbdf780 1 < canceled multipart upload key=HM2GVOA72HHR upload=EOVGKM5ADBST tag=G8WG9UNNHE1J type=write size=4043594 2024-09-14T11:04:20.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.128+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~GJUG4BU2F65V.0 size=604993 2024-09-14T11:04:20.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.128+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=GJUG4BU2F65V tag=EUS9Y7SG1QBC type=write size=1653569 2024-09-14T11:04:20.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.129+0000 7f907bbdf780 1 < canceled part key=_multipart_P0701O36E1JI.2~B7ILYSD8NG95.0 size=460428 2024-09-14T11:04:20.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.131+0000 7f907bbdf780 1 < canceled multipart upload key=P0701O36E1JI upload=B7ILYSD8NG95 tag=3QJOJLUDIPK1 type=write size=1509004 2024-09-14T11:04:20.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.132+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=46USTIWZ7JRS type=write size=406070 2024-09-14T11:04:20.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.133+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=XZOSYIXV4LT0 type=del 2024-09-14T11:04:20.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.134+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=GDTJUBZ8L0FM type=write size=587082 2024-09-14T11:04:20.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.135+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=JK5Z692Y1C45 type=del 2024-09-14T11:04:20.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.136+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=U38CL1XNUS3X type=del size=3669689 2024-09-14T11:04:20.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.137+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.0 size=1048576 2024-09-14T11:04:20.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.137+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.1 size=1048576 2024-09-14T11:04:20.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.138+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~YH6C7TQCV8G1.2 size=646279 2024-09-14T11:04:20.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.140+0000 7f907bbdf780 1 < canceled multipart upload key=8NO5BA4HL03L upload=YH6C7TQCV8G1 tag=GD7GGY4JIU72 type=write size=3792007 2024-09-14T11:04:20.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.141+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=CI84SVZ4ROO1 type=del size=3138397 2024-09-14T11:04:20.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.142+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=23XMJPI0369B type=del 2024-09-14T11:04:20.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.144+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=U6CS464FLX30 type=del size=756128 2024-09-14T11:04:20.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.145+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=D57CBESBMI41 type=del 2024-09-14T11:04:20.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.147+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.0 size=1048576 2024-09-14T11:04:20.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.148+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.1 size=1048576 2024-09-14T11:04:20.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.149+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.2 size=418019 2024-09-14T11:04:20.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.149+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=1YP4Q69MVKLR tag=VQN0F0OJWE8L type=write size=3563747 2024-09-14T11:04:20.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.150+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=5YXWSM4IEWCL type=del 2024-09-14T11:04:20.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.151+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=UWDVA6PNKAG4 type=write size=911315 2024-09-14T11:04:20.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.153+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~0VXVXK9I7YA1.0 size=343137 2024-09-14T11:04:20.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.154+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=0VXVXK9I7YA1 tag=J0J32CYK7N0I type=write size=1391713 2024-09-14T11:04:20.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.157+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~4IH88CQJWI79.0 size=1048576 2024-09-14T11:04:20.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.157+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~4IH88CQJWI79.1 size=1019059 2024-09-14T11:04:20.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.157+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=4IH88CQJWI79 tag=0XZ9WPYWWYC9 type=write size=3116211 2024-09-14T11:04:20.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.159+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=L1Z9WUMYOI5T type=del 2024-09-14T11:04:20.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.160+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=N8SGYRJ2MPD5 type=del size=354770 2024-09-14T11:04:20.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.162+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=YHWQ3DSFFBYC type=write size=1021238 2024-09-14T11:04:20.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.163+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=UX0HSNTASRK0 type=del size=1516959 2024-09-14T11:04:20.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.165+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=YOZLUJZ82J08 type=del 2024-09-14T11:04:20.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.167+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~EIZ7DEGAG58F.0 size=1048576 2024-09-14T11:04:20.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.168+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~EIZ7DEGAG58F.1 size=825209 2024-09-14T11:04:20.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.168+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=EIZ7DEGAG58F tag=K0FG1JRB2AN4 type=write size=2922361 2024-09-14T11:04:20.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.169+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=7AZP882BHC7X type=del 2024-09-14T11:04:20.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.171+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~OMLG3H84C18V.0 size=1048576 2024-09-14T11:04:20.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.172+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~OMLG3H84C18V.1 size=282793 2024-09-14T11:04:20.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.172+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=OMLG3H84C18V tag=WVRRLZ01Z352 type=write size=2379945 2024-09-14T11:04:20.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.174+0000 7f907bbdf780 1 < canceled operation key=9OKQI3W8M5GA tag=BTXZL40586LO type=write size=606515 2024-09-14T11:04:20.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.175+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=AE85S5MHZTF6 type=del size=1345913 2024-09-14T11:04:20.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.176+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=26QURXRIFH5J type=del 2024-09-14T11:04:20.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.178+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.0 size=1048576 2024-09-14T11:04:20.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.179+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.1 size=1048576 2024-09-14T11:04:20.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.180+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.2 size=737765 2024-09-14T11:04:20.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.180+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=IYDSW7US7R2Y tag=P3JD5UHVGQXT type=write size=3883493 2024-09-14T11:04:20.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.181+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~39NQ1XD20E7S.0 size=62665 2024-09-14T11:04:20.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.184+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=39NQ1XD20E7S tag=VK0WJAH3KYO8 type=write size=1111241 2024-09-14T11:04:20.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.185+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=J80O1L6VQ3G7 type=del size=1837431 2024-09-14T11:04:20.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.186+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~GJUG4BU2F65V.0 size=604993 2024-09-14T11:04:20.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.188+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=GJUG4BU2F65V tag=EUS9Y7SG1QBC type=write size=1653569 2024-09-14T11:04:20.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.189+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=MMK24LKVGQ07 type=del size=483992 2024-09-14T11:04:20.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.190+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=46USTIWZ7JRS type=write size=406070 2024-09-14T11:04:20.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.192+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=R8B6PK3K401D type=del size=163629 2024-09-14T11:04:20.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.193+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=GDTJUBZ8L0FM type=write size=587082 2024-09-14T11:04:20.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.194+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=Y5U5GHZ7FNNG type=del size=3493112 2024-09-14T11:04:20.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.195+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=U38CL1XNUS3X type=del 2024-09-14T11:04:20.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.197+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=FK7D22AJTUHF type=del size=2589474 2024-09-14T11:04:20.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.198+0000 7f907bbdf780 1 < canceled operation key=P546JCSFB00N tag=CI84SVZ4ROO1 type=del size=3138397 2024-09-14T11:04:20.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.199+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=0KVI0L93ML9V type=del size=3018025 2024-09-14T11:04:20.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.200+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=U6CS464FLX30 type=del 2024-09-14T11:04:20.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.201+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=1HGYKPL62RRL type=del size=4011709 2024-09-14T11:04:20.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.203+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.0 size=1048576 2024-09-14T11:04:20.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.204+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.1 size=1048576 2024-09-14T11:04:20.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.204+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~1YP4Q69MVKLR.2 size=418019 2024-09-14T11:04:20.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.206+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=1YP4Q69MVKLR tag=VQN0F0OJWE8L type=write size=3563747 2024-09-14T11:04:20.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.207+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=3ECGFVH7TJ0Z type=del size=2846001 2024-09-14T11:04:20.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.208+0000 7f907bbdf780 1 < completed write operation key=GC52N456IYD7 tag=UWDVA6PNKAG4 type=write size=911315 2024-09-14T11:04:20.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.210+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.0 size=1048576 2024-09-14T11:04:20.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.211+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.1 size=1048576 2024-09-14T11:04:20.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.212+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.2 size=101712 2024-09-14T11:04:20.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.212+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=2DQKSKH2VTTF tag=6NJOQQ0F4FD0 type=write size=3247440 2024-09-14T11:04:20.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.214+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~4IH88CQJWI79.0 size=1048576 2024-09-14T11:04:20.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.214+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~4IH88CQJWI79.1 size=1019059 2024-09-14T11:04:20.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.216+0000 7f907bbdf780 1 < canceled multipart upload key=5MFLA6XFV3Y5 upload=4IH88CQJWI79 tag=0XZ9WPYWWYC9 type=write size=3116211 2024-09-14T11:04:20.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.217+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=K99Z63ZF3ILZ type=del size=3106790 2024-09-14T11:04:20.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.218+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=N8SGYRJ2MPD5 type=del 2024-09-14T11:04:20.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.220+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=W30JFYL4X8WT type=write size=201795 2024-09-14T11:04:20.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.221+0000 7f907bbdf780 1 < canceled operation key=GC52N456IYD7 tag=UX0HSNTASRK0 type=del size=1516959 2024-09-14T11:04:20.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.223+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~SKHQ3BVRLII6.0 size=1048576 2024-09-14T11:04:20.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.224+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~SKHQ3BVRLII6.1 size=583532 2024-09-14T11:04:20.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.224+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=SKHQ3BVRLII6 tag=GIMA2SFD4MJ0 type=write size=2680684 2024-09-14T11:04:20.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.225+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~EIZ7DEGAG58F.0 size=1048576 2024-09-14T11:04:20.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.226+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~EIZ7DEGAG58F.1 size=825209 2024-09-14T11:04:20.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.228+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=EIZ7DEGAG58F tag=K0FG1JRB2AN4 type=write size=2922361 2024-09-14T11:04:20.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.231+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~XUFIE1XQMP6O.0 size=1048576 2024-09-14T11:04:20.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.232+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~XUFIE1XQMP6O.1 size=121794 2024-09-14T11:04:20.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.232+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=XUFIE1XQMP6O tag=O3UORIGW3DTX type=write size=2218946 2024-09-14T11:04:20.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.233+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~OMLG3H84C18V.0 size=1048576 2024-09-14T11:04:20.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.234+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~OMLG3H84C18V.1 size=282793 2024-09-14T11:04:20.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.237+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=OMLG3H84C18V tag=WVRRLZ01Z352 type=write size=2379945 2024-09-14T11:04:20.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.238+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=YQVW559I9667 type=write size=267735 2024-09-14T11:04:20.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.240+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=AE85S5MHZTF6 type=del 2024-09-14T11:04:20.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.241+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=C71GX3T3R0WL type=del size=1992677 2024-09-14T11:04:20.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.242+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.0 size=1048576 2024-09-14T11:04:20.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.243+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.1 size=1048576 2024-09-14T11:04:20.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.244+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~IYDSW7US7R2Y.2 size=737765 2024-09-14T11:04:20.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.246+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=IYDSW7US7R2Y tag=P3JD5UHVGQXT type=write size=3883493 2024-09-14T11:04:20.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.248+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=97RXG5VXY8XE type=del size=2596494 2024-09-14T11:04:20.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.249+0000 7f907bbdf780 1 < canceled operation key=9OKQI3W8M5GA tag=J80O1L6VQ3G7 type=del size=1837431 2024-09-14T11:04:20.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.250+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=U66Z1O2UALCI type=del size=1160057 2024-09-14T11:04:20.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.251+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=MMK24LKVGQ07 type=del 2024-09-14T11:04:20.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.253+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~LFH7SCU6XSKO.0 size=213864 2024-09-14T11:04:20.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.253+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=LFH7SCU6XSKO tag=87KVJV6H3S1F type=write size=1262440 2024-09-14T11:04:20.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.254+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=R8B6PK3K401D type=del 2024-09-14T11:04:20.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.257+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~FW1CBMNW8LE9.0 size=151066 2024-09-14T11:04:20.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.257+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=FW1CBMNW8LE9 tag=EEY6QOXXOT1R type=write size=1199642 2024-09-14T11:04:20.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.258+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=Y5U5GHZ7FNNG type=del 2024-09-14T11:04:20.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.259+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=BCBD7WM6E4QO type=del size=2449708 2024-09-14T11:04:20.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.261+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=FK7D22AJTUHF type=del size=2589474 2024-09-14T11:04:20.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.262+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=AA6BVH02LOPY type=del size=1170950 2024-09-14T11:04:20.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.263+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=0KVI0L93ML9V type=del 2024-09-14T11:04:20.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.265+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=SVNT5NPQ99F0 type=del size=3552465 2024-09-14T11:04:20.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.267+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=1HGYKPL62RRL type=del 2024-09-14T11:04:20.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.269+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.0 size=1048576 2024-09-14T11:04:20.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.270+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.1 size=1048576 2024-09-14T11:04:20.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.271+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.2 size=815301 2024-09-14T11:04:20.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.271+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=LC2ZUX35RG78 tag=00UIA0QG6WIV type=write size=3961029 2024-09-14T11:04:20.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.273+0000 7f907bbdf780 1 < suggested remove operation key=LJ720PV3SQ8L tag=3ECGFVH7TJ0Z type=del 2024-09-14T11:04:20.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.275+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=Z2XBQ4FFMLM5 type=del size=3561377 2024-09-14T11:04:20.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.276+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.0 size=1048576 2024-09-14T11:04:20.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.277+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.1 size=1048576 2024-09-14T11:04:20.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.278+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~2DQKSKH2VTTF.2 size=101712 2024-09-14T11:04:20.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.280+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=2DQKSKH2VTTF tag=6NJOQQ0F4FD0 type=write size=3247440 2024-09-14T11:04:20.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.281+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=37JQVNO28NLI type=write size=78506 2024-09-14T11:04:20.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.282+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=K99Z63ZF3ILZ type=del 2024-09-14T11:04:20.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.285+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~PW4LHJD7RNZ9.0 size=697986 2024-09-14T11:04:20.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.285+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=PW4LHJD7RNZ9 tag=2F9CF22Y2PFD type=write size=1746562 2024-09-14T11:04:20.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.286+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=W30JFYL4X8WT type=write size=201795 2024-09-14T11:04:20.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.287+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=S1KUFH8AO2CA type=del size=168497 2024-09-14T11:04:20.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.289+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~SKHQ3BVRLII6.0 size=1048576 2024-09-14T11:04:20.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.290+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~SKHQ3BVRLII6.1 size=583532 2024-09-14T11:04:20.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.292+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=SKHQ3BVRLII6 tag=GIMA2SFD4MJ0 type=write size=2680684 2024-09-14T11:04:20.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.293+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=RO8HAIFUCF8C type=del size=467852 2024-09-14T11:04:20.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.293+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~XUFIE1XQMP6O.0 size=1048576 2024-09-14T11:04:20.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.294+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~XUFIE1XQMP6O.1 size=121794 2024-09-14T11:04:20.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.296+0000 7f907bbdf780 1 < canceled multipart upload key=S8RIEED24PUM upload=XUFIE1XQMP6O tag=O3UORIGW3DTX type=write size=2218946 2024-09-14T11:04:20.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.298+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.0 size=1048576 2024-09-14T11:04:20.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.299+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.1 size=1048576 2024-09-14T11:04:20.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.300+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.2 size=387092 2024-09-14T11:04:20.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.300+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=YOX4GYPS74ZE tag=6ICAXMT02U7Y type=write size=3532820 2024-09-14T11:04:20.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.301+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=YQVW559I9667 type=write size=267735 2024-09-14T11:04:20.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.302+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=SE8MD3DTOS07 type=del size=2868604 2024-09-14T11:04:20.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.304+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=C71GX3T3R0WL type=del 2024-09-14T11:04:20.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.305+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=J85Q8IJ95PGF type=del size=3127369 2024-09-14T11:04:20.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.307+0000 7f907bbdf780 1 < suggested remove operation key=T81OF13I2JVH tag=97RXG5VXY8XE type=del 2024-09-14T11:04:20.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.309+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.0 size=1048576 2024-09-14T11:04:20.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.310+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.1 size=1048576 2024-09-14T11:04:20.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.311+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.2 size=270841 2024-09-14T11:04:20.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.311+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=OYQGO7UWTLCC tag=X6F4HZK9C6W2 type=write size=3416569 2024-09-14T11:04:20.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.312+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=U66Z1O2UALCI type=del 2024-09-14T11:04:20.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.315+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7LMA0HOM138N.0 size=679545 2024-09-14T11:04:20.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.315+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=7LMA0HOM138N tag=7VJZ0BN9DUOZ type=write size=1728121 2024-09-14T11:04:20.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.316+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~LFH7SCU6XSKO.0 size=213864 2024-09-14T11:04:20.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.318+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=LFH7SCU6XSKO tag=87KVJV6H3S1F type=write size=1262440 2024-09-14T11:04:20.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.320+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~LZ2PC4501WQY.0 size=581419 2024-09-14T11:04:20.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.320+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=LZ2PC4501WQY tag=GOXIXTZYKY0I type=write size=1629995 2024-09-14T11:04:20.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.321+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~FW1CBMNW8LE9.0 size=151066 2024-09-14T11:04:20.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.323+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=FW1CBMNW8LE9 tag=EEY6QOXXOT1R type=write size=1199642 2024-09-14T11:04:20.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.326+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~FYUXMBFV8Y4F.0 size=1048576 2024-09-14T11:04:20.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.327+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~FYUXMBFV8Y4F.1 size=294045 2024-09-14T11:04:20.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.327+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=FYUXMBFV8Y4F tag=CFLLJDFAZ6FF type=write size=2391197 2024-09-14T11:04:20.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.328+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=BCBD7WM6E4QO type=del size=2449708 2024-09-14T11:04:20.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.329+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=LXI65MTHJ6S2 type=write size=31640 2024-09-14T11:04:20.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.330+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=AA6BVH02LOPY type=del 2024-09-14T11:04:20.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.331+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=D6F72SBHYP9P type=del size=3542468 2024-09-14T11:04:20.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.334+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=SVNT5NPQ99F0 type=del 2024-09-14T11:04:20.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.336+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~M6NJ6ZNP7PMQ.0 size=272840 2024-09-14T11:04:20.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.336+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=M6NJ6ZNP7PMQ tag=8RCRR3IYD15Z type=write size=1321416 2024-09-14T11:04:20.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.337+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.0 size=1048576 2024-09-14T11:04:20.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.338+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.1 size=1048576 2024-09-14T11:04:20.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.339+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~LC2ZUX35RG78.2 size=815301 2024-09-14T11:04:20.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.341+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=LC2ZUX35RG78 tag=00UIA0QG6WIV type=write size=3961029 2024-09-14T11:04:20.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.343+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XIFABPSMKI43.0 size=352256 2024-09-14T11:04:20.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.343+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=XIFABPSMKI43 tag=4AZZ8KI4GRUY type=write size=1400832 2024-09-14T11:04:20.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.345+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=Z2XBQ4FFMLM5 type=del 2024-09-14T11:04:20.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.346+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=O5BHEFRRBPUA type=del size=2018132 2024-09-14T11:04:20.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.347+0000 7f907bbdf780 1 < canceled operation key=77H37YF6MJEO tag=37JQVNO28NLI type=write size=78506 2024-09-14T11:04:20.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.348+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=X82XK7RGGIGO type=del size=3845089 2024-09-14T11:04:20.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.349+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~PW4LHJD7RNZ9.0 size=697986 2024-09-14T11:04:20.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.352+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=PW4LHJD7RNZ9 tag=2F9CF22Y2PFD type=write size=1746562 2024-09-14T11:04:20.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.353+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=4OH1ZQXFYP2H type=write size=844146 2024-09-14T11:04:20.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.354+0000 7f907bbdf780 -1 < failed to complete operation key=T81OF13I2JVH tag=S1KUFH8AO2CA type=del size=168497: (22) Invalid argument 2024-09-14T11:04:20.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.355+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=PLFBTFQL6LLT type=del size=3113622 2024-09-14T11:04:20.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.358+0000 7f907bbdf780 1 < suggested remove operation key=P546JCSFB00N tag=RO8HAIFUCF8C type=del 2024-09-14T11:04:20.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.360+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~PNJQ87HLZVK7.0 size=1048576 2024-09-14T11:04:20.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.361+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~PNJQ87HLZVK7.1 size=896096 2024-09-14T11:04:20.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.361+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=PNJQ87HLZVK7 tag=LTVR9G0C94MP type=write size=2993248 2024-09-14T11:04:20.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.362+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.0 size=1048576 2024-09-14T11:04:20.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.363+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.1 size=1048576 2024-09-14T11:04:20.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.364+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~YOX4GYPS74ZE.2 size=387092 2024-09-14T11:04:20.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.366+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=YOX4GYPS74ZE tag=6ICAXMT02U7Y type=write size=3532820 2024-09-14T11:04:20.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.367+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=DHZS4FT8IRZD type=write size=114612 2024-09-14T11:04:20.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.368+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=SE8MD3DTOS07 type=del 2024-09-14T11:04:20.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.370+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=LAP633S1V5TV type=del size=3426614 2024-09-14T11:04:20.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.371+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=J85Q8IJ95PGF type=del 2024-09-14T11:04:20.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.372+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=68YXTYS4EP2B type=del size=3147369 2024-09-14T11:04:20.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.373+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.0 size=1048576 2024-09-14T11:04:20.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.374+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.1 size=1048576 2024-09-14T11:04:20.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.375+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~OYQGO7UWTLCC.2 size=270841 2024-09-14T11:04:20.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.377+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=OYQGO7UWTLCC tag=X6F4HZK9C6W2 type=write size=3416569 2024-09-14T11:04:20.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.379+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.0 size=1048576 2024-09-14T11:04:20.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.380+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.1 size=1048576 2024-09-14T11:04:20.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.381+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.2 size=99605 2024-09-14T11:04:20.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.381+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=99N8UGAE25Y1 tag=63Z2M5S4U20R type=write size=3245333 2024-09-14T11:04:20.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.382+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7LMA0HOM138N.0 size=679545 2024-09-14T11:04:20.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.384+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=7LMA0HOM138N tag=7VJZ0BN9DUOZ type=write size=1728121 2024-09-14T11:04:20.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.385+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=HWEQD8F5BQ2M type=del size=2289681 2024-09-14T11:04:20.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.385+0000 7f907bbdf780 1 < canceled part key=_multipart_GC52N456IYD7.2~LZ2PC4501WQY.0 size=581419 2024-09-14T11:04:20.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.387+0000 7f907bbdf780 1 < canceled multipart upload key=GC52N456IYD7 upload=LZ2PC4501WQY tag=GOXIXTZYKY0I type=write size=1629995 2024-09-14T11:04:20.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.388+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=GZXY1GCDFAFW type=write size=227738 2024-09-14T11:04:20.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.389+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~FYUXMBFV8Y4F.0 size=1048576 2024-09-14T11:04:20.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.390+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~FYUXMBFV8Y4F.1 size=294045 2024-09-14T11:04:20.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.392+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=FYUXMBFV8Y4F tag=CFLLJDFAZ6FF type=write size=2391197 2024-09-14T11:04:20.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.393+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=JM6QAU3ES1J7 type=del size=2136477 2024-09-14T11:04:20.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.395+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=LXI65MTHJ6S2 type=write size=31640 2024-09-14T11:04:20.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.396+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=X2KG7P1LY1AM type=del size=3385606 2024-09-14T11:04:20.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.397+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=D6F72SBHYP9P type=del 2024-09-14T11:04:20.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.398+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=AMEBFDVOR9JA type=del size=2117964 2024-09-14T11:04:20.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.399+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~M6NJ6ZNP7PMQ.0 size=272840 2024-09-14T11:04:20.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.401+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=M6NJ6ZNP7PMQ tag=8RCRR3IYD15Z type=write size=1321416 2024-09-14T11:04:20.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.403+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~ZGOMPDUIFMYX.0 size=1048576 2024-09-14T11:04:20.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.404+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~ZGOMPDUIFMYX.1 size=120404 2024-09-14T11:04:20.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.404+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=ZGOMPDUIFMYX tag=P2MP82U0BJWF type=write size=2217556 2024-09-14T11:04:20.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.405+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XIFABPSMKI43.0 size=352256 2024-09-14T11:04:20.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.407+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=XIFABPSMKI43 tag=4AZZ8KI4GRUY type=write size=1400832 2024-09-14T11:04:20.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.409+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~NFMPKO22EXH8.0 size=634093 2024-09-14T11:04:20.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.409+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=NFMPKO22EXH8 tag=EHA5E6MST7P7 type=write size=1682669 2024-09-14T11:04:20.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.410+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=O5BHEFRRBPUA type=del 2024-09-14T11:04:20.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.411+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=IRP7RMZ2XZJL type=del size=3640707 2024-09-14T11:04:20.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.414+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=X82XK7RGGIGO type=del size=3845089 2024-09-14T11:04:20.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.415+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=KZVMITWH59VF type=write size=715908 2024-09-14T11:04:20.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.417+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=4OH1ZQXFYP2H type=write size=844146 2024-09-14T11:04:20.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.418+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=AUI17IPLVG81 type=del size=3246667 2024-09-14T11:04:20.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.419+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=PLFBTFQL6LLT type=del 2024-09-14T11:04:20.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.420+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=4293KTL9OVTG type=del size=1497681 2024-09-14T11:04:20.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.422+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~PNJQ87HLZVK7.0 size=1048576 2024-09-14T11:04:20.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.423+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~PNJQ87HLZVK7.1 size=896096 2024-09-14T11:04:20.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.424+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=PNJQ87HLZVK7 tag=LTVR9G0C94MP type=write size=2993248 2024-09-14T11:04:20.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.426+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=VF0O10883WNS type=del size=3316220 2024-09-14T11:04:20.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.427+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=DHZS4FT8IRZD type=write size=114612 2024-09-14T11:04:20.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.428+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=41QDJNI10BPG type=write size=110675 2024-09-14T11:04:20.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.429+0000 7f907bbdf780 -1 < failed to complete operation key=WZ064RU647Y7 tag=LAP633S1V5TV type=del size=3426614: (22) Invalid argument 2024-09-14T11:04:20.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.430+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=LY46OO9HAUUR type=del size=1447828 2024-09-14T11:04:20.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.433+0000 7f907bbdf780 1 < suggested remove operation key=8FRZW4YC3ATE tag=68YXTYS4EP2B type=del 2024-09-14T11:04:20.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.434+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=Y0380QOWQ9M3 type=del size=1298552 2024-09-14T11:04:20.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.435+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.0 size=1048576 2024-09-14T11:04:20.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.436+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.1 size=1048576 2024-09-14T11:04:20.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.437+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~99N8UGAE25Y1.2 size=99605 2024-09-14T11:04:20.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.440+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=99N8UGAE25Y1 tag=63Z2M5S4U20R type=write size=3245333 2024-09-14T11:04:20.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.442+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~POTF55N3E83I.0 size=882048 2024-09-14T11:04:20.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.442+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=POTF55N3E83I tag=UN5ANI827ZPM type=write size=1930624 2024-09-14T11:04:20.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.443+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=HWEQD8F5BQ2M type=del size=2289681 2024-09-14T11:04:20.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.444+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=ENF0F6HEBREM type=del size=335262 2024-09-14T11:04:20.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.446+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=GZXY1GCDFAFW type=write size=227738 2024-09-14T11:04:20.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.447+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=S7HET1Q7L4JI type=del size=201571 2024-09-14T11:04:20.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.449+0000 7f907bbdf780 1 < suggested update operation key=91RL2KD0XCSI tag=JM6QAU3ES1J7 type=del size=2136477 2024-09-14T11:04:20.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.451+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=HA0PME15FNRQ type=write size=331687 2024-09-14T11:04:20.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.452+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=X2KG7P1LY1AM type=del 2024-09-14T11:04:20.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.453+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=B0NZVC7CFJEL type=write size=734213 2024-09-14T11:04:20.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.454+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=AMEBFDVOR9JA type=del 2024-09-14T11:04:20.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.456+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.0 size=1048576 2024-09-14T11:04:20.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.457+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.1 size=1048576 2024-09-14T11:04:20.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.458+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.2 size=585869 2024-09-14T11:04:20.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.458+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=RNLBPSPE658G tag=8LJIJTM28DI0 type=write size=3731597 2024-09-14T11:04:20.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.460+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~ZGOMPDUIFMYX.0 size=1048576 2024-09-14T11:04:20.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.462+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~ZGOMPDUIFMYX.1 size=120404 2024-09-14T11:04:20.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.464+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=ZGOMPDUIFMYX tag=P2MP82U0BJWF type=write size=2217556 2024-09-14T11:04:20.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.465+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=4PJAPKRA4GB1 type=del size=3409173 2024-09-14T11:04:20.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.466+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~NFMPKO22EXH8.0 size=634093 2024-09-14T11:04:20.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.468+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=NFMPKO22EXH8 tag=EHA5E6MST7P7 type=write size=1682669 2024-09-14T11:04:20.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.470+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~K52KJMGU8WKN.0 size=457278 2024-09-14T11:04:20.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.471+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=K52KJMGU8WKN tag=AVQICTJ3VN0Y type=write size=1505854 2024-09-14T11:04:20.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.472+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=IRP7RMZ2XZJL type=del 2024-09-14T11:04:20.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.473+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=EI42M8JWYTWH type=del size=1246023 2024-09-14T11:04:20.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.475+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=KZVMITWH59VF type=write size=715908 2024-09-14T11:04:20.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.477+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~9GDBT3OFM8DH.0 size=1048576 2024-09-14T11:04:20.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.478+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~9GDBT3OFM8DH.1 size=768514 2024-09-14T11:04:20.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.478+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=9GDBT3OFM8DH tag=FN2S53OA6D5U type=write size=2865666 2024-09-14T11:04:20.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.480+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=AUI17IPLVG81 type=del 2024-09-14T11:04:20.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.482+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~T2GMPYBO9JLD.0 size=1048576 2024-09-14T11:04:20.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.483+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~T2GMPYBO9JLD.1 size=556488 2024-09-14T11:04:20.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.483+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=T2GMPYBO9JLD tag=4S2QH6DQK86Z type=write size=2653640 2024-09-14T11:04:20.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.484+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=4293KTL9OVTG type=del 2024-09-14T11:04:20.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.486+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~PVC5GCIL2F7M.0 size=1025881 2024-09-14T11:04:20.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.486+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=PVC5GCIL2F7M tag=2UGJSQXC93U7 type=write size=2074457 2024-09-14T11:04:20.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.487+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=VF0O10883WNS type=del 2024-09-14T11:04:20.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.488+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=32WAU3N3V6PE type=del size=1572233 2024-09-14T11:04:20.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.490+0000 7f907bbdf780 1 < completed write operation key=WAFH5BKM2P23 tag=41QDJNI10BPG type=write size=110675 2024-09-14T11:04:20.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.491+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=G1QXDERI9PMT type=del size=3361509 2024-09-14T11:04:20.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.492+0000 7f907bbdf780 -1 < failed to complete operation key=9OKQI3W8M5GA tag=LY46OO9HAUUR type=del size=1447828: (22) Invalid argument 2024-09-14T11:04:20.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.494+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.0 size=1048576 2024-09-14T11:04:20.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.495+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.1 size=1048576 2024-09-14T11:04:20.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.496+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.2 size=607327 2024-09-14T11:04:20.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.496+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=6I99KHZL2PL5 tag=BXMRP6I7KW43 type=write size=3753055 2024-09-14T11:04:20.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.497+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=Y0380QOWQ9M3 type=del 2024-09-14T11:04:20.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.500+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~KMM243Q6E6OB.0 size=1048576 2024-09-14T11:04:20.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.500+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~KMM243Q6E6OB.1 size=31202 2024-09-14T11:04:20.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.500+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=KMM243Q6E6OB tag=DPYTS3TFFU6R type=write size=2128354 2024-09-14T11:04:20.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.502+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~POTF55N3E83I.0 size=882048 2024-09-14T11:04:20.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.504+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=POTF55N3E83I tag=UN5ANI827ZPM type=write size=1930624 2024-09-14T11:04:20.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.505+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=H6ILWX0VW4ZQ type=del size=429781 2024-09-14T11:04:20.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.506+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=ENF0F6HEBREM type=del 2024-09-14T11:04:20.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.508+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.0 size=1048576 2024-09-14T11:04:20.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.509+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.1 size=1048576 2024-09-14T11:04:20.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.510+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.2 size=752234 2024-09-14T11:04:20.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.510+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=BJPRNT15E7QG tag=8MXTCN6EJCOZ type=write size=3897962 2024-09-14T11:04:20.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.512+0000 7f907bbdf780 1 < canceled operation key=8NO5BA4HL03L tag=S7HET1Q7L4JI type=del size=201571 2024-09-14T11:04:20.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.513+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=4Z4NABN3ZLW6 type=del size=129172 2024-09-14T11:04:20.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.514+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=HA0PME15FNRQ type=write size=331687 2024-09-14T11:04:20.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.516+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.0 size=1048576 2024-09-14T11:04:20.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.517+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.1 size=1048576 2024-09-14T11:04:20.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.518+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.2 size=996099 2024-09-14T11:04:20.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.518+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=6RW2N0AK3ZP6 tag=J0V3JQ08HLBV type=write size=4141827 2024-09-14T11:04:20.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.519+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=B0NZVC7CFJEL type=write size=734213 2024-09-14T11:04:20.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.522+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~LWGF5CC89N0E.0 size=1048576 2024-09-14T11:04:20.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.522+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~LWGF5CC89N0E.1 size=820374 2024-09-14T11:04:20.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.522+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=LWGF5CC89N0E tag=HI7P3I5W8RGF type=write size=2917526 2024-09-14T11:04:20.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.524+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.0 size=1048576 2024-09-14T11:04:20.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.524+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.1 size=1048576 2024-09-14T11:04:20.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.525+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~RNLBPSPE658G.2 size=585869 2024-09-14T11:04:20.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.527+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=RNLBPSPE658G tag=8LJIJTM28DI0 type=write size=3731597 2024-09-14T11:04:20.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.529+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=1SJTOY6X1626 type=write size=939492 2024-09-14T11:04:20.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.531+0000 7f907bbdf780 1 < suggested remove operation key=WAFH5BKM2P23 tag=4PJAPKRA4GB1 type=del 2024-09-14T11:04:20.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.533+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~05GJK4V3CPT0.0 size=1048576 2024-09-14T11:04:20.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.534+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~05GJK4V3CPT0.1 size=414197 2024-09-14T11:04:20.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.534+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=05GJK4V3CPT0 tag=8G1VJ2JD3EX0 type=write size=2511349 2024-09-14T11:04:20.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.535+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~K52KJMGU8WKN.0 size=457278 2024-09-14T11:04:20.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.537+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=K52KJMGU8WKN tag=AVQICTJ3VN0Y type=write size=1505854 2024-09-14T11:04:20.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.538+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=7LIOVKRO61LP type=del size=317156 2024-09-14T11:04:20.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.540+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=EI42M8JWYTWH type=del 2024-09-14T11:04:20.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.542+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.0 size=1048576 2024-09-14T11:04:20.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.543+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.1 size=1048576 2024-09-14T11:04:20.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.544+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.2 size=217327 2024-09-14T11:04:20.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.544+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=OKCYRBG9IYF9 tag=7ZX49A00I9L1 type=write size=3363055 2024-09-14T11:04:20.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.545+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~9GDBT3OFM8DH.0 size=1048576 2024-09-14T11:04:20.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.546+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~9GDBT3OFM8DH.1 size=768514 2024-09-14T11:04:20.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.548+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=9GDBT3OFM8DH tag=FN2S53OA6D5U type=write size=2865666 2024-09-14T11:04:20.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.549+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=DGU680MCYWH4 type=del size=3189475 2024-09-14T11:04:20.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.550+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~T2GMPYBO9JLD.0 size=1048576 2024-09-14T11:04:20.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.551+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~T2GMPYBO9JLD.1 size=556488 2024-09-14T11:04:20.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.553+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=T2GMPYBO9JLD tag=4S2QH6DQK86Z type=write size=2653640 2024-09-14T11:04:20.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.554+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=42BABRDKYTOC type=del size=3930407 2024-09-14T11:04:20.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.555+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~PVC5GCIL2F7M.0 size=1025881 2024-09-14T11:04:20.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.557+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=PVC5GCIL2F7M tag=2UGJSQXC93U7 type=write size=2074457 2024-09-14T11:04:20.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.558+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=GQ7UZICGRE9J type=del size=3177539 2024-09-14T11:04:20.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.560+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=32WAU3N3V6PE type=del 2024-09-14T11:04:20.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.562+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~3PBVZ7U7N572.0 size=167297 2024-09-14T11:04:20.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.562+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=3PBVZ7U7N572 tag=3GFJ264PV49S type=write size=1215873 2024-09-14T11:04:20.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.563+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=G1QXDERI9PMT type=del 2024-09-14T11:04:20.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.564+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=C7X7B13I83G2 type=write size=197778 2024-09-14T11:04:20.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.565+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.0 size=1048576 2024-09-14T11:04:20.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.566+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.1 size=1048576 2024-09-14T11:04:20.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.567+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~6I99KHZL2PL5.2 size=607327 2024-09-14T11:04:20.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.569+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=6I99KHZL2PL5 tag=BXMRP6I7KW43 type=write size=3753055 2024-09-14T11:04:20.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.572+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.0 size=1048576 2024-09-14T11:04:20.571 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.573+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.1 size=1048576 2024-09-14T11:04:20.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.574+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.2 size=956874 2024-09-14T11:04:20.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.574+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=LPP9NK9GXKUF tag=ZBYH8X1ZAHQW type=write size=4102602 2024-09-14T11:04:20.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.575+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~KMM243Q6E6OB.0 size=1048576 2024-09-14T11:04:20.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.576+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~KMM243Q6E6OB.1 size=31202 2024-09-14T11:04:20.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.578+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=KMM243Q6E6OB tag=DPYTS3TFFU6R type=write size=2128354 2024-09-14T11:04:20.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.581+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~XBAZ3V4I0LF1.0 size=562818 2024-09-14T11:04:20.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.581+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=XBAZ3V4I0LF1 tag=ZO0J99IXZPKT type=write size=1611394 2024-09-14T11:04:20.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.582+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=H6ILWX0VW4ZQ type=del 2024-09-14T11:04:20.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.584+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~4N227JR1QISQ.0 size=1048576 2024-09-14T11:04:20.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.585+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~4N227JR1QISQ.1 size=291531 2024-09-14T11:04:20.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.585+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=4N227JR1QISQ tag=HI2Q5MXXIWPB type=write size=2388683 2024-09-14T11:04:20.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.586+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.0 size=1048576 2024-09-14T11:04:20.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.586+0000 7f907bbdf780 1 < canceled part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.1 size=1048576 2024-09-14T11:04:20.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.587+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~BJPRNT15E7QG.2 size=752234 2024-09-14T11:04:20.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.589+0000 7f907bbdf780 1 < canceled multipart upload key=JEXUT5F7AKZ1 upload=BJPRNT15E7QG tag=8MXTCN6EJCOZ type=write size=3897962 2024-09-14T11:04:20.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.590+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=XDJO1R06ABQV type=write size=574583 2024-09-14T11:04:20.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.591+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=4Z4NABN3ZLW6 type=del 2024-09-14T11:04:20.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.593+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~K9M5G5B06Y8O.0 size=1048576 2024-09-14T11:04:20.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.594+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~K9M5G5B06Y8O.1 size=208258 2024-09-14T11:04:20.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.594+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=K9M5G5B06Y8O tag=N8LW26GTGKWG type=write size=2305410 2024-09-14T11:04:20.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.596+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.0 size=1048576 2024-09-14T11:04:20.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.597+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.1 size=1048576 2024-09-14T11:04:20.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.597+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~6RW2N0AK3ZP6.2 size=996099 2024-09-14T11:04:20.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.600+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=6RW2N0AK3ZP6 tag=J0V3JQ08HLBV type=write size=4141827 2024-09-14T11:04:20.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.602+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.0 size=1048576 2024-09-14T11:04:20.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.603+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.1 size=1048576 2024-09-14T11:04:20.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.604+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.2 size=215975 2024-09-14T11:04:20.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.604+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=4LKPN8199IZU tag=9F4HVOZFZ34B type=write size=3361703 2024-09-14T11:04:20.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.605+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~LWGF5CC89N0E.0 size=1048576 2024-09-14T11:04:20.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.606+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~LWGF5CC89N0E.1 size=820374 2024-09-14T11:04:20.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.609+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=LWGF5CC89N0E tag=HI7P3I5W8RGF type=write size=2917526 2024-09-14T11:04:20.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.610+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=YZP3CXS12A31 type=del size=3925385 2024-09-14T11:04:20.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.611+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=1SJTOY6X1626 type=write size=939492 2024-09-14T11:04:20.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.614+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~3VQBD7H97GU6.0 size=904896 2024-09-14T11:04:20.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.614+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=3VQBD7H97GU6 tag=GJ423JJMQPJO type=write size=1953472 2024-09-14T11:04:20.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.615+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~05GJK4V3CPT0.0 size=1048576 2024-09-14T11:04:20.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.616+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~05GJK4V3CPT0.1 size=414197 2024-09-14T11:04:20.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.618+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=05GJK4V3CPT0 tag=8G1VJ2JD3EX0 type=write size=2511349 2024-09-14T11:04:20.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.620+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=SZDAIR3W6I83 type=del size=1071093 2024-09-14T11:04:20.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.621+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=7LIOVKRO61LP type=del 2024-09-14T11:04:20.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.623+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.0 size=1048576 2024-09-14T11:04:20.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.625+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.1 size=1048576 2024-09-14T11:04:20.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.626+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.2 size=233754 2024-09-14T11:04:20.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.626+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=PYSZ140WPPA1 tag=KENAE42PBQWT type=write size=3379482 2024-09-14T11:04:20.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.627+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.0 size=1048576 2024-09-14T11:04:20.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.628+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.1 size=1048576 2024-09-14T11:04:20.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.629+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~OKCYRBG9IYF9.2 size=217327 2024-09-14T11:04:20.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.631+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=OKCYRBG9IYF9 tag=7ZX49A00I9L1 type=write size=3363055 2024-09-14T11:04:20.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.634+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~0U0MAU0M6DS1.0 size=848726 2024-09-14T11:04:20.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.634+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=0U0MAU0M6DS1 tag=J46JNFTRNGVM type=write size=1897302 2024-09-14T11:04:20.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.635+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=DGU680MCYWH4 type=del 2024-09-14T11:04:20.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.638+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~6GOTAZM2XDHP.0 size=1048576 2024-09-14T11:04:20.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.639+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~6GOTAZM2XDHP.1 size=860084 2024-09-14T11:04:20.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.639+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=6GOTAZM2XDHP tag=ZH2AHKQA0PDS type=write size=2957236 2024-09-14T11:04:20.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.640+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=42BABRDKYTOC type=del 2024-09-14T11:04:20.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.643+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~D5URPNY2Q0N2.0 size=800273 2024-09-14T11:04:20.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.643+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=D5URPNY2Q0N2 tag=6CLK02Z3GMX0 type=write size=1848849 2024-09-14T11:04:20.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.644+0000 7f907bbdf780 1 < canceled operation key=HHXUGVBHQ2US tag=GQ7UZICGRE9J type=del size=3177539 2024-09-14T11:04:20.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.645+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=1XENQN53PPFT type=del size=2600511 2024-09-14T11:04:20.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.647+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~3PBVZ7U7N572.0 size=167297 2024-09-14T11:04:20.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.648+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=3PBVZ7U7N572 tag=3GFJ264PV49S type=write size=1215873 2024-09-14T11:04:20.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.651+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~JYCMTRSH21V7.0 size=1045711 2024-09-14T11:04:20.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.651+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=JYCMTRSH21V7 tag=Y6FOQN4FJZTA type=write size=2094287 2024-09-14T11:04:20.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.652+0000 7f907bbdf780 1 < completed write operation key=E3OIUTR3JCQY tag=C7X7B13I83G2 type=write size=197778 2024-09-14T11:04:20.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.654+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~8Z40B2AOWSWB.0 size=67073 2024-09-14T11:04:20.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.654+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=8Z40B2AOWSWB tag=2YMQ233FFCKM type=write size=1115649 2024-09-14T11:04:20.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.655+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.0 size=1048576 2024-09-14T11:04:20.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.656+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.1 size=1048576 2024-09-14T11:04:20.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.657+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~LPP9NK9GXKUF.2 size=956874 2024-09-14T11:04:20.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.659+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=LPP9NK9GXKUF tag=ZBYH8X1ZAHQW type=write size=4102602 2024-09-14T11:04:20.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.660+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=70IYKMJQEL11 type=del size=575238 2024-09-14T11:04:20.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.661+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~XBAZ3V4I0LF1.0 size=562818 2024-09-14T11:04:20.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.664+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=XBAZ3V4I0LF1 tag=ZO0J99IXZPKT type=write size=1611394 2024-09-14T11:04:20.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.666+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~UD6UXO6H48M4.0 size=511884 2024-09-14T11:04:20.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.666+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=UD6UXO6H48M4 tag=Y2NUT7TGCIGS type=write size=1560460 2024-09-14T11:04:20.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.667+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~4N227JR1QISQ.0 size=1048576 2024-09-14T11:04:20.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.668+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~4N227JR1QISQ.1 size=291531 2024-09-14T11:04:20.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.670+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=4N227JR1QISQ tag=HI2Q5MXXIWPB type=write size=2388683 2024-09-14T11:04:20.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.672+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=KPXPD0SGFM2Q type=del size=1456613 2024-09-14T11:04:20.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.673+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=XDJO1R06ABQV type=write size=574583 2024-09-14T11:04:20.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.674+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=N5FQSJP4Q7UZ type=del size=598250 2024-09-14T11:04:20.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.675+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~K9M5G5B06Y8O.0 size=1048576 2024-09-14T11:04:20.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.676+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~K9M5G5B06Y8O.1 size=208258 2024-09-14T11:04:20.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.678+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=K9M5G5B06Y8O tag=N8LW26GTGKWG type=write size=2305410 2024-09-14T11:04:20.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.681+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~2PDRGRJ3UYVM.0 size=1048576 2024-09-14T11:04:20.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.682+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~2PDRGRJ3UYVM.1 size=876522 2024-09-14T11:04:20.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.682+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=2PDRGRJ3UYVM tag=963N7VVCD6Y1 type=write size=2973674 2024-09-14T11:04:20.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.683+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.0 size=1048576 2024-09-14T11:04:20.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.685+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.1 size=1048576 2024-09-14T11:04:20.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.686+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4LKPN8199IZU.2 size=215975 2024-09-14T11:04:20.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.688+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=4LKPN8199IZU tag=9F4HVOZFZ34B type=write size=3361703 2024-09-14T11:04:20.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.690+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.0 size=1048576 2024-09-14T11:04:20.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.691+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.1 size=1048576 2024-09-14T11:04:20.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.692+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.2 size=259533 2024-09-14T11:04:20.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.692+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=HU157B0LQJF9 tag=T2BGLSNIDV1J type=write size=3405261 2024-09-14T11:04:20.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.693+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=YZP3CXS12A31 type=del 2024-09-14T11:04:20.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.694+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=ETHR9K5B1WV5 type=del size=2302389 2024-09-14T11:04:20.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.695+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~3VQBD7H97GU6.0 size=904896 2024-09-14T11:04:20.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.697+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=3VQBD7H97GU6 tag=GJ423JJMQPJO type=write size=1953472 2024-09-14T11:04:20.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.698+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=PVNQ6MVT1S5Z type=del size=2916150 2024-09-14T11:04:20.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.700+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=SZDAIR3W6I83 type=del 2024-09-14T11:04:20.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.702+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~0J4P0BIV3V7H.0 size=645324 2024-09-14T11:04:20.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.702+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=0J4P0BIV3V7H tag=DWFPBGT56V4L type=write size=1693900 2024-09-14T11:04:20.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.703+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.0 size=1048576 2024-09-14T11:04:20.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.704+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.1 size=1048576 2024-09-14T11:04:20.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.705+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~PYSZ140WPPA1.2 size=233754 2024-09-14T11:04:20.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.707+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=PYSZ140WPPA1 tag=KENAE42PBQWT type=write size=3379482 2024-09-14T11:04:20.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.708+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=VP9HXFHHSUUI type=del size=1655352 2024-09-14T11:04:20.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.709+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~0U0MAU0M6DS1.0 size=848726 2024-09-14T11:04:20.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.711+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=0U0MAU0M6DS1 tag=J46JNFTRNGVM type=write size=1897302 2024-09-14T11:04:20.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.713+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~REZG8J1F5GX3.0 size=1048576 2024-09-14T11:04:20.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.714+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~REZG8J1F5GX3.1 size=838479 2024-09-14T11:04:20.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.714+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=REZG8J1F5GX3 tag=I5AH4NQ9E465 type=write size=2935631 2024-09-14T11:04:20.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.715+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~6GOTAZM2XDHP.0 size=1048576 2024-09-14T11:04:20.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.716+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~6GOTAZM2XDHP.1 size=860084 2024-09-14T11:04:20.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.718+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=6GOTAZM2XDHP tag=ZH2AHKQA0PDS type=write size=2957236 2024-09-14T11:04:20.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.719+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=CI1JRKD376QU type=write size=776564 2024-09-14T11:04:20.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.721+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~D5URPNY2Q0N2.0 size=800273 2024-09-14T11:04:20.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.723+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=D5URPNY2Q0N2 tag=6CLK02Z3GMX0 type=write size=1848849 2024-09-14T11:04:20.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.725+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.0 size=1048576 2024-09-14T11:04:20.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.726+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.1 size=1048576 2024-09-14T11:04:20.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.727+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.2 size=690504 2024-09-14T11:04:20.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.727+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=QEWUB859XLWQ tag=1JWBVOMGD933 type=write size=3836232 2024-09-14T11:04:20.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.729+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=1XENQN53PPFT type=del size=2600511 2024-09-14T11:04:20.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.730+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=LCBAZOTPI69F type=write size=974122 2024-09-14T11:04:20.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.731+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~JYCMTRSH21V7.0 size=1045711 2024-09-14T11:04:20.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.733+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=JYCMTRSH21V7 tag=Y6FOQN4FJZTA type=write size=2094287 2024-09-14T11:04:20.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.734+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=8GX3LI6113I7 type=write size=764466 2024-09-14T11:04:20.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.736+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~8Z40B2AOWSWB.0 size=67073 2024-09-14T11:04:20.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.738+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=8Z40B2AOWSWB tag=2YMQ233FFCKM type=write size=1115649 2024-09-14T11:04:20.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.739+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=B1MRAWN3IGMR type=del size=1706788 2024-09-14T11:04:20.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.740+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=70IYKMJQEL11 type=del 2024-09-14T11:04:20.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.742+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.0 size=1048576 2024-09-14T11:04:20.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.743+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.1 size=1048576 2024-09-14T11:04:20.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.744+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.2 size=762670 2024-09-14T11:04:20.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.744+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=8GX2RT599F3T tag=PNTZ5TRBJ8Q8 type=write size=3908398 2024-09-14T11:04:20.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.745+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~UD6UXO6H48M4.0 size=511884 2024-09-14T11:04:20.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.747+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=UD6UXO6H48M4 tag=Y2NUT7TGCIGS type=write size=1560460 2024-09-14T11:04:20.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.748+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=PTS5AGMVLMS3 type=del size=2855808 2024-09-14T11:04:20.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.751+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=KPXPD0SGFM2Q type=del size=1456613 2024-09-14T11:04:20.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.753+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.0 size=1048576 2024-09-14T11:04:20.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.754+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.1 size=1048576 2024-09-14T11:04:20.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.755+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.2 size=200427 2024-09-14T11:04:20.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.755+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=7F86LEOHMK9W tag=YVBTDAYPNKHJ type=write size=3346155 2024-09-14T11:04:20.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.758+0000 7f907bbdf780 1 < suggested update operation key=AGMKZ7PGPUAM tag=N5FQSJP4Q7UZ type=del size=598250 2024-09-14T11:04:20.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.760+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.0 size=1048576 2024-09-14T11:04:20.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.761+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.1 size=1048576 2024-09-14T11:04:20.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.762+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.2 size=252931 2024-09-14T11:04:20.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.762+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=VEH1P197K8BF tag=FX97DH461XKM type=write size=3398659 2024-09-14T11:04:20.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.763+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~2PDRGRJ3UYVM.0 size=1048576 2024-09-14T11:04:20.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.764+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~2PDRGRJ3UYVM.1 size=876522 2024-09-14T11:04:20.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.766+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=2PDRGRJ3UYVM tag=963N7VVCD6Y1 type=write size=2973674 2024-09-14T11:04:20.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.767+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=0MDWYH8JV3NM type=del size=1209097 2024-09-14T11:04:20.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.768+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.0 size=1048576 2024-09-14T11:04:20.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.769+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.1 size=1048576 2024-09-14T11:04:20.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.770+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~HU157B0LQJF9.2 size=259533 2024-09-14T11:04:20.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.772+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=HU157B0LQJF9 tag=T2BGLSNIDV1J type=write size=3405261 2024-09-14T11:04:20.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.774+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=PFY03T0CXH2Z type=del size=1142872 2024-09-14T11:04:20.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.775+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=ETHR9K5B1WV5 type=del 2024-09-14T11:04:20.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.776+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=9NIA691US30Z type=del size=2467221 2024-09-14T11:04:20.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.777+0000 7f907bbdf780 1 < canceled operation key=VRQ0ZNN9FG4C tag=PVNQ6MVT1S5Z type=del size=2916150 2024-09-14T11:04:20.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.779+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~63WGYA87C36I.0 size=1048576 2024-09-14T11:04:20.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.780+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~63WGYA87C36I.1 size=846164 2024-09-14T11:04:20.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.780+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=63WGYA87C36I tag=KEFD60GDNTY9 type=write size=2943316 2024-09-14T11:04:20.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.781+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~0J4P0BIV3V7H.0 size=645324 2024-09-14T11:04:20.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.783+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=0J4P0BIV3V7H tag=DWFPBGT56V4L type=write size=1693900 2024-09-14T11:04:20.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.785+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=ENYSVEWCIOPX type=del size=3440490 2024-09-14T11:04:20.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.786+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=VP9HXFHHSUUI type=del 2024-09-14T11:04:20.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.787+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=PJOC8U4XIVBO type=del size=2296292 2024-09-14T11:04:20.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.788+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~REZG8J1F5GX3.0 size=1048576 2024-09-14T11:04:20.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.789+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~REZG8J1F5GX3.1 size=838479 2024-09-14T11:04:20.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.791+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=REZG8J1F5GX3 tag=I5AH4NQ9E465 type=write size=2935631 2024-09-14T11:04:20.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.793+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=SS0P68CX2MQG type=del size=4165327 2024-09-14T11:04:20.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.796+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=CI1JRKD376QU type=write 2024-09-14T11:04:20.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.798+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~QEUY51H6FF9Z.0 size=873785 2024-09-14T11:04:20.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.798+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=QEUY51H6FF9Z tag=2J115BLEVRQE type=write size=1922361 2024-09-14T11:04:20.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.798+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.0 size=1048576 2024-09-14T11:04:20.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.799+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.1 size=1048576 2024-09-14T11:04:20.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.800+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~QEWUB859XLWQ.2 size=690504 2024-09-14T11:04:20.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.802+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=QEWUB859XLWQ tag=1JWBVOMGD933 type=write size=3836232 2024-09-14T11:04:20.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.803+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=J5ZS89DS6JZD type=del size=2003524 2024-09-14T11:04:20.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.804+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=LCBAZOTPI69F type=write size=974122 2024-09-14T11:04:20.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.806+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~VIONLW4872PD.0 size=649102 2024-09-14T11:04:20.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.806+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=VIONLW4872PD tag=3S4S1TLA52GI type=write size=1697678 2024-09-14T11:04:20.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.807+0000 7f907bbdf780 1 < completed write operation key=HM2GVOA72HHR tag=8GX3LI6113I7 type=write size=764466 2024-09-14T11:04:20.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.810+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~MHY8JS23Z98F.0 size=786481 2024-09-14T11:04:20.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.810+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=MHY8JS23Z98F tag=XDGHKCK5YN1S type=write size=1835057 2024-09-14T11:04:20.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.811+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=B1MRAWN3IGMR type=del 2024-09-14T11:04:20.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.813+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~N6WU8U4OKM91.0 size=824573 2024-09-14T11:04:20.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.813+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=N6WU8U4OKM91 tag=D0OEV0ON4JQJ type=write size=1873149 2024-09-14T11:04:20.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.814+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.0 size=1048576 2024-09-14T11:04:20.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.815+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.1 size=1048576 2024-09-14T11:04:20.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.816+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~8GX2RT599F3T.2 size=762670 2024-09-14T11:04:20.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.818+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=8GX2RT599F3T tag=PNTZ5TRBJ8Q8 type=write size=3908398 2024-09-14T11:04:20.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.820+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~USADYUO90K1Q.0 size=150979 2024-09-14T11:04:20.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.820+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=USADYUO90K1Q tag=NUSZ4N60BRP3 type=write size=1199555 2024-09-14T11:04:20.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.821+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=PTS5AGMVLMS3 type=del 2024-09-14T11:04:20.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.822+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=FE5I5AYTWRLX type=del size=2550475 2024-09-14T11:04:20.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.823+0000 7f907bbdf780 1 < canceled part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.0 size=1048576 2024-09-14T11:04:20.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.824+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.1 size=1048576 2024-09-14T11:04:20.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.825+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~7F86LEOHMK9W.2 size=200427 2024-09-14T11:04:20.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.826+0000 7f907bbdf780 1 < canceled multipart upload key=VRQ0ZNN9FG4C upload=7F86LEOHMK9W tag=YVBTDAYPNKHJ type=write size=3346155 2024-09-14T11:04:20.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.828+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=4IPEYSTX77Y3 type=del size=3867912 2024-09-14T11:04:20.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.829+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.0 size=1048576 2024-09-14T11:04:20.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.830+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.1 size=1048576 2024-09-14T11:04:20.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.831+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~VEH1P197K8BF.2 size=252931 2024-09-14T11:04:20.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.833+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=VEH1P197K8BF tag=FX97DH461XKM type=write size=3398659 2024-09-14T11:04:20.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.834+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=WO46EK7OWJMK type=del size=1921526 2024-09-14T11:04:20.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.835+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=0MDWYH8JV3NM type=del 2024-09-14T11:04:20.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.836+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=SZEFJEYOKW28 type=del size=2658534 2024-09-14T11:04:20.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.839+0000 7f907bbdf780 1 < suggested remove operation key=ZFF333CYOK5P tag=PFY03T0CXH2Z type=del 2024-09-14T11:04:20.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.840+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=AITD2544O2F7 type=write size=599971 2024-09-14T11:04:20.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.842+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=9NIA691US30Z type=del 2024-09-14T11:04:20.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.843+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=EI21MK3X2PDN type=del size=1941236 2024-09-14T11:04:20.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.844+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~63WGYA87C36I.0 size=1048576 2024-09-14T11:04:20.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.845+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~63WGYA87C36I.1 size=846164 2024-09-14T11:04:20.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.847+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=63WGYA87C36I tag=KEFD60GDNTY9 type=write size=2943316 2024-09-14T11:04:20.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.849+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~WPX5ZNF5CZ7Z.0 size=1048576 2024-09-14T11:04:20.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.850+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~WPX5ZNF5CZ7Z.1 size=309122 2024-09-14T11:04:20.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.850+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=WPX5ZNF5CZ7Z tag=EZU732P3UV48 type=write size=2406274 2024-09-14T11:04:20.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.851+0000 7f907bbdf780 -1 < failed to complete operation key=ZFF333CYOK5P tag=ENYSVEWCIOPX type=del size=3440490: (22) Invalid argument 2024-09-14T11:04:20.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.853+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~0DK7Q8UDC0KW.0 size=940079 2024-09-14T11:04:20.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.853+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=0DK7Q8UDC0KW tag=922WOWMYEHAU type=write size=1988655 2024-09-14T11:04:20.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.855+0000 7f907bbdf780 1 < suggested update operation key=JEXUT5F7AKZ1 tag=PJOC8U4XIVBO type=del size=2296292 2024-09-14T11:04:20.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.858+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~RUSZYR0IOGV0.0 size=1048576 2024-09-14T11:04:20.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.858+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~RUSZYR0IOGV0.1 size=565778 2024-09-14T11:04:20.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.858+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=RUSZYR0IOGV0 tag=0Q1UAX7G89MY type=write size=2662930 2024-09-14T11:04:20.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.860+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=SS0P68CX2MQG type=del 2024-09-14T11:04:20.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.862+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.0 size=1048576 2024-09-14T11:04:20.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.863+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.1 size=1048576 2024-09-14T11:04:20.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.864+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.2 size=939619 2024-09-14T11:04:20.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.864+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=8XK8CA6PSMBU tag=WPZNQ7B43DVT type=write size=4085347 2024-09-14T11:04:20.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.865+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~QEUY51H6FF9Z.0 size=873785 2024-09-14T11:04:20.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.867+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=QEUY51H6FF9Z tag=2J115BLEVRQE type=write size=1922361 2024-09-14T11:04:20.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.869+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~378HLLJ43NOU.0 size=1048576 2024-09-14T11:04:20.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.870+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~378HLLJ43NOU.1 size=1009304 2024-09-14T11:04:20.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.870+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=378HLLJ43NOU tag=1PA328LJZ2P6 type=write size=3106456 2024-09-14T11:04:20.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.871+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=J5ZS89DS6JZD type=del 2024-09-14T11:04:20.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.873+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~NFLPRU470M2K.0 size=1048576 2024-09-14T11:04:20.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.874+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~NFLPRU470M2K.1 size=543264 2024-09-14T11:04:20.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.874+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=NFLPRU470M2K tag=IMITNYLLAXFS type=write size=2640416 2024-09-14T11:04:20.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.876+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~VIONLW4872PD.0 size=649102 2024-09-14T11:04:20.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.877+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=VIONLW4872PD tag=3S4S1TLA52GI type=write size=1697678 2024-09-14T11:04:20.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.880+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~QLIED2CJZWCH.0 size=726965 2024-09-14T11:04:20.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.880+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=QLIED2CJZWCH tag=4K76SF2X9OXV type=write size=1775541 2024-09-14T11:04:20.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.881+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~MHY8JS23Z98F.0 size=786481 2024-09-14T11:04:20.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.883+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=MHY8JS23Z98F tag=XDGHKCK5YN1S type=write size=1835057 2024-09-14T11:04:20.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.884+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=0ZPSYMWPV6Q2 type=del size=909535 2024-09-14T11:04:20.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.885+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~N6WU8U4OKM91.0 size=824573 2024-09-14T11:04:20.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.887+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=N6WU8U4OKM91 tag=D0OEV0ON4JQJ type=write size=1873149 2024-09-14T11:04:20.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.888+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=D2SYLFZ44M0Y type=del size=1553082 2024-09-14T11:04:20.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.890+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~USADYUO90K1Q.0 size=150979 2024-09-14T11:04:20.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.891+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=USADYUO90K1Q tag=NUSZ4N60BRP3 type=write size=1199555 2024-09-14T11:04:20.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.893+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=2JOC3HQ979HQ type=del size=499595 2024-09-14T11:04:20.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.894+0000 7f907bbdf780 1 < canceled operation key=GC52N456IYD7 tag=FE5I5AYTWRLX type=del size=2550475 2024-09-14T11:04:20.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.896+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~W5SVEI7C3PHK.0 size=405009 2024-09-14T11:04:20.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.896+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=W5SVEI7C3PHK tag=1XO8ZP0B2Y76 type=write size=1453585 2024-09-14T11:04:20.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.898+0000 7f907bbdf780 1 < suggested remove operation key=JEXUT5F7AKZ1 tag=4IPEYSTX77Y3 type=del 2024-09-14T11:04:20.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.900+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=3Z4YZYAIVV0U type=del size=1434099 2024-09-14T11:04:20.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.901+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=WO46EK7OWJMK type=del 2024-09-14T11:04:20.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.903+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=JTUHO9P4YBOV type=del size=3064134 2024-09-14T11:04:20.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.905+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=SZEFJEYOKW28 type=del 2024-09-14T11:04:20.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.906+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=BD3NBXORE6JN type=del size=2216584 2024-09-14T11:04:20.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.907+0000 7f907bbdf780 1 < completed write operation key=HM2GVOA72HHR tag=AITD2544O2F7 type=write size=599971 2024-09-14T11:04:20.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.908+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=WVH91IMB2JPV type=del size=3130379 2024-09-14T11:04:20.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.911+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=EI21MK3X2PDN type=del 2024-09-14T11:04:20.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.913+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~ZGX6NLWNV16F.0 size=1048576 2024-09-14T11:04:20.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.914+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~ZGX6NLWNV16F.1 size=625740 2024-09-14T11:04:20.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.914+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=ZGX6NLWNV16F tag=48A73I118LAD type=write size=2722892 2024-09-14T11:04:20.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.915+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~WPX5ZNF5CZ7Z.0 size=1048576 2024-09-14T11:04:20.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.917+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~WPX5ZNF5CZ7Z.1 size=309122 2024-09-14T11:04:20.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.919+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=WPX5ZNF5CZ7Z tag=EZU732P3UV48 type=write size=2406274 2024-09-14T11:04:20.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.920+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=US6H855WUTAP type=del size=3029147 2024-09-14T11:04:20.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.921+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~0DK7Q8UDC0KW.0 size=940079 2024-09-14T11:04:20.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.923+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=0DK7Q8UDC0KW tag=922WOWMYEHAU type=write size=1988655 2024-09-14T11:04:20.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.925+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=OU3I81DZQQZC type=del size=2222311 2024-09-14T11:04:20.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.926+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~RUSZYR0IOGV0.0 size=1048576 2024-09-14T11:04:20.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.927+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~RUSZYR0IOGV0.1 size=565778 2024-09-14T11:04:20.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.929+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=RUSZYR0IOGV0 tag=0Q1UAX7G89MY type=write size=2662930 2024-09-14T11:04:20.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.932+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.0 size=1048576 2024-09-14T11:04:20.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.933+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.1 size=1048576 2024-09-14T11:04:20.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.933+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.2 size=346297 2024-09-14T11:04:20.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.933+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=EDODN36QUZW4 tag=GWC7295TE46X type=write size=3492025 2024-09-14T11:04:20.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.935+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.0 size=1048576 2024-09-14T11:04:20.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.936+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.1 size=1048576 2024-09-14T11:04:20.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.937+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~8XK8CA6PSMBU.2 size=939619 2024-09-14T11:04:20.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.939+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=8XK8CA6PSMBU tag=WPZNQ7B43DVT type=write size=4085347 2024-09-14T11:04:20.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.940+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=OZOP7CQDN9BT type=del size=3973908 2024-09-14T11:04:20.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.941+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~378HLLJ43NOU.0 size=1048576 2024-09-14T11:04:20.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.942+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~378HLLJ43NOU.1 size=1009304 2024-09-14T11:04:20.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.944+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=378HLLJ43NOU tag=1PA328LJZ2P6 type=write size=3106456 2024-09-14T11:04:20.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.945+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=K48829G5WZJ2 type=write size=789490 2024-09-14T11:04:20.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.947+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~NFLPRU470M2K.0 size=1048576 2024-09-14T11:04:20.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.948+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~NFLPRU470M2K.1 size=543264 2024-09-14T11:04:20.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.950+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=NFLPRU470M2K tag=IMITNYLLAXFS type=write size=2640416 2024-09-14T11:04:20.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.951+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=VVV2W2H6NN11 type=del size=3428660 2024-09-14T11:04:20.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.952+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~QLIED2CJZWCH.0 size=726965 2024-09-14T11:04:20.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.954+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=QLIED2CJZWCH tag=4K76SF2X9OXV type=write size=1775541 2024-09-14T11:04:20.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.955+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=7SXB86C335YF type=write size=107346 2024-09-14T11:04:20.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.956+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=0ZPSYMWPV6Q2 type=del 2024-09-14T11:04:20.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.957+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=MO41G7FK63A6 type=del size=2956356 2024-09-14T11:04:20.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.959+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=D2SYLFZ44M0Y type=del 2024-09-14T11:04:20.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.960+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=D6IRGZNDQ1ZP type=del size=234978 2024-09-14T11:04:20.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.962+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=2JOC3HQ979HQ type=del 2024-09-14T11:04:20.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.963+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=KXEUYI93YOE0 type=del size=2179168 2024-09-14T11:04:20.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.963+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~W5SVEI7C3PHK.0 size=405009 2024-09-14T11:04:20.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.965+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=W5SVEI7C3PHK tag=1XO8ZP0B2Y76 type=write size=1453585 2024-09-14T11:04:20.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.967+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.0 size=1048576 2024-09-14T11:04:20.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.968+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.1 size=1048576 2024-09-14T11:04:20.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.969+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.2 size=767340 2024-09-14T11:04:20.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.969+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=QL8V5BT5RNTW tag=Y6HXR6GU6C6Z type=write size=3913068 2024-09-14T11:04:20.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.970+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=3Z4YZYAIVV0U type=del 2024-09-14T11:04:20.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.971+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=LO44IG9G06M2 type=write size=97093 2024-09-14T11:04:20.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.974+0000 7f907bbdf780 1 < suggested remove operation key=WAFH5BKM2P23 tag=JTUHO9P4YBOV type=del 2024-09-14T11:04:20.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.976+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~YSNGI2T2IDKD.0 size=1048576 2024-09-14T11:04:20.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.977+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~YSNGI2T2IDKD.1 size=838186 2024-09-14T11:04:20.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.977+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=YSNGI2T2IDKD tag=VFCV8VI4WUNU type=write size=2935338 2024-09-14T11:04:20.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.980+0000 7f907bbdf780 1 < suggested remove operation key=VRQ0ZNN9FG4C tag=BD3NBXORE6JN type=del 2024-09-14T11:04:20.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.981+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=TKTAQ7KEZ2U9 type=write size=470586 2024-09-14T11:04:20.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.982+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=WVH91IMB2JPV type=del size=3130379 2024-09-14T11:04:20.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.983+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=ZUFIVJ8IEUJJ type=del size=612433 2024-09-14T11:04:20.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.985+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~ZGX6NLWNV16F.0 size=1048576 2024-09-14T11:04:20.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.986+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~ZGX6NLWNV16F.1 size=625740 2024-09-14T11:04:20.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.987+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=ZGX6NLWNV16F tag=48A73I118LAD type=write size=2722892 2024-09-14T11:04:20.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.990+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~MO3BD5UEVE0V.0 size=189925 2024-09-14T11:04:20.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.990+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=MO3BD5UEVE0V tag=9XQFDVIX8LZN type=write size=1238501 2024-09-14T11:04:20.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.992+0000 7f907bbdf780 1 < suggested update operation key=T79IR10S3HAB tag=US6H855WUTAP type=del size=3029147 2024-09-14T11:04:20.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.995+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~IO6P4TWG952U.0 size=104566 2024-09-14T11:04:20.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.995+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=IO6P4TWG952U tag=W3O0ZOZQ6UQJ type=write size=1153142 2024-09-14T11:04:20.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.996+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=OU3I81DZQQZC type=del 2024-09-14T11:04:20.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.997+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=PMZSIAQEL6VA type=del size=1099924 2024-09-14T11:04:20.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.998+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.0 size=1048576 2024-09-14T11:04:20.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:20.999+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.1 size=1048576 2024-09-14T11:04:20.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.000+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~EDODN36QUZW4.2 size=346297 2024-09-14T11:04:21.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.002+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=EDODN36QUZW4 tag=GWC7295TE46X type=write size=3492025 2024-09-14T11:04:21.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.004+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=LO6ZPL5JQATT type=del size=2596369 2024-09-14T11:04:21.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.005+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=OZOP7CQDN9BT type=del 2024-09-14T11:04:21.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.007+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~LM38XIPG4IM3.0 size=143150 2024-09-14T11:04:21.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.007+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=LM38XIPG4IM3 tag=JC8VEV2QKP87 type=write size=1191726 2024-09-14T11:04:21.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.009+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=K48829G5WZJ2 type=write size=789490 2024-09-14T11:04:21.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.010+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=52OBAH285RV7 type=del size=1429556 2024-09-14T11:04:21.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.012+0000 7f907bbdf780 1 < suggested update operation key=59WHXDR0S8DM tag=VVV2W2H6NN11 type=del size=3428660 2024-09-14T11:04:21.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.013+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=X4CDDW2V5ST0 type=del size=2231645 2024-09-14T11:04:21.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.015+0000 7f907bbdf780 1 < completed write operation key=P0701O36E1JI tag=7SXB86C335YF type=write size=107346 2024-09-14T11:04:21.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.016+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=AIDM0QTB1S5U type=del size=77792 2024-09-14T11:04:21.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.020+0000 7f907bbdf780 1 < suggested update operation key=LJ720PV3SQ8L tag=MO41G7FK63A6 type=del size=2956356 2024-09-14T11:04:21.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.021+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=I6P39BW7BXSN type=del size=2860531 2024-09-14T11:04:21.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.022+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=D6IRGZNDQ1ZP type=del size=234978 2024-09-14T11:04:21.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.023+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=8YUU1L3WMU3X type=write size=167334 2024-09-14T11:04:21.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.026+0000 7f907bbdf780 1 < suggested remove operation key=Y3KOCA4072NM tag=KXEUYI93YOE0 type=del 2024-09-14T11:04:21.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.027+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=TAFZVHJGUPFT type=del size=2109313 2024-09-14T11:04:21.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.028+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.0 size=1048576 2024-09-14T11:04:21.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.029+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.1 size=1048576 2024-09-14T11:04:21.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.030+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~QL8V5BT5RNTW.2 size=767340 2024-09-14T11:04:21.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.032+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=QL8V5BT5RNTW tag=Y6HXR6GU6C6Z type=write size=3913068 2024-09-14T11:04:21.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.033+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=HMJCYZLG4ELG type=del size=2107692 2024-09-14T11:04:21.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.034+0000 7f907bbdf780 -1 < no bi entry to suggest for operation key=VRQ0ZNN9FG4C tag=LO44IG9G06M2 type=write size=97093: (2) No such file or directory 2024-09-14T11:04:21.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.036+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~4M5I3VBGBRUJ.0 size=1048576 2024-09-14T11:04:21.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.037+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~4M5I3VBGBRUJ.1 size=936650 2024-09-14T11:04:21.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.037+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=4M5I3VBGBRUJ tag=R7Z4BH177V0E type=write size=3033802 2024-09-14T11:04:21.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.037+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~YSNGI2T2IDKD.0 size=1048576 2024-09-14T11:04:21.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.038+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~YSNGI2T2IDKD.1 size=838186 2024-09-14T11:04:21.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.040+0000 7f907bbdf780 1 < canceled multipart upload key=5MFLA6XFV3Y5 upload=YSNGI2T2IDKD tag=VFCV8VI4WUNU type=write size=2935338 2024-09-14T11:04:21.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.041+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=S7GKDPJ4CW8A type=del size=369115 2024-09-14T11:04:21.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.043+0000 7f907bbdf780 1 < suggested update operation key=P546JCSFB00N tag=TKTAQ7KEZ2U9 type=write size=470586 2024-09-14T11:04:21.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.044+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=5VPH3A2GCU02 type=del size=765024 2024-09-14T11:04:21.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.045+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=ZUFIVJ8IEUJJ type=del 2024-09-14T11:04:21.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.046+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=6Q8UON6F0RA5 type=del size=3388814 2024-09-14T11:04:21.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.048+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~MO3BD5UEVE0V.0 size=189925 2024-09-14T11:04:21.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.050+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=MO3BD5UEVE0V tag=9XQFDVIX8LZN type=write size=1238501 2024-09-14T11:04:21.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.052+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.0 size=1048576 2024-09-14T11:04:21.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.053+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.1 size=1048576 2024-09-14T11:04:21.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.054+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.2 size=630642 2024-09-14T11:04:21.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.054+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=N5DZYLTOU9MB tag=WEJSMX0LXUDZ type=write size=3776370 2024-09-14T11:04:21.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.055+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~IO6P4TWG952U.0 size=104566 2024-09-14T11:04:21.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.057+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=IO6P4TWG952U tag=W3O0ZOZQ6UQJ type=write size=1153142 2024-09-14T11:04:21.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.059+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=MAZUTKPISBHF type=write size=371287 2024-09-14T11:04:21.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.060+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=PMZSIAQEL6VA type=del 2024-09-14T11:04:21.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.062+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~TXNEOM9OXGGH.0 size=1048576 2024-09-14T11:04:21.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.063+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~TXNEOM9OXGGH.1 size=815274 2024-09-14T11:04:21.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.063+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=TXNEOM9OXGGH tag=JP4H3MDHXF4H type=write size=2912426 2024-09-14T11:04:21.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.064+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=LO6ZPL5JQATT type=del 2024-09-14T11:04:21.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.065+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=FX5AWTQEX8BR type=del size=1006781 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.067+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~LM38XIPG4IM3.0 size=143150 2024-09-14T11:04:21.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.069+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=LM38XIPG4IM3 tag=JC8VEV2QKP87 type=write size=1191726 2024-09-14T11:04:21.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.070+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=1TNC3IVPBQCO type=del size=3911923 2024-09-14T11:04:21.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.071+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=52OBAH285RV7 type=del 2024-09-14T11:04:21.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.072+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=3O33RT14B4JF type=del size=3458013 2024-09-14T11:04:21.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.073+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=X4CDDW2V5ST0 type=del 2024-09-14T11:04:21.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.076+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~SC9FR32525G7.0 size=510018 2024-09-14T11:04:21.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.076+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=SC9FR32525G7 tag=KEJEAIMHFP4V type=write size=1558594 2024-09-14T11:04:21.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.078+0000 7f907bbdf780 1 < suggested remove operation key=T79IR10S3HAB tag=AIDM0QTB1S5U type=del 2024-09-14T11:04:21.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.079+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=RRF2EYBXKD6P type=write size=186213 2024-09-14T11:04:21.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.080+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=I6P39BW7BXSN type=del 2024-09-14T11:04:21.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.082+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=1LWFPR72S686 type=del size=1679657 2024-09-14T11:04:21.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.083+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=8YUU1L3WMU3X type=write size=167334 2024-09-14T11:04:21.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.084+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=NS8YU9G9PQJ0 type=del size=2077554 2024-09-14T11:04:21.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.085+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=TAFZVHJGUPFT type=del 2024-09-14T11:04:21.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.087+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=CIS9MYR4IPHO type=del size=2227949 2024-09-14T11:04:21.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.089+0000 7f907bbdf780 1 < suggested update operation key=YH0YMRDQERBF tag=HMJCYZLG4ELG type=del size=2107692 2024-09-14T11:04:21.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.091+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.0 size=1048576 2024-09-14T11:04:21.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.092+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.1 size=1048576 2024-09-14T11:04:21.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.093+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.2 size=689649 2024-09-14T11:04:21.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.093+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=RQZJY7IYDEX3 tag=4VUGS3AWYD74 type=write size=3835377 2024-09-14T11:04:21.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.094+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~4M5I3VBGBRUJ.0 size=1048576 2024-09-14T11:04:21.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.095+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~4M5I3VBGBRUJ.1 size=936650 2024-09-14T11:04:21.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.097+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=4M5I3VBGBRUJ tag=R7Z4BH177V0E type=write size=3033802 2024-09-14T11:04:21.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.098+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=RL67BJIREJFO type=del size=2214656 2024-09-14T11:04:21.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.099+0000 7f907bbdf780 1 < canceled operation key=VRQ0ZNN9FG4C tag=S7GKDPJ4CW8A type=del size=369115 2024-09-14T11:04:21.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.102+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.0 size=1048576 2024-09-14T11:04:21.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.102+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.1 size=1048576 2024-09-14T11:04:21.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.103+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.2 size=87815 2024-09-14T11:04:21.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.103+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=P13O87H752XA tag=T9VMYVBCOSXC type=write size=3233543 2024-09-14T11:04:21.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.105+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=5VPH3A2GCU02 type=del 2024-09-14T11:04:21.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.107+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.0 size=1048576 2024-09-14T11:04:21.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.108+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.1 size=1048576 2024-09-14T11:04:21.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.109+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.2 size=860873 2024-09-14T11:04:21.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.109+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=4MSEMOIFM2FK tag=4SNM4TO0KQ2J type=write size=4006601 2024-09-14T11:04:21.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.110+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=6Q8UON6F0RA5 type=del 2024-09-14T11:04:21.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.112+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.0 size=1048576 2024-09-14T11:04:21.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.113+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.1 size=1048576 2024-09-14T11:04:21.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.115+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.2 size=914770 2024-09-14T11:04:21.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.115+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=MVVG187QG2CN tag=FQ2VC6FYBXK4 type=write size=4060498 2024-09-14T11:04:21.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.115+0000 7f907bbdf780 1 < canceled part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.0 size=1048576 2024-09-14T11:04:21.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.116+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.1 size=1048576 2024-09-14T11:04:21.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.117+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~N5DZYLTOU9MB.2 size=630642 2024-09-14T11:04:21.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.119+0000 7f907bbdf780 1 < canceled multipart upload key=9OKQI3W8M5GA upload=N5DZYLTOU9MB tag=WEJSMX0LXUDZ type=write size=3776370 2024-09-14T11:04:21.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.120+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=H145QONG6T9A type=del size=2455508 2024-09-14T11:04:21.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.122+0000 7f907bbdf780 1 < suggested remove operation key=LQNZKMX52SWO tag=MAZUTKPISBHF type=write 2024-09-14T11:04:21.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.123+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=WG4VVAQGFPY5 type=del size=1414893 2024-09-14T11:04:21.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.124+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~TXNEOM9OXGGH.0 size=1048576 2024-09-14T11:04:21.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.125+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~TXNEOM9OXGGH.1 size=815274 2024-09-14T11:04:21.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.128+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=TXNEOM9OXGGH tag=JP4H3MDHXF4H type=write size=2912426 2024-09-14T11:04:21.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.129+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=DV4CLQZ2EERR type=del size=2176800 2024-09-14T11:04:21.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.131+0000 7f907bbdf780 -1 < failed to complete operation key=YH0YMRDQERBF tag=FX5AWTQEX8BR type=del size=1006781: (22) Invalid argument 2024-09-14T11:04:21.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.134+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~4VEE1G12AKB3.0 size=883350 2024-09-14T11:04:21.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.134+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=4VEE1G12AKB3 tag=HB55DIJMQ2RB type=write size=1931926 2024-09-14T11:04:21.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.135+0000 7f907bbdf780 -1 < failed to complete operation key=YH0YMRDQERBF tag=1TNC3IVPBQCO type=del size=3911923: (22) Invalid argument 2024-09-14T11:04:21.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.137+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.0 size=1048576 2024-09-14T11:04:21.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.138+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.1 size=1048576 2024-09-14T11:04:21.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.139+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.2 size=546152 2024-09-14T11:04:21.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.139+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=43C3OCDZY7OP tag=76XGCDDPRMDQ type=write size=3691880 2024-09-14T11:04:21.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.140+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=3O33RT14B4JF type=del 2024-09-14T11:04:21.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.141+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=AJNFE3VRU1TE type=del size=876574 2024-09-14T11:04:21.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.142+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~SC9FR32525G7.0 size=510018 2024-09-14T11:04:21.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.144+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=SC9FR32525G7 tag=KEJEAIMHFP4V type=write size=1558594 2024-09-14T11:04:21.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.145+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=X1B1ZE0D6HW3 type=del size=3772406 2024-09-14T11:04:21.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.147+0000 7f907bbdf780 1 < completed write operation key=GC52N456IYD7 tag=RRF2EYBXKD6P type=write size=186213 2024-09-14T11:04:21.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.148+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=RM3J98ZRC7K0 type=del size=2452606 2024-09-14T11:04:21.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.149+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=1LWFPR72S686 type=del 2024-09-14T11:04:21.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.150+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=PEEM7V7UIDNS type=del size=2071100 2024-09-14T11:04:21.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.151+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=NS8YU9G9PQJ0 type=del 2024-09-14T11:04:21.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.153+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~QUQJBI0WFH9G.0 size=1048576 2024-09-14T11:04:21.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.154+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~QUQJBI0WFH9G.1 size=104333 2024-09-14T11:04:21.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.154+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=QUQJBI0WFH9G tag=JUJGM7K3MNA4 type=write size=2201485 2024-09-14T11:04:21.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.155+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=CIS9MYR4IPHO type=del 2024-09-14T11:04:21.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.156+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=YI12ZKP2IUDZ type=del size=3211579 2024-09-14T11:04:21.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.158+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.0 size=1048576 2024-09-14T11:04:21.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.158+0000 7f907bbdf780 1 < canceled part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.1 size=1048576 2024-09-14T11:04:21.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.159+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~RQZJY7IYDEX3.2 size=689649 2024-09-14T11:04:21.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.160+0000 7f907bbdf780 1 < canceled multipart upload key=9OKQI3W8M5GA upload=RQZJY7IYDEX3 tag=4VUGS3AWYD74 type=write size=3835377 2024-09-14T11:04:21.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.162+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~R466YQNSJAP8.0 size=1048576 2024-09-14T11:04:21.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.163+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~R466YQNSJAP8.1 size=847575 2024-09-14T11:04:21.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.163+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=R466YQNSJAP8 tag=45QFYUTVG9UH type=write size=2944727 2024-09-14T11:04:21.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.164+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=RL67BJIREJFO type=del 2024-09-14T11:04:21.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.166+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=LYB9J7XU9R6L type=del size=1362582 2024-09-14T11:04:21.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.167+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.0 size=1048576 2024-09-14T11:04:21.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.168+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.1 size=1048576 2024-09-14T11:04:21.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.168+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~P13O87H752XA.2 size=87815 2024-09-14T11:04:21.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.170+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=P13O87H752XA tag=T9VMYVBCOSXC type=write size=3233543 2024-09-14T11:04:21.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.172+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IJ8RKBE4SWCX.0 size=1048576 2024-09-14T11:04:21.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.173+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IJ8RKBE4SWCX.1 size=931962 2024-09-14T11:04:21.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.173+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=IJ8RKBE4SWCX tag=69O11KR87ZUN type=write size=3029114 2024-09-14T11:04:21.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.174+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.0 size=1048576 2024-09-14T11:04:21.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.175+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.1 size=1048576 2024-09-14T11:04:21.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.177+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~4MSEMOIFM2FK.2 size=860873 2024-09-14T11:04:21.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.179+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=4MSEMOIFM2FK tag=4SNM4TO0KQ2J type=write size=4006601 2024-09-14T11:04:21.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.180+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=TJVL89PLEEST type=write size=103975 2024-09-14T11:04:21.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.182+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.0 size=1048576 2024-09-14T11:04:21.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.183+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.1 size=1048576 2024-09-14T11:04:21.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.184+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~MVVG187QG2CN.2 size=914770 2024-09-14T11:04:21.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.186+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=MVVG187QG2CN tag=FQ2VC6FYBXK4 type=write size=4060498 2024-09-14T11:04:21.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.187+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=VU1G8V1WMJ88 type=del size=1386495 2024-09-14T11:04:21.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.188+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=H145QONG6T9A type=del 2024-09-14T11:04:21.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.190+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=YP9EIU7C58D0 type=del size=210367 2024-09-14T11:04:21.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.191+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=WG4VVAQGFPY5 type=del 2024-09-14T11:04:21.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.192+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=A1YSIV54L724 type=del size=373121 2024-09-14T11:04:21.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.195+0000 7f907bbdf780 1 < suggested remove operation key=Y3KOCA4072NM tag=DV4CLQZ2EERR type=del 2024-09-14T11:04:21.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.197+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=43C7M6UUTRR1 type=del size=264390 2024-09-14T11:04:21.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.198+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~4VEE1G12AKB3.0 size=883350 2024-09-14T11:04:21.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.200+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=4VEE1G12AKB3 tag=HB55DIJMQ2RB type=write size=1931926 2024-09-14T11:04:21.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.202+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=J91TMN9WILQF type=del size=940662 2024-09-14T11:04:21.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.203+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.0 size=1048576 2024-09-14T11:04:21.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.204+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.1 size=1048576 2024-09-14T11:04:21.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.205+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~43C3OCDZY7OP.2 size=546152 2024-09-14T11:04:21.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.208+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=43C3OCDZY7OP tag=76XGCDDPRMDQ type=write size=3691880 2024-09-14T11:04:21.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.210+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NMLNLJGAQFFT.0 size=1048576 2024-09-14T11:04:21.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.211+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NMLNLJGAQFFT.1 size=38573 2024-09-14T11:04:21.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.211+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=NMLNLJGAQFFT tag=ELDZVEDU7LHC type=write size=2135725 2024-09-14T11:04:21.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.213+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=AJNFE3VRU1TE type=del 2024-09-14T11:04:21.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.214+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=MMABML4PO11E type=del size=1913582 2024-09-14T11:04:21.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.216+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=X1B1ZE0D6HW3 type=del 2024-09-14T11:04:21.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.217+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=GVMCN3MMRZII type=del size=3575362 2024-09-14T11:04:21.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.218+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=RM3J98ZRC7K0 type=del 2024-09-14T11:04:21.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.221+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~GOB2UQPYOA4A.0 size=1048576 2024-09-14T11:04:21.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.222+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~GOB2UQPYOA4A.1 size=514697 2024-09-14T11:04:21.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.222+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=GOB2UQPYOA4A tag=OQ41FG8A3VDN type=write size=2611849 2024-09-14T11:04:21.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.224+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=PEEM7V7UIDNS type=del 2024-09-14T11:04:21.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.226+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~O2R1XLEU7F6Z.0 size=789330 2024-09-14T11:04:21.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.226+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=O2R1XLEU7F6Z tag=4FR94P1Q18HY type=write size=1837906 2024-09-14T11:04:21.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.228+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~QUQJBI0WFH9G.0 size=1048576 2024-09-14T11:04:21.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.229+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~QUQJBI0WFH9G.1 size=104333 2024-09-14T11:04:21.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.231+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=QUQJBI0WFH9G tag=JUJGM7K3MNA4 type=write size=2201485 2024-09-14T11:04:21.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.232+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=4JG8RUWOUYEQ type=write size=637079 2024-09-14T11:04:21.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.234+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=YI12ZKP2IUDZ type=del 2024-09-14T11:04:21.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.235+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=F67ZODWO2XMR type=del size=102381 2024-09-14T11:04:21.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.237+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~R466YQNSJAP8.0 size=1048576 2024-09-14T11:04:21.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.238+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~R466YQNSJAP8.1 size=847575 2024-09-14T11:04:21.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.240+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=R466YQNSJAP8 tag=45QFYUTVG9UH type=write size=2944727 2024-09-14T11:04:21.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.243+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~9K5I2KX4AAC1.0 size=793014 2024-09-14T11:04:21.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.243+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=9K5I2KX4AAC1 tag=QIDFLJQ44IVC type=write size=1841590 2024-09-14T11:04:21.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.244+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=LYB9J7XU9R6L type=del size=1362582 2024-09-14T11:04:21.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.246+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.0 size=1048576 2024-09-14T11:04:21.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.247+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.1 size=1048576 2024-09-14T11:04:21.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.248+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.2 size=427762 2024-09-14T11:04:21.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.248+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=GCPZYIXHM8TK tag=SGS5FZXQ9223 type=write size=3573490 2024-09-14T11:04:21.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.251+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IJ8RKBE4SWCX.0 size=1048576 2024-09-14T11:04:21.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.252+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IJ8RKBE4SWCX.1 size=931962 2024-09-14T11:04:21.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.253+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=IJ8RKBE4SWCX tag=69O11KR87ZUN type=write size=3029114 2024-09-14T11:04:21.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.255+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=Z2S8G9OLMHAM type=write size=407589 2024-09-14T11:04:21.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.256+0000 7f907bbdf780 1 < canceled operation key=T79IR10S3HAB tag=TJVL89PLEEST type=write size=103975 2024-09-14T11:04:21.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.257+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=R3IIMEFDCXNA type=write size=926659 2024-09-14T11:04:21.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.258+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=VU1G8V1WMJ88 type=del 2024-09-14T11:04:21.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.259+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=9BIF2B94FXP1 type=write size=421889 2024-09-14T11:04:21.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.262+0000 7f907bbdf780 1 < suggested remove operation key=LQNZKMX52SWO tag=YP9EIU7C58D0 type=del 2024-09-14T11:04:21.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.263+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=HBKOSFR9I0FM type=del size=2555200 2024-09-14T11:04:21.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.264+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=A1YSIV54L724 type=del 2024-09-14T11:04:21.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.265+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=CYS9ID50OBSZ type=del size=1444765 2024-09-14T11:04:21.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.266+0000 7f907bbdf780 1 < canceled operation key=GC52N456IYD7 tag=43C7M6UUTRR1 type=del size=264390 2024-09-14T11:04:21.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.268+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~7CYW85O9Y5ZJ.0 size=1048576 2024-09-14T11:04:21.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.269+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~7CYW85O9Y5ZJ.1 size=471015 2024-09-14T11:04:21.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.269+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=7CYW85O9Y5ZJ tag=5J3GRG5PRC0Q type=write size=2568167 2024-09-14T11:04:21.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.270+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=J91TMN9WILQF type=del 2024-09-14T11:04:21.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.271+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=V9W7U1J4V2QZ type=del size=1006760 2024-09-14T11:04:21.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.273+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NMLNLJGAQFFT.0 size=1048576 2024-09-14T11:04:21.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.273+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NMLNLJGAQFFT.1 size=38573 2024-09-14T11:04:21.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.276+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=NMLNLJGAQFFT tag=ELDZVEDU7LHC type=write size=2135725 2024-09-14T11:04:21.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.277+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=7DNZNCGGH0HW type=del size=2683129 2024-09-14T11:04:21.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.278+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=MMABML4PO11E type=del 2024-09-14T11:04:21.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.279+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=5XMHXELY2RD5 type=del size=3288989 2024-09-14T11:04:21.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.280+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=GVMCN3MMRZII type=del 2024-09-14T11:04:21.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.281+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=05G0AGJOE13Y type=del size=751063 2024-09-14T11:04:21.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.283+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~GOB2UQPYOA4A.0 size=1048576 2024-09-14T11:04:21.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.283+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~GOB2UQPYOA4A.1 size=514697 2024-09-14T11:04:21.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.284+0000 7f907bbdf780 1 < canceled multipart upload key=8NO5BA4HL03L upload=GOB2UQPYOA4A tag=OQ41FG8A3VDN type=write size=2611849 2024-09-14T11:04:21.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.287+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~290MQI56JPV6.0 size=139030 2024-09-14T11:04:21.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.287+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=290MQI56JPV6 tag=RLALP655KU1F type=write size=1187606 2024-09-14T11:04:21.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.288+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~O2R1XLEU7F6Z.0 size=789330 2024-09-14T11:04:21.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.290+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=O2R1XLEU7F6Z tag=4FR94P1Q18HY type=write size=1837906 2024-09-14T11:04:21.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.292+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=4RPUUI0Z1BL3 type=del size=532283 2024-09-14T11:04:21.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.293+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=4JG8RUWOUYEQ type=write size=637079 2024-09-14T11:04:21.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.294+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=OZTG1OUG6CO3 type=del size=1759056 2024-09-14T11:04:21.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.296+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=F67ZODWO2XMR type=del 2024-09-14T11:04:21.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.297+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=S0MR46GROOD1 type=write size=928160 2024-09-14T11:04:21.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.298+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~9K5I2KX4AAC1.0 size=793014 2024-09-14T11:04:21.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.300+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=9K5I2KX4AAC1 tag=QIDFLJQ44IVC type=write size=1841590 2024-09-14T11:04:21.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.301+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=1SIIMA39UO1P type=del size=3194385 2024-09-14T11:04:21.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.302+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.0 size=1048576 2024-09-14T11:04:21.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.303+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.1 size=1048576 2024-09-14T11:04:21.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.304+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GCPZYIXHM8TK.2 size=427762 2024-09-14T11:04:21.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.306+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=GCPZYIXHM8TK tag=SGS5FZXQ9223 type=write size=3573490 2024-09-14T11:04:21.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.307+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=P3XYLMJSZGGE type=write size=565600 2024-09-14T11:04:21.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.308+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=Z2S8G9OLMHAM type=write size=407589 2024-09-14T11:04:21.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.310+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~MXD5UQK22LLI.0 size=1048576 2024-09-14T11:04:21.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.311+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~MXD5UQK22LLI.1 size=741543 2024-09-14T11:04:21.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.311+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=MXD5UQK22LLI tag=ZMLKIM3YOPSB type=write size=2838695 2024-09-14T11:04:21.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.312+0000 7f907bbdf780 1 < completed write operation key=8NO5BA4HL03L tag=R3IIMEFDCXNA type=write size=926659 2024-09-14T11:04:21.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.314+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~0EQ1R8U9HP54.0 size=37795 2024-09-14T11:04:21.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.314+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=0EQ1R8U9HP54 tag=GT0769SI28ZR type=write size=1086371 2024-09-14T11:04:21.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.316+0000 7f907bbdf780 1 < completed write operation key=P0701O36E1JI tag=9BIF2B94FXP1 type=write size=421889 2024-09-14T11:04:21.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.318+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~2NL52HUO2TU9.0 size=313852 2024-09-14T11:04:21.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.318+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=2NL52HUO2TU9 tag=RT35XUOC5626 type=write size=1362428 2024-09-14T11:04:21.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.319+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=HBKOSFR9I0FM type=del 2024-09-14T11:04:21.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.321+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.0 size=1048576 2024-09-14T11:04:21.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.322+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.1 size=1048576 2024-09-14T11:04:21.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.323+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.2 size=4211 2024-09-14T11:04:21.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.323+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=1P02TX9P2DA8 tag=OVIWML6EB0YA type=write size=3149939 2024-09-14T11:04:21.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.324+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=CYS9ID50OBSZ type=del 2024-09-14T11:04:21.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.325+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=TM23EH69B4BD type=del size=424384 2024-09-14T11:04:21.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.326+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~7CYW85O9Y5ZJ.0 size=1048576 2024-09-14T11:04:21.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.327+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~7CYW85O9Y5ZJ.1 size=471015 2024-09-14T11:04:21.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.329+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=7CYW85O9Y5ZJ tag=5J3GRG5PRC0Q type=write size=2568167 2024-09-14T11:04:21.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.331+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=PRNPWI0APVOK type=del size=1390940 2024-09-14T11:04:21.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.332+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=V9W7U1J4V2QZ type=del 2024-09-14T11:04:21.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.334+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~7SQK76TGLWFY.0 size=1048576 2024-09-14T11:04:21.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.335+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~7SQK76TGLWFY.1 size=575835 2024-09-14T11:04:21.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.335+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=7SQK76TGLWFY tag=NE6BJ0U6YSZZ type=write size=2672987 2024-09-14T11:04:21.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.336+0000 7f907bbdf780 1 < canceled operation key=8FRZW4YC3ATE tag=7DNZNCGGH0HW type=del size=2683129 2024-09-14T11:04:21.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.338+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.0 size=1048576 2024-09-14T11:04:21.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.339+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.1 size=1048576 2024-09-14T11:04:21.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.340+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.2 size=390028 2024-09-14T11:04:21.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.340+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=A01J4BAUAODZ tag=RY7NXZBAPKGD type=write size=3535756 2024-09-14T11:04:21.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.341+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=5XMHXELY2RD5 type=del 2024-09-14T11:04:21.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.342+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=YJ0HDWTY0Y11 type=del size=3989755 2024-09-14T11:04:21.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.345+0000 7f907bbdf780 1 < suggested update operation key=S8RIEED24PUM tag=05G0AGJOE13Y type=del size=751063 2024-09-14T11:04:21.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.347+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~KXFPOBBLGRZI.0 size=1048576 2024-09-14T11:04:21.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.348+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~KXFPOBBLGRZI.1 size=1026387 2024-09-14T11:04:21.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.348+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=KXFPOBBLGRZI tag=IZA37ERQOZAZ type=write size=3123539 2024-09-14T11:04:21.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.349+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~290MQI56JPV6.0 size=139030 2024-09-14T11:04:21.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.351+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=290MQI56JPV6 tag=RLALP655KU1F type=write size=1187606 2024-09-14T11:04:21.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.353+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~I74KZP72AV9H.0 size=1048576 2024-09-14T11:04:21.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.353+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~I74KZP72AV9H.1 size=623548 2024-09-14T11:04:21.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.353+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=I74KZP72AV9H tag=V27058IM12XH type=write size=2720700 2024-09-14T11:04:21.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.355+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=4RPUUI0Z1BL3 type=del 2024-09-14T11:04:21.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.357+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~6OC1E7IMJA24.0 size=1048576 2024-09-14T11:04:21.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.357+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~6OC1E7IMJA24.1 size=283915 2024-09-14T11:04:21.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.358+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=6OC1E7IMJA24 tag=PQ9A1WCUO8FJ type=write size=2381067 2024-09-14T11:04:21.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.360+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=OZTG1OUG6CO3 type=del 2024-09-14T11:04:21.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.361+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=83QBSSQTF0FE type=del size=302921 2024-09-14T11:04:21.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.362+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=S0MR46GROOD1 type=write size=928160 2024-09-14T11:04:21.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.363+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=BD1R1O12O7G9 type=del size=140451 2024-09-14T11:04:21.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.364+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=1SIIMA39UO1P type=del 2024-09-14T11:04:21.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.365+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=T8Q7ATB0D6RS type=del size=2810198 2024-09-14T11:04:21.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.367+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=P3XYLMJSZGGE type=write size=565600 2024-09-14T11:04:21.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.368+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=IR71C6U0EQ3H type=del size=3822540 2024-09-14T11:04:21.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.369+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~MXD5UQK22LLI.0 size=1048576 2024-09-14T11:04:21.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.370+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~MXD5UQK22LLI.1 size=741543 2024-09-14T11:04:21.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.372+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=MXD5UQK22LLI tag=ZMLKIM3YOPSB type=write size=2838695 2024-09-14T11:04:21.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.374+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~HFS2TNHJDE2A.0 size=412480 2024-09-14T11:04:21.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.374+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=HFS2TNHJDE2A tag=BAASDCTI7NO8 type=write size=1461056 2024-09-14T11:04:21.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.375+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~0EQ1R8U9HP54.0 size=37795 2024-09-14T11:04:21.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.377+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=0EQ1R8U9HP54 tag=GT0769SI28ZR type=write size=1086371 2024-09-14T11:04:21.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.378+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=RXDUP6404J3D type=del size=2607642 2024-09-14T11:04:21.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.380+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~2NL52HUO2TU9.0 size=313852 2024-09-14T11:04:21.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.382+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=2NL52HUO2TU9 tag=RT35XUOC5626 type=write size=1362428 2024-09-14T11:04:21.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.384+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.0 size=1048576 2024-09-14T11:04:21.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.384+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.1 size=1048576 2024-09-14T11:04:21.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.385+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.2 size=454343 2024-09-14T11:04:21.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.385+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=PG32U42ORILJ tag=8XMG1XAK2SXN type=write size=3600071 2024-09-14T11:04:21.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.387+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.0 size=1048576 2024-09-14T11:04:21.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.387+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.1 size=1048576 2024-09-14T11:04:21.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.388+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~1P02TX9P2DA8.2 size=4211 2024-09-14T11:04:21.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.390+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=1P02TX9P2DA8 tag=OVIWML6EB0YA type=write size=3149939 2024-09-14T11:04:21.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.391+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=CNM2L2N53X8M type=write size=994649 2024-09-14T11:04:21.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.392+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=TM23EH69B4BD type=del 2024-09-14T11:04:21.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.395+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.0 size=1048576 2024-09-14T11:04:21.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.395+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.1 size=1048576 2024-09-14T11:04:21.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.396+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.2 size=312730 2024-09-14T11:04:21.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.396+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=VW85BCN7WM9G tag=425G63LVAN2R type=write size=3458458 2024-09-14T11:04:21.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.398+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=PRNPWI0APVOK type=del 2024-09-14T11:04:21.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.399+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=SNTV7NB10H2R type=del size=869872 2024-09-14T11:04:21.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.400+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~7SQK76TGLWFY.0 size=1048576 2024-09-14T11:04:21.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.400+0000 7f907bbdf780 1 < canceled part key=_multipart_FTYIOOQROLG6.2~7SQK76TGLWFY.1 size=575835 2024-09-14T11:04:21.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.402+0000 7f907bbdf780 1 < canceled multipart upload key=FTYIOOQROLG6 upload=7SQK76TGLWFY tag=NE6BJ0U6YSZZ type=write size=2672987 2024-09-14T11:04:21.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.403+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=MA23FKH0QFQ0 type=del size=2409243 2024-09-14T11:04:21.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.404+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.0 size=1048576 2024-09-14T11:04:21.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.405+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.1 size=1048576 2024-09-14T11:04:21.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.406+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~A01J4BAUAODZ.2 size=390028 2024-09-14T11:04:21.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.408+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=A01J4BAUAODZ tag=RY7NXZBAPKGD type=write size=3535756 2024-09-14T11:04:21.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.411+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~DZ0MUWKD1RMF.0 size=1048576 2024-09-14T11:04:21.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.412+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~DZ0MUWKD1RMF.1 size=899248 2024-09-14T11:04:21.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.412+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=DZ0MUWKD1RMF tag=ED2HTZA5YDJ1 type=write size=2996400 2024-09-14T11:04:21.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.413+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=YJ0HDWTY0Y11 type=del 2024-09-14T11:04:21.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.414+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=52HO4HUAEPLR type=write size=234496 2024-09-14T11:04:21.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.415+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~KXFPOBBLGRZI.0 size=1048576 2024-09-14T11:04:21.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.416+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~KXFPOBBLGRZI.1 size=1026387 2024-09-14T11:04:21.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.418+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=KXFPOBBLGRZI tag=IZA37ERQOZAZ type=write size=3123539 2024-09-14T11:04:21.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.420+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=W5543N2CV2VB type=del size=2071221 2024-09-14T11:04:21.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.421+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~I74KZP72AV9H.0 size=1048576 2024-09-14T11:04:21.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.422+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~I74KZP72AV9H.1 size=623548 2024-09-14T11:04:21.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.424+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=I74KZP72AV9H tag=V27058IM12XH type=write size=2720700 2024-09-14T11:04:21.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.425+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=1U6VZJRH1FWC type=del size=827440 2024-09-14T11:04:21.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.426+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~6OC1E7IMJA24.0 size=1048576 2024-09-14T11:04:21.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.427+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~6OC1E7IMJA24.1 size=283915 2024-09-14T11:04:21.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.429+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=6OC1E7IMJA24 tag=PQ9A1WCUO8FJ type=write size=2381067 2024-09-14T11:04:21.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.431+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~DB6YGC8GHI6K.0 size=788371 2024-09-14T11:04:21.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.431+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=DB6YGC8GHI6K tag=9EY3WCKZW7ZD type=write size=1836947 2024-09-14T11:04:21.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.433+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=83QBSSQTF0FE type=del 2024-09-14T11:04:21.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.435+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.0 size=1048576 2024-09-14T11:04:21.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.436+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.1 size=1048576 2024-09-14T11:04:21.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.437+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.2 size=604556 2024-09-14T11:04:21.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.437+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=2OG3JU2MIKT8 tag=8VAZN6YNNI96 type=write size=3750284 2024-09-14T11:04:21.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.438+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=BD1R1O12O7G9 type=del 2024-09-14T11:04:21.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.440+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7USL9CZA2LXY.0 size=325405 2024-09-14T11:04:21.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.440+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=7USL9CZA2LXY tag=61BRLPA37ABG type=write size=1373981 2024-09-14T11:04:21.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.441+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=T8Q7ATB0D6RS type=del 2024-09-14T11:04:21.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.443+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=Q1HH5Z0A9E04 type=del size=1886103 2024-09-14T11:04:21.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.444+0000 7f907bbdf780 1 < canceled operation key=8FRZW4YC3ATE tag=IR71C6U0EQ3H type=del size=3822540 2024-09-14T11:04:21.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.446+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.0 size=1048576 2024-09-14T11:04:21.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.447+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.1 size=1048576 2024-09-14T11:04:21.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.448+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.2 size=769580 2024-09-14T11:04:21.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.448+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=Z0Z030HOCLUW tag=H47K9T106LVW type=write size=3915308 2024-09-14T11:04:21.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.449+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~HFS2TNHJDE2A.0 size=412480 2024-09-14T11:04:21.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.451+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=HFS2TNHJDE2A tag=BAASDCTI7NO8 type=write size=1461056 2024-09-14T11:04:21.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.452+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=CYHJG6WC0K61 type=del size=3771943 2024-09-14T11:04:21.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.453+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=RXDUP6404J3D type=del size=2607642 2024-09-14T11:04:21.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.455+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=TZDHK4G5ENDU type=del size=3255477 2024-09-14T11:04:21.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.456+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.0 size=1048576 2024-09-14T11:04:21.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.457+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.1 size=1048576 2024-09-14T11:04:21.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.458+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~PG32U42ORILJ.2 size=454343 2024-09-14T11:04:21.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.460+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=PG32U42ORILJ tag=8XMG1XAK2SXN type=write size=3600071 2024-09-14T11:04:21.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.461+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=ODMD1S0QM0PV type=del size=2227800 2024-09-14T11:04:21.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.462+0000 7f907bbdf780 1 < completed write operation key=8FRZW4YC3ATE tag=CNM2L2N53X8M type=write size=994649 2024-09-14T11:04:21.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.464+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=V7DNI9LKWTVU type=del size=1161525 2024-09-14T11:04:21.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.465+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.0 size=1048576 2024-09-14T11:04:21.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.466+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.1 size=1048576 2024-09-14T11:04:21.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.467+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~VW85BCN7WM9G.2 size=312730 2024-09-14T11:04:21.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.470+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=VW85BCN7WM9G tag=425G63LVAN2R type=write size=3458458 2024-09-14T11:04:21.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.472+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~J9TRP591MTD2.0 size=1048576 2024-09-14T11:04:21.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.473+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~J9TRP591MTD2.1 size=556901 2024-09-14T11:04:21.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.473+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=J9TRP591MTD2 tag=TTK1TJY709KR type=write size=2654053 2024-09-14T11:04:21.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.475+0000 7f907bbdf780 1 < suggested remove operation key=P0701O36E1JI tag=SNTV7NB10H2R type=del 2024-09-14T11:04:21.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.478+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.0 size=1048576 2024-09-14T11:04:21.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.479+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.1 size=1048576 2024-09-14T11:04:21.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.479+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.2 size=407062 2024-09-14T11:04:21.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.479+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=NR7VZBECSLVE tag=AHS2MZ11FYVG type=write size=3552790 2024-09-14T11:04:21.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.481+0000 7f907bbdf780 -1 < failed to complete operation key=P0701O36E1JI tag=MA23FKH0QFQ0 type=del size=2409243: (22) Invalid argument 2024-09-14T11:04:21.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.483+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.0 size=1048576 2024-09-14T11:04:21.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.484+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.1 size=1048576 2024-09-14T11:04:21.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.485+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.2 size=992425 2024-09-14T11:04:21.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.485+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=1F4YWQXXPJL3 tag=189V0507ZK1J type=write size=4138153 2024-09-14T11:04:21.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.486+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~DZ0MUWKD1RMF.0 size=1048576 2024-09-14T11:04:21.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.487+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~DZ0MUWKD1RMF.1 size=899248 2024-09-14T11:04:21.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.489+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=DZ0MUWKD1RMF tag=ED2HTZA5YDJ1 type=write size=2996400 2024-09-14T11:04:21.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.491+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.0 size=1048576 2024-09-14T11:04:21.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.492+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.1 size=1048576 2024-09-14T11:04:21.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.493+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.2 size=797694 2024-09-14T11:04:21.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.493+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=PVG62H92X2VH tag=CG4XNDL81CMF type=write size=3943422 2024-09-14T11:04:21.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.494+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=52HO4HUAEPLR type=write size=234496 2024-09-14T11:04:21.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.496+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.0 size=1048576 2024-09-14T11:04:21.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.497+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.1 size=1048576 2024-09-14T11:04:21.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.498+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.2 size=902124 2024-09-14T11:04:21.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.498+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=AP2WX0YQ0SPI tag=IA6EF67BUQ2G type=write size=4047852 2024-09-14T11:04:21.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.499+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=W5543N2CV2VB type=del 2024-09-14T11:04:21.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.501+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.0 size=1048576 2024-09-14T11:04:21.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.502+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.1 size=1048576 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.503+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.2 size=271942 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.503+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=ISFVQPH96G4K tag=Z3X39XQ8MBV7 type=write size=3417670 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.505+0000 7f907bbdf780 1 < suggested update operation key=8FRZW4YC3ATE tag=1U6VZJRH1FWC type=del size=827440 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.506+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=FGDLVH0ASQOV type=write size=114523 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.506+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~DB6YGC8GHI6K.0 size=788371 2024-09-14T11:04:21.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.508+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=DB6YGC8GHI6K tag=9EY3WCKZW7ZD type=write size=1836947 2024-09-14T11:04:21.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.509+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=4JFKIW1MUSCW type=del size=3613415 2024-09-14T11:04:21.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.510+0000 7f907bbdf780 1 < canceled part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.0 size=1048576 2024-09-14T11:04:21.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.511+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.1 size=1048576 2024-09-14T11:04:21.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.511+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~2OG3JU2MIKT8.2 size=604556 2024-09-14T11:04:21.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.513+0000 7f907bbdf780 1 < canceled multipart upload key=LQNZKMX52SWO upload=2OG3JU2MIKT8 tag=8VAZN6YNNI96 type=write size=3750284 2024-09-14T11:04:21.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.516+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.0 size=1048576 2024-09-14T11:04:21.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.516+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.1 size=1048576 2024-09-14T11:04:21.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.517+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.2 size=816061 2024-09-14T11:04:21.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.517+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=Y3Q3U6HVCMEQ tag=55ZRNGQA9J2S type=write size=3961789 2024-09-14T11:04:21.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.518+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7USL9CZA2LXY.0 size=325405 2024-09-14T11:04:21.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.520+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=7USL9CZA2LXY tag=61BRLPA37ABG type=write size=1373981 2024-09-14T11:04:21.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.522+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~Z7QZM2MXCHB5.0 size=765914 2024-09-14T11:04:21.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.522+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=Z7QZM2MXCHB5 tag=UYPVEH6EKF3S type=write size=1814490 2024-09-14T11:04:21.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.523+0000 7f907bbdf780 -1 < failed to complete operation key=P0701O36E1JI tag=Q1HH5Z0A9E04 type=del size=1886103: (22) Invalid argument 2024-09-14T11:04:21.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.526+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~N7DVL5FPVG31.0 size=320794 2024-09-14T11:04:21.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.526+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=N7DVL5FPVG31 tag=3LEIAZW90IN5 type=write size=1369370 2024-09-14T11:04:21.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.527+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.0 size=1048576 2024-09-14T11:04:21.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.528+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.1 size=1048576 2024-09-14T11:04:21.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.529+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~Z0Z030HOCLUW.2 size=769580 2024-09-14T11:04:21.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.531+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=Z0Z030HOCLUW tag=H47K9T106LVW type=write size=3915308 2024-09-14T11:04:21.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.532+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=VHF0QTIIAC1F type=del size=455388 2024-09-14T11:04:21.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.534+0000 7f907bbdf780 1 < suggested remove operation key=77H37YF6MJEO tag=CYHJG6WC0K61 type=del 2024-09-14T11:04:21.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.536+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=C99TDZW6PJL7 type=del size=4177519 2024-09-14T11:04:21.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.537+0000 7f907bbdf780 -1 < failed to complete operation key=77H37YF6MJEO tag=TZDHK4G5ENDU type=del size=3255477: (22) Invalid argument 2024-09-14T11:04:21.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.538+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=SRZLHABCR5YP type=del size=3303101 2024-09-14T11:04:21.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.540+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=ODMD1S0QM0PV type=del size=2227800 2024-09-14T11:04:21.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.542+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~LBW92URSZZYN.0 size=1048576 2024-09-14T11:04:21.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.543+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~LBW92URSZZYN.1 size=597622 2024-09-14T11:04:21.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.543+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=LBW92URSZZYN tag=EOER3W52VZM9 type=write size=2694774 2024-09-14T11:04:21.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.545+0000 7f907bbdf780 1 < suggested update operation key=AGMKZ7PGPUAM tag=V7DNI9LKWTVU type=del size=1161525 2024-09-14T11:04:21.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.546+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=I6IXPTY29OIL type=del size=1586149 2024-09-14T11:04:21.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.548+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~J9TRP591MTD2.0 size=1048576 2024-09-14T11:04:21.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.548+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~J9TRP591MTD2.1 size=556901 2024-09-14T11:04:21.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.550+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=J9TRP591MTD2 tag=TTK1TJY709KR type=write size=2654053 2024-09-14T11:04:21.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.552+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~L1M2R2AFERXN.0 size=474519 2024-09-14T11:04:21.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.552+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=L1M2R2AFERXN tag=9EB22TJXI9S0 type=write size=1523095 2024-09-14T11:04:21.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.554+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.0 size=1048576 2024-09-14T11:04:21.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.554+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.1 size=1048576 2024-09-14T11:04:21.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.555+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~NR7VZBECSLVE.2 size=407062 2024-09-14T11:04:21.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.557+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=NR7VZBECSLVE tag=AHS2MZ11FYVG type=write size=3552790 2024-09-14T11:04:21.556 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.559+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=T9WIPBTISR5W type=write size=798020 2024-09-14T11:04:21.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.560+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.0 size=1048576 2024-09-14T11:04:21.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.561+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.1 size=1048576 2024-09-14T11:04:21.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.562+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~1F4YWQXXPJL3.2 size=992425 2024-09-14T11:04:21.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.564+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=1F4YWQXXPJL3 tag=189V0507ZK1J type=write size=4138153 2024-09-14T11:04:21.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.566+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~QRW7B21KNB29.0 size=1048576 2024-09-14T11:04:21.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.566+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~QRW7B21KNB29.1 size=719611 2024-09-14T11:04:21.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.566+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=QRW7B21KNB29 tag=IXCWL1QEYFVX type=write size=2816763 2024-09-14T11:04:21.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.567+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.0 size=1048576 2024-09-14T11:04:21.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.568+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.1 size=1048576 2024-09-14T11:04:21.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.569+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~PVG62H92X2VH.2 size=797694 2024-09-14T11:04:21.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.571+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=PVG62H92X2VH tag=CG4XNDL81CMF type=write size=3943422 2024-09-14T11:04:21.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.573+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.0 size=1048576 2024-09-14T11:04:21.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.575+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.1 size=1048576 2024-09-14T11:04:21.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.576+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.2 size=12377 2024-09-14T11:04:21.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.576+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=XYRQ5PBRMSKB tag=QN5M22JEX4FT type=write size=3158105 2024-09-14T11:04:21.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.577+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.0 size=1048576 2024-09-14T11:04:21.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.578+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.1 size=1048576 2024-09-14T11:04:21.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.579+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~AP2WX0YQ0SPI.2 size=902124 2024-09-14T11:04:21.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.581+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=AP2WX0YQ0SPI tag=IA6EF67BUQ2G type=write size=4047852 2024-09-14T11:04:21.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.582+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=3T902LGQNX17 type=del size=2763900 2024-09-14T11:04:21.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.583+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.0 size=1048576 2024-09-14T11:04:21.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.583+0000 7f907bbdf780 1 < canceled part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.1 size=1048576 2024-09-14T11:04:21.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.584+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~ISFVQPH96G4K.2 size=271942 2024-09-14T11:04:21.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.586+0000 7f907bbdf780 1 < canceled multipart upload key=77H37YF6MJEO upload=ISFVQPH96G4K tag=Z3X39XQ8MBV7 type=write size=3417670 2024-09-14T11:04:21.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.587+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=N3665V3BAXDW type=del size=287039 2024-09-14T11:04:21.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.589+0000 7f907bbdf780 1 < completed write operation key=YH0YMRDQERBF tag=FGDLVH0ASQOV type=write size=114523 2024-09-14T11:04:21.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.591+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~Z3ORF505WSFB.0 size=151749 2024-09-14T11:04:21.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.591+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=Z3ORF505WSFB tag=BEM35C3AD7MM type=write size=1200325 2024-09-14T11:04:21.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.592+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=4JFKIW1MUSCW type=del 2024-09-14T11:04:21.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.593+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=EQE5JOAM39W2 type=del size=1663309 2024-09-14T11:04:21.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.593+0000 7f907bbdf780 1 < canceled part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.0 size=1048576 2024-09-14T11:04:21.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.593+0000 7f907bbdf780 1 < canceled part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.1 size=1048576 2024-09-14T11:04:21.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.595+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~Y3Q3U6HVCMEQ.2 size=816061 2024-09-14T11:04:21.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.596+0000 7f907bbdf780 1 < canceled multipart upload key=YH0YMRDQERBF upload=Y3Q3U6HVCMEQ tag=55ZRNGQA9J2S type=write size=3961789 2024-09-14T11:04:21.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.598+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~MKR0ACDKD1W1.0 size=681960 2024-09-14T11:04:21.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.598+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=MKR0ACDKD1W1 tag=FV3NXAQ10UTW type=write size=1730536 2024-09-14T11:04:21.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.599+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~Z7QZM2MXCHB5.0 size=765914 2024-09-14T11:04:21.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.601+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=Z7QZM2MXCHB5 tag=UYPVEH6EKF3S type=write size=1814490 2024-09-14T11:04:21.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.602+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=1RABB370RK6A type=write size=267644 2024-09-14T11:04:21.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.604+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~N7DVL5FPVG31.0 size=320794 2024-09-14T11:04:21.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.605+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=N7DVL5FPVG31 tag=3LEIAZW90IN5 type=write size=1369370 2024-09-14T11:04:21.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.608+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SAGQH9QQ46KV.0 size=1048576 2024-09-14T11:04:21.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.608+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SAGQH9QQ46KV.1 size=222439 2024-09-14T11:04:21.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.608+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=SAGQH9QQ46KV tag=H9THGG1JFWWX type=write size=2319591 2024-09-14T11:04:21.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.610+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=VHF0QTIIAC1F type=del 2024-09-14T11:04:21.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.611+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=D0NNQ5YCKSJ3 type=del size=2244643 2024-09-14T11:04:21.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.612+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=C99TDZW6PJL7 type=del 2024-09-14T11:04:21.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.613+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=OLTXCV704Q1X type=del size=564769 2024-09-14T11:04:21.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.614+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=SRZLHABCR5YP type=del 2024-09-14T11:04:21.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.615+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=76EGAT3PNLOT type=write size=323983 2024-09-14T11:04:21.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.617+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~LBW92URSZZYN.0 size=1048576 2024-09-14T11:04:21.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.618+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~LBW92URSZZYN.1 size=597622 2024-09-14T11:04:21.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.620+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=LBW92URSZZYN tag=EOER3W52VZM9 type=write size=2694774 2024-09-14T11:04:21.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.621+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=35L7UGGISA3K type=del size=69537 2024-09-14T11:04:21.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.622+0000 7f907bbdf780 1 < canceled operation key=T79IR10S3HAB tag=I6IXPTY29OIL type=del size=1586149 2024-09-14T11:04:21.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.623+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=VHV0KTLMYGO3 type=del size=1399355 2024-09-14T11:04:21.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.624+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~L1M2R2AFERXN.0 size=474519 2024-09-14T11:04:21.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.626+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=L1M2R2AFERXN tag=9EB22TJXI9S0 type=write size=1523095 2024-09-14T11:04:21.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.628+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=9U59VZBGOZCU type=write size=634700 2024-09-14T11:04:21.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.629+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=T9WIPBTISR5W type=write size=798020 2024-09-14T11:04:21.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.630+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=IDQJ8KZO5J4H type=del size=2742641 2024-09-14T11:04:21.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.631+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~QRW7B21KNB29.0 size=1048576 2024-09-14T11:04:21.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.632+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~QRW7B21KNB29.1 size=719611 2024-09-14T11:04:21.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.634+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=QRW7B21KNB29 tag=IXCWL1QEYFVX type=write size=2816763 2024-09-14T11:04:21.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.636+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~OB8LUMNQ5LFV.0 size=1048576 2024-09-14T11:04:21.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.637+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~OB8LUMNQ5LFV.1 size=202849 2024-09-14T11:04:21.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.637+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=OB8LUMNQ5LFV tag=L03E0LCBS3PB type=write size=2300001 2024-09-14T11:04:21.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.639+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.0 size=1048576 2024-09-14T11:04:21.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.640+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.1 size=1048576 2024-09-14T11:04:21.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.641+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~XYRQ5PBRMSKB.2 size=12377 2024-09-14T11:04:21.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.643+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=XYRQ5PBRMSKB tag=QN5M22JEX4FT type=write size=3158105 2024-09-14T11:04:21.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.644+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=OTL2EJGOU55W type=del size=3793143 2024-09-14T11:04:21.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.645+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=3T902LGQNX17 type=del 2024-09-14T11:04:21.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.646+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=U2A23QU13I90 type=del size=2911198 2024-09-14T11:04:21.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.647+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=N3665V3BAXDW type=del 2024-09-14T11:04:21.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.648+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=0PSUSOAFTIWD type=del size=3137743 2024-09-14T11:04:21.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.650+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~Z3ORF505WSFB.0 size=151749 2024-09-14T11:04:21.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.651+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=Z3ORF505WSFB tag=BEM35C3AD7MM type=write size=1200325 2024-09-14T11:04:21.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.653+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=144AJN88R5ZI type=del size=1788650 2024-09-14T11:04:21.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.655+0000 7f907bbdf780 1 < suggested remove operation key=AI0W2MEG08HF tag=EQE5JOAM39W2 type=del 2024-09-14T11:04:21.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.656+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=0UP0WXVHYWIN type=del size=3310103 2024-09-14T11:04:21.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.656+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~MKR0ACDKD1W1.0 size=681960 2024-09-14T11:04:21.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.658+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=MKR0ACDKD1W1 tag=FV3NXAQ10UTW type=write size=1730536 2024-09-14T11:04:21.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.661+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~PMFCN8MUW5GJ.0 size=597472 2024-09-14T11:04:21.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.661+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=PMFCN8MUW5GJ tag=385EZJANCQG2 type=write size=1646048 2024-09-14T11:04:21.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.662+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=1RABB370RK6A type=write size=267644 2024-09-14T11:04:21.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.664+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~QLTOQCKG0ZQI.0 size=1048576 2024-09-14T11:04:21.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.665+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~QLTOQCKG0ZQI.1 size=177543 2024-09-14T11:04:21.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.665+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=QLTOQCKG0ZQI tag=RGDWW32267U4 type=write size=2274695 2024-09-14T11:04:21.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.666+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~SAGQH9QQ46KV.0 size=1048576 2024-09-14T11:04:21.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.666+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~SAGQH9QQ46KV.1 size=222439 2024-09-14T11:04:21.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.668+0000 7f907bbdf780 1 < canceled multipart upload key=5MFLA6XFV3Y5 upload=SAGQH9QQ46KV tag=H9THGG1JFWWX type=write size=2319591 2024-09-14T11:04:21.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.669+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=TMH8TNQG05ER type=del size=919968 2024-09-14T11:04:21.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.672+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=D0NNQ5YCKSJ3 type=del 2024-09-14T11:04:21.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.673+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=3FV4P5VFK2MH type=del size=2208707 2024-09-14T11:04:21.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.675+0000 7f907bbdf780 1 < suggested remove operation key=E3OIUTR3JCQY tag=OLTXCV704Q1X type=del 2024-09-14T11:04:21.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.677+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.0 size=1048576 2024-09-14T11:04:21.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.678+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.1 size=1048576 2024-09-14T11:04:21.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.680+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.2 size=80167 2024-09-14T11:04:21.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.680+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=0JIX7GBBANYE tag=XM2FPE275Q8U type=write size=3225895 2024-09-14T11:04:21.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.682+0000 7f907bbdf780 1 < suggested remove operation key=KQBX4UP53FV1 tag=76EGAT3PNLOT type=write 2024-09-14T11:04:21.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.685+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~P5RE19YAYQ9U.0 size=707922 2024-09-14T11:04:21.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.685+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=P5RE19YAYQ9U tag=B1OO0Q5R0NTL type=write size=1756498 2024-09-14T11:04:21.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.686+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=35L7UGGISA3K type=del 2024-09-14T11:04:21.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.688+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=UDVC30C31RG7 type=del size=982237 2024-09-14T11:04:21.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.690+0000 7f907bbdf780 1 < suggested remove operation key=8FRZW4YC3ATE tag=VHV0KTLMYGO3 type=del 2024-09-14T11:04:21.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.691+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=1I4FPRQ2QRC9 type=del size=822962 2024-09-14T11:04:21.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.693+0000 7f907bbdf780 1 < suggested remove operation key=77H37YF6MJEO tag=9U59VZBGOZCU type=write 2024-09-14T11:04:21.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.695+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~Z8PQ0WU1E2TU.0 size=866552 2024-09-14T11:04:21.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.695+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=Z8PQ0WU1E2TU tag=Y6ZDFUXQE3V1 type=write size=1915128 2024-09-14T11:04:21.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.697+0000 7f907bbdf780 1 < suggested update operation key=AGMKZ7PGPUAM tag=IDQJ8KZO5J4H type=del size=2742641 2024-09-14T11:04:21.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.700+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ZJDU8KF0D6MT.0 size=1048576 2024-09-14T11:04:21.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.700+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ZJDU8KF0D6MT.1 size=346339 2024-09-14T11:04:21.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.700+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=ZJDU8KF0D6MT tag=0AOGKILBPB3J type=write size=2443491 2024-09-14T11:04:21.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.702+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~OB8LUMNQ5LFV.0 size=1048576 2024-09-14T11:04:21.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.703+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~OB8LUMNQ5LFV.1 size=202849 2024-09-14T11:04:21.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.705+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=OB8LUMNQ5LFV tag=L03E0LCBS3PB type=write size=2300001 2024-09-14T11:04:21.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.706+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=M09A2R36X6IC type=del size=3086924 2024-09-14T11:04:21.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.707+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=OTL2EJGOU55W type=del 2024-09-14T11:04:21.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.708+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=4N56XBV51MC4 type=del size=3515147 2024-09-14T11:04:21.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.709+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=U2A23QU13I90 type=del size=2911198 2024-09-14T11:04:21.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.712+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~U7AE8RVIALFU.0 size=702846 2024-09-14T11:04:21.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.712+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=U7AE8RVIALFU tag=SVW5UTSWHP4S type=write size=1751422 2024-09-14T11:04:21.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.713+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=0PSUSOAFTIWD type=del 2024-09-14T11:04:21.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.714+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=8J3XGDK7BED2 type=write size=523858 2024-09-14T11:04:21.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.715+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=144AJN88R5ZI type=del size=1788650 2024-09-14T11:04:21.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.716+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=GUEPZ0JIABH4 type=del size=564770 2024-09-14T11:04:21.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.718+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=0UP0WXVHYWIN type=del 2024-09-14T11:04:21.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.719+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=W17OCXWEZCRY type=del size=2702729 2024-09-14T11:04:21.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.720+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~PMFCN8MUW5GJ.0 size=597472 2024-09-14T11:04:21.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.722+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=PMFCN8MUW5GJ tag=385EZJANCQG2 type=write size=1646048 2024-09-14T11:04:21.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.723+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=Z76215LFDSHJ type=del size=1231132 2024-09-14T11:04:21.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.725+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~QLTOQCKG0ZQI.0 size=1048576 2024-09-14T11:04:21.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.726+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~QLTOQCKG0ZQI.1 size=177543 2024-09-14T11:04:21.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.728+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=QLTOQCKG0ZQI tag=RGDWW32267U4 type=write size=2274695 2024-09-14T11:04:21.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.730+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~NPEYLFNPQN02.0 size=653796 2024-09-14T11:04:21.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.730+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=NPEYLFNPQN02 tag=COI44ZJE74UF type=write size=1702372 2024-09-14T11:04:21.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.733+0000 7f907bbdf780 1 < suggested remove operation key=LJ720PV3SQ8L tag=TMH8TNQG05ER type=del 2024-09-14T11:04:21.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.734+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=84J05SZBFJ24 type=del size=3589396 2024-09-14T11:04:21.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.735+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=3FV4P5VFK2MH type=del 2024-09-14T11:04:21.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.736+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=G7QQ061EL012 type=del size=1666977 2024-09-14T11:04:21.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.738+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.0 size=1048576 2024-09-14T11:04:21.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.739+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.1 size=1048576 2024-09-14T11:04:21.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.740+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~0JIX7GBBANYE.2 size=80167 2024-09-14T11:04:21.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.742+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=0JIX7GBBANYE tag=XM2FPE275Q8U type=write size=3225895 2024-09-14T11:04:21.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.744+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.0 size=1048576 2024-09-14T11:04:21.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.745+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.1 size=1048576 2024-09-14T11:04:21.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.746+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.2 size=173602 2024-09-14T11:04:21.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.746+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=TOJ9TYPXTDCT tag=VJHLWXUAN2WL type=write size=3319330 2024-09-14T11:04:21.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.748+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~P5RE19YAYQ9U.0 size=707922 2024-09-14T11:04:21.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.750+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=P5RE19YAYQ9U tag=B1OO0Q5R0NTL type=write size=1756498 2024-09-14T11:04:21.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.751+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=LC28MVWPSVRT type=del size=2328550 2024-09-14T11:04:21.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.753+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=UDVC30C31RG7 type=del 2024-09-14T11:04:21.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.755+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~K4JC587CI8HP.0 size=1048576 2024-09-14T11:04:21.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.756+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~K4JC587CI8HP.1 size=34640 2024-09-14T11:04:21.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.756+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=K4JC587CI8HP tag=Y9M1IARYAWTG type=write size=2131792 2024-09-14T11:04:21.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.757+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=1I4FPRQ2QRC9 type=del 2024-09-14T11:04:21.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.758+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=N9IB4VWZJLEB type=write size=1004944 2024-09-14T11:04:21.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.759+0000 7f907bbdf780 1 < canceled part key=_multipart_6AWG2GM1ZP31.2~Z8PQ0WU1E2TU.0 size=866552 2024-09-14T11:04:21.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.760+0000 7f907bbdf780 1 < canceled multipart upload key=6AWG2GM1ZP31 upload=Z8PQ0WU1E2TU tag=Y6ZDFUXQE3V1 type=write size=1915128 2024-09-14T11:04:21.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.762+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=80J39JEAUP6X type=del size=1612718 2024-09-14T11:04:21.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.763+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ZJDU8KF0D6MT.0 size=1048576 2024-09-14T11:04:21.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.764+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ZJDU8KF0D6MT.1 size=346339 2024-09-14T11:04:21.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.767+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=ZJDU8KF0D6MT tag=0AOGKILBPB3J type=write size=2443491 2024-09-14T11:04:21.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.768+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=F4FOQ7BKNIDF type=del size=1118066 2024-09-14T11:04:21.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.770+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=M09A2R36X6IC type=del 2024-09-14T11:04:21.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.772+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~P1JLXAUPO3VZ.0 size=901122 2024-09-14T11:04:21.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.772+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=P1JLXAUPO3VZ tag=JDO96ZFEN6XG type=write size=1949698 2024-09-14T11:04:21.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.773+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=4N56XBV51MC4 type=del 2024-09-14T11:04:21.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.776+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.0 size=1048576 2024-09-14T11:04:21.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.777+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.1 size=1048576 2024-09-14T11:04:21.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.778+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.2 size=826117 2024-09-14T11:04:21.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.778+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=GL18XYB2GOQJ tag=172ZBIHP5K9M type=write size=3971845 2024-09-14T11:04:21.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.779+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~U7AE8RVIALFU.0 size=702846 2024-09-14T11:04:21.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.781+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=U7AE8RVIALFU tag=SVW5UTSWHP4S type=write size=1751422 2024-09-14T11:04:21.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.783+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=CL7M42ZYNZG4 type=del size=152459 2024-09-14T11:04:21.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.784+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=8J3XGDK7BED2 type=write size=523858 2024-09-14T11:04:21.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.785+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=ZFLKBUKQK20H type=del size=658488 2024-09-14T11:04:21.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.787+0000 7f907bbdf780 -1 < failed to complete operation key=LJ720PV3SQ8L tag=GUEPZ0JIABH4 type=del size=564770: (22) Invalid argument 2024-09-14T11:04:21.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.788+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=BT7VAE4I8GZX type=del size=3824761 2024-09-14T11:04:21.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.791+0000 7f907bbdf780 1 < suggested remove operation key=FTYIOOQROLG6 tag=W17OCXWEZCRY type=del 2024-09-14T11:04:21.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.793+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.0 size=1048576 2024-09-14T11:04:21.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.794+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.1 size=1048576 2024-09-14T11:04:21.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.795+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.2 size=274517 2024-09-14T11:04:21.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.795+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=5WIY7SGISFVV tag=GO66JM77UU9L type=write size=3420245 2024-09-14T11:04:21.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.796+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=Z76215LFDSHJ type=del 2024-09-14T11:04:21.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.798+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=ZWOXVZ5S23RW type=del size=3883366 2024-09-14T11:04:21.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.799+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~NPEYLFNPQN02.0 size=653796 2024-09-14T11:04:21.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.801+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=NPEYLFNPQN02 tag=COI44ZJE74UF type=write size=1702372 2024-09-14T11:04:21.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.803+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=D69XS5VR80O7 type=write size=435172 2024-09-14T11:04:21.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.804+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=84J05SZBFJ24 type=del 2024-09-14T11:04:21.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.807+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~6YBCOC27P7DX.0 size=1048576 2024-09-14T11:04:21.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.808+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~6YBCOC27P7DX.1 size=252277 2024-09-14T11:04:21.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.808+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=6YBCOC27P7DX tag=Y1OKBUF0APXW type=write size=2349429 2024-09-14T11:04:21.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.809+0000 7f907bbdf780 1 < canceled operation key=Y3KOCA4072NM tag=G7QQ061EL012 type=del size=1666977 2024-09-14T11:04:21.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.811+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~09NMQ1SA4QPZ.0 size=966854 2024-09-14T11:04:21.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.811+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=09NMQ1SA4QPZ tag=CERQOX1NFPM8 type=write size=2015430 2024-09-14T11:04:21.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.812+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.0 size=1048576 2024-09-14T11:04:21.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.813+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.1 size=1048576 2024-09-14T11:04:21.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.814+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~TOJ9TYPXTDCT.2 size=173602 2024-09-14T11:04:21.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.816+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=TOJ9TYPXTDCT tag=VJHLWXUAN2WL type=write size=3319330 2024-09-14T11:04:21.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.817+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=8WIKRBX0E9Y1 type=del size=1002657 2024-09-14T11:04:21.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.818+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=LC28MVWPSVRT type=del 2024-09-14T11:04:21.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.821+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~5Z25S2XZKMS5.0 size=74987 2024-09-14T11:04:21.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.821+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=5Z25S2XZKMS5 tag=6PANMLO24KZV type=write size=1123563 2024-09-14T11:04:21.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.822+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~K4JC587CI8HP.0 size=1048576 2024-09-14T11:04:21.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.823+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~K4JC587CI8HP.1 size=34640 2024-09-14T11:04:21.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.825+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=K4JC587CI8HP tag=Y9M1IARYAWTG type=write size=2131792 2024-09-14T11:04:21.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.826+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=SERP7027RWBF type=del size=2549269 2024-09-14T11:04:21.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.828+0000 7f907bbdf780 1 < suggested remove operation key=S8RIEED24PUM tag=N9IB4VWZJLEB type=write 2024-09-14T11:04:21.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.830+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=GZXAVY8AYWXS type=del size=3783818 2024-09-14T11:04:21.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.831+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=80J39JEAUP6X type=del 2024-09-14T11:04:21.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.832+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=V3M0VCYE6BQA type=del size=3163734 2024-09-14T11:04:21.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.833+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=F4FOQ7BKNIDF type=del 2024-09-14T11:04:21.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.835+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=5N7K8ZRFKHM5 type=del size=3108701 2024-09-14T11:04:21.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.836+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~P1JLXAUPO3VZ.0 size=901122 2024-09-14T11:04:21.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.838+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=P1JLXAUPO3VZ tag=JDO96ZFEN6XG type=write size=1949698 2024-09-14T11:04:21.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.839+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=3CEU1VCJGZBF type=del size=2531550 2024-09-14T11:04:21.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.840+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.0 size=1048576 2024-09-14T11:04:21.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.841+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.1 size=1048576 2024-09-14T11:04:21.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.842+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~GL18XYB2GOQJ.2 size=826117 2024-09-14T11:04:21.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.844+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=GL18XYB2GOQJ tag=172ZBIHP5K9M type=write size=3971845 2024-09-14T11:04:21.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.845+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=1IKG34NRO7ZF type=write size=984391 2024-09-14T11:04:21.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.847+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=CL7M42ZYNZG4 type=del 2024-09-14T11:04:21.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.848+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=9519L4BOT6CJ type=del size=2643074 2024-09-14T11:04:21.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.849+0000 7f907bbdf780 -1 < failed to complete operation key=FTYIOOQROLG6 tag=ZFLKBUKQK20H type=del size=658488: (22) Invalid argument 2024-09-14T11:04:21.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.850+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=3BN69WRJ409W type=del size=802144 2024-09-14T11:04:21.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.852+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=BT7VAE4I8GZX type=del 2024-09-14T11:04:21.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.853+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=9ZP3LEBDQ9XY type=write size=561821 2024-09-14T11:04:21.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.854+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.0 size=1048576 2024-09-14T11:04:21.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.855+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.1 size=1048576 2024-09-14T11:04:21.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.856+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~5WIY7SGISFVV.2 size=274517 2024-09-14T11:04:21.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.858+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=5WIY7SGISFVV tag=GO66JM77UU9L type=write size=3420245 2024-09-14T11:04:21.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.859+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=G4NC6FQU0RSR type=del size=1826178 2024-09-14T11:04:21.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.860+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=ZWOXVZ5S23RW type=del 2024-09-14T11:04:21.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.862+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~NAGNC9RIXQXQ.0 size=1048576 2024-09-14T11:04:21.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.863+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~NAGNC9RIXQXQ.1 size=739823 2024-09-14T11:04:21.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.863+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=NAGNC9RIXQXQ tag=6GGP5LTJSHV5 type=write size=2836975 2024-09-14T11:04:21.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.865+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=D69XS5VR80O7 type=write size=435172 2024-09-14T11:04:21.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.866+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=YK2EVTE6HL9L type=del size=1970478 2024-09-14T11:04:21.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.867+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~6YBCOC27P7DX.0 size=1048576 2024-09-14T11:04:21.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.868+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~6YBCOC27P7DX.1 size=252277 2024-09-14T11:04:21.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.870+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=6YBCOC27P7DX tag=Y1OKBUF0APXW type=write size=2349429 2024-09-14T11:04:21.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.871+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=XLO7578QL3X3 type=del size=2409954 2024-09-14T11:04:21.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.871+0000 7f907bbdf780 1 < canceled part key=_multipart_91RL2KD0XCSI.2~09NMQ1SA4QPZ.0 size=966854 2024-09-14T11:04:21.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.873+0000 7f907bbdf780 1 < canceled multipart upload key=91RL2KD0XCSI upload=09NMQ1SA4QPZ tag=CERQOX1NFPM8 type=write size=2015430 2024-09-14T11:04:21.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.874+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=ZZY03OY433E3 type=write size=10673 2024-09-14T11:04:21.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.876+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=8WIKRBX0E9Y1 type=del 2024-09-14T11:04:21.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.877+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=QCE1CMF20D71 type=write size=559913 2024-09-14T11:04:21.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.878+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~5Z25S2XZKMS5.0 size=74987 2024-09-14T11:04:21.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.880+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=5Z25S2XZKMS5 tag=6PANMLO24KZV type=write size=1123563 2024-09-14T11:04:21.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.881+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=NCFDKIPRDL4O type=del size=4174550 2024-09-14T11:04:21.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.884+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=SERP7027RWBF type=del size=2549269 2024-09-14T11:04:21.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.885+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=H2Z7HK91YPYE type=del size=2002211 2024-09-14T11:04:21.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.886+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=GZXAVY8AYWXS type=del 2024-09-14T11:04:21.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.888+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~33BY4NHLQMQY.0 size=593498 2024-09-14T11:04:21.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.888+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=33BY4NHLQMQY tag=MWULMSKFJV6Q type=write size=1642074 2024-09-14T11:04:21.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.890+0000 7f907bbdf780 1 < suggested update operation key=KQBX4UP53FV1 tag=V3M0VCYE6BQA type=del size=3163734 2024-09-14T11:04:21.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.892+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=BG20RVY7Z6XT type=del size=1093455 2024-09-14T11:04:21.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.893+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=5N7K8ZRFKHM5 type=del size=3108701 2024-09-14T11:04:21.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.895+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~85B0S3XV6VJY.0 size=1048576 2024-09-14T11:04:21.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.896+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~85B0S3XV6VJY.1 size=195683 2024-09-14T11:04:21.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.896+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=85B0S3XV6VJY tag=JJS56VFDD3DR type=write size=2292835 2024-09-14T11:04:21.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.897+0000 7f907bbdf780 -1 < failed to complete operation key=WZ064RU647Y7 tag=3CEU1VCJGZBF type=del size=2531550: (22) Invalid argument 2024-09-14T11:04:21.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.899+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~HDOJ4D817WPL.0 size=1048576 2024-09-14T11:04:21.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.900+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~HDOJ4D817WPL.1 size=71463 2024-09-14T11:04:21.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.900+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=HDOJ4D817WPL tag=4CNQST1V0VO7 type=write size=2168615 2024-09-14T11:04:21.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.902+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=1IKG34NRO7ZF type=write size=984391 2024-09-14T11:04:21.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.903+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=6SGMJ8A0SZ24 type=del size=3933540 2024-09-14T11:04:21.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.904+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=9519L4BOT6CJ type=del 2024-09-14T11:04:21.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.905+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=S8FGCTE6Q5D3 type=del size=1965046 2024-09-14T11:04:21.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.906+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=3BN69WRJ409W type=del 2024-09-14T11:04:21.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.909+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~KTWHBLP0IQUH.0 size=174352 2024-09-14T11:04:21.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.909+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=KTWHBLP0IQUH tag=EY6HKZOQODR6 type=write size=1222928 2024-09-14T11:04:21.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.910+0000 7f907bbdf780 1 < completed write operation key=8C398XZ7XKU7 tag=9ZP3LEBDQ9XY type=write size=561821 2024-09-14T11:04:21.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.911+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=C00DG60BHL2D type=del size=3155126 2024-09-14T11:04:21.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.914+0000 7f907bbdf780 1 < suggested remove operation key=8NO5BA4HL03L tag=G4NC6FQU0RSR type=del 2024-09-14T11:04:21.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.917+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~RP97XGLEKZ1Q.0 size=932735 2024-09-14T11:04:21.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.917+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=RP97XGLEKZ1Q tag=TEXZMB2AEKIT type=write size=1981311 2024-09-14T11:04:21.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.919+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~NAGNC9RIXQXQ.0 size=1048576 2024-09-14T11:04:21.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.920+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~NAGNC9RIXQXQ.1 size=739823 2024-09-14T11:04:21.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.922+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=NAGNC9RIXQXQ tag=6GGP5LTJSHV5 type=write size=2836975 2024-09-14T11:04:21.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.924+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.0 size=1048576 2024-09-14T11:04:21.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.925+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.1 size=1048576 2024-09-14T11:04:21.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.926+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.2 size=846312 2024-09-14T11:04:21.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.926+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=X0TL74G5C1UN tag=JGOXB294ITPH type=write size=3992040 2024-09-14T11:04:21.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.928+0000 7f907bbdf780 1 < suggested remove operation key=E3OIUTR3JCQY tag=YK2EVTE6HL9L type=del 2024-09-14T11:04:21.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.931+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~CO0PYZKOW2HE.0 size=1048576 2024-09-14T11:04:21.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.932+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~CO0PYZKOW2HE.1 size=990550 2024-09-14T11:04:21.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.932+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=CO0PYZKOW2HE tag=846FDDB8J8MM type=write size=3087702 2024-09-14T11:04:21.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.933+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=XLO7578QL3X3 type=del 2024-09-14T11:04:21.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.935+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=KW4QRXPYHU82 type=write size=124325 2024-09-14T11:04:21.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.937+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=ZZY03OY433E3 type=write 2024-09-14T11:04:21.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.940+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.0 size=1048576 2024-09-14T11:04:21.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.941+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.1 size=1048576 2024-09-14T11:04:21.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.942+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.2 size=776829 2024-09-14T11:04:21.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.942+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=7QORRA5VYSG3 tag=3YRR9K0G4FO1 type=write size=3922557 2024-09-14T11:04:21.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.943+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=QCE1CMF20D71 type=write size=559913 2024-09-14T11:04:21.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.945+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=J3USOHP8U2RH type=del size=3924735 2024-09-14T11:04:21.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.946+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=NCFDKIPRDL4O type=del size=4174550 2024-09-14T11:04:21.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.947+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=WO4I4QBKKUAV type=write size=902165 2024-09-14T11:04:21.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.949+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=H2Z7HK91YPYE type=del size=2002211 2024-09-14T11:04:21.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.951+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~5NLK3I1B32S2.0 size=514607 2024-09-14T11:04:21.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.951+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=5NLK3I1B32S2 tag=CN2P0VXUE8GW type=write size=1563183 2024-09-14T11:04:21.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.952+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~33BY4NHLQMQY.0 size=593498 2024-09-14T11:04:21.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.954+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=33BY4NHLQMQY tag=MWULMSKFJV6Q type=write size=1642074 2024-09-14T11:04:21.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.955+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=RDQOE5MRI1UX type=del size=3357870 2024-09-14T11:04:21.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.956+0000 7f907bbdf780 -1 < failed to complete operation key=8NO5BA4HL03L tag=BG20RVY7Z6XT type=del size=1093455: (22) Invalid argument 2024-09-14T11:04:21.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.958+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~0MOEWZVDHEJB.0 size=326831 2024-09-14T11:04:21.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.958+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=0MOEWZVDHEJB tag=RIQWQ5D38GVA type=write size=1375407 2024-09-14T11:04:21.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.960+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~85B0S3XV6VJY.0 size=1048576 2024-09-14T11:04:21.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.961+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~85B0S3XV6VJY.1 size=195683 2024-09-14T11:04:21.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.963+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=85B0S3XV6VJY tag=JJS56VFDD3DR type=write size=2292835 2024-09-14T11:04:21.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.964+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=UBWBNI6SN415 type=del size=1566722 2024-09-14T11:04:21.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.965+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~HDOJ4D817WPL.0 size=1048576 2024-09-14T11:04:21.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.966+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~HDOJ4D817WPL.1 size=71463 2024-09-14T11:04:21.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.968+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=HDOJ4D817WPL tag=4CNQST1V0VO7 type=write size=2168615 2024-09-14T11:04:21.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.969+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=0EONFDUV04MA type=del size=3800438 2024-09-14T11:04:21.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.970+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=6SGMJ8A0SZ24 type=del 2024-09-14T11:04:21.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.972+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=C5G6MLAEFPQO type=write size=186030 2024-09-14T11:04:21.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.973+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=S8FGCTE6Q5D3 type=del 2024-09-14T11:04:21.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.975+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~UZG8RX9L264F.0 size=604084 2024-09-14T11:04:21.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.975+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=UZG8RX9L264F tag=NMEC5BRXPZWU type=write size=1652660 2024-09-14T11:04:21.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.976+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~KTWHBLP0IQUH.0 size=174352 2024-09-14T11:04:21.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.978+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=KTWHBLP0IQUH tag=EY6HKZOQODR6 type=write size=1222928 2024-09-14T11:04:21.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.980+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=12IJH5WW2VFC type=write size=86201 2024-09-14T11:04:21.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.981+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=C00DG60BHL2D type=del 2024-09-14T11:04:21.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.983+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.0 size=1048576 2024-09-14T11:04:21.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.984+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.1 size=1048576 2024-09-14T11:04:21.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.985+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.2 size=353688 2024-09-14T11:04:21.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.985+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=QLONWLPBZGQO tag=2E6YB82L32XT type=write size=3499416 2024-09-14T11:04:21.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.987+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~RP97XGLEKZ1Q.0 size=932735 2024-09-14T11:04:21.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.989+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=RP97XGLEKZ1Q tag=TEXZMB2AEKIT type=write size=1981311 2024-09-14T11:04:21.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.991+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~MJF4H7VLI3Z1.0 size=1048576 2024-09-14T11:04:21.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.992+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~MJF4H7VLI3Z1.1 size=523556 2024-09-14T11:04:21.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.992+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=MJF4H7VLI3Z1 tag=KAP93PB3VBRF type=write size=2620708 2024-09-14T11:04:21.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.994+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.0 size=1048576 2024-09-14T11:04:21.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.995+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.1 size=1048576 2024-09-14T11:04:21.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.996+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~X0TL74G5C1UN.2 size=846312 2024-09-14T11:04:21.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.998+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=X0TL74G5C1UN tag=JGOXB294ITPH type=write size=3992040 2024-09-14T11:04:21.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:21.999+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=PDAAJUH80Y97 type=del size=3335930 2024-09-14T11:04:21.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.001+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~CO0PYZKOW2HE.0 size=1048576 2024-09-14T11:04:21.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.001+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~CO0PYZKOW2HE.1 size=990550 2024-09-14T11:04:22.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.003+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=CO0PYZKOW2HE tag=846FDDB8J8MM type=write size=3087702 2024-09-14T11:04:22.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.005+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~TVI8FJPMKNQ7.0 size=1048576 2024-09-14T11:04:22.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.006+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~TVI8FJPMKNQ7.1 size=783968 2024-09-14T11:04:22.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.006+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=TVI8FJPMKNQ7 tag=RYD8NCPAIRV5 type=write size=2881120 2024-09-14T11:04:22.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.008+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=KW4QRXPYHU82 type=write size=124325 2024-09-14T11:04:22.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.009+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=3VL26X9RYMEF type=del size=3862331 2024-09-14T11:04:22.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.010+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.0 size=1048576 2024-09-14T11:04:22.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.011+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.1 size=1048576 2024-09-14T11:04:22.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.011+0000 7f907bbdf780 1 < canceled part key=_multipart_77H37YF6MJEO.2~7QORRA5VYSG3.2 size=776829 2024-09-14T11:04:22.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.013+0000 7f907bbdf780 1 < canceled multipart upload key=77H37YF6MJEO upload=7QORRA5VYSG3 tag=3YRR9K0G4FO1 type=write size=3922557 2024-09-14T11:04:22.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.015+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=R0E4JPH3XH65 type=del size=25941 2024-09-14T11:04:22.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.016+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=J3USOHP8U2RH type=del 2024-09-14T11:04:22.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.017+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=1M0LVGGUCAJB type=del size=1883686 2024-09-14T11:04:22.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.018+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=WO4I4QBKKUAV type=write size=902165 2024-09-14T11:04:22.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.020+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~9CP937HEJ8T8.0 size=1048576 2024-09-14T11:04:22.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.021+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~9CP937HEJ8T8.1 size=32939 2024-09-14T11:04:22.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.021+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=9CP937HEJ8T8 tag=CTAU478ZOT06 type=write size=2130091 2024-09-14T11:04:22.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.023+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~5NLK3I1B32S2.0 size=514607 2024-09-14T11:04:22.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.024+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=5NLK3I1B32S2 tag=CN2P0VXUE8GW type=write size=1563183 2024-09-14T11:04:22.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.026+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=H33W945NM5K1 type=del size=1025729 2024-09-14T11:04:22.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.028+0000 7f907bbdf780 1 < suggested update operation key=T79IR10S3HAB tag=RDQOE5MRI1UX type=del size=3357870 2024-09-14T11:04:22.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.030+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=O023HLL6YQM1 type=del size=3251818 2024-09-14T11:04:22.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.031+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~0MOEWZVDHEJB.0 size=326831 2024-09-14T11:04:22.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.035+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=0MOEWZVDHEJB tag=RIQWQ5D38GVA type=write size=1375407 2024-09-14T11:04:22.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.037+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.0 size=1048576 2024-09-14T11:04:22.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.038+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.1 size=1048576 2024-09-14T11:04:22.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.039+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.2 size=926163 2024-09-14T11:04:22.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.039+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=F8TQG4IN90PS tag=OOB6WD24UGVN type=write size=4071891 2024-09-14T11:04:22.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.040+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=UBWBNI6SN415 type=del 2024-09-14T11:04:22.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.042+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.0 size=1048576 2024-09-14T11:04:22.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.043+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.1 size=1048576 2024-09-14T11:04:22.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.044+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.2 size=689523 2024-09-14T11:04:22.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.044+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=DXGPEM5O08K0 tag=FDBYJ9LRGEL6 type=write size=3835251 2024-09-14T11:04:22.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.047+0000 7f907bbdf780 1 < suggested remove operation key=LQNZKMX52SWO tag=0EONFDUV04MA type=del 2024-09-14T11:04:22.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.048+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=ZSAF6Z3RRNUN type=del size=3421760 2024-09-14T11:04:22.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.049+0000 7f907bbdf780 1 < completed write operation key=YH0YMRDQERBF tag=C5G6MLAEFPQO type=write size=186030 2024-09-14T11:04:22.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.050+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=IRRBEWA472IE type=write size=843848 2024-09-14T11:04:22.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.051+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~UZG8RX9L264F.0 size=604084 2024-09-14T11:04:22.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.053+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=UZG8RX9L264F tag=NMEC5BRXPZWU type=write size=1652660 2024-09-14T11:04:22.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.055+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~DHIVXC0X76BO.0 size=863216 2024-09-14T11:04:22.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.055+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=DHIVXC0X76BO tag=BGZQGONUCO5I type=write size=1911792 2024-09-14T11:04:22.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.056+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=12IJH5WW2VFC type=write size=86201 2024-09-14T11:04:22.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.058+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=7SWSAOA60GCI type=del size=1024702 2024-09-14T11:04:22.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.058+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.0 size=1048576 2024-09-14T11:04:22.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.058+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.1 size=1048576 2024-09-14T11:04:22.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.059+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~QLONWLPBZGQO.2 size=353688 2024-09-14T11:04:22.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.061+0000 7f907bbdf780 1 < canceled multipart upload key=S8RIEED24PUM upload=QLONWLPBZGQO tag=2E6YB82L32XT type=write size=3499416 2024-09-14T11:04:22.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.062+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=IQZ3FY6RPQAV type=write size=716910 2024-09-14T11:04:22.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.063+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~MJF4H7VLI3Z1.0 size=1048576 2024-09-14T11:04:22.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.064+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~MJF4H7VLI3Z1.1 size=523556 2024-09-14T11:04:22.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.066+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=MJF4H7VLI3Z1 tag=KAP93PB3VBRF type=write size=2620708 2024-09-14T11:04:22.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.067+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=YRNQEO03L8T4 type=write size=724761 2024-09-14T11:04:22.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.068+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=PDAAJUH80Y97 type=del 2024-09-14T11:04:22.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.070+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~JL4EU0CLCMZZ.0 size=1048576 2024-09-14T11:04:22.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.071+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~JL4EU0CLCMZZ.1 size=582545 2024-09-14T11:04:22.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.071+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=JL4EU0CLCMZZ tag=EN6SJLE4SI0E type=write size=2679697 2024-09-14T11:04:22.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.072+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~TVI8FJPMKNQ7.0 size=1048576 2024-09-14T11:04:22.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.073+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~TVI8FJPMKNQ7.1 size=783968 2024-09-14T11:04:22.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.075+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=TVI8FJPMKNQ7 tag=RYD8NCPAIRV5 type=write size=2881120 2024-09-14T11:04:22.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.077+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~FS6TEAL2UK37.0 size=284334 2024-09-14T11:04:22.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.077+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=FS6TEAL2UK37 tag=VKNVI8ACSKH2 type=write size=1332910 2024-09-14T11:04:22.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.079+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=3VL26X9RYMEF type=del 2024-09-14T11:04:22.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.081+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~6ADF8TLY6BKZ.0 size=1048576 2024-09-14T11:04:22.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.082+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~6ADF8TLY6BKZ.1 size=533020 2024-09-14T11:04:22.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.082+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=6ADF8TLY6BKZ tag=VPRBJMVM7B4Z type=write size=2630172 2024-09-14T11:04:22.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.083+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=R0E4JPH3XH65 type=del 2024-09-14T11:04:22.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.085+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~FZKCLZP2336Z.0 size=1048576 2024-09-14T11:04:22.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.086+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~FZKCLZP2336Z.1 size=774675 2024-09-14T11:04:22.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.086+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=FZKCLZP2336Z tag=TF2VYKNMQMQ7 type=write size=2871827 2024-09-14T11:04:22.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.089+0000 7f907bbdf780 1 < suggested remove operation key=E3OIUTR3JCQY tag=1M0LVGGUCAJB type=del 2024-09-14T11:04:22.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.090+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=3HVX6L32M2OX type=del size=763095 2024-09-14T11:04:22.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.092+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~9CP937HEJ8T8.0 size=1048576 2024-09-14T11:04:22.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.093+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~9CP937HEJ8T8.1 size=32939 2024-09-14T11:04:22.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.095+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=9CP937HEJ8T8 tag=CTAU478ZOT06 type=write size=2130091 2024-09-14T11:04:22.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.096+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=3PNDZBU91UAF type=write size=442770 2024-09-14T11:04:22.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.097+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=H33W945NM5K1 type=del 2024-09-14T11:04:22.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.099+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.0 size=1048576 2024-09-14T11:04:22.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.100+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.1 size=1048576 2024-09-14T11:04:22.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.101+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.2 size=383421 2024-09-14T11:04:22.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.101+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=ASP6SGJZ426W tag=53VOPXNUGB4M type=write size=3529149 2024-09-14T11:04:22.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.103+0000 7f907bbdf780 1 < canceled operation key=KQBX4UP53FV1 tag=O023HLL6YQM1 type=del size=3251818 2024-09-14T11:04:22.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.104+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=CD2LULG9EI9V type=del size=3055709 2024-09-14T11:04:22.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.105+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.0 size=1048576 2024-09-14T11:04:22.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.106+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.1 size=1048576 2024-09-14T11:04:22.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.106+0000 7f907bbdf780 1 < canceled part key=_multipart_GC52N456IYD7.2~F8TQG4IN90PS.2 size=926163 2024-09-14T11:04:22.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.108+0000 7f907bbdf780 1 < canceled multipart upload key=GC52N456IYD7 upload=F8TQG4IN90PS tag=OOB6WD24UGVN type=write size=4071891 2024-09-14T11:04:22.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.109+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=09M3PZIPL61A type=write size=110984 2024-09-14T11:04:22.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.110+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.0 size=1048576 2024-09-14T11:04:22.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.111+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.1 size=1048576 2024-09-14T11:04:22.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.112+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DXGPEM5O08K0.2 size=689523 2024-09-14T11:04:22.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.114+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=DXGPEM5O08K0 tag=FDBYJ9LRGEL6 type=write size=3835251 2024-09-14T11:04:22.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.116+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=LRAG3AV9FSST type=del size=943591 2024-09-14T11:04:22.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.117+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=ZSAF6Z3RRNUN type=del 2024-09-14T11:04:22.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.119+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~FVGUAJ6FRY8D.0 size=1048576 2024-09-14T11:04:22.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.120+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~FVGUAJ6FRY8D.1 size=834757 2024-09-14T11:04:22.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.120+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=FVGUAJ6FRY8D tag=V6CGZX63HQF1 type=write size=2931909 2024-09-14T11:04:22.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.121+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=IRRBEWA472IE type=write size=843848 2024-09-14T11:04:22.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.123+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=AQ21UNC6IWA7 type=write size=587522 2024-09-14T11:04:22.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.124+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~DHIVXC0X76BO.0 size=863216 2024-09-14T11:04:22.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.126+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=DHIVXC0X76BO tag=BGZQGONUCO5I type=write size=1911792 2024-09-14T11:04:22.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.128+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~V33JNWDIMWSX.0 size=412945 2024-09-14T11:04:22.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.128+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=V33JNWDIMWSX tag=17D814APVVA6 type=write size=1461521 2024-09-14T11:04:22.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.130+0000 7f907bbdf780 1 < canceled operation key=WAFH5BKM2P23 tag=7SWSAOA60GCI type=del size=1024702 2024-09-14T11:04:22.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.131+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=MEI2322815IS type=del size=1245346 2024-09-14T11:04:22.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.132+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=IQZ3FY6RPQAV type=write size=716910 2024-09-14T11:04:22.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.133+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=ME84N0HDYV1Z type=del size=693217 2024-09-14T11:04:22.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.135+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=YRNQEO03L8T4 type=write size=724761 2024-09-14T11:04:22.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.136+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=JZFVZ508FOJ7 type=del size=992903 2024-09-14T11:04:22.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.137+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~JL4EU0CLCMZZ.0 size=1048576 2024-09-14T11:04:22.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.138+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~JL4EU0CLCMZZ.1 size=582545 2024-09-14T11:04:22.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.140+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=JL4EU0CLCMZZ tag=EN6SJLE4SI0E type=write size=2679697 2024-09-14T11:04:22.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.143+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.0 size=1048576 2024-09-14T11:04:22.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.143+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.1 size=1048576 2024-09-14T11:04:22.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.144+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.2 size=593595 2024-09-14T11:04:22.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.144+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=U6465VCBVLT4 tag=4QYW4ZW751F7 type=write size=3739323 2024-09-14T11:04:22.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.147+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~FS6TEAL2UK37.0 size=284334 2024-09-14T11:04:22.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.149+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=FS6TEAL2UK37 tag=VKNVI8ACSKH2 type=write size=1332910 2024-09-14T11:04:22.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.151+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~RSHF0AFSGEJX.0 size=1048576 2024-09-14T11:04:22.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.152+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~RSHF0AFSGEJX.1 size=452819 2024-09-14T11:04:22.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.152+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=RSHF0AFSGEJX tag=QAWOVB6YOZDV type=write size=2549971 2024-09-14T11:04:22.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.153+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~6ADF8TLY6BKZ.0 size=1048576 2024-09-14T11:04:22.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.154+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~6ADF8TLY6BKZ.1 size=533020 2024-09-14T11:04:22.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.155+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=6ADF8TLY6BKZ tag=VPRBJMVM7B4Z type=write size=2630172 2024-09-14T11:04:22.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.158+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.0 size=1048576 2024-09-14T11:04:22.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.158+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.1 size=1048576 2024-09-14T11:04:22.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.159+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.2 size=892907 2024-09-14T11:04:22.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.159+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=9R3KDW9MI0X5 tag=ZJ767HPW47F9 type=write size=4038635 2024-09-14T11:04:22.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.161+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~FZKCLZP2336Z.0 size=1048576 2024-09-14T11:04:22.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.161+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~FZKCLZP2336Z.1 size=774675 2024-09-14T11:04:22.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.163+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=FZKCLZP2336Z tag=TF2VYKNMQMQ7 type=write size=2871827 2024-09-14T11:04:22.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.165+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=T4SAJC3TJXE7 type=del size=331409 2024-09-14T11:04:22.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.166+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=3HVX6L32M2OX type=del 2024-09-14T11:04:22.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.168+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~8OZ45A9GMVRX.0 size=177783 2024-09-14T11:04:22.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.168+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=8OZ45A9GMVRX tag=IR2UJ1UZFYZ3 type=write size=1226359 2024-09-14T11:04:22.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.169+0000 7f907bbdf780 1 < completed write operation key=P0701O36E1JI tag=3PNDZBU91UAF type=write size=442770 2024-09-14T11:04:22.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.171+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.0 size=1048576 2024-09-14T11:04:22.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.172+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.1 size=1048576 2024-09-14T11:04:22.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.173+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.2 size=631297 2024-09-14T11:04:22.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.173+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=H2J0BA4DEOUZ tag=PWX0X1SMQ9G1 type=write size=3777025 2024-09-14T11:04:22.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.174+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.0 size=1048576 2024-09-14T11:04:22.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.175+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.1 size=1048576 2024-09-14T11:04:22.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.176+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~ASP6SGJZ426W.2 size=383421 2024-09-14T11:04:22.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.178+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=ASP6SGJZ426W tag=53VOPXNUGB4M type=write size=3529149 2024-09-14T11:04:22.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.180+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=EFK2897E3QL7 type=del size=2204539 2024-09-14T11:04:22.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.181+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=CD2LULG9EI9V type=del 2024-09-14T11:04:22.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.183+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~5FL4PNWWNHGZ.0 size=1048576 2024-09-14T11:04:22.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.184+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~5FL4PNWWNHGZ.1 size=566992 2024-09-14T11:04:22.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.184+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=5FL4PNWWNHGZ tag=54C9NZ1MO3B8 type=write size=2664144 2024-09-14T11:04:22.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.185+0000 7f907bbdf780 1 < completed write operation key=P546JCSFB00N tag=09M3PZIPL61A type=write size=110984 2024-09-14T11:04:22.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.186+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=H4SZ5OVWSJ2F type=del size=2948932 2024-09-14T11:04:22.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.188+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=LRAG3AV9FSST type=del 2024-09-14T11:04:22.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.189+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=RBHJLSGJ1B90 type=del size=1190692 2024-09-14T11:04:22.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.190+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~FVGUAJ6FRY8D.0 size=1048576 2024-09-14T11:04:22.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.191+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~FVGUAJ6FRY8D.1 size=834757 2024-09-14T11:04:22.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.193+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=FVGUAJ6FRY8D tag=V6CGZX63HQF1 type=write size=2931909 2024-09-14T11:04:22.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.194+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=35NH0NS9Y5YA type=del size=2661763 2024-09-14T11:04:22.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.197+0000 7f907bbdf780 1 < suggested update operation key=5MFLA6XFV3Y5 tag=AQ21UNC6IWA7 type=write size=587522 2024-09-14T11:04:22.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.198+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=EOWF80CXDAOG type=del size=1368996 2024-09-14T11:04:22.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.199+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~V33JNWDIMWSX.0 size=412945 2024-09-14T11:04:22.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.201+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=V33JNWDIMWSX tag=17D814APVVA6 type=write size=1461521 2024-09-14T11:04:22.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.202+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=XAAC0N92PC72 type=del size=2682711 2024-09-14T11:04:22.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.204+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=MEI2322815IS type=del 2024-09-14T11:04:22.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.205+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=1RTWC505DHC1 type=del size=572887 2024-09-14T11:04:22.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.207+0000 7f907bbdf780 1 < suggested update operation key=T79IR10S3HAB tag=ME84N0HDYV1Z type=del size=693217 2024-09-14T11:04:22.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.208+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=XA0XHJNIJA19 type=del size=4099296 2024-09-14T11:04:22.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.211+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=JZFVZ508FOJ7 type=del 2024-09-14T11:04:22.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.212+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=OHO9KMGW6EDZ type=write size=252766 2024-09-14T11:04:22.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.213+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.0 size=1048576 2024-09-14T11:04:22.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.214+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.1 size=1048576 2024-09-14T11:04:22.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.215+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~U6465VCBVLT4.2 size=593595 2024-09-14T11:04:22.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.217+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=U6465VCBVLT4 tag=4QYW4ZW751F7 type=write size=3739323 2024-09-14T11:04:22.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.220+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.0 size=1048576 2024-09-14T11:04:22.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.221+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.1 size=1048576 2024-09-14T11:04:22.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.222+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.2 size=705494 2024-09-14T11:04:22.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.222+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=QL2MY0MKMWR6 tag=81DG2VW9X9VG type=write size=3851222 2024-09-14T11:04:22.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.222+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~RSHF0AFSGEJX.0 size=1048576 2024-09-14T11:04:22.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.223+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~RSHF0AFSGEJX.1 size=452819 2024-09-14T11:04:22.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.225+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=RSHF0AFSGEJX tag=QAWOVB6YOZDV type=write size=2549971 2024-09-14T11:04:22.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.227+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~375JCSPBO6Q2.0 size=1048576 2024-09-14T11:04:22.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.228+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~375JCSPBO6Q2.1 size=85370 2024-09-14T11:04:22.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.228+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=375JCSPBO6Q2 tag=LSGDV1D3YMS0 type=write size=2182522 2024-09-14T11:04:22.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.230+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.0 size=1048576 2024-09-14T11:04:22.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.231+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.1 size=1048576 2024-09-14T11:04:22.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.232+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~9R3KDW9MI0X5.2 size=892907 2024-09-14T11:04:22.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.234+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=9R3KDW9MI0X5 tag=ZJ767HPW47F9 type=write size=4038635 2024-09-14T11:04:22.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.235+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=K8P1NLN8VEZT type=del size=2494673 2024-09-14T11:04:22.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.236+0000 7f907bbdf780 -1 < failed to complete operation key=HM2GVOA72HHR tag=T4SAJC3TJXE7 type=del size=331409: (22) Invalid argument 2024-09-14T11:04:22.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.238+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.0 size=1048576 2024-09-14T11:04:22.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.239+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.1 size=1048576 2024-09-14T11:04:22.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.240+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.2 size=389827 2024-09-14T11:04:22.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.240+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=BRL4IUFUYR6L tag=K2F47EOQJ2M6 type=write size=3535555 2024-09-14T11:04:22.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.242+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~8OZ45A9GMVRX.0 size=177783 2024-09-14T11:04:22.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.244+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=8OZ45A9GMVRX tag=IR2UJ1UZFYZ3 type=write size=1226359 2024-09-14T11:04:22.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.245+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=1YZ3BY7PG312 type=write size=8099 2024-09-14T11:04:22.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.246+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.0 size=1048576 2024-09-14T11:04:22.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.247+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.1 size=1048576 2024-09-14T11:04:22.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.248+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~H2J0BA4DEOUZ.2 size=631297 2024-09-14T11:04:22.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.250+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=H2J0BA4DEOUZ tag=PWX0X1SMQ9G1 type=write size=3777025 2024-09-14T11:04:22.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.251+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=A7NNDKMVYS57 type=del size=3365295 2024-09-14T11:04:22.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.253+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=EFK2897E3QL7 type=del 2024-09-14T11:04:22.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.255+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~ALE6NDKC46DX.0 size=1048576 2024-09-14T11:04:22.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.256+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~ALE6NDKC46DX.1 size=471726 2024-09-14T11:04:22.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.256+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=ALE6NDKC46DX tag=6BNVITEQAZQ6 type=write size=2568878 2024-09-14T11:04:22.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.258+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~5FL4PNWWNHGZ.0 size=1048576 2024-09-14T11:04:22.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.259+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~5FL4PNWWNHGZ.1 size=566992 2024-09-14T11:04:22.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.261+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=5FL4PNWWNHGZ tag=54C9NZ1MO3B8 type=write size=2664144 2024-09-14T11:04:22.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.262+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=TLNP52CTJS0E type=del size=1194795 2024-09-14T11:04:22.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.264+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=H4SZ5OVWSJ2F type=del 2024-09-14T11:04:22.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.266+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.0 size=1048576 2024-09-14T11:04:22.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.267+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.1 size=1048576 2024-09-14T11:04:22.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.268+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.2 size=1004333 2024-09-14T11:04:22.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.268+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=XXC0X0N4S5MA tag=OWOFUD04GUC4 type=write size=4150061 2024-09-14T11:04:22.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.270+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=RBHJLSGJ1B90 type=del 2024-09-14T11:04:22.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.271+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=VZ53MS3NA26X type=del size=172868 2024-09-14T11:04:22.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.272+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=35NH0NS9Y5YA type=del 2024-09-14T11:04:22.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.274+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7UUH56IOWOD0.0 size=243369 2024-09-14T11:04:22.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.274+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=7UUH56IOWOD0 tag=6DR80VSSJFWK type=write size=1291945 2024-09-14T11:04:22.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.276+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=EOWF80CXDAOG type=del 2024-09-14T11:04:22.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.278+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~TLQ5Y39R56F0.0 size=1048576 2024-09-14T11:04:22.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.279+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~TLQ5Y39R56F0.1 size=814413 2024-09-14T11:04:22.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.279+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=TLQ5Y39R56F0 tag=OT1CMDDW634V type=write size=2911565 2024-09-14T11:04:22.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.281+0000 7f907bbdf780 1 < suggested update operation key=LQNZKMX52SWO tag=XAAC0N92PC72 type=del size=2682711 2024-09-14T11:04:22.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.283+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~KQX8SYZ9R5KD.0 size=1048576 2024-09-14T11:04:22.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.284+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~KQX8SYZ9R5KD.1 size=689028 2024-09-14T11:04:22.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.284+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=KQX8SYZ9R5KD tag=M807L0YX3DYY type=write size=2786180 2024-09-14T11:04:22.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.286+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=1RTWC505DHC1 type=del 2024-09-14T11:04:22.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.287+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=N0IYD9L666CO type=del size=52765 2024-09-14T11:04:22.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.288+0000 7f907bbdf780 1 < canceled operation key=9OKQI3W8M5GA tag=XA0XHJNIJA19 type=del size=4099296 2024-09-14T11:04:22.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.289+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=G3GTBRMOJDL1 type=del size=2254772 2024-09-14T11:04:22.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.290+0000 7f907bbdf780 1 < completed write operation key=JEXUT5F7AKZ1 tag=OHO9KMGW6EDZ type=write size=252766 2024-09-14T11:04:22.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.291+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=3JUUWIVGNG01 type=del size=4008855 2024-09-14T11:04:22.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.293+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.0 size=1048576 2024-09-14T11:04:22.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.294+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.1 size=1048576 2024-09-14T11:04:22.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.295+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~QL2MY0MKMWR6.2 size=705494 2024-09-14T11:04:22.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.297+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=QL2MY0MKMWR6 tag=81DG2VW9X9VG type=write size=3851222 2024-09-14T11:04:22.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.299+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.0 size=1048576 2024-09-14T11:04:22.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.300+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.1 size=1048576 2024-09-14T11:04:22.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.301+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.2 size=799982 2024-09-14T11:04:22.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.301+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=1TAXREOV7OBZ tag=AS2YLMDQ4V16 type=write size=3945710 2024-09-14T11:04:22.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.302+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~375JCSPBO6Q2.0 size=1048576 2024-09-14T11:04:22.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.303+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~375JCSPBO6Q2.1 size=85370 2024-09-14T11:04:22.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.305+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=375JCSPBO6Q2 tag=LSGDV1D3YMS0 type=write size=2182522 2024-09-14T11:04:22.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.306+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=RYMR1LERJFH5 type=del size=44730 2024-09-14T11:04:22.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.307+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=K8P1NLN8VEZT type=del 2024-09-14T11:04:22.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.308+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=N1C7KLESD24T type=del size=400581 2024-09-14T11:04:22.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.309+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.0 size=1048576 2024-09-14T11:04:22.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.309+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.1 size=1048576 2024-09-14T11:04:22.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.309+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~BRL4IUFUYR6L.2 size=389827 2024-09-14T11:04:22.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.311+0000 7f907bbdf780 1 < canceled multipart upload key=8NO5BA4HL03L upload=BRL4IUFUYR6L tag=K2F47EOQJ2M6 type=write size=3535555 2024-09-14T11:04:22.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.312+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=R27G8J6M724S type=del size=3945665 2024-09-14T11:04:22.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.313+0000 7f907bbdf780 -1 < failed to complete operation key=YH0YMRDQERBF tag=1YZ3BY7PG312 type=write size=8099: (22) Invalid argument 2024-09-14T11:04:22.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.315+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~MFVZCMI8ZTLH.0 size=847422 2024-09-14T11:04:22.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.315+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=MFVZCMI8ZTLH tag=51VJ8G7FPIXB type=write size=1895998 2024-09-14T11:04:22.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.317+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=A7NNDKMVYS57 type=del 2024-09-14T11:04:22.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.318+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=1DJ3UDU12Q7R type=del size=661456 2024-09-14T11:04:22.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.319+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~ALE6NDKC46DX.0 size=1048576 2024-09-14T11:04:22.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.320+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~ALE6NDKC46DX.1 size=471726 2024-09-14T11:04:22.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.322+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=ALE6NDKC46DX tag=6BNVITEQAZQ6 type=write size=2568878 2024-09-14T11:04:22.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.324+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~1MXWKCL8PMNQ.0 size=353562 2024-09-14T11:04:22.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.324+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=1MXWKCL8PMNQ tag=EWO82ZHA2QLI type=write size=1402138 2024-09-14T11:04:22.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.325+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=TLNP52CTJS0E type=del 2024-09-14T11:04:22.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.327+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=6HVNSX028EJU type=del size=442712 2024-09-14T11:04:22.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.328+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.0 size=1048576 2024-09-14T11:04:22.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.329+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.1 size=1048576 2024-09-14T11:04:22.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.330+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~XXC0X0N4S5MA.2 size=1004333 2024-09-14T11:04:22.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.332+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=XXC0X0N4S5MA tag=OWOFUD04GUC4 type=write size=4150061 2024-09-14T11:04:22.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.334+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~TQ3F33H2K71L.0 size=487111 2024-09-14T11:04:22.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.334+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=TQ3F33H2K71L tag=NXOTZ0YFGW07 type=write size=1535687 2024-09-14T11:04:22.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.335+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=VZ53MS3NA26X type=del 2024-09-14T11:04:22.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.336+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=JYME17410LHA type=del size=1422881 2024-09-14T11:04:22.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.337+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7UUH56IOWOD0.0 size=243369 2024-09-14T11:04:22.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.339+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=7UUH56IOWOD0 tag=6DR80VSSJFWK type=write size=1291945 2024-09-14T11:04:22.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.341+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~TKDZU1U98DGE.0 size=1048576 2024-09-14T11:04:22.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.342+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~TKDZU1U98DGE.1 size=708992 2024-09-14T11:04:22.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.342+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=TKDZU1U98DGE tag=G097AFYRE5TF type=write size=2806144 2024-09-14T11:04:22.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.343+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~TLQ5Y39R56F0.0 size=1048576 2024-09-14T11:04:22.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.343+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~TLQ5Y39R56F0.1 size=814413 2024-09-14T11:04:22.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.345+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=TLQ5Y39R56F0 tag=OT1CMDDW634V type=write size=2911565 2024-09-14T11:04:22.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.347+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=D686DM17UXRO type=del size=2257505 2024-09-14T11:04:22.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.348+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~KQX8SYZ9R5KD.0 size=1048576 2024-09-14T11:04:22.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.349+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~KQX8SYZ9R5KD.1 size=689028 2024-09-14T11:04:22.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.351+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=KQX8SYZ9R5KD tag=M807L0YX3DYY type=write size=2786180 2024-09-14T11:04:22.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.353+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.0 size=1048576 2024-09-14T11:04:22.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.354+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.1 size=1048576 2024-09-14T11:04:22.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.355+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.2 size=122184 2024-09-14T11:04:22.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.355+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=T1B960WV8J06 tag=VU16UUKZS1NO type=write size=3267912 2024-09-14T11:04:22.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.357+0000 7f907bbdf780 1 < suggested remove operation key=S8RIEED24PUM tag=N0IYD9L666CO type=del 2024-09-14T11:04:22.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.359+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~V6FG4855IGQH.0 size=376913 2024-09-14T11:04:22.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.359+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=V6FG4855IGQH tag=CI5FF27MSX4G type=write size=1425489 2024-09-14T11:04:22.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.360+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=G3GTBRMOJDL1 type=del 2024-09-14T11:04:22.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.361+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=3XNZE1YI5A4O type=del size=3944364 2024-09-14T11:04:22.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.363+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=3JUUWIVGNG01 type=del 2024-09-14T11:04:22.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.365+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~HNTW1VGKOMR1.0 size=254944 2024-09-14T11:04:22.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.365+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=HNTW1VGKOMR1 tag=H2OMKNDG0SXU type=write size=1303520 2024-09-14T11:04:22.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.366+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.0 size=1048576 2024-09-14T11:04:22.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.368+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.1 size=1048576 2024-09-14T11:04:22.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.369+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1TAXREOV7OBZ.2 size=799982 2024-09-14T11:04:22.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.371+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=1TAXREOV7OBZ tag=AS2YLMDQ4V16 type=write size=3945710 2024-09-14T11:04:22.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.373+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ISYCSUAQYHKW.0 size=607446 2024-09-14T11:04:22.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.373+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=ISYCSUAQYHKW tag=499SSNKXX4S9 type=write size=1656022 2024-09-14T11:04:22.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.374+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=RYMR1LERJFH5 type=del 2024-09-14T11:04:22.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.376+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=ZTDB4H1AX2X5 type=del size=1921214 2024-09-14T11:04:22.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.377+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=N1C7KLESD24T type=del 2024-09-14T11:04:22.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.379+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.0 size=1048576 2024-09-14T11:04:22.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.380+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.1 size=1048576 2024-09-14T11:04:22.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.381+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.2 size=1007966 2024-09-14T11:04:22.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.381+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=CR0W1PSGEJDY tag=B4SSVX4K006K type=write size=4153694 2024-09-14T11:04:22.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.382+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=R27G8J6M724S type=del 2024-09-14T11:04:22.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.383+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=G7EG0418U6PY type=del size=1692245 2024-09-14T11:04:22.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.384+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~MFVZCMI8ZTLH.0 size=847422 2024-09-14T11:04:22.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.386+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=MFVZCMI8ZTLH tag=51VJ8G7FPIXB type=write size=1895998 2024-09-14T11:04:22.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.388+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~DVX34WJD5IGL.0 size=1048576 2024-09-14T11:04:22.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.389+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~DVX34WJD5IGL.1 size=278932 2024-09-14T11:04:22.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.389+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=DVX34WJD5IGL tag=FU2WSNLHEC3S type=write size=2376084 2024-09-14T11:04:22.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.390+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=1DJ3UDU12Q7R type=del 2024-09-14T11:04:22.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.392+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.0 size=1048576 2024-09-14T11:04:22.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.393+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.1 size=1048576 2024-09-14T11:04:22.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.394+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.2 size=48904 2024-09-14T11:04:22.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.394+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=W9QE6MFVSXMF tag=1SX31VL0VMU0 type=write size=3194632 2024-09-14T11:04:22.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.395+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~1MXWKCL8PMNQ.0 size=353562 2024-09-14T11:04:22.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.397+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=1MXWKCL8PMNQ tag=EWO82ZHA2QLI type=write size=1402138 2024-09-14T11:04:22.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.398+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=9BRPOEO70K7B type=del size=2255665 2024-09-14T11:04:22.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.400+0000 7f907bbdf780 1 < canceled operation key=GC52N456IYD7 tag=6HVNSX028EJU type=del size=442712 2024-09-14T11:04:22.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.402+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.0 size=1048576 2024-09-14T11:04:22.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.403+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.1 size=1048576 2024-09-14T11:04:22.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.404+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.2 size=743615 2024-09-14T11:04:22.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.404+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=BDM7NT845R3K tag=KYI1EXEZJCL2 type=write size=3889343 2024-09-14T11:04:22.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.405+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~TQ3F33H2K71L.0 size=487111 2024-09-14T11:04:22.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.407+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=TQ3F33H2K71L tag=NXOTZ0YFGW07 type=write size=1535687 2024-09-14T11:04:22.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.408+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=1XZXYFG6XU60 type=write size=375313 2024-09-14T11:04:22.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.409+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=JYME17410LHA type=del 2024-09-14T11:04:22.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.410+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=JXVNU1P1AKCZ type=del size=3481847 2024-09-14T11:04:22.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.411+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~TKDZU1U98DGE.0 size=1048576 2024-09-14T11:04:22.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.411+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~TKDZU1U98DGE.1 size=708992 2024-09-14T11:04:22.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.413+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=TKDZU1U98DGE tag=G097AFYRE5TF type=write size=2806144 2024-09-14T11:04:22.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.415+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~9CW138FTSMYN.0 size=1048576 2024-09-14T11:04:22.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.416+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~9CW138FTSMYN.1 size=580720 2024-09-14T11:04:22.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.416+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=9CW138FTSMYN tag=D48JBWW4NU30 type=write size=2677872 2024-09-14T11:04:22.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.417+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=D686DM17UXRO type=del 2024-09-14T11:04:22.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.419+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~6GDS91OQ459T.0 size=1048576 2024-09-14T11:04:22.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.420+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~6GDS91OQ459T.1 size=652380 2024-09-14T11:04:22.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.420+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=6GDS91OQ459T tag=L5Q7UT3CXJG4 type=write size=2749532 2024-09-14T11:04:22.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.422+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.0 size=1048576 2024-09-14T11:04:22.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.423+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.1 size=1048576 2024-09-14T11:04:22.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.424+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~T1B960WV8J06.2 size=122184 2024-09-14T11:04:22.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.425+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=T1B960WV8J06 tag=VU16UUKZS1NO type=write size=3267912 2024-09-14T11:04:22.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.427+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=COVBPN9MY7EA type=write size=415515 2024-09-14T11:04:22.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.428+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~V6FG4855IGQH.0 size=376913 2024-09-14T11:04:22.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.430+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=V6FG4855IGQH tag=CI5FF27MSX4G type=write size=1425489 2024-09-14T11:04:22.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.431+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=6COS6SJWI6L2 type=del size=3321699 2024-09-14T11:04:22.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.433+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=3XNZE1YI5A4O type=del 2024-09-14T11:04:22.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.434+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=EKA9FG3I7EXJ type=del size=1631070 2024-09-14T11:04:22.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.434+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~HNTW1VGKOMR1.0 size=254944 2024-09-14T11:04:22.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.436+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=HNTW1VGKOMR1 tag=H2OMKNDG0SXU type=write size=1303520 2024-09-14T11:04:22.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.438+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=90GJC2A19I19 type=del size=1088421 2024-09-14T11:04:22.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.439+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ISYCSUAQYHKW.0 size=607446 2024-09-14T11:04:22.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.441+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=ISYCSUAQYHKW tag=499SSNKXX4S9 type=write size=1656022 2024-09-14T11:04:22.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.444+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~7292453H9L2A.0 size=1048576 2024-09-14T11:04:22.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.445+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~7292453H9L2A.1 size=780693 2024-09-14T11:04:22.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.445+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=7292453H9L2A tag=9BOWUR28C1GP type=write size=2877845 2024-09-14T11:04:22.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.447+0000 7f907bbdf780 1 < suggested remove operation key=Y3KOCA4072NM tag=ZTDB4H1AX2X5 type=del 2024-09-14T11:04:22.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.448+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=1INJOME14D3B type=del size=2362095 2024-09-14T11:04:22.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.449+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.0 size=1048576 2024-09-14T11:04:22.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.450+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.1 size=1048576 2024-09-14T11:04:22.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.451+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~CR0W1PSGEJDY.2 size=1007966 2024-09-14T11:04:22.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.453+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=CR0W1PSGEJDY tag=B4SSVX4K006K type=write size=4153694 2024-09-14T11:04:22.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.455+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=J85U7J50HJD9 type=write size=806214 2024-09-14T11:04:22.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.457+0000 7f907bbdf780 1 < suggested remove operation key=JEXUT5F7AKZ1 tag=G7EG0418U6PY type=del 2024-09-14T11:04:22.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.458+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=YPM2ALX1PPV8 type=del size=4113903 2024-09-14T11:04:22.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.460+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~DVX34WJD5IGL.0 size=1048576 2024-09-14T11:04:22.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.460+0000 7f907bbdf780 1 < canceled part key=_multipart_P0701O36E1JI.2~DVX34WJD5IGL.1 size=278932 2024-09-14T11:04:22.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.462+0000 7f907bbdf780 1 < canceled multipart upload key=P0701O36E1JI upload=DVX34WJD5IGL tag=FU2WSNLHEC3S type=write size=2376084 2024-09-14T11:04:22.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.463+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=E7ITDATG8O50 type=del size=4135207 2024-09-14T11:04:22.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.464+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.0 size=1048576 2024-09-14T11:04:22.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.465+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.1 size=1048576 2024-09-14T11:04:22.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.466+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~W9QE6MFVSXMF.2 size=48904 2024-09-14T11:04:22.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.469+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=W9QE6MFVSXMF tag=1SX31VL0VMU0 type=write size=3194632 2024-09-14T11:04:22.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.470+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=2472EXOQ2X1M type=del size=3779710 2024-09-14T11:04:22.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.471+0000 7f907bbdf780 1 < canceled operation key=6AWG2GM1ZP31 tag=9BRPOEO70K7B type=del size=2255665 2024-09-14T11:04:22.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.473+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~6TMXQQ7YQEY1.0 size=930734 2024-09-14T11:04:22.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.473+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=6TMXQQ7YQEY1 tag=RZAWZSBJ5ZPH type=write size=1979310 2024-09-14T11:04:22.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.475+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.0 size=1048576 2024-09-14T11:04:22.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.476+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.1 size=1048576 2024-09-14T11:04:22.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.477+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~BDM7NT845R3K.2 size=743615 2024-09-14T11:04:22.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.480+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=BDM7NT845R3K tag=KYI1EXEZJCL2 type=write size=3889343 2024-09-14T11:04:22.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.481+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=EV5HGA9SE217 type=del size=1722075 2024-09-14T11:04:22.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.482+0000 7f907bbdf780 1 < canceled operation key=5MFLA6XFV3Y5 tag=1XZXYFG6XU60 type=write size=375313 2024-09-14T11:04:22.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.484+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~GOVJ0ANNTCX3.0 size=122553 2024-09-14T11:04:22.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.484+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=GOVJ0ANNTCX3 tag=BTNT0KD4H28U type=write size=1171129 2024-09-14T11:04:22.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.486+0000 7f907bbdf780 -1 < failed to complete operation key=Y3KOCA4072NM tag=JXVNU1P1AKCZ type=del size=3481847: (22) Invalid argument 2024-09-14T11:04:22.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.487+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=7XO52HVIGKYA type=del size=6688 2024-09-14T11:04:22.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.488+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~9CW138FTSMYN.0 size=1048576 2024-09-14T11:04:22.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.489+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~9CW138FTSMYN.1 size=580720 2024-09-14T11:04:22.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.491+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=9CW138FTSMYN tag=D48JBWW4NU30 type=write size=2677872 2024-09-14T11:04:22.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.493+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~4Y8M2M7ONL2M.0 size=195343 2024-09-14T11:04:22.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.493+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=4Y8M2M7ONL2M tag=DQOA6QKJV2O6 type=write size=1243919 2024-09-14T11:04:22.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.494+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~6GDS91OQ459T.0 size=1048576 2024-09-14T11:04:22.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.495+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~6GDS91OQ459T.1 size=652380 2024-09-14T11:04:22.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.498+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=6GDS91OQ459T tag=L5Q7UT3CXJG4 type=write size=2749532 2024-09-14T11:04:22.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.499+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=TQODP0VY8LHJ type=del size=1888697 2024-09-14T11:04:22.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.500+0000 7f907bbdf780 1 < completed write operation key=WAFH5BKM2P23 tag=COVBPN9MY7EA type=write size=415515 2024-09-14T11:04:22.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.501+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=CW7356MBO45N type=del size=1951246 2024-09-14T11:04:22.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.503+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=6COS6SJWI6L2 type=del 2024-09-14T11:04:22.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.505+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~7I5NNUPPHI0D.0 size=1048576 2024-09-14T11:04:22.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.506+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~7I5NNUPPHI0D.1 size=478829 2024-09-14T11:04:22.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.506+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=7I5NNUPPHI0D tag=11SWG11RW4IY type=write size=2575981 2024-09-14T11:04:22.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.507+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=EKA9FG3I7EXJ type=del size=1631070 2024-09-14T11:04:22.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.508+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=Y4KLAJV04STC type=del size=1003030 2024-09-14T11:04:22.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.509+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=90GJC2A19I19 type=del 2024-09-14T11:04:22.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.511+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~NVOIOMGQGUEC.0 size=266100 2024-09-14T11:04:22.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.511+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=NVOIOMGQGUEC tag=WXPT71J6VFQS type=write size=1314676 2024-09-14T11:04:22.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.513+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~7292453H9L2A.0 size=1048576 2024-09-14T11:04:22.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.514+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~7292453H9L2A.1 size=780693 2024-09-14T11:04:22.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.515+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=7292453H9L2A tag=9BOWUR28C1GP type=write size=2877845 2024-09-14T11:04:22.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.517+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~FS78P9SAH16I.0 size=1048576 2024-09-14T11:04:22.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.518+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~FS78P9SAH16I.1 size=931872 2024-09-14T11:04:22.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.518+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=FS78P9SAH16I tag=O4VN4I3A2WZQ type=write size=3029024 2024-09-14T11:04:22.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.520+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=1INJOME14D3B type=del 2024-09-14T11:04:22.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.522+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~8A5EVAQGQS5E.0 size=1048576 2024-09-14T11:04:22.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.523+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~8A5EVAQGQS5E.1 size=967428 2024-09-14T11:04:22.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.523+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=8A5EVAQGQS5E tag=QEDUA25YJVCM type=write size=3064580 2024-09-14T11:04:22.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.524+0000 7f907bbdf780 1 < canceled operation key=LQNZKMX52SWO tag=J85U7J50HJD9 type=write size=806214 2024-09-14T11:04:22.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.525+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=PIQARSK7PI5F type=del size=812605 2024-09-14T11:04:22.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.526+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=YPM2ALX1PPV8 type=del 2024-09-14T11:04:22.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.528+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~M8IZ4ZHY8C6P.0 size=1048576 2024-09-14T11:04:22.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.529+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~M8IZ4ZHY8C6P.1 size=848531 2024-09-14T11:04:22.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.529+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=M8IZ4ZHY8C6P tag=M2QCULE7H2KO type=write size=2945683 2024-09-14T11:04:22.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.531+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=E7ITDATG8O50 type=del 2024-09-14T11:04:22.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.532+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=I0F8VDVY95AT type=del size=2950958 2024-09-14T11:04:22.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.533+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=2472EXOQ2X1M type=del 2024-09-14T11:04:22.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.534+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=YI9MK86W54PQ type=write size=148560 2024-09-14T11:04:22.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.536+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~6TMXQQ7YQEY1.0 size=930734 2024-09-14T11:04:22.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.538+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=6TMXQQ7YQEY1 tag=RZAWZSBJ5ZPH type=write size=1979310 2024-09-14T11:04:22.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.540+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.0 size=1048576 2024-09-14T11:04:22.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.541+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.1 size=1048576 2024-09-14T11:04:22.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.542+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.2 size=808412 2024-09-14T11:04:22.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.542+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=2HME8NA79FRD tag=E18NIS6F69FP type=write size=3954140 2024-09-14T11:04:22.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.543+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=EV5HGA9SE217 type=del 2024-09-14T11:04:22.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.544+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=M53QUACKSZED type=del size=4038751 2024-09-14T11:04:22.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.544+0000 7f907bbdf780 1 < canceled part key=_multipart_YH0YMRDQERBF.2~GOVJ0ANNTCX3.0 size=122553 2024-09-14T11:04:22.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.546+0000 7f907bbdf780 1 < canceled multipart upload key=YH0YMRDQERBF upload=GOVJ0ANNTCX3 tag=BTNT0KD4H28U type=write size=1171129 2024-09-14T11:04:22.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.548+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.0 size=1048576 2024-09-14T11:04:22.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.549+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.1 size=1048576 2024-09-14T11:04:22.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.550+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.2 size=704128 2024-09-14T11:04:22.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.550+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=3NKP9JRCT8U2 tag=XNC3MIM64926 type=write size=3849856 2024-09-14T11:04:22.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.552+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=7XO52HVIGKYA type=del 2024-09-14T11:04:22.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.554+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.0 size=1048576 2024-09-14T11:04:22.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.555+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.1 size=1048576 2024-09-14T11:04:22.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.556+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.2 size=983620 2024-09-14T11:04:22.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.556+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=G9TD2XF6M1IA tag=CLWNTADRGWPE type=write size=4129348 2024-09-14T11:04:22.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.557+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~4Y8M2M7ONL2M.0 size=195343 2024-09-14T11:04:22.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.559+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=4Y8M2M7ONL2M tag=DQOA6QKJV2O6 type=write size=1243919 2024-09-14T11:04:22.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.561+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~KM8L8KD1IAF1.0 size=1048576 2024-09-14T11:04:22.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.562+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~KM8L8KD1IAF1.1 size=12947 2024-09-14T11:04:22.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.562+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=KM8L8KD1IAF1 tag=CWNLUUQH54G0 type=write size=2110099 2024-09-14T11:04:22.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.563+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=TQODP0VY8LHJ type=del 2024-09-14T11:04:22.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.566+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.0 size=1048576 2024-09-14T11:04:22.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.567+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.1 size=1048576 2024-09-14T11:04:22.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.567+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.2 size=871582 2024-09-14T11:04:22.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.567+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=QZT1ZTL33B3L tag=FT2JO9IABB9O type=write size=4017310 2024-09-14T11:04:22.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.569+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=CW7356MBO45N type=del 2024-09-14T11:04:22.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.570+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=OQD3D9W05WS7 type=write size=349364 2024-09-14T11:04:22.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.571+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~7I5NNUPPHI0D.0 size=1048576 2024-09-14T11:04:22.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.572+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~7I5NNUPPHI0D.1 size=478829 2024-09-14T11:04:22.571 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.574+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=7I5NNUPPHI0D tag=11SWG11RW4IY type=write size=2575981 2024-09-14T11:04:22.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.575+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=VDUDRBSLQJV1 type=del size=2099011 2024-09-14T11:04:22.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.576+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=Y4KLAJV04STC type=del 2024-09-14T11:04:22.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.578+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~J02MT3G4KSJ3.0 size=245733 2024-09-14T11:04:22.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.578+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=J02MT3G4KSJ3 tag=NNDMFKAVIUE6 type=write size=1294309 2024-09-14T11:04:22.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.580+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~NVOIOMGQGUEC.0 size=266100 2024-09-14T11:04:22.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.582+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=NVOIOMGQGUEC tag=WXPT71J6VFQS type=write size=1314676 2024-09-14T11:04:22.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.584+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~KW1C22TMVNJE.0 size=247264 2024-09-14T11:04:22.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.584+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=KW1C22TMVNJE tag=3PA0AFQQ1G1I type=write size=1295840 2024-09-14T11:04:22.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.586+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~FS78P9SAH16I.0 size=1048576 2024-09-14T11:04:22.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.587+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~FS78P9SAH16I.1 size=931872 2024-09-14T11:04:22.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.590+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=FS78P9SAH16I tag=O4VN4I3A2WZQ type=write size=3029024 2024-09-14T11:04:22.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.591+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=B6EFRFIKY446 type=del size=1386838 2024-09-14T11:04:22.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.593+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~8A5EVAQGQS5E.0 size=1048576 2024-09-14T11:04:22.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.594+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~8A5EVAQGQS5E.1 size=967428 2024-09-14T11:04:22.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.595+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=8A5EVAQGQS5E tag=QEDUA25YJVCM type=write size=3064580 2024-09-14T11:04:22.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.597+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=2YMR1K5AKW7P type=del size=1471662 2024-09-14T11:04:22.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.598+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=PIQARSK7PI5F type=del 2024-09-14T11:04:22.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.600+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.0 size=1048576 2024-09-14T11:04:22.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.601+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.1 size=1048576 2024-09-14T11:04:22.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.602+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.2 size=591448 2024-09-14T11:04:22.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.602+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=2UPUEK0PT7C3 tag=MBXZCH5BTRGA type=write size=3737176 2024-09-14T11:04:22.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.603+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~M8IZ4ZHY8C6P.0 size=1048576 2024-09-14T11:04:22.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.604+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~M8IZ4ZHY8C6P.1 size=848531 2024-09-14T11:04:22.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.606+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=M8IZ4ZHY8C6P tag=M2QCULE7H2KO type=write size=2945683 2024-09-14T11:04:22.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.608+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=SDPMTXMPWUEA type=del size=168311 2024-09-14T11:04:22.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.610+0000 7f907bbdf780 1 < suggested update operation key=ZFF333CYOK5P tag=I0F8VDVY95AT type=del size=2950958 2024-09-14T11:04:22.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.612+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~XT8NLVI9D583.0 size=850797 2024-09-14T11:04:22.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.612+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=XT8NLVI9D583 tag=FF8JX0KTZN9E type=write size=1899373 2024-09-14T11:04:22.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.615+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=YI9MK86W54PQ type=write size=148560 2024-09-14T11:04:22.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.616+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=V3OQ02LLLAVP type=write size=135828 2024-09-14T11:04:22.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.618+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.0 size=1048576 2024-09-14T11:04:22.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.619+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.1 size=1048576 2024-09-14T11:04:22.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.620+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~2HME8NA79FRD.2 size=808412 2024-09-14T11:04:22.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.622+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=2HME8NA79FRD tag=E18NIS6F69FP type=write size=3954140 2024-09-14T11:04:22.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.623+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=ZIGXIO9KS1HS type=del size=3945500 2024-09-14T11:04:22.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.625+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=M53QUACKSZED type=del size=4038751 2024-09-14T11:04:22.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.626+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=K45P0PPK60EZ type=write size=905891 2024-09-14T11:04:22.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.627+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.0 size=1048576 2024-09-14T11:04:22.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.628+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.1 size=1048576 2024-09-14T11:04:22.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.629+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~3NKP9JRCT8U2.2 size=704128 2024-09-14T11:04:22.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.632+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=3NKP9JRCT8U2 tag=XNC3MIM64926 type=write size=3849856 2024-09-14T11:04:22.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.634+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.0 size=1048576 2024-09-14T11:04:22.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.635+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.1 size=1048576 2024-09-14T11:04:22.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.636+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.2 size=369520 2024-09-14T11:04:22.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.636+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=G1B9UJOEUGJ6 tag=ZG4JCXQV5R6R type=write size=3515248 2024-09-14T11:04:22.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.637+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.0 size=1048576 2024-09-14T11:04:22.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.638+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.1 size=1048576 2024-09-14T11:04:22.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.639+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~G9TD2XF6M1IA.2 size=983620 2024-09-14T11:04:22.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.641+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=G9TD2XF6M1IA tag=CLWNTADRGWPE type=write size=4129348 2024-09-14T11:04:22.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.642+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=NXI00C61JKKF type=del size=3764010 2024-09-14T11:04:22.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.643+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~KM8L8KD1IAF1.0 size=1048576 2024-09-14T11:04:22.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.644+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~KM8L8KD1IAF1.1 size=12947 2024-09-14T11:04:22.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.646+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=KM8L8KD1IAF1 tag=CWNLUUQH54G0 type=write size=2110099 2024-09-14T11:04:22.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.649+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~YRNXH9PEG0QG.0 size=824065 2024-09-14T11:04:22.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.649+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=YRNXH9PEG0QG tag=0LNCNNLNIGV3 type=write size=1872641 2024-09-14T11:04:22.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.650+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.0 size=1048576 2024-09-14T11:04:22.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.651+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.1 size=1048576 2024-09-14T11:04:22.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.651+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~QZT1ZTL33B3L.2 size=871582 2024-09-14T11:04:22.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.653+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=QZT1ZTL33B3L tag=FT2JO9IABB9O type=write size=4017310 2024-09-14T11:04:22.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.655+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~MLEOGBXNPGEX.0 size=348000 2024-09-14T11:04:22.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.655+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=MLEOGBXNPGEX tag=JEDP6U4IJ9Q3 type=write size=1396576 2024-09-14T11:04:22.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.658+0000 7f907bbdf780 1 < suggested remove operation key=WAFH5BKM2P23 tag=OQD3D9W05WS7 type=write 2024-09-14T11:04:22.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.660+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~VMMLVG5162BM.0 size=532665 2024-09-14T11:04:22.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.660+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=VMMLVG5162BM tag=RZC2AET3NUYI type=write size=1581241 2024-09-14T11:04:22.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.662+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=VDUDRBSLQJV1 type=del 2024-09-14T11:04:22.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.664+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~JMY4MBQMPU62.0 size=582018 2024-09-14T11:04:22.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.664+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=JMY4MBQMPU62 tag=3H156E0S0M2Z type=write size=1630594 2024-09-14T11:04:22.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.666+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~J02MT3G4KSJ3.0 size=245733 2024-09-14T11:04:22.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.668+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=J02MT3G4KSJ3 tag=NNDMFKAVIUE6 type=write size=1294309 2024-09-14T11:04:22.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.670+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~VB6OO2OMXZFR.0 size=1048576 2024-09-14T11:04:22.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.671+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~VB6OO2OMXZFR.1 size=612692 2024-09-14T11:04:22.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.671+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=VB6OO2OMXZFR tag=ZOAEMEBJFBI6 type=write size=2709844 2024-09-14T11:04:22.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.673+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~KW1C22TMVNJE.0 size=247264 2024-09-14T11:04:22.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.675+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=KW1C22TMVNJE tag=3PA0AFQQ1G1I type=write size=1295840 2024-09-14T11:04:22.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.676+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=HRH3Q16FJVEB type=write size=56423 2024-09-14T11:04:22.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.677+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=B6EFRFIKY446 type=del 2024-09-14T11:04:22.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.679+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=AD22608Z9GXZ type=del size=1653830 2024-09-14T11:04:22.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.681+0000 7f907bbdf780 1 < suggested update operation key=FTYIOOQROLG6 tag=2YMR1K5AKW7P type=del size=1471662 2024-09-14T11:04:22.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.682+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=BT6FWM9P0N5W type=write size=225683 2024-09-14T11:04:22.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.683+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.0 size=1048576 2024-09-14T11:04:22.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.684+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.1 size=1048576 2024-09-14T11:04:22.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.685+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~2UPUEK0PT7C3.2 size=591448 2024-09-14T11:04:22.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.688+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=2UPUEK0PT7C3 tag=MBXZCH5BTRGA type=write size=3737176 2024-09-14T11:04:22.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.689+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=536R11UMBEPO type=del size=1877740 2024-09-14T11:04:22.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.690+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=SDPMTXMPWUEA type=del 2024-09-14T11:04:22.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.691+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=V8DB5ZJPCOKF type=del size=314396 2024-09-14T11:04:22.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.693+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~XT8NLVI9D583.0 size=850797 2024-09-14T11:04:22.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.695+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=XT8NLVI9D583 tag=FF8JX0KTZN9E type=write size=1899373 2024-09-14T11:04:22.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.697+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~OX7D6PNXVS4O.0 size=532156 2024-09-14T11:04:22.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.697+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=OX7D6PNXVS4O tag=JTFMBXVLPOUL type=write size=1580732 2024-09-14T11:04:22.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.698+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=V3OQ02LLLAVP type=write size=135828 2024-09-14T11:04:22.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.700+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.0 size=1048576 2024-09-14T11:04:22.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.701+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.1 size=1048576 2024-09-14T11:04:22.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.702+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.2 size=671794 2024-09-14T11:04:22.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.702+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=2G2I1PREONMH tag=NZTQLN1VU9DP type=write size=3817522 2024-09-14T11:04:22.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.705+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=ZIGXIO9KS1HS type=del 2024-09-14T11:04:22.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.706+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=K2MDV8CAD1OX type=del size=2391405 2024-09-14T11:04:22.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.707+0000 7f907bbdf780 -1 < failed to complete operation key=WAFH5BKM2P23 tag=K45P0PPK60EZ type=write size=905891: (22) Invalid argument 2024-09-14T11:04:22.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.708+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=1OLWLQV7WQ4A type=del size=3529051 2024-09-14T11:04:22.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.709+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.0 size=1048576 2024-09-14T11:04:22.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.710+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.1 size=1048576 2024-09-14T11:04:22.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.711+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~G1B9UJOEUGJ6.2 size=369520 2024-09-14T11:04:22.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.713+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=G1B9UJOEUGJ6 tag=ZG4JCXQV5R6R type=write size=3515248 2024-09-14T11:04:22.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.715+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=FF8V07LTHVCK type=del size=2467017 2024-09-14T11:04:22.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.717+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=NXI00C61JKKF type=del 2024-09-14T11:04:22.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.718+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=QK1YHVOO1HS0 type=del size=1500682 2024-09-14T11:04:22.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.719+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~YRNXH9PEG0QG.0 size=824065 2024-09-14T11:04:22.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.721+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=YRNXH9PEG0QG tag=0LNCNNLNIGV3 type=write size=1872641 2024-09-14T11:04:22.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.723+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=DZSU621IKBXP type=del size=1698589 2024-09-14T11:04:22.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.724+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~MLEOGBXNPGEX.0 size=348000 2024-09-14T11:04:22.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.726+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=MLEOGBXNPGEX tag=JEDP6U4IJ9Q3 type=write size=1396576 2024-09-14T11:04:22.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.728+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~18WLOWL2WUEY.0 size=812370 2024-09-14T11:04:22.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.728+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=18WLOWL2WUEY tag=WNP1LII6Z68T type=write size=1860946 2024-09-14T11:04:22.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.730+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~VMMLVG5162BM.0 size=532665 2024-09-14T11:04:22.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.732+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=VMMLVG5162BM tag=RZC2AET3NUYI type=write size=1581241 2024-09-14T11:04:22.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.734+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~G7KPF5OLDDUZ.0 size=1048576 2024-09-14T11:04:22.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.735+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~G7KPF5OLDDUZ.1 size=349914 2024-09-14T11:04:22.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.735+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=G7KPF5OLDDUZ tag=78BFDXKT7LWT type=write size=2447066 2024-09-14T11:04:22.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.736+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~JMY4MBQMPU62.0 size=582018 2024-09-14T11:04:22.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.738+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=JMY4MBQMPU62 tag=3H156E0S0M2Z type=write size=1630594 2024-09-14T11:04:22.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.739+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=TOSEWQ168GDP type=del size=1357233 2024-09-14T11:04:22.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.740+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~VB6OO2OMXZFR.0 size=1048576 2024-09-14T11:04:22.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.741+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~VB6OO2OMXZFR.1 size=612692 2024-09-14T11:04:22.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.743+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=VB6OO2OMXZFR tag=ZOAEMEBJFBI6 type=write size=2709844 2024-09-14T11:04:22.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.745+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=23VMFK3IKQEL type=del size=2902282 2024-09-14T11:04:22.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.746+0000 7f907bbdf780 1 < canceled operation key=8NO5BA4HL03L tag=HRH3Q16FJVEB type=write size=56423 2024-09-14T11:04:22.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.748+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~858U3SAZRF8P.0 size=99290 2024-09-14T11:04:22.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.748+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=858U3SAZRF8P tag=I781L9FT36AU type=write size=1147866 2024-09-14T11:04:22.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.749+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=AD22608Z9GXZ type=del 2024-09-14T11:04:22.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.750+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=8RBDKANKRFL7 type=del size=1589446 2024-09-14T11:04:22.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.751+0000 7f907bbdf780 1 < completed write operation key=P546JCSFB00N tag=BT6FWM9P0N5W type=write size=225683 2024-09-14T11:04:22.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.753+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=ZBJ3V39I7NT6 type=del size=2488884 2024-09-14T11:04:22.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.754+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=536R11UMBEPO type=del 2024-09-14T11:04:22.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.755+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=CPZ327TV08ZG type=del size=2966615 2024-09-14T11:04:22.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.756+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=V8DB5ZJPCOKF type=del 2024-09-14T11:04:22.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.757+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=LLUSWX6DC4C6 type=del size=2949822 2024-09-14T11:04:22.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.758+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~OX7D6PNXVS4O.0 size=532156 2024-09-14T11:04:22.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.760+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=OX7D6PNXVS4O tag=JTFMBXVLPOUL type=write size=1580732 2024-09-14T11:04:22.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.763+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~MZP4AAKX0Y2T.0 size=1047561 2024-09-14T11:04:22.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.763+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=MZP4AAKX0Y2T tag=EJ0M0KI8WV8B type=write size=2096137 2024-09-14T11:04:22.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.763+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.0 size=1048576 2024-09-14T11:04:22.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.764+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.1 size=1048576 2024-09-14T11:04:22.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.765+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~2G2I1PREONMH.2 size=671794 2024-09-14T11:04:22.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.767+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=2G2I1PREONMH tag=NZTQLN1VU9DP type=write size=3817522 2024-09-14T11:04:22.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.769+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~M9XP2JEUQ07R.0 size=177631 2024-09-14T11:04:22.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.769+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=M9XP2JEUQ07R tag=1T7NZ7YOHGYR type=write size=1226207 2024-09-14T11:04:22.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.770+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=K2MDV8CAD1OX type=del 2024-09-14T11:04:22.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.771+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=ZXMA298JDU1L type=del size=2216126 2024-09-14T11:04:22.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.773+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=1OLWLQV7WQ4A type=del 2024-09-14T11:04:22.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.774+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=F9ER0ASWDW2B type=del size=1192174 2024-09-14T11:04:22.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.775+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=FF8V07LTHVCK type=del 2024-09-14T11:04:22.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.776+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=1WRZDGP8KVTT type=del size=101272 2024-09-14T11:04:22.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.778+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=QK1YHVOO1HS0 type=del size=1500682 2024-09-14T11:04:22.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.779+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=W9CIB7E1O01K type=del size=3389864 2024-09-14T11:04:22.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.780+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=DZSU621IKBXP type=del 2024-09-14T11:04:22.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.782+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~FS07X34HI74A.0 size=1048576 2024-09-14T11:04:22.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.783+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~FS07X34HI74A.1 size=30 2024-09-14T11:04:22.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.783+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=FS07X34HI74A tag=9KLSEHSQXS2G type=write size=2097182 2024-09-14T11:04:22.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.785+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~18WLOWL2WUEY.0 size=812370 2024-09-14T11:04:22.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.787+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=18WLOWL2WUEY tag=WNP1LII6Z68T type=write size=1860946 2024-09-14T11:04:22.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.789+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.0 size=1048576 2024-09-14T11:04:22.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.790+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.1 size=1048576 2024-09-14T11:04:22.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.791+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.2 size=394476 2024-09-14T11:04:22.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.791+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=5V3IJ4B3US2Y tag=G0QZXDD7C6OX type=write size=3540204 2024-09-14T11:04:22.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.792+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~G7KPF5OLDDUZ.0 size=1048576 2024-09-14T11:04:22.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.793+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~G7KPF5OLDDUZ.1 size=349914 2024-09-14T11:04:22.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.795+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=G7KPF5OLDDUZ tag=78BFDXKT7LWT type=write size=2447066 2024-09-14T11:04:22.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.797+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=FACCOETDXUME type=del size=2388834 2024-09-14T11:04:22.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.798+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=TOSEWQ168GDP type=del 2024-09-14T11:04:22.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.800+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~1RB5S0K3E8UT.0 size=1048576 2024-09-14T11:04:22.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.801+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~1RB5S0K3E8UT.1 size=223178 2024-09-14T11:04:22.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.801+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=1RB5S0K3E8UT tag=LZ2FCUUUH8YA type=write size=2320330 2024-09-14T11:04:22.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.802+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=23VMFK3IKQEL type=del 2024-09-14T11:04:22.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.803+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=OBZ7DEQA5EG7 type=del size=811993 2024-09-14T11:04:22.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.805+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~858U3SAZRF8P.0 size=99290 2024-09-14T11:04:22.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.807+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=858U3SAZRF8P tag=I781L9FT36AU type=write size=1147866 2024-09-14T11:04:22.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.809+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.0 size=1048576 2024-09-14T11:04:22.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.810+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.1 size=1048576 2024-09-14T11:04:22.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.811+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.2 size=104216 2024-09-14T11:04:22.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.811+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=9YKXZQJO6FJ6 tag=MGC3DC2WV0AW type=write size=3249944 2024-09-14T11:04:22.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.813+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=8RBDKANKRFL7 type=del 2024-09-14T11:04:22.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.814+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=UN02JU43JKA1 type=del size=4018429 2024-09-14T11:04:22.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.815+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=ZBJ3V39I7NT6 type=del 2024-09-14T11:04:22.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.816+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=TCZ0BP12ONPV type=del size=2131001 2024-09-14T11:04:22.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.819+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=CPZ327TV08ZG type=del 2024-09-14T11:04:22.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.820+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=VNIVYSYE2C0O type=del size=3946046 2024-09-14T11:04:22.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.821+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=LLUSWX6DC4C6 type=del 2024-09-14T11:04:22.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.823+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=F8WIJIC3AA61 type=del size=825670 2024-09-14T11:04:22.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.823+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~MZP4AAKX0Y2T.0 size=1047561 2024-09-14T11:04:22.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.825+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=MZP4AAKX0Y2T tag=EJ0M0KI8WV8B type=write size=2096137 2024-09-14T11:04:22.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.826+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=V9DP0P7SPDY5 type=del size=2547445 2024-09-14T11:04:22.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.827+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~M9XP2JEUQ07R.0 size=177631 2024-09-14T11:04:22.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.829+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=M9XP2JEUQ07R tag=1T7NZ7YOHGYR type=write size=1226207 2024-09-14T11:04:22.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.831+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=0PR6BO0RQ4PH type=del size=3380564 2024-09-14T11:04:22.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.832+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=ZXMA298JDU1L type=del 2024-09-14T11:04:22.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.834+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~OIUUBWCCJIGC.0 size=41573 2024-09-14T11:04:22.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.834+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=OIUUBWCCJIGC tag=SEIF7OA7OX7F type=write size=1090149 2024-09-14T11:04:22.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.835+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=F9ER0ASWDW2B type=del 2024-09-14T11:04:22.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.838+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~49S3QP3IOD8M.0 size=181204 2024-09-14T11:04:22.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.838+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=49S3QP3IOD8M tag=PGLD02UDTWPT type=write size=1229780 2024-09-14T11:04:22.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.840+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=1WRZDGP8KVTT type=del 2024-09-14T11:04:22.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.842+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ZKYP8CFFAZDY.0 size=750929 2024-09-14T11:04:22.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.842+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=ZKYP8CFFAZDY tag=YQKXV7GIMD7Q type=write size=1799505 2024-09-14T11:04:22.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.843+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=W9CIB7E1O01K type=del 2024-09-14T11:04:22.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.844+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=J281H5EZGL3I type=del size=3831143 2024-09-14T11:04:22.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.846+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~FS07X34HI74A.0 size=1048576 2024-09-14T11:04:22.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.847+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~FS07X34HI74A.1 size=30 2024-09-14T11:04:22.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.849+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=FS07X34HI74A tag=9KLSEHSQXS2G type=write size=2097182 2024-09-14T11:04:22.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.850+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=09YDIRU58F6R type=del size=758005 2024-09-14T11:04:22.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.851+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.0 size=1048576 2024-09-14T11:04:22.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.852+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.1 size=1048576 2024-09-14T11:04:22.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.853+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~5V3IJ4B3US2Y.2 size=394476 2024-09-14T11:04:22.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.855+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=5V3IJ4B3US2Y tag=G0QZXDD7C6OX type=write size=3540204 2024-09-14T11:04:22.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.856+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=CEA9NDJ9SHTV type=del size=3238668 2024-09-14T11:04:22.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.857+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=FACCOETDXUME type=del 2024-09-14T11:04:22.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.860+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.0 size=1048576 2024-09-14T11:04:22.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.861+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.1 size=1048576 2024-09-14T11:04:22.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.861+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.2 size=366295 2024-09-14T11:04:22.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.861+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=59ON84ZN36IO tag=MKR5JEGVZ4PI type=write size=3512023 2024-09-14T11:04:22.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.863+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~1RB5S0K3E8UT.0 size=1048576 2024-09-14T11:04:22.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.864+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~1RB5S0K3E8UT.1 size=223178 2024-09-14T11:04:22.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.866+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=1RB5S0K3E8UT tag=LZ2FCUUUH8YA type=write size=2320330 2024-09-14T11:04:22.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.867+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=0TVB9GN8X2WB type=del size=2045172 2024-09-14T11:04:22.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.869+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=OBZ7DEQA5EG7 type=del 2024-09-14T11:04:22.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.872+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.0 size=1048576 2024-09-14T11:04:22.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.873+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.1 size=1048576 2024-09-14T11:04:22.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.874+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.2 size=929636 2024-09-14T11:04:22.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.874+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=Y9UNEAPBYB7U tag=N0VGK6J4D31E type=write size=4075364 2024-09-14T11:04:22.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.875+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.0 size=1048576 2024-09-14T11:04:22.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.876+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.1 size=1048576 2024-09-14T11:04:22.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.877+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~9YKXZQJO6FJ6.2 size=104216 2024-09-14T11:04:22.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.879+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=9YKXZQJO6FJ6 tag=MGC3DC2WV0AW type=write size=3249944 2024-09-14T11:04:22.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.880+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=3UMV9GNJN5WB type=write size=933092 2024-09-14T11:04:22.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.881+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=UN02JU43JKA1 type=del 2024-09-14T11:04:22.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.883+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~467I1TS36A0Z.0 size=608682 2024-09-14T11:04:22.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.883+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=467I1TS36A0Z tag=Z5QP9OKYJD5E type=write size=1657258 2024-09-14T11:04:22.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.884+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=TCZ0BP12ONPV type=del 2024-09-14T11:04:22.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.886+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=UGRI5FAHMMLM type=write size=286707 2024-09-14T11:04:22.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.887+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=VNIVYSYE2C0O type=del 2024-09-14T11:04:22.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.889+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.0 size=1048576 2024-09-14T11:04:22.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.890+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.1 size=1048576 2024-09-14T11:04:22.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.891+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.2 size=289200 2024-09-14T11:04:22.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.891+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=GH1Z10TB4JBA tag=0ST7ALREKK25 type=write size=3434928 2024-09-14T11:04:22.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.893+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=F8WIJIC3AA61 type=del 2024-09-14T11:04:22.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.894+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=NI5VKX5VN0DM type=del size=89130 2024-09-14T11:04:22.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.896+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=V9DP0P7SPDY5 type=del size=2547445: (22) Invalid argument 2024-09-14T11:04:22.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.898+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.0 size=1048576 2024-09-14T11:04:22.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.899+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.1 size=1048576 2024-09-14T11:04:22.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.900+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.2 size=119599 2024-09-14T11:04:22.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.900+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=APJZ4HLFO4JQ tag=B0XM3ZQUNAJ2 type=write size=3265327 2024-09-14T11:04:22.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.901+0000 7f907bbdf780 -1 < failed to complete operation key=5MFLA6XFV3Y5 tag=0PR6BO0RQ4PH type=del size=3380564: (22) Invalid argument 2024-09-14T11:04:22.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.902+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=B0ZXBOT9XFTR type=del size=4087545 2024-09-14T11:04:22.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.904+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~OIUUBWCCJIGC.0 size=41573 2024-09-14T11:04:22.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.905+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=OIUUBWCCJIGC tag=SEIF7OA7OX7F type=write size=1090149 2024-09-14T11:04:22.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.908+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~ZPCVYV8IM387.0 size=1048576 2024-09-14T11:04:22.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.909+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~ZPCVYV8IM387.1 size=1048176 2024-09-14T11:04:22.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.909+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=ZPCVYV8IM387 tag=ON8EG7EFG619 type=write size=3145328 2024-09-14T11:04:22.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.909+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~49S3QP3IOD8M.0 size=181204 2024-09-14T11:04:22.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.911+0000 7f907bbdf780 1 < canceled multipart upload key=5MFLA6XFV3Y5 upload=49S3QP3IOD8M tag=PGLD02UDTWPT type=write size=1229780 2024-09-14T11:04:22.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.913+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~N0EBUQH51A2I.0 size=1048576 2024-09-14T11:04:22.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.914+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~N0EBUQH51A2I.1 size=581260 2024-09-14T11:04:22.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.914+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=N0EBUQH51A2I tag=YDULVIV0AK5O type=write size=2678412 2024-09-14T11:04:22.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.916+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ZKYP8CFFAZDY.0 size=750929 2024-09-14T11:04:22.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.918+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=ZKYP8CFFAZDY tag=YQKXV7GIMD7Q type=write size=1799505 2024-09-14T11:04:22.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.919+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=4GNCPIPZ7CB6 type=del size=3480939 2024-09-14T11:04:22.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.921+0000 7f907bbdf780 1 < suggested remove operation key=VRQ0ZNN9FG4C tag=J281H5EZGL3I type=del 2024-09-14T11:04:22.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.923+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=GK09UPEPG39U type=write size=968741 2024-09-14T11:04:22.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.925+0000 7f907bbdf780 1 < suggested remove operation key=8FRZW4YC3ATE tag=09YDIRU58F6R type=del 2024-09-14T11:04:22.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.927+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~XQSCZY8NKW6A.0 size=640066 2024-09-14T11:04:22.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.927+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=XQSCZY8NKW6A tag=SOIMDCUF1LO3 type=write size=1688642 2024-09-14T11:04:22.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.929+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=CEA9NDJ9SHTV type=del 2024-09-14T11:04:22.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.930+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=0L2IP2STLLUN type=del size=323669 2024-09-14T11:04:22.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.933+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.0 size=1048576 2024-09-14T11:04:22.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.934+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.1 size=1048576 2024-09-14T11:04:22.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.935+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~59ON84ZN36IO.2 size=366295 2024-09-14T11:04:22.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.937+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=59ON84ZN36IO tag=MKR5JEGVZ4PI type=write size=3512023 2024-09-14T11:04:22.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.939+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~ACXT9IJB9ZB4.0 size=484047 2024-09-14T11:04:22.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.939+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=ACXT9IJB9ZB4 tag=Y9J629GIBHI6 type=write size=1532623 2024-09-14T11:04:22.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.941+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=0TVB9GN8X2WB type=del 2024-09-14T11:04:22.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.942+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=6Y3NV65R549V type=write size=249846 2024-09-14T11:04:22.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.943+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.0 size=1048576 2024-09-14T11:04:22.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.944+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.1 size=1048576 2024-09-14T11:04:22.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.945+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~Y9UNEAPBYB7U.2 size=929636 2024-09-14T11:04:22.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.947+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=Y9UNEAPBYB7U tag=N0VGK6J4D31E type=write size=4075364 2024-09-14T11:04:22.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.949+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~J9YMKVI5QW1N.0 size=1048576 2024-09-14T11:04:22.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.950+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~J9YMKVI5QW1N.1 size=371178 2024-09-14T11:04:22.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.950+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=J9YMKVI5QW1N tag=4Z8HE3MVH7SI type=write size=2468330 2024-09-14T11:04:22.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.952+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=3UMV9GNJN5WB type=write size=933092 2024-09-14T11:04:22.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.953+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=YX4QB5FY1U3A type=del size=1524333 2024-09-14T11:04:22.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.954+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~467I1TS36A0Z.0 size=608682 2024-09-14T11:04:22.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.956+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=467I1TS36A0Z tag=Z5QP9OKYJD5E type=write size=1657258 2024-09-14T11:04:22.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.958+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~4UCJA0DT1U4D.0 size=161317 2024-09-14T11:04:22.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.958+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=4UCJA0DT1U4D tag=STBPMXZJMV34 type=write size=1209893 2024-09-14T11:04:22.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.959+0000 7f907bbdf780 1 < completed write operation key=E3OIUTR3JCQY tag=UGRI5FAHMMLM type=write size=286707 2024-09-14T11:04:22.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.960+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=V7TSVNWICAR1 type=del size=3685431 2024-09-14T11:04:22.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.961+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.0 size=1048576 2024-09-14T11:04:22.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.961+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.1 size=1048576 2024-09-14T11:04:22.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.962+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~GH1Z10TB4JBA.2 size=289200 2024-09-14T11:04:22.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.964+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=GH1Z10TB4JBA tag=0ST7ALREKK25 type=write size=3434928 2024-09-14T11:04:22.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.966+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=TZV0AQU1HB2M type=del size=240582 2024-09-14T11:04:22.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.968+0000 7f907bbdf780 1 < suggested update operation key=LJ720PV3SQ8L tag=NI5VKX5VN0DM type=del size=89130 2024-09-14T11:04:22.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.969+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=PUVEE3D9SIG4 type=del size=1037459 2024-09-14T11:04:22.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.969+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.0 size=1048576 2024-09-14T11:04:22.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.969+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.1 size=1048576 2024-09-14T11:04:22.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.970+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~APJZ4HLFO4JQ.2 size=119599 2024-09-14T11:04:22.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.972+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=APJZ4HLFO4JQ tag=B0XM3ZQUNAJ2 type=write size=3265327 2024-09-14T11:04:22.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.973+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=SBY7Q594T48L type=write size=810474 2024-09-14T11:04:22.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.974+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=B0ZXBOT9XFTR type=del 2024-09-14T11:04:22.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.976+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.0 size=1048576 2024-09-14T11:04:22.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.977+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.1 size=1048576 2024-09-14T11:04:22.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.978+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.2 size=455803 2024-09-14T11:04:22.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.978+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=P3GLS0WZQNTX tag=61RHWPIF0ZHC type=write size=3601531 2024-09-14T11:04:22.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.979+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~ZPCVYV8IM387.0 size=1048576 2024-09-14T11:04:22.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.980+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~ZPCVYV8IM387.1 size=1048176 2024-09-14T11:04:22.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.982+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=ZPCVYV8IM387 tag=ON8EG7EFG619 type=write size=3145328 2024-09-14T11:04:22.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.983+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=D7ZW8JKSQ7QM type=write size=982431 2024-09-14T11:04:22.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.983+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~N0EBUQH51A2I.0 size=1048576 2024-09-14T11:04:22.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.984+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~N0EBUQH51A2I.1 size=581260 2024-09-14T11:04:22.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.986+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=N0EBUQH51A2I tag=YDULVIV0AK5O type=write size=2678412 2024-09-14T11:04:22.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.989+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~ANRBEERYZ1SX.0 size=1048576 2024-09-14T11:04:22.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.990+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~ANRBEERYZ1SX.1 size=445738 2024-09-14T11:04:22.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.990+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=ANRBEERYZ1SX tag=NV1ZCBUMDF8B type=write size=2542890 2024-09-14T11:04:22.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.991+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=4GNCPIPZ7CB6 type=del 2024-09-14T11:04:22.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.992+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=3DXWPAUBGHCQ type=del size=1259220 2024-09-14T11:04:22.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.993+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=GK09UPEPG39U type=write size=968741 2024-09-14T11:04:22.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.994+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=DTV5Q04KE7GJ type=del size=2704617 2024-09-14T11:04:22.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.996+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~XQSCZY8NKW6A.0 size=640066 2024-09-14T11:04:22.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:22.997+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=XQSCZY8NKW6A tag=SOIMDCUF1LO3 type=write size=1688642 2024-09-14T11:04:22.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.000+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~M0YVKDHLSJV0.0 size=591845 2024-09-14T11:04:22.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.000+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=M0YVKDHLSJV0 tag=VA55QYLPFXD8 type=write size=1640421 2024-09-14T11:04:22.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.001+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=0L2IP2STLLUN type=del 2024-09-14T11:04:23.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.003+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~HJ1W9XQEH4H6.0 size=1048576 2024-09-14T11:04:23.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.004+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~HJ1W9XQEH4H6.1 size=545143 2024-09-14T11:04:23.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.004+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=HJ1W9XQEH4H6 tag=D3UV1TEQDD7A type=write size=2642295 2024-09-14T11:04:23.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.005+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~ACXT9IJB9ZB4.0 size=484047 2024-09-14T11:04:23.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.007+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=ACXT9IJB9ZB4 tag=Y9J629GIBHI6 type=write size=1532623 2024-09-14T11:04:23.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.009+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~8BZ8ZWHEYF7I.0 size=1048576 2024-09-14T11:04:23.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.010+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~8BZ8ZWHEYF7I.1 size=562098 2024-09-14T11:04:23.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.010+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=8BZ8ZWHEYF7I tag=GTVSE51KLE30 type=write size=2659250 2024-09-14T11:04:23.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.011+0000 7f907bbdf780 1 < canceled operation key=VRQ0ZNN9FG4C tag=6Y3NV65R549V type=write size=249846 2024-09-14T11:04:23.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.012+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=T196T7DHDKS3 type=del size=2374021 2024-09-14T11:04:23.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.013+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~J9YMKVI5QW1N.0 size=1048576 2024-09-14T11:04:23.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.014+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~J9YMKVI5QW1N.1 size=371178 2024-09-14T11:04:23.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.016+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=J9YMKVI5QW1N tag=4Z8HE3MVH7SI type=write size=2468330 2024-09-14T11:04:23.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.018+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~7Q10G43FNXA0.0 size=234937 2024-09-14T11:04:23.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.018+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=7Q10G43FNXA0 tag=GTGLPEKTDUB9 type=write size=1283513 2024-09-14T11:04:23.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.020+0000 7f907bbdf780 1 < suggested update operation key=5C8LLJF5MSVP tag=YX4QB5FY1U3A type=del size=1524333 2024-09-14T11:04:23.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.022+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~3O8MUWQGVDYK.0 size=1048576 2024-09-14T11:04:23.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.023+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~3O8MUWQGVDYK.1 size=451919 2024-09-14T11:04:23.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.023+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=3O8MUWQGVDYK tag=KWP8IPU5ZGJ9 type=write size=2549071 2024-09-14T11:04:23.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.024+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~4UCJA0DT1U4D.0 size=161317 2024-09-14T11:04:23.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.026+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=4UCJA0DT1U4D tag=STBPMXZJMV34 type=write size=1209893 2024-09-14T11:04:23.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.027+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=EN6ZJHQOAVVY type=del size=143299 2024-09-14T11:04:23.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.029+0000 7f907bbdf780 1 < canceled operation key=WZ064RU647Y7 tag=V7TSVNWICAR1 type=del size=3685431 2024-09-14T11:04:23.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.031+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.0 size=1048576 2024-09-14T11:04:23.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.032+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.1 size=1048576 2024-09-14T11:04:23.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.032+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.2 size=876565 2024-09-14T11:04:23.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.032+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=JZ5AC36UC27B tag=CQZZN1CBGV3I type=write size=4022293 2024-09-14T11:04:23.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.035+0000 7f907bbdf780 1 < suggested remove operation key=T79IR10S3HAB tag=TZV0AQU1HB2M type=del 2024-09-14T11:04:23.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.036+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=7DBZK2DC9GGX type=del size=2169438 2024-09-14T11:04:23.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.038+0000 7f907bbdf780 1 < suggested update operation key=VRQ0ZNN9FG4C tag=PUVEE3D9SIG4 type=del size=1037459 2024-09-14T11:04:23.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.041+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=XUQ4HIB603CI type=del size=3730848 2024-09-14T11:04:23.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.042+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=SBY7Q594T48L type=write size=810474 2024-09-14T11:04:23.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.044+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~9GPV18I4ZD22.0 size=145662 2024-09-14T11:04:23.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.044+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=9GPV18I4ZD22 tag=0FTTFY844I4C type=write size=1194238 2024-09-14T11:04:23.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.044+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.0 size=1048576 2024-09-14T11:04:23.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.045+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.1 size=1048576 2024-09-14T11:04:23.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.046+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~P3GLS0WZQNTX.2 size=455803 2024-09-14T11:04:23.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.048+0000 7f907bbdf780 1 < canceled multipart upload key=8NO5BA4HL03L upload=P3GLS0WZQNTX tag=61RHWPIF0ZHC type=write size=3601531 2024-09-14T11:04:23.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.050+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.0 size=1048576 2024-09-14T11:04:23.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.051+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.1 size=1048576 2024-09-14T11:04:23.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.052+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.2 size=132989 2024-09-14T11:04:23.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.052+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=29XEHQOKVBJ8 tag=0WPHWI9X6KD9 type=write size=3278717 2024-09-14T11:04:23.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.053+0000 7f907bbdf780 1 < completed write operation key=GC52N456IYD7 tag=D7ZW8JKSQ7QM type=write size=982431 2024-09-14T11:04:23.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.055+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.0 size=1048576 2024-09-14T11:04:23.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.056+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.1 size=1048576 2024-09-14T11:04:23.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.056+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.2 size=472944 2024-09-14T11:04:23.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.056+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=BJRDZ1CD4O2E tag=9DFXH3EWLXFR type=write size=3618672 2024-09-14T11:04:23.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.057+0000 7f907bbdf780 1 < canceled part key=_multipart_WAFH5BKM2P23.2~ANRBEERYZ1SX.0 size=1048576 2024-09-14T11:04:23.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.057+0000 7f907bbdf780 1 < canceled part key=_multipart_WAFH5BKM2P23.2~ANRBEERYZ1SX.1 size=445738 2024-09-14T11:04:23.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.059+0000 7f907bbdf780 1 < canceled multipart upload key=WAFH5BKM2P23 upload=ANRBEERYZ1SX tag=NV1ZCBUMDF8B type=write size=2542890 2024-09-14T11:04:23.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.060+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=IXSYWTVIJA7T type=write size=490922 2024-09-14T11:04:23.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.061+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=3DXWPAUBGHCQ type=del 2024-09-14T11:04:23.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.062+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=UMAMHHUF6ZBZ type=del size=2904887 2024-09-14T11:04:23.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.064+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=DTV5Q04KE7GJ type=del 2024-09-14T11:04:23.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.065+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=N7A701UONJV6 type=del size=2895661 2024-09-14T11:04:23.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.066+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~M0YVKDHLSJV0.0 size=591845 2024-09-14T11:04:23.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.068+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=M0YVKDHLSJV0 tag=VA55QYLPFXD8 type=write size=1640421 2024-09-14T11:04:23.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.071+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~Q91MOYX0B9DA.0 size=7888 2024-09-14T11:04:23.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.071+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=Q91MOYX0B9DA tag=CUD1DU2JSVPJ type=write size=1056464 2024-09-14T11:04:23.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.071+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~HJ1W9XQEH4H6.0 size=1048576 2024-09-14T11:04:23.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.072+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~HJ1W9XQEH4H6.1 size=545143 2024-09-14T11:04:23.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.074+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=HJ1W9XQEH4H6 tag=D3UV1TEQDD7A type=write size=2642295 2024-09-14T11:04:23.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.076+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.0 size=1048576 2024-09-14T11:04:23.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.077+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.1 size=1048576 2024-09-14T11:04:23.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.078+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.2 size=577297 2024-09-14T11:04:23.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.078+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=V9H1I63PGL3T tag=7NE8HTG0TTPC type=write size=3723025 2024-09-14T11:04:23.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.079+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~8BZ8ZWHEYF7I.0 size=1048576 2024-09-14T11:04:23.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.080+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~8BZ8ZWHEYF7I.1 size=562098 2024-09-14T11:04:23.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.082+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=8BZ8ZWHEYF7I tag=GTVSE51KLE30 type=write size=2659250 2024-09-14T11:04:23.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.083+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=NF1Y5BEBDLJG type=del size=74178 2024-09-14T11:04:23.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.085+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=T196T7DHDKS3 type=del 2024-09-14T11:04:23.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.087+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~APLHS30FKXY1.0 size=1048576 2024-09-14T11:04:23.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.088+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~APLHS30FKXY1.1 size=214270 2024-09-14T11:04:23.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.088+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=APLHS30FKXY1 tag=OU37KJMOMJVF type=write size=2311422 2024-09-14T11:04:23.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.088+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~7Q10G43FNXA0.0 size=234937 2024-09-14T11:04:23.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.090+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=7Q10G43FNXA0 tag=GTGLPEKTDUB9 type=write size=1283513 2024-09-14T11:04:23.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.091+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=DWLKHH0AY3QA type=del size=3836677 2024-09-14T11:04:23.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.092+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~3O8MUWQGVDYK.0 size=1048576 2024-09-14T11:04:23.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.093+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~3O8MUWQGVDYK.1 size=451919 2024-09-14T11:04:23.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.095+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=3O8MUWQGVDYK tag=KWP8IPU5ZGJ9 type=write size=2549071 2024-09-14T11:04:23.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.098+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.0 size=1048576 2024-09-14T11:04:23.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.098+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.1 size=1048576 2024-09-14T11:04:23.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.099+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.2 size=1003039 2024-09-14T11:04:23.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.099+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=0NPC20VY0FQS tag=07C37XE8QGDU type=write size=4148767 2024-09-14T11:04:23.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.101+0000 7f907bbdf780 1 < canceled operation key=6AWG2GM1ZP31 tag=EN6ZJHQOAVVY type=del size=143299 2024-09-14T11:04:23.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.102+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=EXFK6IEIBKCC type=del size=328535 2024-09-14T11:04:23.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.103+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.0 size=1048576 2024-09-14T11:04:23.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.104+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.1 size=1048576 2024-09-14T11:04:23.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.105+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~JZ5AC36UC27B.2 size=876565 2024-09-14T11:04:23.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.107+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=JZ5AC36UC27B tag=CQZZN1CBGV3I type=write size=4022293 2024-09-14T11:04:23.106 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.108+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=EWBY0U4YTI7C type=del size=3051572 2024-09-14T11:04:23.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.109+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=7DBZK2DC9GGX type=del size=2169438 2024-09-14T11:04:23.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.111+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=GA3ZQJEIEOJY type=write size=660449 2024-09-14T11:04:23.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.112+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=XUQ4HIB603CI type=del 2024-09-14T11:04:23.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.114+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~0CG9U3CQKED1.0 size=48294 2024-09-14T11:04:23.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.114+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=0CG9U3CQKED1 tag=0J64EAN1AYVT type=write size=1096870 2024-09-14T11:04:23.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.116+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~9GPV18I4ZD22.0 size=145662 2024-09-14T11:04:23.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.118+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=9GPV18I4ZD22 tag=0FTTFY844I4C type=write size=1194238 2024-09-14T11:04:23.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.119+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=V7RZVK06LBN5 type=del size=2037844 2024-09-14T11:04:23.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.121+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.0 size=1048576 2024-09-14T11:04:23.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.122+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.1 size=1048576 2024-09-14T11:04:23.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.123+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~29XEHQOKVBJ8.2 size=132989 2024-09-14T11:04:23.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.125+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=29XEHQOKVBJ8 tag=0WPHWI9X6KD9 type=write size=3278717 2024-09-14T11:04:23.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.127+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~XORXALC83UNS.0 size=1048576 2024-09-14T11:04:23.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.128+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~XORXALC83UNS.1 size=232285 2024-09-14T11:04:23.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.128+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=XORXALC83UNS tag=TU2B8MDAV0DA type=write size=2329437 2024-09-14T11:04:23.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.128+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.0 size=1048576 2024-09-14T11:04:23.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.129+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.1 size=1048576 2024-09-14T11:04:23.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.130+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~BJRDZ1CD4O2E.2 size=472944 2024-09-14T11:04:23.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.132+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=BJRDZ1CD4O2E tag=9DFXH3EWLXFR type=write size=3618672 2024-09-14T11:04:23.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.135+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~3EOJWBRH9ASU.0 size=148233 2024-09-14T11:04:23.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.135+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=3EOJWBRH9ASU tag=2K00AWZBX83F type=write size=1196809 2024-09-14T11:04:23.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.136+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=IXSYWTVIJA7T type=write size=490922 2024-09-14T11:04:23.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.137+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=I0ZMGJ3OBZNU type=del size=4002174 2024-09-14T11:04:23.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.138+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=UMAMHHUF6ZBZ type=del 2024-09-14T11:04:23.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.140+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=1ATEZQIYH8OR type=write size=473042 2024-09-14T11:04:23.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.141+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=N7A701UONJV6 type=del 2024-09-14T11:04:23.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.143+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~J3D7M39DGNHJ.0 size=1048576 2024-09-14T11:04:23.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.144+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~J3D7M39DGNHJ.1 size=784978 2024-09-14T11:04:23.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.144+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=J3D7M39DGNHJ tag=TSOHGUH83WOJ type=write size=2882130 2024-09-14T11:04:23.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.145+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~Q91MOYX0B9DA.0 size=7888 2024-09-14T11:04:23.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.148+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=Q91MOYX0B9DA tag=CUD1DU2JSVPJ type=write size=1056464 2024-09-14T11:04:23.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.149+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=U95SV4LRJHVM type=del size=3588299 2024-09-14T11:04:23.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.150+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.0 size=1048576 2024-09-14T11:04:23.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.153+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.1 size=1048576 2024-09-14T11:04:23.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.154+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~V9H1I63PGL3T.2 size=577297 2024-09-14T11:04:23.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.156+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=V9H1I63PGL3T tag=7NE8HTG0TTPC type=write size=3723025 2024-09-14T11:04:23.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.157+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=IKAPJLSFUY4I type=del size=932772 2024-09-14T11:04:23.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.158+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=NF1Y5BEBDLJG type=del 2024-09-14T11:04:23.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.159+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=QELNTAZB1901 type=del size=502848 2024-09-14T11:04:23.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.160+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~APLHS30FKXY1.0 size=1048576 2024-09-14T11:04:23.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.161+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~APLHS30FKXY1.1 size=214270 2024-09-14T11:04:23.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.163+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=APLHS30FKXY1 tag=OU37KJMOMJVF type=write size=2311422 2024-09-14T11:04:23.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.164+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=8XA54N4T5CR6 type=del size=3662752 2024-09-14T11:04:23.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.165+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=DWLKHH0AY3QA type=del 2024-09-14T11:04:23.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.166+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=KC3QER6CRDVG type=write size=743472 2024-09-14T11:04:23.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.167+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.0 size=1048576 2024-09-14T11:04:23.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.168+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.1 size=1048576 2024-09-14T11:04:23.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.169+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~0NPC20VY0FQS.2 size=1003039 2024-09-14T11:04:23.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.171+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=0NPC20VY0FQS tag=07C37XE8QGDU type=write size=4148767 2024-09-14T11:04:23.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.173+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=GHV7193V13GZ type=del size=1675330 2024-09-14T11:04:23.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.175+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=EXFK6IEIBKCC type=del size=328535 2024-09-14T11:04:23.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.176+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=LECK5RX7B21D type=del size=2810035 2024-09-14T11:04:23.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.179+0000 7f907bbdf780 1 < suggested update operation key=8NO5BA4HL03L tag=EWBY0U4YTI7C type=del size=3051572 2024-09-14T11:04:23.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.180+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=24ALGESNQI2G type=del size=95802 2024-09-14T11:04:23.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.182+0000 7f907bbdf780 1 < suggested update operation key=HM2GVOA72HHR tag=GA3ZQJEIEOJY type=write size=660449 2024-09-14T11:04:23.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.183+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=ZCT0FMWU02T0 type=del size=871506 2024-09-14T11:04:23.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.184+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~0CG9U3CQKED1.0 size=48294 2024-09-14T11:04:23.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.186+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=0CG9U3CQKED1 tag=0J64EAN1AYVT type=write size=1096870 2024-09-14T11:04:23.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.187+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=L4YXWYRP2HNA type=del size=2673949 2024-09-14T11:04:23.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.188+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=V7RZVK06LBN5 type=del 2024-09-14T11:04:23.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.191+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~VUCX0XR7W149.0 size=337546 2024-09-14T11:04:23.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.191+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=VUCX0XR7W149 tag=8IG86HX893IR type=write size=1386122 2024-09-14T11:04:23.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.192+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~XORXALC83UNS.0 size=1048576 2024-09-14T11:04:23.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.193+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~XORXALC83UNS.1 size=232285 2024-09-14T11:04:23.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.195+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=XORXALC83UNS tag=TU2B8MDAV0DA type=write size=2329437 2024-09-14T11:04:23.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.197+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~WQENLTAJ2GOY.0 size=1048576 2024-09-14T11:04:23.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.198+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~WQENLTAJ2GOY.1 size=305699 2024-09-14T11:04:23.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.198+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=WQENLTAJ2GOY tag=EVRRF41514W3 type=write size=2402851 2024-09-14T11:04:23.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.199+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~3EOJWBRH9ASU.0 size=148233 2024-09-14T11:04:23.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.201+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=3EOJWBRH9ASU tag=2K00AWZBX83F type=write size=1196809 2024-09-14T11:04:23.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.202+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=AUD0VFFZ3FV2 type=del size=3480995 2024-09-14T11:04:23.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.203+0000 7f907bbdf780 -1 < failed to complete operation key=8NO5BA4HL03L tag=I0ZMGJ3OBZNU type=del size=4002174: (22) Invalid argument 2024-09-14T11:04:23.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.205+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=IDFZTPB0AEF2 type=write size=186820 2024-09-14T11:04:23.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.207+0000 7f907bbdf780 1 < suggested update operation key=5MFLA6XFV3Y5 tag=1ATEZQIYH8OR type=write size=473042 2024-09-14T11:04:23.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.208+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=KSSYM8V2OMQA type=del size=3609164 2024-09-14T11:04:23.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.209+0000 7f907bbdf780 1 < canceled part key=_multipart_8NO5BA4HL03L.2~J3D7M39DGNHJ.0 size=1048576 2024-09-14T11:04:23.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.210+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~J3D7M39DGNHJ.1 size=784978 2024-09-14T11:04:23.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.211+0000 7f907bbdf780 1 < canceled multipart upload key=8NO5BA4HL03L upload=J3D7M39DGNHJ tag=TSOHGUH83WOJ type=write size=2882130 2024-09-14T11:04:23.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.214+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~O3B6A0L0018Y.0 size=1048576 2024-09-14T11:04:23.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.215+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~O3B6A0L0018Y.1 size=605054 2024-09-14T11:04:23.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.215+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=O3B6A0L0018Y tag=U2YNSHNYYHKS type=write size=2702206 2024-09-14T11:04:23.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.216+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=U95SV4LRJHVM type=del 2024-09-14T11:04:23.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.217+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=LFKCGZS30RVN type=del size=565501 2024-09-14T11:04:23.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.218+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=IKAPJLSFUY4I type=del 2024-09-14T11:04:23.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.219+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=H7VEYBTNYW3R type=del size=3795862 2024-09-14T11:04:23.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.221+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=QELNTAZB1901 type=del 2024-09-14T11:04:23.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.222+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=SEU89HET8PWU type=del size=274453 2024-09-14T11:04:23.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.223+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=8XA54N4T5CR6 type=del 2024-09-14T11:04:23.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.224+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=JN36T17HK6Z8 type=del size=1169203 2024-09-14T11:04:23.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.226+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=KC3QER6CRDVG type=write size=743472 2024-09-14T11:04:23.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.227+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=W5YJW951YP8U type=write size=1016309 2024-09-14T11:04:23.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.228+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=GHV7193V13GZ type=del 2024-09-14T11:04:23.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.230+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~7HTAOVFH1AGD.0 size=1048576 2024-09-14T11:04:23.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.231+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~7HTAOVFH1AGD.1 size=977598 2024-09-14T11:04:23.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.231+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=7HTAOVFH1AGD tag=M163W348T8OU type=write size=3074750 2024-09-14T11:04:23.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.232+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=LECK5RX7B21D type=del 2024-09-14T11:04:23.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.234+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=03ZHEXA1198B type=write size=458520 2024-09-14T11:04:23.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.235+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=24ALGESNQI2G type=del 2024-09-14T11:04:23.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.236+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=U2H3HDUIQFQV type=write size=905804 2024-09-14T11:04:23.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.237+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=ZCT0FMWU02T0 type=del 2024-09-14T11:04:23.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.239+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=2L5ZGH6PPQ0T type=del size=1511934 2024-09-14T11:04:23.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.240+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=L4YXWYRP2HNA type=del 2024-09-14T11:04:23.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.241+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=HJLH7D326IMJ type=del size=3348544 2024-09-14T11:04:23.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.243+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~VUCX0XR7W149.0 size=337546 2024-09-14T11:04:23.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.245+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=VUCX0XR7W149 tag=8IG86HX893IR type=write size=1386122 2024-09-14T11:04:23.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.246+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=JQV8SZJASTX3 type=write size=421613 2024-09-14T11:04:23.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.248+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~WQENLTAJ2GOY.0 size=1048576 2024-09-14T11:04:23.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.249+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~WQENLTAJ2GOY.1 size=305699 2024-09-14T11:04:23.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.251+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=WQENLTAJ2GOY tag=EVRRF41514W3 type=write size=2402851 2024-09-14T11:04:23.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.253+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=VXJOJEGTF947 type=del size=399358 2024-09-14T11:04:23.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.255+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=AUD0VFFZ3FV2 type=del size=3480995 2024-09-14T11:04:23.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.256+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=T2ICBWMMAKQI type=del size=1102306 2024-09-14T11:04:23.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.257+0000 7f907bbdf780 1 < completed write operation key=HM2GVOA72HHR tag=IDFZTPB0AEF2 type=write size=186820 2024-09-14T11:04:23.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.259+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=9WZYH0JSACKO type=write size=1024876 2024-09-14T11:04:23.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.260+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=KSSYM8V2OMQA type=del 2024-09-14T11:04:23.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.261+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=ZH1J6UIKFE27 type=del size=825711 2024-09-14T11:04:23.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.262+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~O3B6A0L0018Y.0 size=1048576 2024-09-14T11:04:23.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.263+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~O3B6A0L0018Y.1 size=605054 2024-09-14T11:04:23.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.265+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=O3B6A0L0018Y tag=U2YNSHNYYHKS type=write size=2702206 2024-09-14T11:04:23.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.268+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.0 size=1048576 2024-09-14T11:04:23.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.269+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.1 size=1048576 2024-09-14T11:04:23.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.270+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.2 size=680767 2024-09-14T11:04:23.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.270+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=F5TKIE3QHQV0 tag=JOXJH6VHCSQ0 type=write size=3826495 2024-09-14T11:04:23.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.273+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=LFKCGZS30RVN type=del 2024-09-14T11:04:23.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.275+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~AXHDL2EX53K0.0 size=257558 2024-09-14T11:04:23.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.275+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=AXHDL2EX53K0 tag=0AL6CRZFFHVJ type=write size=1306134 2024-09-14T11:04:23.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.276+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=H7VEYBTNYW3R type=del 2024-09-14T11:04:23.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.277+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=TOYWD79L3D1A type=del size=3165777 2024-09-14T11:04:23.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.278+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=SEU89HET8PWU type=del 2024-09-14T11:04:23.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.279+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=90HTTS16CVRV type=del size=2855461 2024-09-14T11:04:23.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.280+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=JN36T17HK6Z8 type=del 2024-09-14T11:04:23.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.282+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=8A3Z6E823YKR type=del size=1042582 2024-09-14T11:04:23.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.283+0000 7f907bbdf780 1 < completed write operation key=T81OF13I2JVH tag=W5YJW951YP8U type=write size=1016309 2024-09-14T11:04:23.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.285+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.0 size=1048576 2024-09-14T11:04:23.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.286+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.1 size=1048576 2024-09-14T11:04:23.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.287+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.2 size=684649 2024-09-14T11:04:23.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.287+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=KJ2CAG3WDW72 tag=4Z9WHC7ELO7S type=write size=3830377 2024-09-14T11:04:23.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.288+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~7HTAOVFH1AGD.0 size=1048576 2024-09-14T11:04:23.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.289+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~7HTAOVFH1AGD.1 size=977598 2024-09-14T11:04:23.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.291+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=7HTAOVFH1AGD tag=M163W348T8OU type=write size=3074750 2024-09-14T11:04:23.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.292+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=GX5SP3OECB9A type=del size=2804598 2024-09-14T11:04:23.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.293+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=03ZHEXA1198B type=write size=458520 2024-09-14T11:04:23.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.295+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=O2HD5VHEEMET type=del size=411712 2024-09-14T11:04:23.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.296+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=U2H3HDUIQFQV type=write size=905804 2024-09-14T11:04:23.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.297+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=Y3B428ATRYYV type=del size=3581314 2024-09-14T11:04:23.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.298+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=2L5ZGH6PPQ0T type=del 2024-09-14T11:04:23.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.299+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=CRR9B0YPBJRN type=del size=1320723 2024-09-14T11:04:23.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.300+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=HJLH7D326IMJ type=del 2024-09-14T11:04:23.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.302+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=0FOSKZ0IUBW0 type=write size=148267 2024-09-14T11:04:23.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.303+0000 7f907bbdf780 1 < completed write operation key=8FRZW4YC3ATE tag=JQV8SZJASTX3 type=write size=421613 2024-09-14T11:04:23.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.305+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~RL215W4ODHPN.0 size=920720 2024-09-14T11:04:23.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.305+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=RL215W4ODHPN tag=X5B3UF5BZXTH type=write size=1969296 2024-09-14T11:04:23.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.306+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=VXJOJEGTF947 type=del 2024-09-14T11:04:23.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.307+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=9116ZXI0KMCT type=del size=697831 2024-09-14T11:04:23.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.308+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=T2ICBWMMAKQI type=del 2024-09-14T11:04:23.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.309+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=WQY6RVKYK9ZU type=del size=2461587 2024-09-14T11:04:23.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.311+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=9WZYH0JSACKO type=write size=1024876 2024-09-14T11:04:23.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.312+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=G2LSMK0WPA9T type=write size=129945 2024-09-14T11:04:23.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.313+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=ZH1J6UIKFE27 type=del 2024-09-14T11:04:23.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.314+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=Y39QXCTYARK7 type=del size=1478566 2024-09-14T11:04:23.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.315+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.0 size=1048576 2024-09-14T11:04:23.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.316+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.1 size=1048576 2024-09-14T11:04:23.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.316+0000 7f907bbdf780 1 < canceled part key=_multipart_WAFH5BKM2P23.2~F5TKIE3QHQV0.2 size=680767 2024-09-14T11:04:23.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.318+0000 7f907bbdf780 1 < canceled multipart upload key=WAFH5BKM2P23 upload=F5TKIE3QHQV0 tag=JOXJH6VHCSQ0 type=write size=3826495 2024-09-14T11:04:23.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.320+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~3TA0ANVELZB6.0 size=662947 2024-09-14T11:04:23.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.320+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=3TA0ANVELZB6 tag=2H6T4LDPHQ0D type=write size=1711523 2024-09-14T11:04:23.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.322+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~AXHDL2EX53K0.0 size=257558 2024-09-14T11:04:23.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.324+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=AXHDL2EX53K0 tag=0AL6CRZFFHVJ type=write size=1306134 2024-09-14T11:04:23.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.325+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=X6S6XM5VT3OA type=del size=2781361 2024-09-14T11:04:23.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.326+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=TOYWD79L3D1A type=del 2024-09-14T11:04:23.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.327+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=XKX99NW2F320 type=del size=3898701 2024-09-14T11:04:23.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.328+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=90HTTS16CVRV type=del 2024-09-14T11:04:23.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.329+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=NZUGHO9TOSKL type=write size=242540 2024-09-14T11:04:23.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.331+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=8A3Z6E823YKR type=del 2024-09-14T11:04:23.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.332+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=ECKHI4318GY3 type=write size=333421 2024-09-14T11:04:23.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.333+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.0 size=1048576 2024-09-14T11:04:23.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.334+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.1 size=1048576 2024-09-14T11:04:23.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.335+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~KJ2CAG3WDW72.2 size=684649 2024-09-14T11:04:23.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.337+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=KJ2CAG3WDW72 tag=4Z9WHC7ELO7S type=write size=3830377 2024-09-14T11:04:23.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.339+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.0 size=1048576 2024-09-14T11:04:23.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.340+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.1 size=1048576 2024-09-14T11:04:23.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.341+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.2 size=742297 2024-09-14T11:04:23.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.341+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=59311XL7MW51 tag=6G6HSF5XZAOW type=write size=3888025 2024-09-14T11:04:23.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.344+0000 7f907bbdf780 1 < suggested remove operation key=59WHXDR0S8DM tag=GX5SP3OECB9A type=del 2024-09-14T11:04:23.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.346+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.0 size=1048576 2024-09-14T11:04:23.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.347+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.1 size=1048576 2024-09-14T11:04:23.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.348+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.2 size=44832 2024-09-14T11:04:23.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.348+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=TBCHQGN5DZ7E tag=48LEES425EJO type=write size=3190560 2024-09-14T11:04:23.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.349+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=O2HD5VHEEMET type=del 2024-09-14T11:04:23.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.351+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~O4WFTDFSTPIG.0 size=926970 2024-09-14T11:04:23.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.351+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=O4WFTDFSTPIG tag=HW0ZB2M09IJ3 type=write size=1975546 2024-09-14T11:04:23.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.353+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=Y3B428ATRYYV type=del 2024-09-14T11:04:23.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.355+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DW8ZQ8D2O1FF.0 size=348353 2024-09-14T11:04:23.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.355+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=DW8ZQ8D2O1FF tag=JQQTXV9QKEH3 type=write size=1396929 2024-09-14T11:04:23.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.356+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=CRR9B0YPBJRN type=del 2024-09-14T11:04:23.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.357+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=7V667DT5SL7G type=del size=744077 2024-09-14T11:04:23.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.359+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=0FOSKZ0IUBW0 type=write size=148267 2024-09-14T11:04:23.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.361+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~OBCIXB4EYUVT.0 size=773320 2024-09-14T11:04:23.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.361+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=OBCIXB4EYUVT tag=P1PHH4JHZZMW type=write size=1821896 2024-09-14T11:04:23.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.362+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~RL215W4ODHPN.0 size=920720 2024-09-14T11:04:23.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.364+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=RL215W4ODHPN tag=X5B3UF5BZXTH type=write size=1969296 2024-09-14T11:04:23.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.365+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=26MDKI3EFN4S type=del size=2177540 2024-09-14T11:04:23.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.366+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=9116ZXI0KMCT type=del 2024-09-14T11:04:23.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.369+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~L66IBM30VENO.0 size=1048576 2024-09-14T11:04:23.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.370+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~L66IBM30VENO.1 size=489369 2024-09-14T11:04:23.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.370+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=L66IBM30VENO tag=GIMR8LVRG0HN type=write size=2586521 2024-09-14T11:04:23.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.372+0000 7f907bbdf780 1 < suggested remove operation key=KQBX4UP53FV1 tag=WQY6RVKYK9ZU type=del 2024-09-14T11:04:23.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.373+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=8EKGNEIF6I5O type=del size=2773950 2024-09-14T11:04:23.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.374+0000 7f907bbdf780 1 < completed write operation key=P546JCSFB00N tag=G2LSMK0WPA9T type=write size=129945 2024-09-14T11:04:23.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.375+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=UQ95OCDEXEE8 type=del size=3938041 2024-09-14T11:04:23.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.377+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=Y39QXCTYARK7 type=del 2024-09-14T11:04:23.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.379+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~SIGV4JIZ96TD.0 size=1048576 2024-09-14T11:04:23.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.381+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~SIGV4JIZ96TD.1 size=260159 2024-09-14T11:04:23.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.381+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=SIGV4JIZ96TD tag=T9QRRQ5YCYGD type=write size=2357311 2024-09-14T11:04:23.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.383+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~3TA0ANVELZB6.0 size=662947 2024-09-14T11:04:23.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.384+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=3TA0ANVELZB6 tag=2H6T4LDPHQ0D type=write size=1711523 2024-09-14T11:04:23.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.386+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=YPHPO7P4J9ZZ type=del size=2844053 2024-09-14T11:04:23.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.388+0000 7f907bbdf780 1 < suggested update operation key=GC52N456IYD7 tag=X6S6XM5VT3OA type=del size=2781361 2024-09-14T11:04:23.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.390+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.0 size=1048576 2024-09-14T11:04:23.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.391+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.1 size=1048576 2024-09-14T11:04:23.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.392+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.2 size=438975 2024-09-14T11:04:23.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.392+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=N77STIXYQF7K tag=S0JZWHJQMHTV type=write size=3584703 2024-09-14T11:04:23.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.394+0000 7f907bbdf780 1 < suggested remove operation key=Y3KOCA4072NM tag=XKX99NW2F320 type=del 2024-09-14T11:04:23.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.395+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=R32N5D65WKQA type=del size=2766741 2024-09-14T11:04:23.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.397+0000 7f907bbdf780 1 < completed write operation key=5MFLA6XFV3Y5 tag=NZUGHO9TOSKL type=write size=242540 2024-09-14T11:04:23.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.399+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~5QRFY5FU529J.0 size=1048576 2024-09-14T11:04:23.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.400+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~5QRFY5FU529J.1 size=880212 2024-09-14T11:04:23.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.400+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=5QRFY5FU529J tag=YRSG1FGLZNAO type=write size=2977364 2024-09-14T11:04:23.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.402+0000 7f907bbdf780 1 < suggested remove operation key=WAFH5BKM2P23 tag=ECKHI4318GY3 type=write 2024-09-14T11:04:23.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.404+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~XR1WAHI3VDFD.0 size=1048576 2024-09-14T11:04:23.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.405+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~XR1WAHI3VDFD.1 size=162558 2024-09-14T11:04:23.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.405+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=XR1WAHI3VDFD tag=FTFPFO92P1A0 type=write size=2259710 2024-09-14T11:04:23.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.406+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.0 size=1048576 2024-09-14T11:04:23.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.407+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.1 size=1048576 2024-09-14T11:04:23.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.408+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~59311XL7MW51.2 size=742297 2024-09-14T11:04:23.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.410+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=59311XL7MW51 tag=6G6HSF5XZAOW type=write size=3888025 2024-09-14T11:04:23.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.411+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=KTA1ESTV7YVF type=del size=3890306 2024-09-14T11:04:23.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.413+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.0 size=1048576 2024-09-14T11:04:23.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.414+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.1 size=1048576 2024-09-14T11:04:23.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.415+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~TBCHQGN5DZ7E.2 size=44832 2024-09-14T11:04:23.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.417+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=TBCHQGN5DZ7E tag=48LEES425EJO type=write size=3190560 2024-09-14T11:04:23.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.419+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=YQBEV9BUQQ9V type=del size=3930801 2024-09-14T11:04:23.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.420+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~O4WFTDFSTPIG.0 size=926970 2024-09-14T11:04:23.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.422+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=O4WFTDFSTPIG tag=HW0ZB2M09IJ3 type=write size=1975546 2024-09-14T11:04:23.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.423+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=4MCNPWX3DGOH type=del size=1576231 2024-09-14T11:04:23.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.425+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DW8ZQ8D2O1FF.0 size=348353 2024-09-14T11:04:23.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.427+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=DW8ZQ8D2O1FF tag=JQQTXV9QKEH3 type=write size=1396929 2024-09-14T11:04:23.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.428+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=52IG0DW7YBUA type=del size=3271390 2024-09-14T11:04:23.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.431+0000 7f907bbdf780 1 < suggested update operation key=AGMKZ7PGPUAM tag=7V667DT5SL7G type=del size=744077 2024-09-14T11:04:23.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.433+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~2KUEXF3WX6LX.0 size=1048576 2024-09-14T11:04:23.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.434+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~2KUEXF3WX6LX.1 size=367816 2024-09-14T11:04:23.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.434+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=2KUEXF3WX6LX tag=J26WQHNM6K0S type=write size=2464968 2024-09-14T11:04:23.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.434+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~OBCIXB4EYUVT.0 size=773320 2024-09-14T11:04:23.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.436+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=OBCIXB4EYUVT tag=P1PHH4JHZZMW type=write size=1821896 2024-09-14T11:04:23.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.437+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=JMDTFB10C56E type=del size=2751370 2024-09-14T11:04:23.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.438+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=26MDKI3EFN4S type=del 2024-09-14T11:04:23.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.440+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=2B313S1XFT3U type=write size=160248 2024-09-14T11:04:23.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.441+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~L66IBM30VENO.0 size=1048576 2024-09-14T11:04:23.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.442+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~L66IBM30VENO.1 size=489369 2024-09-14T11:04:23.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.444+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=L66IBM30VENO tag=GIMR8LVRG0HN type=write size=2586521 2024-09-14T11:04:23.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.445+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=6DZR08LVZ16Y type=del size=3632958 2024-09-14T11:04:23.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.448+0000 7f907bbdf780 1 < suggested update operation key=T81OF13I2JVH tag=8EKGNEIF6I5O type=del size=2773950 2024-09-14T11:04:23.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.449+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=E4I1W87ZJPM0 type=del size=1654259 2024-09-14T11:04:23.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.450+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=UQ95OCDEXEE8 type=del 2024-09-14T11:04:23.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.452+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=BWSZ9RPI7SIQ type=write size=593448 2024-09-14T11:04:23.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.453+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~SIGV4JIZ96TD.0 size=1048576 2024-09-14T11:04:23.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.454+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~SIGV4JIZ96TD.1 size=260159 2024-09-14T11:04:23.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.456+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=SIGV4JIZ96TD tag=T9QRRQ5YCYGD type=write size=2357311 2024-09-14T11:04:23.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.458+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~2NVEKKCCAOXC.0 size=896471 2024-09-14T11:04:23.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.458+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=2NVEKKCCAOXC tag=MGX1D3LYWTLV type=write size=1945047 2024-09-14T11:04:23.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.460+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=YPHPO7P4J9ZZ type=del 2024-09-14T11:04:23.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.461+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=WKKKUHL0FYGA type=del size=3933860 2024-09-14T11:04:23.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.462+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.0 size=1048576 2024-09-14T11:04:23.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.463+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.1 size=1048576 2024-09-14T11:04:23.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.464+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~N77STIXYQF7K.2 size=438975 2024-09-14T11:04:23.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.466+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=N77STIXYQF7K tag=S0JZWHJQMHTV type=write size=3584703 2024-09-14T11:04:23.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.468+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.0 size=1048576 2024-09-14T11:04:23.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.469+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.1 size=1048576 2024-09-14T11:04:23.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.470+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.2 size=491414 2024-09-14T11:04:23.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.470+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=QXV9WGKOKO29 tag=8XQV9CPV58PY type=write size=3637142 2024-09-14T11:04:23.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.472+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=R32N5D65WKQA type=del 2024-09-14T11:04:23.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.474+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~F83CU3UR2BEO.0 size=1048576 2024-09-14T11:04:23.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.475+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~F83CU3UR2BEO.1 size=396512 2024-09-14T11:04:23.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.475+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=F83CU3UR2BEO tag=IIYNRQ1UNCR3 type=write size=2493664 2024-09-14T11:04:23.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.476+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~5QRFY5FU529J.0 size=1048576 2024-09-14T11:04:23.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.477+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~5QRFY5FU529J.1 size=880212 2024-09-14T11:04:23.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.479+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=5QRFY5FU529J tag=YRSG1FGLZNAO type=write size=2977364 2024-09-14T11:04:23.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.480+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=R0PXDOJEB5SJ type=del size=3299817 2024-09-14T11:04:23.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.481+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~XR1WAHI3VDFD.0 size=1048576 2024-09-14T11:04:23.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.482+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~XR1WAHI3VDFD.1 size=162558 2024-09-14T11:04:23.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.484+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=XR1WAHI3VDFD tag=FTFPFO92P1A0 type=write size=2259710 2024-09-14T11:04:23.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.485+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=9ZUNATG2ICUD type=del size=1765616 2024-09-14T11:04:23.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.488+0000 7f907bbdf780 1 < suggested update operation key=YH0YMRDQERBF tag=KTA1ESTV7YVF type=del size=3890306 2024-09-14T11:04:23.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.489+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=PRNE554L8Z5W type=del size=2199694 2024-09-14T11:04:23.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.492+0000 7f907bbdf780 1 < suggested update operation key=91RL2KD0XCSI tag=YQBEV9BUQQ9V type=del size=3930801 2024-09-14T11:04:23.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.495+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~TAH19AZCGS1U.0 size=397400 2024-09-14T11:04:23.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.495+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=TAH19AZCGS1U tag=RK4VFS8JEDVG type=write size=1445976 2024-09-14T11:04:23.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.496+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=4MCNPWX3DGOH type=del 2024-09-14T11:04:23.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.497+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=8G1KPY58PT6N type=write size=173819 2024-09-14T11:04:23.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.499+0000 7f907bbdf780 1 < suggested update operation key=P0701O36E1JI tag=52IG0DW7YBUA type=del size=3271390 2024-09-14T11:04:23.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.500+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=5JCSD5LOIAHX type=del size=2657168 2024-09-14T11:04:23.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.502+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~2KUEXF3WX6LX.0 size=1048576 2024-09-14T11:04:23.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.503+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~2KUEXF3WX6LX.1 size=367816 2024-09-14T11:04:23.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.505+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=2KUEXF3WX6LX tag=J26WQHNM6K0S type=write size=2464968 2024-09-14T11:04:23.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.507+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~IGRG27K4FLT7.0 size=1048576 2024-09-14T11:04:23.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.508+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~IGRG27K4FLT7.1 size=561058 2024-09-14T11:04:23.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.508+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=IGRG27K4FLT7 tag=4RJQINOTG0F2 type=write size=2658210 2024-09-14T11:04:23.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.509+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=JMDTFB10C56E type=del 2024-09-14T11:04:23.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.510+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=I9ZNWGFCIMJR type=del size=1944772 2024-09-14T11:04:23.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.511+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=2B313S1XFT3U type=write size=160248 2024-09-14T11:04:23.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.513+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~WDFJ88RCWG3L.0 size=716493 2024-09-14T11:04:23.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.513+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=WDFJ88RCWG3L tag=2AR9H888HYK6 type=write size=1765069 2024-09-14T11:04:23.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.515+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=6DZR08LVZ16Y type=del 2024-09-14T11:04:23.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.516+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=TPBZRI6JE55R type=del size=3566385 2024-09-14T11:04:23.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.517+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=E4I1W87ZJPM0 type=del 2024-09-14T11:04:23.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.520+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ZQ32VLKQ3QSC.0 size=1048576 2024-09-14T11:04:23.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.521+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~ZQ32VLKQ3QSC.1 size=178344 2024-09-14T11:04:23.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.521+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=ZQ32VLKQ3QSC tag=ENRP6ZJR3BVQ type=write size=2275496 2024-09-14T11:04:23.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.522+0000 7f907bbdf780 1 < completed write operation key=ZFF333CYOK5P tag=BWSZ9RPI7SIQ type=write size=593448 2024-09-14T11:04:23.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.523+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=BJWTNJ3TCZA7 type=del size=1389256 2024-09-14T11:04:23.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.524+0000 7f907bbdf780 1 < canceled part key=_multipart_77H37YF6MJEO.2~2NVEKKCCAOXC.0 size=896471 2024-09-14T11:04:23.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.526+0000 7f907bbdf780 1 < canceled multipart upload key=77H37YF6MJEO upload=2NVEKKCCAOXC tag=MGX1D3LYWTLV type=write size=1945047 2024-09-14T11:04:23.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.527+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=QJ71HZ1VOIY8 type=write size=386697 2024-09-14T11:04:23.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.528+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=WKKKUHL0FYGA type=del 2024-09-14T11:04:23.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.530+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=XLNDIWFC5YME type=del size=974765 2024-09-14T11:04:23.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.531+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.0 size=1048576 2024-09-14T11:04:23.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.532+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.1 size=1048576 2024-09-14T11:04:23.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.533+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QXV9WGKOKO29.2 size=491414 2024-09-14T11:04:23.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.535+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=QXV9WGKOKO29 tag=8XQV9CPV58PY type=write size=3637142 2024-09-14T11:04:23.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.536+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=Z1JRV13ONZ8I type=write size=632577 2024-09-14T11:04:23.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.537+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~F83CU3UR2BEO.0 size=1048576 2024-09-14T11:04:23.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.538+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~F83CU3UR2BEO.1 size=396512 2024-09-14T11:04:23.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.540+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=F83CU3UR2BEO tag=IIYNRQ1UNCR3 type=write size=2493664 2024-09-14T11:04:23.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.541+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=O730P1LMN8L9 type=del size=96824 2024-09-14T11:04:23.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.544+0000 7f907bbdf780 1 < suggested remove operation key=59WHXDR0S8DM tag=R0PXDOJEB5SJ type=del 2024-09-14T11:04:23.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.545+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=8C4DR17DTYU4 type=del size=3274552 2024-09-14T11:04:23.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.546+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=9ZUNATG2ICUD type=del 2024-09-14T11:04:23.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.548+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~CK1UOTBE9QW8.0 size=959296 2024-09-14T11:04:23.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.548+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=CK1UOTBE9QW8 tag=3Z8LGABAEQO7 type=write size=2007872 2024-09-14T11:04:23.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.549+0000 7f907bbdf780 1 < canceled operation key=5C8LLJF5MSVP tag=PRNE554L8Z5W type=del size=2199694 2024-09-14T11:04:23.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.551+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=7754Q2PN4JB5 type=del size=3555212 2024-09-14T11:04:23.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.552+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~TAH19AZCGS1U.0 size=397400 2024-09-14T11:04:23.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.554+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=TAH19AZCGS1U tag=RK4VFS8JEDVG type=write size=1445976 2024-09-14T11:04:23.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.556+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~IKRUWT3QXXE0.0 size=1048576 2024-09-14T11:04:23.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.556+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~IKRUWT3QXXE0.1 size=258311 2024-09-14T11:04:23.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.556+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=IKRUWT3QXXE0 tag=F4CKG76M3H66 type=write size=2355463 2024-09-14T11:04:23.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.559+0000 7f907bbdf780 1 < suggested update operation key=YH0YMRDQERBF tag=8G1KPY58PT6N type=write size=173819 2024-09-14T11:04:23.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.560+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=O5N1OBET5WIE type=del size=1972461 2024-09-14T11:04:23.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.561+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=5JCSD5LOIAHX type=del 2024-09-14T11:04:23.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.562+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=10D2LK5G9W2C type=del size=572048 2024-09-14T11:04:23.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.563+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~IGRG27K4FLT7.0 size=1048576 2024-09-14T11:04:23.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.563+0000 7f907bbdf780 1 < canceled part key=_multipart_5C8LLJF5MSVP.2~IGRG27K4FLT7.1 size=561058 2024-09-14T11:04:23.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.565+0000 7f907bbdf780 1 < canceled multipart upload key=5C8LLJF5MSVP upload=IGRG27K4FLT7 tag=4RJQINOTG0F2 type=write size=2658210 2024-09-14T11:04:23.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.567+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~3PSMFPNYP00U.0 size=847169 2024-09-14T11:04:23.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.567+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=3PSMFPNYP00U tag=Y7NR9E9J18XQ type=write size=1895745 2024-09-14T11:04:23.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.568+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=I9ZNWGFCIMJR type=del 2024-09-14T11:04:23.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.569+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=VLZJQ9BB3WAT type=del size=2073204 2024-09-14T11:04:23.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.571+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~WDFJ88RCWG3L.0 size=716493 2024-09-14T11:04:23.571 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.573+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=WDFJ88RCWG3L tag=2AR9H888HYK6 type=write size=1765069 2024-09-14T11:04:23.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.574+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=V02BHM4U8KY8 type=del size=1624932 2024-09-14T11:04:23.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.575+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=TPBZRI6JE55R type=del 2024-09-14T11:04:23.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.576+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=7IROZWEVQ4UK type=write size=129636 2024-09-14T11:04:23.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.578+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ZQ32VLKQ3QSC.0 size=1048576 2024-09-14T11:04:23.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.578+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~ZQ32VLKQ3QSC.1 size=178344 2024-09-14T11:04:23.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.580+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=ZQ32VLKQ3QSC tag=ENRP6ZJR3BVQ type=write size=2275496 2024-09-14T11:04:23.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.583+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.0 size=1048576 2024-09-14T11:04:23.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.584+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.1 size=1048576 2024-09-14T11:04:23.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.584+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.2 size=470727 2024-09-14T11:04:23.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.584+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=O9CTEMT9SQWH tag=YK1VTYVEJX47 type=write size=3616455 2024-09-14T11:04:23.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.587+0000 7f907bbdf780 1 < suggested update operation key=KQBX4UP53FV1 tag=BJWTNJ3TCZA7 type=del size=1389256 2024-09-14T11:04:23.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.588+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=7HEQ80V4KVD1 type=del size=2576019 2024-09-14T11:04:23.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.590+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=QJ71HZ1VOIY8 type=write 2024-09-14T11:04:23.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.592+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.0 size=1048576 2024-09-14T11:04:23.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.593+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.1 size=1048576 2024-09-14T11:04:23.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.594+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.2 size=800665 2024-09-14T11:04:23.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.594+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=4C4SOQWX7ZU9 tag=BUQ9SLMJPK6F type=write size=3946393 2024-09-14T11:04:23.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.595+0000 7f907bbdf780 -1 < failed to complete operation key=59WHXDR0S8DM tag=XLNDIWFC5YME type=del size=974765: (22) Invalid argument 2024-09-14T11:04:23.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.597+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=C33PQ8QIV96V type=del size=223026 2024-09-14T11:04:23.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.598+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=Z1JRV13ONZ8I type=write size=632577 2024-09-14T11:04:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.600+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~ABOWF8PHYLSL.0 size=982386 2024-09-14T11:04:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.600+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=ABOWF8PHYLSL tag=ATFVGI16DJVF type=write size=2030962 2024-09-14T11:04:23.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.601+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=O730P1LMN8L9 type=del 2024-09-14T11:04:23.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.602+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=G6WMVSYC8QZ2 type=del size=2721110 2024-09-14T11:04:23.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.603+0000 7f907bbdf780 -1 < failed to complete operation key=5MFLA6XFV3Y5 tag=8C4DR17DTYU4 type=del size=3274552: (22) Invalid argument 2024-09-14T11:04:23.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.605+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=9Z6UT5M8LOTN type=del size=518152 2024-09-14T11:04:23.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.607+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~CK1UOTBE9QW8.0 size=959296 2024-09-14T11:04:23.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.609+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=CK1UOTBE9QW8 tag=3Z8LGABAEQO7 type=write size=2007872 2024-09-14T11:04:23.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.610+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=JC8VL2T3A9KJ type=del size=4062207 2024-09-14T11:04:23.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.611+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=7754Q2PN4JB5 type=del 2024-09-14T11:04:23.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.612+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=63NIC8FBJPMS type=del size=371478 2024-09-14T11:04:23.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.614+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~IKRUWT3QXXE0.0 size=1048576 2024-09-14T11:04:23.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.615+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~IKRUWT3QXXE0.1 size=258311 2024-09-14T11:04:23.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.617+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=IKRUWT3QXXE0 tag=F4CKG76M3H66 type=write size=2355463 2024-09-14T11:04:23.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.620+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.0 size=1048576 2024-09-14T11:04:23.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.621+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.1 size=1048576 2024-09-14T11:04:23.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.621+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.2 size=70632 2024-09-14T11:04:23.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.621+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=FI4FWSQXJ22P tag=1348IRFQYYBP type=write size=3216360 2024-09-14T11:04:23.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.624+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=O5N1OBET5WIE type=del size=1972461 2024-09-14T11:04:23.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.625+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=WDT4R3TVFDWX type=del size=3962758 2024-09-14T11:04:23.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.627+0000 7f907bbdf780 1 < suggested update operation key=8C398XZ7XKU7 tag=10D2LK5G9W2C type=del size=572048 2024-09-14T11:04:23.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.629+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=O0LWIG9O62V0 type=del size=25642 2024-09-14T11:04:23.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.630+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~3PSMFPNYP00U.0 size=847169 2024-09-14T11:04:23.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.632+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=3PSMFPNYP00U tag=Y7NR9E9J18XQ type=write size=1895745 2024-09-14T11:04:23.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.633+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=A0VRECJPKAEU type=del size=1839143 2024-09-14T11:04:23.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.635+0000 7f907bbdf780 1 < suggested remove operation key=KQBX4UP53FV1 tag=VLZJQ9BB3WAT type=del 2024-09-14T11:04:23.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.637+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=XJ3BFOTEWDOU type=del size=1941812 2024-09-14T11:04:23.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.638+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=V02BHM4U8KY8 type=del 2024-09-14T11:04:23.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.639+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=PBFQDIPR5OOG type=write size=938506 2024-09-14T11:04:23.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.640+0000 7f907bbdf780 1 < completed write operation key=E3OIUTR3JCQY tag=7IROZWEVQ4UK type=write size=129636 2024-09-14T11:04:23.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.641+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=FG8F70ZXYXN9 type=write size=311620 2024-09-14T11:04:23.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.643+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.0 size=1048576 2024-09-14T11:04:23.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.644+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.1 size=1048576 2024-09-14T11:04:23.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.645+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~O9CTEMT9SQWH.2 size=470727 2024-09-14T11:04:23.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.647+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=O9CTEMT9SQWH tag=YK1VTYVEJX47 type=write size=3616455 2024-09-14T11:04:23.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.648+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=46XP3PM1E08G type=del size=472658 2024-09-14T11:04:23.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.650+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=7HEQ80V4KVD1 type=del 2024-09-14T11:04:23.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.651+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=V6996I99RTAM type=del size=2097254 2024-09-14T11:04:23.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.653+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.0 size=1048576 2024-09-14T11:04:23.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.654+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.1 size=1048576 2024-09-14T11:04:23.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.655+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~4C4SOQWX7ZU9.2 size=800665 2024-09-14T11:04:23.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.657+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=4C4SOQWX7ZU9 tag=BUQ9SLMJPK6F type=write size=3946393 2024-09-14T11:04:23.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.659+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~6YQXHRSBZHR8.0 size=664371 2024-09-14T11:04:23.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.659+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=6YQXHRSBZHR8 tag=2VMCBESGI5DP type=write size=1712947 2024-09-14T11:04:23.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.660+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=C33PQ8QIV96V type=del 2024-09-14T11:04:23.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.663+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~MCY8RGTIBFPL.0 size=30869 2024-09-14T11:04:23.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.663+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=MCY8RGTIBFPL tag=8HR1PN4254ZU type=write size=1079445 2024-09-14T11:04:23.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.664+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~ABOWF8PHYLSL.0 size=982386 2024-09-14T11:04:23.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.666+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=ABOWF8PHYLSL tag=ATFVGI16DJVF type=write size=2030962 2024-09-14T11:04:23.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.667+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=FDCTQ5J9V0S2 type=del size=4087510 2024-09-14T11:04:23.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.669+0000 7f907bbdf780 1 < canceled operation key=Y3KOCA4072NM tag=G6WMVSYC8QZ2 type=del size=2721110 2024-09-14T11:04:23.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.670+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=IEEU7LYNAGT1 type=del size=3824889 2024-09-14T11:04:23.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.671+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=9Z6UT5M8LOTN type=del 2024-09-14T11:04:23.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.672+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=M0075TK5DJWF type=del size=1600692 2024-09-14T11:04:23.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.673+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=JC8VL2T3A9KJ type=del 2024-09-14T11:04:23.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.675+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=F0Z06S3B08DS type=write size=464313 2024-09-14T11:04:23.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.676+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=63NIC8FBJPMS type=del 2024-09-14T11:04:23.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.679+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~4DLB4HEQN2ZM.0 size=1048576 2024-09-14T11:04:23.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.680+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~4DLB4HEQN2ZM.1 size=831169 2024-09-14T11:04:23.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.680+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=4DLB4HEQN2ZM tag=5WJMVUB3JR1V type=write size=2928321 2024-09-14T11:04:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.681+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.0 size=1048576 2024-09-14T11:04:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.682+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.1 size=1048576 2024-09-14T11:04:23.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.683+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~FI4FWSQXJ22P.2 size=70632 2024-09-14T11:04:23.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.686+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=FI4FWSQXJ22P tag=1348IRFQYYBP type=write size=3216360 2024-09-14T11:04:23.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.689+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~Q2IJAL52504O.0 size=1048576 2024-09-14T11:04:23.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.690+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~Q2IJAL52504O.1 size=104853 2024-09-14T11:04:23.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.690+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=Q2IJAL52504O tag=OG65CO3TCCOF type=write size=2202005 2024-09-14T11:04:23.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.691+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=WDT4R3TVFDWX type=del 2024-09-14T11:04:23.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.692+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=W0E9PZ9QQX0K type=del size=2621242 2024-09-14T11:04:23.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.694+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=O0LWIG9O62V0 type=del size=25642 2024-09-14T11:04:23.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.696+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~CAF69XQ0Z4AD.0 size=1048576 2024-09-14T11:04:23.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.698+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~CAF69XQ0Z4AD.1 size=156880 2024-09-14T11:04:23.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.698+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=CAF69XQ0Z4AD tag=VWR7YP31UEFQ type=write size=2254032 2024-09-14T11:04:23.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.699+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=A0VRECJPKAEU type=del 2024-09-14T11:04:23.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.701+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.0 size=1048576 2024-09-14T11:04:23.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.702+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.1 size=1048576 2024-09-14T11:04:23.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.703+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.2 size=296531 2024-09-14T11:04:23.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.703+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=2UU8250E2CRT tag=07N42BPB9S3A type=write size=3442259 2024-09-14T11:04:23.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.704+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=XJ3BFOTEWDOU type=del 2024-09-14T11:04:23.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.707+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~DBCOPN6ZE0U7.0 size=127873 2024-09-14T11:04:23.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.707+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=DBCOPN6ZE0U7 tag=0F3JCBTTH934 type=write size=1176449 2024-09-14T11:04:23.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.708+0000 7f907bbdf780 1 < completed write operation key=91RL2KD0XCSI tag=PBFQDIPR5OOG type=write size=938506 2024-09-14T11:04:23.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.709+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=CHY2K1GPR482 type=del size=2537675 2024-09-14T11:04:23.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.710+0000 7f907bbdf780 1 < completed write operation key=77H37YF6MJEO tag=FG8F70ZXYXN9 type=write size=311620 2024-09-14T11:04:23.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.711+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=6SC7WBKKM35R type=del size=2360423 2024-09-14T11:04:23.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.713+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=46XP3PM1E08G type=del 2024-09-14T11:04:23.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.714+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=WQB1DAJYHSOA type=del size=809266 2024-09-14T11:04:23.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.715+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=V6996I99RTAM type=del 2024-09-14T11:04:23.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.716+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=AUSQED7BCAPE type=del size=1904943 2024-09-14T11:04:23.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.718+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~6YQXHRSBZHR8.0 size=664371 2024-09-14T11:04:23.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.720+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=6YQXHRSBZHR8 tag=2VMCBESGI5DP type=write size=1712947 2024-09-14T11:04:23.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.721+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=A0KQSPIZNB43 type=del size=979798 2024-09-14T11:04:23.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.723+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~MCY8RGTIBFPL.0 size=30869 2024-09-14T11:04:23.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.726+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=MCY8RGTIBFPL tag=8HR1PN4254ZU type=write size=1079445 2024-09-14T11:04:23.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.727+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=9MXAQK9C9X4G type=del size=352845 2024-09-14T11:04:23.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.730+0000 7f907bbdf780 1 < suggested update operation key=59WHXDR0S8DM tag=FDCTQ5J9V0S2 type=del size=4087510 2024-09-14T11:04:23.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.731+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=YMSB1WC89PM2 type=write size=445230 2024-09-14T11:04:23.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.732+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=IEEU7LYNAGT1 type=del 2024-09-14T11:04:23.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.735+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~3J7O87I5JNTE.0 size=1048576 2024-09-14T11:04:23.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.736+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~3J7O87I5JNTE.1 size=661258 2024-09-14T11:04:23.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.736+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=3J7O87I5JNTE tag=JIWHT5M74C51 type=write size=2758410 2024-09-14T11:04:23.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.738+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=M0075TK5DJWF type=del 2024-09-14T11:04:23.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.740+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~T4C4BK1EXRDG.0 size=936511 2024-09-14T11:04:23.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.740+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=T4C4BK1EXRDG tag=J7YI21338K9D type=write size=1985087 2024-09-14T11:04:23.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.741+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=F0Z06S3B08DS type=write size=464313 2024-09-14T11:04:23.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.742+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=7G5XGMCJ3KG4 type=write size=779915 2024-09-14T11:04:23.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.743+0000 7f907bbdf780 1 < canceled part key=_multipart_T79IR10S3HAB.2~4DLB4HEQN2ZM.0 size=1048576 2024-09-14T11:04:23.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.744+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~4DLB4HEQN2ZM.1 size=831169 2024-09-14T11:04:23.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.746+0000 7f907bbdf780 1 < canceled multipart upload key=T79IR10S3HAB upload=4DLB4HEQN2ZM tag=5WJMVUB3JR1V type=write size=2928321 2024-09-14T11:04:23.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.748+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~42EZVL5H33IJ.0 size=894516 2024-09-14T11:04:23.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.748+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=42EZVL5H33IJ tag=JG41PT0YSW13 type=write size=1943092 2024-09-14T11:04:23.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.749+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~Q2IJAL52504O.0 size=1048576 2024-09-14T11:04:23.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.750+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~Q2IJAL52504O.1 size=104853 2024-09-14T11:04:23.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.752+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=Q2IJAL52504O tag=OG65CO3TCCOF type=write size=2202005 2024-09-14T11:04:23.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.753+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=28X41ZDTDOYO type=del size=2371046 2024-09-14T11:04:23.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.755+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=W0E9PZ9QQX0K type=del 2024-09-14T11:04:23.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.757+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.0 size=1048576 2024-09-14T11:04:23.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.758+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.1 size=1048576 2024-09-14T11:04:23.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.759+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.2 size=217083 2024-09-14T11:04:23.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.759+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=MYAJGOAPOP5H tag=WE0WR6TX5UO1 type=write size=3362811 2024-09-14T11:04:23.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.760+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~CAF69XQ0Z4AD.0 size=1048576 2024-09-14T11:04:23.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.761+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~CAF69XQ0Z4AD.1 size=156880 2024-09-14T11:04:23.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.763+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=CAF69XQ0Z4AD tag=VWR7YP31UEFQ type=write size=2254032 2024-09-14T11:04:23.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.765+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~S0W7AON1NQGV.0 size=108571 2024-09-14T11:04:23.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.765+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=S0W7AON1NQGV tag=PHCJEX5OJMZ3 type=write size=1157147 2024-09-14T11:04:23.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.766+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.0 size=1048576 2024-09-14T11:04:23.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.767+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.1 size=1048576 2024-09-14T11:04:23.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.768+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~2UU8250E2CRT.2 size=296531 2024-09-14T11:04:23.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.770+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=2UU8250E2CRT tag=07N42BPB9S3A type=write size=3442259 2024-09-14T11:04:23.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.772+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~N2R4KJAFWEB0.0 size=1048576 2024-09-14T11:04:23.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.773+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~N2R4KJAFWEB0.1 size=302949 2024-09-14T11:04:23.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.773+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=N2R4KJAFWEB0 tag=K8ML26D4CG9L type=write size=2400101 2024-09-14T11:04:23.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.774+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~DBCOPN6ZE0U7.0 size=127873 2024-09-14T11:04:23.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.776+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=DBCOPN6ZE0U7 tag=0F3JCBTTH934 type=write size=1176449 2024-09-14T11:04:23.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.777+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=074QB15RZMAO type=del size=3604961 2024-09-14T11:04:23.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.780+0000 7f907bbdf780 1 < suggested remove operation key=P546JCSFB00N tag=CHY2K1GPR482 type=del 2024-09-14T11:04:23.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.781+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=WJWRN72AB27O type=del size=932329 2024-09-14T11:04:23.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.782+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=6SC7WBKKM35R type=del 2024-09-14T11:04:23.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.784+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~WXPK1XC0Q1ZD.0 size=1048576 2024-09-14T11:04:23.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.785+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~WXPK1XC0Q1ZD.1 size=400537 2024-09-14T11:04:23.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.785+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=WXPK1XC0Q1ZD tag=K8OET9DD3UJX type=write size=2497689 2024-09-14T11:04:23.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.786+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=WQB1DAJYHSOA type=del 2024-09-14T11:04:23.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.788+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=NNJWLZJO00MT type=del size=2575405 2024-09-14T11:04:23.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.789+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=AUSQED7BCAPE type=del 2024-09-14T11:04:23.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.790+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=EOMU4VE2EV4X type=del size=1959906 2024-09-14T11:04:23.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.793+0000 7f907bbdf780 1 < suggested remove operation key=YH0YMRDQERBF tag=A0KQSPIZNB43 type=del 2024-09-14T11:04:23.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.794+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=DNI123TSDQN3 type=del size=2832003 2024-09-14T11:04:23.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.795+0000 7f907bbdf780 -1 < failed to complete operation key=P546JCSFB00N tag=9MXAQK9C9X4G type=del size=352845: (22) Invalid argument 2024-09-14T11:04:23.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.797+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.0 size=1048576 2024-09-14T11:04:23.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.798+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.1 size=1048576 2024-09-14T11:04:23.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.799+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.2 size=280990 2024-09-14T11:04:23.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.799+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=KG5JUIG7M9WF tag=IEJ8KGPDV5KR type=write size=3426718 2024-09-14T11:04:23.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.800+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=YMSB1WC89PM2 type=write size=445230 2024-09-14T11:04:23.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.801+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=O8S2JTIBH8IS type=del size=2413354 2024-09-14T11:04:23.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.802+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~3J7O87I5JNTE.0 size=1048576 2024-09-14T11:04:23.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.803+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~3J7O87I5JNTE.1 size=661258 2024-09-14T11:04:23.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.805+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=3J7O87I5JNTE tag=JIWHT5M74C51 type=write size=2758410 2024-09-14T11:04:23.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.807+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~QUK074FABYIO.0 size=830482 2024-09-14T11:04:23.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.807+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=QUK074FABYIO tag=4O99FO2U5F9N type=write size=1879058 2024-09-14T11:04:23.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.808+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~T4C4BK1EXRDG.0 size=936511 2024-09-14T11:04:23.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.810+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=T4C4BK1EXRDG tag=J7YI21338K9D type=write size=1985087 2024-09-14T11:04:23.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.811+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=7FWZ5JXAS9BQ type=del size=2962073 2024-09-14T11:04:23.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.814+0000 7f907bbdf780 1 < suggested update operation key=JEXUT5F7AKZ1 tag=7G5XGMCJ3KG4 type=write size=779915 2024-09-14T11:04:23.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.815+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=AFAAPB7C5TZK type=del size=3545367 2024-09-14T11:04:23.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.816+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~42EZVL5H33IJ.0 size=894516 2024-09-14T11:04:23.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.818+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=42EZVL5H33IJ tag=JG41PT0YSW13 type=write size=1943092 2024-09-14T11:04:23.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.819+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=HL85KCLIIWC8 type=del size=3020377 2024-09-14T11:04:23.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.820+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=28X41ZDTDOYO type=del 2024-09-14T11:04:23.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.821+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=X5SIEV25VN2F type=del size=1482697 2024-09-14T11:04:23.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.823+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.0 size=1048576 2024-09-14T11:04:23.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.823+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.1 size=1048576 2024-09-14T11:04:23.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.824+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~MYAJGOAPOP5H.2 size=217083 2024-09-14T11:04:23.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.826+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=MYAJGOAPOP5H tag=WE0WR6TX5UO1 type=write size=3362811 2024-09-14T11:04:23.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.827+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=CFJRM19QAJ0G type=del size=1644251 2024-09-14T11:04:23.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.828+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~S0W7AON1NQGV.0 size=108571 2024-09-14T11:04:23.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.830+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=S0W7AON1NQGV tag=PHCJEX5OJMZ3 type=write size=1157147 2024-09-14T11:04:23.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.831+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=K6L09TWIIB6H type=del size=1722346 2024-09-14T11:04:23.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.832+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~N2R4KJAFWEB0.0 size=1048576 2024-09-14T11:04:23.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.833+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~N2R4KJAFWEB0.1 size=302949 2024-09-14T11:04:23.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.835+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=N2R4KJAFWEB0 tag=K8ML26D4CG9L type=write size=2400101 2024-09-14T11:04:23.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.837+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=2N64DEPTFYWF type=del size=3067639 2024-09-14T11:04:23.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.839+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=074QB15RZMAO type=del 2024-09-14T11:04:23.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.840+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=GE5HQ8I9Q51C type=del size=937621 2024-09-14T11:04:23.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.841+0000 7f907bbdf780 -1 < failed to complete operation key=JEXUT5F7AKZ1 tag=WJWRN72AB27O type=del size=932329: (22) Invalid argument 2024-09-14T11:04:23.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.842+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=BNWZ8NWH716S type=del size=44709 2024-09-14T11:04:23.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.844+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~WXPK1XC0Q1ZD.0 size=1048576 2024-09-14T11:04:23.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.845+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~WXPK1XC0Q1ZD.1 size=400537 2024-09-14T11:04:23.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.847+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=WXPK1XC0Q1ZD tag=K8OET9DD3UJX type=write size=2497689 2024-09-14T11:04:23.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.850+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~1IQU28BOI2EJ.0 size=1048576 2024-09-14T11:04:23.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.851+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~1IQU28BOI2EJ.1 size=432854 2024-09-14T11:04:23.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.851+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=1IQU28BOI2EJ tag=MSCCO09RG0MK type=write size=2530006 2024-09-14T11:04:23.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.854+0000 7f907bbdf780 1 < suggested update operation key=AGMKZ7PGPUAM tag=NNJWLZJO00MT type=del size=2575405 2024-09-14T11:04:23.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.856+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~51PQRA0RVQWP.0 size=482526 2024-09-14T11:04:23.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.856+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=51PQRA0RVQWP tag=OFR13CRH6EP3 type=write size=1531102 2024-09-14T11:04:23.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.859+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=EOMU4VE2EV4X type=del 2024-09-14T11:04:23.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.860+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=F0JZ2F4WMSO8 type=write size=365977 2024-09-14T11:04:23.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.861+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=DNI123TSDQN3 type=del 2024-09-14T11:04:23.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.864+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.0 size=1048576 2024-09-14T11:04:23.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.865+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.1 size=1048576 2024-09-14T11:04:23.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.866+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.2 size=757821 2024-09-14T11:04:23.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.866+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=7RBP1DDVF9WN tag=QEQMFDWGVZSH type=write size=3903549 2024-09-14T11:04:23.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.867+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.0 size=1048576 2024-09-14T11:04:23.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.867+0000 7f907bbdf780 1 < canceled part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.1 size=1048576 2024-09-14T11:04:23.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.868+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~KG5JUIG7M9WF.2 size=280990 2024-09-14T11:04:23.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.870+0000 7f907bbdf780 1 < canceled multipart upload key=6AWG2GM1ZP31 upload=KG5JUIG7M9WF tag=IEJ8KGPDV5KR type=write size=3426718 2024-09-14T11:04:23.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.871+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=UW28RSVA9Q4F type=del size=3176770 2024-09-14T11:04:23.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.872+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=O8S2JTIBH8IS type=del 2024-09-14T11:04:23.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.874+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=B7YI8NLC8GQJ type=write size=470988 2024-09-14T11:04:23.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.875+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~QUK074FABYIO.0 size=830482 2024-09-14T11:04:23.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.877+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=QUK074FABYIO tag=4O99FO2U5F9N type=write size=1879058 2024-09-14T11:04:23.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.878+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=GDUNMGLG8C8S type=del size=1498967 2024-09-14T11:04:23.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.879+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=7FWZ5JXAS9BQ type=del 2024-09-14T11:04:23.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.880+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=KO8NMRK3Y82P type=del size=1928866 2024-09-14T11:04:23.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.882+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=AFAAPB7C5TZK type=del size=3545367 2024-09-14T11:04:23.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.883+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=KAUAVL7UVIED type=del size=2420508 2024-09-14T11:04:23.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.885+0000 7f907bbdf780 1 < suggested remove operation key=LQNZKMX52SWO tag=HL85KCLIIWC8 type=del 2024-09-14T11:04:23.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.886+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=BUNKTOZXFF3S type=del size=3941023 2024-09-14T11:04:23.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.889+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=X5SIEV25VN2F type=del 2024-09-14T11:04:23.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.890+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=2ZQY9LDQQMFC type=del size=3886219 2024-09-14T11:04:23.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.891+0000 7f907bbdf780 1 < canceled operation key=5MFLA6XFV3Y5 tag=CFJRM19QAJ0G type=del size=1644251 2024-09-14T11:04:23.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.894+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.0 size=1048576 2024-09-14T11:04:23.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.895+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.1 size=1048576 2024-09-14T11:04:23.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.896+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.2 size=374426 2024-09-14T11:04:23.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.896+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=0J622CD4PCAG tag=1FAF6VSNSQN5 type=write size=3520154 2024-09-14T11:04:23.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.897+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=K6L09TWIIB6H type=del size=1722346 2024-09-14T11:04:23.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.898+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=52DKLJDYRW0D type=write size=148988 2024-09-14T11:04:23.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.899+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=2N64DEPTFYWF type=del 2024-09-14T11:04:23.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.901+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=QSENJKUZZR68 type=del size=47629 2024-09-14T11:04:23.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.902+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=GE5HQ8I9Q51C type=del 2024-09-14T11:04:23.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.903+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=3UEH5W8OJXP2 type=del size=1488516 2024-09-14T11:04:23.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.904+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=BNWZ8NWH716S type=del 2024-09-14T11:04:23.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.906+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=60Y22WLUGZR4 type=del size=2405936 2024-09-14T11:04:23.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.907+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~1IQU28BOI2EJ.0 size=1048576 2024-09-14T11:04:23.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.908+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~1IQU28BOI2EJ.1 size=432854 2024-09-14T11:04:23.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.910+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=1IQU28BOI2EJ tag=MSCCO09RG0MK type=write size=2530006 2024-09-14T11:04:23.910 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.912+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~1127GXOFOYF5.0 size=1048576 2024-09-14T11:04:23.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.913+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~1127GXOFOYF5.1 size=165109 2024-09-14T11:04:23.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.913+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=1127GXOFOYF5 tag=9GLF2A0J6NGV type=write size=2262261 2024-09-14T11:04:23.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.914+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~51PQRA0RVQWP.0 size=482526 2024-09-14T11:04:23.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.916+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=51PQRA0RVQWP tag=OFR13CRH6EP3 type=write size=1531102 2024-09-14T11:04:23.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.917+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=C2528BI6OR02 type=write size=696150 2024-09-14T11:04:23.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.918+0000 7f907bbdf780 1 < canceled operation key=WAFH5BKM2P23 tag=F0JZ2F4WMSO8 type=write size=365977 2024-09-14T11:04:23.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.920+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=14I27F8Q019G type=write size=103018 2024-09-14T11:04:23.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.921+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.0 size=1048576 2024-09-14T11:04:23.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.922+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.1 size=1048576 2024-09-14T11:04:23.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.923+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~7RBP1DDVF9WN.2 size=757821 2024-09-14T11:04:23.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.925+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=7RBP1DDVF9WN tag=QEQMFDWGVZSH type=write size=3903549 2024-09-14T11:04:23.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.926+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=JWUD7N9XR1L7 type=del size=793887 2024-09-14T11:04:23.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.927+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=UW28RSVA9Q4F type=del 2024-09-14T11:04:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.929+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=6CLOH1YSQ0DF type=del size=2468465 2024-09-14T11:04:23.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.930+0000 7f907bbdf780 -1 < failed to complete operation key=LQNZKMX52SWO tag=B7YI8NLC8GQJ type=write size=470988: (22) Invalid argument 2024-09-14T11:04:23.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.932+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~JYRBUVBZ86FK.0 size=259204 2024-09-14T11:04:23.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.932+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=JYRBUVBZ86FK tag=MX5IKP53CTV7 type=write size=1307780 2024-09-14T11:04:23.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.934+0000 7f907bbdf780 1 < suggested update operation key=59WHXDR0S8DM tag=GDUNMGLG8C8S type=del size=1498967 2024-09-14T11:04:23.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.935+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=ZP32ORMU3HQT type=del size=1304336 2024-09-14T11:04:23.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.937+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=KO8NMRK3Y82P type=del 2024-09-14T11:04:23.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.938+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=QNR4JTH7EE6M type=del size=3652139 2024-09-14T11:04:23.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.939+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=KAUAVL7UVIED type=del 2024-09-14T11:04:23.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.940+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=Q64DBXVVJH3D type=del size=345942 2024-09-14T11:04:23.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.941+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=BUNKTOZXFF3S type=del 2024-09-14T11:04:23.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.943+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.0 size=1048576 2024-09-14T11:04:23.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.944+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.1 size=1048576 2024-09-14T11:04:23.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.945+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.2 size=547003 2024-09-14T11:04:23.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.945+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=M8Q5LZCM6NV6 tag=Y209NH6SV4S3 type=write size=3692731 2024-09-14T11:04:23.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.947+0000 7f907bbdf780 1 < suggested remove operation key=T81OF13I2JVH tag=2ZQY9LDQQMFC type=del 2024-09-14T11:04:23.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.948+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=CE5FPU6W1XGA type=del size=760243 2024-09-14T11:04:23.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.949+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.0 size=1048576 2024-09-14T11:04:23.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.950+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.1 size=1048576 2024-09-14T11:04:23.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.951+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~0J622CD4PCAG.2 size=374426 2024-09-14T11:04:23.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.954+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=0J622CD4PCAG tag=1FAF6VSNSQN5 type=write size=3520154 2024-09-14T11:04:23.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.955+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=LMXS00RKL4L8 type=del size=1859963 2024-09-14T11:04:23.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.956+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=52DKLJDYRW0D type=write size=148988 2024-09-14T11:04:23.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.957+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=S7PZEGKQIUQA type=del size=1471353 2024-09-14T11:04:23.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.959+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=QSENJKUZZR68 type=del 2024-09-14T11:04:23.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.960+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=3253K3GXCLV3 type=del size=3238469 2024-09-14T11:04:23.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.961+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=3UEH5W8OJXP2 type=del 2024-09-14T11:04:23.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.962+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=4CGODXSKAEHX type=del size=3498873 2024-09-14T11:04:23.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.963+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=60Y22WLUGZR4 type=del 2024-09-14T11:04:23.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.965+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=91848III0X2G type=del size=3741089 2024-09-14T11:04:23.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.966+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~1127GXOFOYF5.0 size=1048576 2024-09-14T11:04:23.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.967+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~1127GXOFOYF5.1 size=165109 2024-09-14T11:04:23.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.969+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=1127GXOFOYF5 tag=9GLF2A0J6NGV type=write size=2262261 2024-09-14T11:04:23.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.970+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=Z5IEL8EB8DQS type=del size=2602064 2024-09-14T11:04:23.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.971+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=C2528BI6OR02 type=write size=696150 2024-09-14T11:04:23.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.972+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=BRG9JTUVBCY1 type=del size=487996 2024-09-14T11:04:23.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.973+0000 7f907bbdf780 1 < completed write operation key=VRQ0ZNN9FG4C tag=14I27F8Q019G type=write size=103018 2024-09-14T11:04:23.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.974+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=P7VCONYU2B4B type=del size=3248587 2024-09-14T11:04:23.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.975+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=JWUD7N9XR1L7 type=del 2024-09-14T11:04:23.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.977+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=1KGI0UXUF2FK type=del size=1014082 2024-09-14T11:04:23.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.978+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=6CLOH1YSQ0DF type=del 2024-09-14T11:04:23.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.980+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~FX4FX1WI5C8P.0 size=598752 2024-09-14T11:04:23.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.980+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=FX4FX1WI5C8P tag=PG40FTXAFVM6 type=write size=1647328 2024-09-14T11:04:23.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.981+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~JYRBUVBZ86FK.0 size=259204 2024-09-14T11:04:23.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.983+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=JYRBUVBZ86FK tag=MX5IKP53CTV7 type=write size=1307780 2024-09-14T11:04:23.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.984+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=WFGHMWTXWZXK type=del size=3876503 2024-09-14T11:04:23.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.986+0000 7f907bbdf780 1 < suggested update operation key=91RL2KD0XCSI tag=ZP32ORMU3HQT type=del size=1304336 2024-09-14T11:04:23.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.987+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=P4FT7HEWY03K type=del size=3859418 2024-09-14T11:04:23.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.989+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=QNR4JTH7EE6M type=del 2024-09-14T11:04:23.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.991+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~I2SCKPC4U854.0 size=1048576 2024-09-14T11:04:23.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.992+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~I2SCKPC4U854.1 size=881207 2024-09-14T11:04:23.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.992+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=I2SCKPC4U854 tag=FB79Z0F4WB83 type=write size=2978359 2024-09-14T11:04:23.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.994+0000 7f907bbdf780 1 < suggested remove operation key=P0701O36E1JI tag=Q64DBXVVJH3D type=del 2024-09-14T11:04:23.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.995+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=QUM05AHS8O2G type=del size=4020901 2024-09-14T11:04:23.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.997+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.0 size=1048576 2024-09-14T11:04:23.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.998+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.1 size=1048576 2024-09-14T11:04:23.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:23.999+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~M8Q5LZCM6NV6.2 size=547003 2024-09-14T11:04:23.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.001+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=M8Q5LZCM6NV6 tag=Y209NH6SV4S3 type=write size=3692731 2024-09-14T11:04:24.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.002+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=5ICM2BQ9FUA6 type=del size=2393069 2024-09-14T11:04:24.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.003+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=CE5FPU6W1XGA type=del 2024-09-14T11:04:24.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.005+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.0 size=1048576 2024-09-14T11:04:24.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.006+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.1 size=1048576 2024-09-14T11:04:24.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.007+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.2 size=932488 2024-09-14T11:04:24.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.007+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=G07CKMCX7DN5 tag=MGEF1MPKHGUO type=write size=4078216 2024-09-14T11:04:24.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.008+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=LMXS00RKL4L8 type=del 2024-09-14T11:04:24.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.011+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.0 size=1048576 2024-09-14T11:04:24.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.012+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.1 size=1048576 2024-09-14T11:04:24.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.013+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.2 size=598233 2024-09-14T11:04:24.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.013+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=T8IP6VW1S60W tag=6ONHHWQYZEEV type=write size=3743961 2024-09-14T11:04:24.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.015+0000 7f907bbdf780 1 < suggested update operation key=Y3KOCA4072NM tag=S7PZEGKQIUQA type=del size=1471353 2024-09-14T11:04:24.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.017+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~I5YELLRW03GW.0 size=1048576 2024-09-14T11:04:24.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.018+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~I5YELLRW03GW.1 size=644249 2024-09-14T11:04:24.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.018+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=I5YELLRW03GW tag=QA2H9PJV64X2 type=write size=2741401 2024-09-14T11:04:24.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.019+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=3253K3GXCLV3 type=del 2024-09-14T11:04:24.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.021+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=3DTTVR2ZZC3H type=write size=133715 2024-09-14T11:04:24.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.022+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=4CGODXSKAEHX type=del size=3498873: (22) Invalid argument 2024-09-14T11:04:24.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.024+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~I1IK39DC1V5Y.0 size=1048576 2024-09-14T11:04:24.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.025+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~I1IK39DC1V5Y.1 size=668004 2024-09-14T11:04:24.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.025+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=I1IK39DC1V5Y tag=CZYJ86TE2SY8 type=write size=2765156 2024-09-14T11:04:24.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.026+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=91848III0X2G type=del 2024-09-14T11:04:24.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.028+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=1TS6UPZVXC5Q type=del size=3179386 2024-09-14T11:04:24.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.030+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=Z5IEL8EB8DQS type=del 2024-09-14T11:04:24.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.031+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=E0O1L04MW89A type=del size=2271320 2024-09-14T11:04:24.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.033+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=BRG9JTUVBCY1 type=del 2024-09-14T11:04:24.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.035+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~GRO1OKUWMK2Z.0 size=482911 2024-09-14T11:04:24.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.035+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=GRO1OKUWMK2Z tag=1ZGQEUQCHQS9 type=write size=1531487 2024-09-14T11:04:24.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.036+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=P7VCONYU2B4B type=del 2024-09-14T11:04:24.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.037+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=MZUC10EJGLBR type=del size=645509 2024-09-14T11:04:24.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.039+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=1KGI0UXUF2FK type=del 2024-09-14T11:04:24.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.040+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=C6U2WLVWFZ00 type=del size=3485149 2024-09-14T11:04:24.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.040+0000 7f907bbdf780 1 < canceled part key=_multipart_P0701O36E1JI.2~FX4FX1WI5C8P.0 size=598752 2024-09-14T11:04:24.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.042+0000 7f907bbdf780 1 < canceled multipart upload key=P0701O36E1JI upload=FX4FX1WI5C8P tag=PG40FTXAFVM6 type=write size=1647328 2024-09-14T11:04:24.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.043+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=DNLOM8Y6SW64 type=del size=390779 2024-09-14T11:04:24.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.044+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=WFGHMWTXWZXK type=del 2024-09-14T11:04:24.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.046+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=99ONHXXUNE67 type=del size=860087 2024-09-14T11:04:24.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.047+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=P4FT7HEWY03K type=del 2024-09-14T11:04:24.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.049+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~3OSAB0XTZTO9.0 size=763371 2024-09-14T11:04:24.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.049+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=3OSAB0XTZTO9 tag=GVETZUX1LBG8 type=write size=1811947 2024-09-14T11:04:24.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.050+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~I2SCKPC4U854.0 size=1048576 2024-09-14T11:04:24.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.051+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~I2SCKPC4U854.1 size=881207 2024-09-14T11:04:24.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.053+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=I2SCKPC4U854 tag=FB79Z0F4WB83 type=write size=2978359 2024-09-14T11:04:24.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.054+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=Z2M443AGDZ7B type=write size=927283 2024-09-14T11:04:24.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.056+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=QUM05AHS8O2G type=del 2024-09-14T11:04:24.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.057+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=M5SGVQDXEI5F type=write size=867223 2024-09-14T11:04:24.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.059+0000 7f907bbdf780 1 < suggested remove operation key=AGMKZ7PGPUAM tag=5ICM2BQ9FUA6 type=del 2024-09-14T11:04:24.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.060+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=08XWP1X8ME35 type=del size=261062 2024-09-14T11:04:24.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.061+0000 7f907bbdf780 1 < canceled part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.0 size=1048576 2024-09-14T11:04:24.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.062+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.1 size=1048576 2024-09-14T11:04:24.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.063+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~G07CKMCX7DN5.2 size=932488 2024-09-14T11:04:24.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.066+0000 7f907bbdf780 1 < canceled multipart upload key=FTYIOOQROLG6 upload=G07CKMCX7DN5 tag=MGEF1MPKHGUO type=write size=4078216 2024-09-14T11:04:24.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.069+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~IIPTG02ECV34.0 size=644309 2024-09-14T11:04:24.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.069+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=IIPTG02ECV34 tag=4T7R53F50EHW type=write size=1692885 2024-09-14T11:04:24.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.070+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.0 size=1048576 2024-09-14T11:04:24.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.071+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.1 size=1048576 2024-09-14T11:04:24.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.072+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~T8IP6VW1S60W.2 size=598233 2024-09-14T11:04:24.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.075+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=T8IP6VW1S60W tag=6ONHHWQYZEEV type=write size=3743961 2024-09-14T11:04:24.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.076+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=ZUP1LEMRO1TE type=del size=1232659 2024-09-14T11:04:24.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.077+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~I5YELLRW03GW.0 size=1048576 2024-09-14T11:04:24.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.078+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~I5YELLRW03GW.1 size=644249 2024-09-14T11:04:24.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.080+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=I5YELLRW03GW tag=QA2H9PJV64X2 type=write size=2741401 2024-09-14T11:04:24.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.082+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~7NKAXWCG6CUH.0 size=689184 2024-09-14T11:04:24.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.082+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=7NKAXWCG6CUH tag=VOXRZ28P69MF type=write size=1737760 2024-09-14T11:04:24.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.084+0000 7f907bbdf780 1 < completed write operation key=8C398XZ7XKU7 tag=3DTTVR2ZZC3H type=write size=133715 2024-09-14T11:04:24.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.085+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=S4XEO1PWDHQN type=write size=645226 2024-09-14T11:04:24.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.086+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~I1IK39DC1V5Y.0 size=1048576 2024-09-14T11:04:24.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.087+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~I1IK39DC1V5Y.1 size=668004 2024-09-14T11:04:24.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.089+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=I1IK39DC1V5Y tag=CZYJ86TE2SY8 type=write size=2765156 2024-09-14T11:04:24.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.090+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=1M1V5CG39E9R type=del size=1994680 2024-09-14T11:04:24.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.093+0000 7f907bbdf780 1 < suggested remove operation key=KQBX4UP53FV1 tag=1TS6UPZVXC5Q type=del 2024-09-14T11:04:24.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.094+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=PO3NHHI66IIB type=del size=4189137 2024-09-14T11:04:24.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.095+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=E0O1L04MW89A type=del 2024-09-14T11:04:24.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.097+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~0DFYIT48XRLG.0 size=1048576 2024-09-14T11:04:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.098+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~0DFYIT48XRLG.1 size=664856 2024-09-14T11:04:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.098+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=0DFYIT48XRLG tag=5FO31HYRLA81 type=write size=2762008 2024-09-14T11:04:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.098+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~GRO1OKUWMK2Z.0 size=482911 2024-09-14T11:04:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.100+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=GRO1OKUWMK2Z tag=1ZGQEUQCHQS9 type=write size=1531487 2024-09-14T11:04:24.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.101+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=EL3L8N14LN7L type=del size=3904312 2024-09-14T11:04:24.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.103+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=MZUC10EJGLBR type=del 2024-09-14T11:04:24.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.104+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=07E7FNVQTBGM type=del size=2976895 2024-09-14T11:04:24.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.105+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=C6U2WLVWFZ00 type=del 2024-09-14T11:04:24.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.106+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=NBLLMG7MRRI2 type=del size=2953484 2024-09-14T11:04:24.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.107+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=DNLOM8Y6SW64 type=del 2024-09-14T11:04:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.110+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~5C23REX6K6Y4.0 size=1048576 2024-09-14T11:04:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.111+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~5C23REX6K6Y4.1 size=1009416 2024-09-14T11:04:24.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.111+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=5C23REX6K6Y4 tag=Q8AOC6D2MBAF type=write size=3106568 2024-09-14T11:04:24.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.112+0000 7f907bbdf780 1 < canceled operation key=YH0YMRDQERBF tag=99ONHXXUNE67 type=del size=860087 2024-09-14T11:04:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.114+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~ZPZCAV6UMH33.0 size=1048576 2024-09-14T11:04:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.115+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~ZPZCAV6UMH33.1 size=507243 2024-09-14T11:04:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.115+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=ZPZCAV6UMH33 tag=ICNXMF1W3FQV type=write size=2604395 2024-09-14T11:04:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.116+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~3OSAB0XTZTO9.0 size=763371 2024-09-14T11:04:24.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.118+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=3OSAB0XTZTO9 tag=GVETZUX1LBG8 type=write size=1811947 2024-09-14T11:04:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.120+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~3ZMMCVOUT4HW.0 size=1048576 2024-09-14T11:04:24.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.121+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~3ZMMCVOUT4HW.1 size=94939 2024-09-14T11:04:24.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.121+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=3ZMMCVOUT4HW tag=WGILFND87TQ8 type=write size=2192091 2024-09-14T11:04:24.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.122+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=Z2M443AGDZ7B type=write size=927283 2024-09-14T11:04:24.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.123+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=EGC4BT9V1HXV type=write size=704279 2024-09-14T11:04:24.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.124+0000 7f907bbdf780 1 < completed write operation key=T79IR10S3HAB tag=M5SGVQDXEI5F type=write size=867223 2024-09-14T11:04:24.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.125+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=CH0W62KKUPB5 type=write size=487354 2024-09-14T11:04:24.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.126+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=08XWP1X8ME35 type=del size=261062 2024-09-14T11:04:24.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.128+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=2QOQJ05MQLY0 type=del size=582398 2024-09-14T11:04:24.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.129+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~IIPTG02ECV34.0 size=644309 2024-09-14T11:04:24.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.131+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=IIPTG02ECV34 tag=4T7R53F50EHW type=write size=1692885 2024-09-14T11:04:24.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.132+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=CPB02MP931U5 type=del size=4169187 2024-09-14T11:04:24.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.133+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=ZUP1LEMRO1TE type=del 2024-09-14T11:04:24.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.135+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~8UB76U7VI8JO.0 size=345453 2024-09-14T11:04:24.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.135+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=8UB76U7VI8JO tag=L4YS64R0SFQW type=write size=1394029 2024-09-14T11:04:24.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.136+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~7NKAXWCG6CUH.0 size=689184 2024-09-14T11:04:24.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.138+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=7NKAXWCG6CUH tag=VOXRZ28P69MF type=write size=1737760 2024-09-14T11:04:24.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.139+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=FOB58GYOR7VL type=del size=1026680 2024-09-14T11:04:24.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.141+0000 7f907bbdf780 1 < completed write operation key=WZ064RU647Y7 tag=S4XEO1PWDHQN type=write size=645226 2024-09-14T11:04:24.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.142+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=8WZ0OUYMKRUB type=del size=1073740 2024-09-14T11:04:24.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.144+0000 7f907bbdf780 1 < suggested update operation key=VRQ0ZNN9FG4C tag=1M1V5CG39E9R type=del size=1994680 2024-09-14T11:04:24.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.145+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=5BV6K2U3I80K type=del size=362161 2024-09-14T11:04:24.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.146+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=PO3NHHI66IIB type=del 2024-09-14T11:04:24.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.147+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=OF8H50QC728C type=write size=787063 2024-09-14T11:04:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.149+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~0DFYIT48XRLG.0 size=1048576 2024-09-14T11:04:24.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.150+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~0DFYIT48XRLG.1 size=664856 2024-09-14T11:04:24.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.151+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=0DFYIT48XRLG tag=5FO31HYRLA81 type=write size=2762008 2024-09-14T11:04:24.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.153+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=VBN7JFX3EGKK type=del size=2671432 2024-09-14T11:04:24.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.154+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=EL3L8N14LN7L type=del 2024-09-14T11:04:24.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.155+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=KTQ2ZL8L9NA8 type=del size=1816518 2024-09-14T11:04:24.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.156+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=07E7FNVQTBGM type=del 2024-09-14T11:04:24.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.157+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=UHBEXAZ9LK2Z type=write size=159101 2024-09-14T11:04:24.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.160+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=NBLLMG7MRRI2 type=del 2024-09-14T11:04:24.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.162+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~BML1NQ63PZXB.0 size=1048576 2024-09-14T11:04:24.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.163+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~BML1NQ63PZXB.1 size=957146 2024-09-14T11:04:24.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.163+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=BML1NQ63PZXB tag=WTETYJ1HEI60 type=write size=3054298 2024-09-14T11:04:24.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.164+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~5C23REX6K6Y4.0 size=1048576 2024-09-14T11:04:24.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.165+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~5C23REX6K6Y4.1 size=1009416 2024-09-14T11:04:24.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.168+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=5C23REX6K6Y4 tag=Q8AOC6D2MBAF type=write size=3106568 2024-09-14T11:04:24.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.170+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.0 size=1048576 2024-09-14T11:04:24.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.171+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.1 size=1048576 2024-09-14T11:04:24.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.172+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.2 size=358253 2024-09-14T11:04:24.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.172+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=5JMXAQXP6GGW tag=N4FRDOXH5KY8 type=write size=3503981 2024-09-14T11:04:24.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.173+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~ZPZCAV6UMH33.0 size=1048576 2024-09-14T11:04:24.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.174+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~ZPZCAV6UMH33.1 size=507243 2024-09-14T11:04:24.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.176+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=ZPZCAV6UMH33 tag=ICNXMF1W3FQV type=write size=2604395 2024-09-14T11:04:24.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.179+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~6J2BEXWCJ4H5.0 size=549029 2024-09-14T11:04:24.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.179+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=6J2BEXWCJ4H5 tag=ROL86Q73WF8E type=write size=1597605 2024-09-14T11:04:24.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.181+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~3ZMMCVOUT4HW.0 size=1048576 2024-09-14T11:04:24.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.181+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~3ZMMCVOUT4HW.1 size=94939 2024-09-14T11:04:24.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.182+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=3ZMMCVOUT4HW tag=WGILFND87TQ8 type=write size=2192091 2024-09-14T11:04:24.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.184+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=J3NAGP10D7QG type=del size=1635692 2024-09-14T11:04:24.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.185+0000 7f907bbdf780 1 < completed write operation key=6AWG2GM1ZP31 tag=EGC4BT9V1HXV type=write size=704279 2024-09-14T11:04:24.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.186+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=PB3FG1GIBL78 type=del size=277117 2024-09-14T11:04:24.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.189+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=CH0W62KKUPB5 type=write 2024-09-14T11:04:24.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.190+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=AH2LN1BOY61O type=del size=1313626 2024-09-14T11:04:24.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.191+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=2QOQJ05MQLY0 type=del 2024-09-14T11:04:24.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.193+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~PGKCZPI4DZ24.0 size=1048576 2024-09-14T11:04:24.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.194+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~PGKCZPI4DZ24.1 size=999346 2024-09-14T11:04:24.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.194+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=PGKCZPI4DZ24 tag=YBORJ8QV6HE4 type=write size=3096498 2024-09-14T11:04:24.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.195+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=CPB02MP931U5 type=del 2024-09-14T11:04:24.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.197+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=3FH67BSW6WHA type=del size=3838834 2024-09-14T11:04:24.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.198+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~8UB76U7VI8JO.0 size=345453 2024-09-14T11:04:24.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.200+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=8UB76U7VI8JO tag=L4YS64R0SFQW type=write size=1394029 2024-09-14T11:04:24.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.202+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.0 size=1048576 2024-09-14T11:04:24.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.203+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.1 size=1048576 2024-09-14T11:04:24.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.204+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.2 size=501359 2024-09-14T11:04:24.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.204+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=3G0UP4A29EU9 tag=97BHXE3LN4TM type=write size=3647087 2024-09-14T11:04:24.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.205+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=FOB58GYOR7VL type=del 2024-09-14T11:04:24.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.207+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.0 size=1048576 2024-09-14T11:04:24.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.208+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.1 size=1048576 2024-09-14T11:04:24.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.209+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.2 size=739720 2024-09-14T11:04:24.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.209+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=GH5G4VKN3GLW tag=O1DBA46C6PD2 type=write size=3885448 2024-09-14T11:04:24.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.210+0000 7f907bbdf780 -1 < failed to complete operation key=HM2GVOA72HHR tag=8WZ0OUYMKRUB type=del size=1073740: (22) Invalid argument 2024-09-14T11:04:24.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.213+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~FA6N9LR2YSI3.0 size=1048576 2024-09-14T11:04:24.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.214+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~FA6N9LR2YSI3.1 size=440697 2024-09-14T11:04:24.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.214+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=FA6N9LR2YSI3 tag=O96IFULHKA2M type=write size=2537849 2024-09-14T11:04:24.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.215+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=5BV6K2U3I80K type=del 2024-09-14T11:04:24.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.217+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~E9VY4XTDCV50.0 size=97660 2024-09-14T11:04:24.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.217+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=E9VY4XTDCV50 tag=Y284USNOZWIM type=write size=1146236 2024-09-14T11:04:24.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.219+0000 7f907bbdf780 1 < suggested update operation key=P546JCSFB00N tag=OF8H50QC728C type=write size=787063 2024-09-14T11:04:24.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.221+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=13B605I5GOQX type=del size=690583 2024-09-14T11:04:24.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.222+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=VBN7JFX3EGKK type=del 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.224+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~VLIPFXA060TX.0 size=790757 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.224+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=VLIPFXA060TX tag=TJBBAVGI1PGG type=write size=1839333 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.226+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=KTQ2ZL8L9NA8 type=del 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.227+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=9UDUAZ5V0HEY type=del size=2709094 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.228+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=UHBEXAZ9LK2Z type=write size=159101 2024-09-14T11:04:24.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.229+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=UBWP09Z03WDD type=del size=2642869 2024-09-14T11:04:24.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.230+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~BML1NQ63PZXB.0 size=1048576 2024-09-14T11:04:24.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.231+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~BML1NQ63PZXB.1 size=957146 2024-09-14T11:04:24.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.233+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=BML1NQ63PZXB tag=WTETYJ1HEI60 type=write size=3054298 2024-09-14T11:04:24.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.235+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=9X30QUSRXDI9 type=del size=3811171 2024-09-14T11:04:24.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.236+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.0 size=1048576 2024-09-14T11:04:24.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.237+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.1 size=1048576 2024-09-14T11:04:24.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.238+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~5JMXAQXP6GGW.2 size=358253 2024-09-14T11:04:24.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.240+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=5JMXAQXP6GGW tag=N4FRDOXH5KY8 type=write size=3503981 2024-09-14T11:04:24.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.241+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=DMSK6ZEIH6AP type=del size=3611495 2024-09-14T11:04:24.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.242+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~6J2BEXWCJ4H5.0 size=549029 2024-09-14T11:04:24.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.245+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=6J2BEXWCJ4H5 tag=ROL86Q73WF8E type=write size=1597605 2024-09-14T11:04:24.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.246+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=G3MCWLUISWLP type=del size=239655 2024-09-14T11:04:24.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.247+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=J3NAGP10D7QG type=del 2024-09-14T11:04:24.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.248+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=XA0U6QHOC2VK type=write size=262490 2024-09-14T11:04:24.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.250+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=PB3FG1GIBL78 type=del 2024-09-14T11:04:24.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.252+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SFBN2W93RR20.0 size=1048576 2024-09-14T11:04:24.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.253+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SFBN2W93RR20.1 size=47653 2024-09-14T11:04:24.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.253+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=SFBN2W93RR20 tag=C14BVS8HWLIZ type=write size=2144805 2024-09-14T11:04:24.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.254+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=AH2LN1BOY61O type=del 2024-09-14T11:04:24.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.255+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=1JTD94ZXZQ18 type=del size=3313630 2024-09-14T11:04:24.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.257+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~PGKCZPI4DZ24.0 size=1048576 2024-09-14T11:04:24.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.257+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~PGKCZPI4DZ24.1 size=999346 2024-09-14T11:04:24.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.260+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=PGKCZPI4DZ24 tag=YBORJ8QV6HE4 type=write size=3096498 2024-09-14T11:04:24.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.261+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=4A0WNV8GZWO9 type=del size=2904274 2024-09-14T11:04:24.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.262+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=3FH67BSW6WHA type=del 2024-09-14T11:04:24.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.263+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=R7ZKDJ0P51CE type=del size=1681926 2024-09-14T11:04:24.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.265+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.0 size=1048576 2024-09-14T11:04:24.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.266+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.1 size=1048576 2024-09-14T11:04:24.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.267+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~3G0UP4A29EU9.2 size=501359 2024-09-14T11:04:24.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.269+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=3G0UP4A29EU9 tag=97BHXE3LN4TM type=write size=3647087 2024-09-14T11:04:24.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.271+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~6PGIU41ANLZH.0 size=340569 2024-09-14T11:04:24.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.271+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=6PGIU41ANLZH tag=F397884UBYJI type=write size=1389145 2024-09-14T11:04:24.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.272+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.0 size=1048576 2024-09-14T11:04:24.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.273+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.1 size=1048576 2024-09-14T11:04:24.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.273+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~GH5G4VKN3GLW.2 size=739720 2024-09-14T11:04:24.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.275+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=GH5G4VKN3GLW tag=O1DBA46C6PD2 type=write size=3885448 2024-09-14T11:04:24.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.277+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=36X67QIJ1M1T type=del size=2946403 2024-09-14T11:04:24.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.278+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~FA6N9LR2YSI3.0 size=1048576 2024-09-14T11:04:24.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.279+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~FA6N9LR2YSI3.1 size=440697 2024-09-14T11:04:24.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.281+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=FA6N9LR2YSI3 tag=O96IFULHKA2M type=write size=2537849 2024-09-14T11:04:24.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.283+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=Z40BAHEO2VB1 type=del size=1810998 2024-09-14T11:04:24.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.284+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~E9VY4XTDCV50.0 size=97660 2024-09-14T11:04:24.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.286+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=E9VY4XTDCV50 tag=Y284USNOZWIM type=write size=1146236 2024-09-14T11:04:24.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.287+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=TPW4296GMRIK type=del size=2560756 2024-09-14T11:04:24.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.289+0000 7f907bbdf780 1 < suggested update operation key=JEXUT5F7AKZ1 tag=13B605I5GOQX type=del size=690583 2024-09-14T11:04:24.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.291+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=L9YFJNL77RUU type=del size=642508 2024-09-14T11:04:24.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.292+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~VLIPFXA060TX.0 size=790757 2024-09-14T11:04:24.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.295+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=VLIPFXA060TX tag=TJBBAVGI1PGG type=write size=1839333 2024-09-14T11:04:24.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.296+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=L0BXTG27IW1K type=del size=1431342 2024-09-14T11:04:24.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.297+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=9UDUAZ5V0HEY type=del 2024-09-14T11:04:24.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.300+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~R3CWSG3QTIN6.0 size=1048576 2024-09-14T11:04:24.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.301+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~R3CWSG3QTIN6.1 size=468648 2024-09-14T11:04:24.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.301+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=R3CWSG3QTIN6 tag=9XEULGWWBDL4 type=write size=2565800 2024-09-14T11:04:24.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.302+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=UBWP09Z03WDD type=del 2024-09-14T11:04:24.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.303+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=BCLJR09VDAGG type=del size=2097493 2024-09-14T11:04:24.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.304+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=9X30QUSRXDI9 type=del 2024-09-14T11:04:24.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.305+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=HGF2KFB1SIU7 type=del size=485271 2024-09-14T11:04:24.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.307+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=DMSK6ZEIH6AP type=del 2024-09-14T11:04:24.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.308+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=VL8Z33A8TL11 type=write size=566966 2024-09-14T11:04:24.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.309+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=G3MCWLUISWLP type=del 2024-09-14T11:04:24.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.311+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~2QQFHLKBL5E1.0 size=720700 2024-09-14T11:04:24.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.311+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=2QQFHLKBL5E1 tag=SAXQ0ZNS3C7X type=write size=1769276 2024-09-14T11:04:24.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.312+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=XA0U6QHOC2VK type=write size=262490 2024-09-14T11:04:24.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.313+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=X2L8GXOU12O6 type=del size=2085897 2024-09-14T11:04:24.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.314+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~SFBN2W93RR20.0 size=1048576 2024-09-14T11:04:24.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.314+0000 7f907bbdf780 1 < canceled part key=_multipart_5MFLA6XFV3Y5.2~SFBN2W93RR20.1 size=47653 2024-09-14T11:04:24.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.316+0000 7f907bbdf780 1 < canceled multipart upload key=5MFLA6XFV3Y5 upload=SFBN2W93RR20 tag=C14BVS8HWLIZ type=write size=2144805 2024-09-14T11:04:24.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.317+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=0U8M7JC5Y0TV type=del size=3525561 2024-09-14T11:04:24.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.318+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=1JTD94ZXZQ18 type=del 2024-09-14T11:04:24.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.320+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~QZHLV338135L.0 size=1048576 2024-09-14T11:04:24.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.321+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~QZHLV338135L.1 size=290340 2024-09-14T11:04:24.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.321+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=QZHLV338135L tag=PLOZ1AV9ZO7N type=write size=2387492 2024-09-14T11:04:24.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.323+0000 7f907bbdf780 1 < suggested remove operation key=VRQ0ZNN9FG4C tag=4A0WNV8GZWO9 type=del 2024-09-14T11:04:24.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.324+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=E1Y912X0K4NV type=del size=1129832 2024-09-14T11:04:24.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.326+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=R7ZKDJ0P51CE type=del 2024-09-14T11:04:24.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.327+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=OR24UI9B99QV type=del size=3749179 2024-09-14T11:04:24.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.328+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~6PGIU41ANLZH.0 size=340569 2024-09-14T11:04:24.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.330+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=6PGIU41ANLZH tag=F397884UBYJI type=write size=1389145 2024-09-14T11:04:24.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.331+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=XAHNDVEIJRVQ type=del size=2636617 2024-09-14T11:04:24.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.332+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=36X67QIJ1M1T type=del 2024-09-14T11:04:24.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.333+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=MFAE18AJFCL4 type=del size=1786881 2024-09-14T11:04:24.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.336+0000 7f907bbdf780 1 < suggested remove operation key=WZ064RU647Y7 tag=Z40BAHEO2VB1 type=del 2024-09-14T11:04:24.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.338+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~03RY2HKF6XN4.0 size=161523 2024-09-14T11:04:24.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.338+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=03RY2HKF6XN4 tag=O1J14ALNIXQT type=write size=1210099 2024-09-14T11:04:24.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.339+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=TPW4296GMRIK type=del 2024-09-14T11:04:24.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.340+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=KFEKKD9GK0G9 type=del size=2519243 2024-09-14T11:04:24.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.343+0000 7f907bbdf780 1 < suggested update operation key=KQBX4UP53FV1 tag=L9YFJNL77RUU type=del size=642508 2024-09-14T11:04:24.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.344+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=CR91JABAD9ST type=del size=2059066 2024-09-14T11:04:24.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.345+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=L0BXTG27IW1K type=del 2024-09-14T11:04:24.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.347+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~G7X3QCQXPFXL.0 size=263855 2024-09-14T11:04:24.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.347+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=G7X3QCQXPFXL tag=M1FE5A89LSYT type=write size=1312431 2024-09-14T11:04:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.348+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~R3CWSG3QTIN6.0 size=1048576 2024-09-14T11:04:24.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.349+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~R3CWSG3QTIN6.1 size=468648 2024-09-14T11:04:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.351+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=R3CWSG3QTIN6 tag=9XEULGWWBDL4 type=write size=2565800 2024-09-14T11:04:24.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.353+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~D76NXMBMVSSB.0 size=1048576 2024-09-14T11:04:24.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.354+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~D76NXMBMVSSB.1 size=943901 2024-09-14T11:04:24.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.354+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=D76NXMBMVSSB tag=DIR0T131LCUN type=write size=3041053 2024-09-14T11:04:24.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.356+0000 7f907bbdf780 -1 < failed to complete operation key=WZ064RU647Y7 tag=BCLJR09VDAGG type=del size=2097493: (22) Invalid argument 2024-09-14T11:04:24.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.357+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=LDTTJZGTKMHH type=del size=3153373 2024-09-14T11:04:24.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.359+0000 7f907bbdf780 1 < suggested remove operation key=77H37YF6MJEO tag=HGF2KFB1SIU7 type=del 2024-09-14T11:04:24.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.361+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=S9XP2M1SFCUG type=del size=3694403 2024-09-14T11:04:24.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.362+0000 7f907bbdf780 1 < completed write operation key=GC52N456IYD7 tag=VL8Z33A8TL11 type=write size=566966 2024-09-14T11:04:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.363+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=TVAF820DAPGM type=del size=2446875 2024-09-14T11:04:24.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.365+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~2QQFHLKBL5E1.0 size=720700 2024-09-14T11:04:24.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.367+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=2QQFHLKBL5E1 tag=SAXQ0ZNS3C7X type=write size=1769276 2024-09-14T11:04:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.369+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.0 size=1048576 2024-09-14T11:04:24.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.370+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.1 size=1048576 2024-09-14T11:04:24.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.371+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.2 size=909865 2024-09-14T11:04:24.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.371+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=QLH243WCWB6N tag=U1NB51S7GVGM type=write size=4055593 2024-09-14T11:04:24.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.372+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=X2L8GXOU12O6 type=del 2024-09-14T11:04:24.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.374+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~LA3ATK0UQNQR.0 size=1048576 2024-09-14T11:04:24.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.375+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~LA3ATK0UQNQR.1 size=129542 2024-09-14T11:04:24.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.375+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=LA3ATK0UQNQR tag=ZFC7YSQ7UB3M type=write size=2226694 2024-09-14T11:04:24.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.377+0000 7f907bbdf780 1 < suggested update operation key=JEXUT5F7AKZ1 tag=0U8M7JC5Y0TV type=del size=3525561 2024-09-14T11:04:24.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.379+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.0 size=1048576 2024-09-14T11:04:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.380+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.1 size=1048576 2024-09-14T11:04:24.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.381+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.2 size=816593 2024-09-14T11:04:24.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.381+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=42GU8601Q69C tag=DS1KLIRSDEOY type=write size=3962321 2024-09-14T11:04:24.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.382+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~QZHLV338135L.0 size=1048576 2024-09-14T11:04:24.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.383+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~QZHLV338135L.1 size=290340 2024-09-14T11:04:24.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.385+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=QZHLV338135L tag=PLOZ1AV9ZO7N type=write size=2387492 2024-09-14T11:04:24.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.387+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~FEJX1ZYXGQ8E.0 size=971733 2024-09-14T11:04:24.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.387+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=FEJX1ZYXGQ8E tag=9DHVUGOVD237 type=write size=2020309 2024-09-14T11:04:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.389+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=E1Y912X0K4NV type=del 2024-09-14T11:04:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.390+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=PPH2ASGBUYH3 type=del size=1104195 2024-09-14T11:04:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.391+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=OR24UI9B99QV type=del 2024-09-14T11:04:24.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.392+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=DNLG1ECO8G9R type=del size=529160 2024-09-14T11:04:24.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.394+0000 7f907bbdf780 1 < suggested remove operation key=HHXUGVBHQ2US tag=XAHNDVEIJRVQ type=del 2024-09-14T11:04:24.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.395+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=LCMELGIG3UD0 type=del size=1566065 2024-09-14T11:04:24.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.397+0000 7f907bbdf780 1 < suggested update operation key=KQBX4UP53FV1 tag=MFAE18AJFCL4 type=del size=1786881 2024-09-14T11:04:24.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.399+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=DFADDQ3OVQOL type=del size=2610343 2024-09-14T11:04:24.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.400+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~03RY2HKF6XN4.0 size=161523 2024-09-14T11:04:24.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.402+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=03RY2HKF6XN4 tag=O1J14ALNIXQT type=write size=1210099 2024-09-14T11:04:24.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.403+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=31NCIABIYNSS type=del size=803658 2024-09-14T11:04:24.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.404+0000 7f907bbdf780 1 < canceled operation key=AI0W2MEG08HF tag=KFEKKD9GK0G9 type=del size=2519243 2024-09-14T11:04:24.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.406+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=0UMD1P2FH5LO type=del size=1121649 2024-09-14T11:04:24.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.407+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=CR91JABAD9ST type=del 2024-09-14T11:04:24.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.408+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=A1UKJB0B23QI type=del size=3179818 2024-09-14T11:04:24.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.410+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~G7X3QCQXPFXL.0 size=263855 2024-09-14T11:04:24.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.412+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=G7X3QCQXPFXL tag=M1FE5A89LSYT type=write size=1312431 2024-09-14T11:04:24.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.414+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~0D5QLI1YRN20.0 size=783325 2024-09-14T11:04:24.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.414+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=0D5QLI1YRN20 tag=G7PKYSYJAJPH type=write size=1831901 2024-09-14T11:04:24.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.415+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~D76NXMBMVSSB.0 size=1048576 2024-09-14T11:04:24.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.416+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~D76NXMBMVSSB.1 size=943901 2024-09-14T11:04:24.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.418+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=D76NXMBMVSSB tag=DIR0T131LCUN type=write size=3041053 2024-09-14T11:04:24.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.419+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=B57YPLJKCXB3 type=write size=51554 2024-09-14T11:04:24.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.421+0000 7f907bbdf780 1 < suggested update operation key=8NO5BA4HL03L tag=LDTTJZGTKMHH type=del size=3153373 2024-09-14T11:04:24.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.423+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=VGSFQ5LZ2TKB type=del size=2497971 2024-09-14T11:04:24.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.424+0000 7f907bbdf780 1 < canceled operation key=5C8LLJF5MSVP tag=S9XP2M1SFCUG type=del size=3694403 2024-09-14T11:04:24.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.426+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.0 size=1048576 2024-09-14T11:04:24.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.427+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.1 size=1048576 2024-09-14T11:04:24.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.428+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.2 size=355226 2024-09-14T11:04:24.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.428+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=UHVK9QQXJ2VG tag=OCS68NLJ5YSX type=write size=3500954 2024-09-14T11:04:24.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.431+0000 7f907bbdf780 1 < suggested remove operation key=6AWG2GM1ZP31 tag=TVAF820DAPGM type=del 2024-09-14T11:04:24.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.432+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=D0M13Y92YY0B type=del size=297288 2024-09-14T11:04:24.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.434+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.0 size=1048576 2024-09-14T11:04:24.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.435+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.1 size=1048576 2024-09-14T11:04:24.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.436+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~QLH243WCWB6N.2 size=909865 2024-09-14T11:04:24.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.438+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=QLH243WCWB6N tag=U1NB51S7GVGM type=write size=4055593 2024-09-14T11:04:24.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.439+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=D8XBG7OJN3CI type=del size=2014843 2024-09-14T11:04:24.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.440+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~LA3ATK0UQNQR.0 size=1048576 2024-09-14T11:04:24.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.441+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~LA3ATK0UQNQR.1 size=129542 2024-09-14T11:04:24.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.443+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=LA3ATK0UQNQR tag=ZFC7YSQ7UB3M type=write size=2226694 2024-09-14T11:04:24.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.444+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=H8HMWOSI4VR6 type=del size=75725 2024-09-14T11:04:24.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.445+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.0 size=1048576 2024-09-14T11:04:24.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.446+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.1 size=1048576 2024-09-14T11:04:24.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.447+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~42GU8601Q69C.2 size=816593 2024-09-14T11:04:24.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.449+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=42GU8601Q69C tag=DS1KLIRSDEOY type=write size=3962321 2024-09-14T11:04:24.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.450+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=KQ116ZP1C736 type=write size=70786 2024-09-14T11:04:24.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.451+0000 7f907bbdf780 1 < canceled part key=_multipart_Y3KOCA4072NM.2~FEJX1ZYXGQ8E.0 size=971733 2024-09-14T11:04:24.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.452+0000 7f907bbdf780 1 < canceled multipart upload key=Y3KOCA4072NM upload=FEJX1ZYXGQ8E tag=9DHVUGOVD237 type=write size=2020309 2024-09-14T11:04:24.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.454+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=SVUQJC3T555C type=del size=1732564 2024-09-14T11:04:24.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.455+0000 7f907bbdf780 -1 < failed to complete operation key=8NO5BA4HL03L tag=PPH2ASGBUYH3 type=del size=1104195: (22) Invalid argument 2024-09-14T11:04:24.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.457+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~3Q2FFVBXEFPG.0 size=593529 2024-09-14T11:04:24.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.457+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=3Q2FFVBXEFPG tag=C3XSYN6329IA type=write size=1642105 2024-09-14T11:04:24.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.459+0000 7f907bbdf780 1 < suggested remove operation key=8C398XZ7XKU7 tag=DNLG1ECO8G9R type=del 2024-09-14T11:04:24.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.460+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=4RRIZ9IMQV2J type=del size=943845 2024-09-14T11:04:24.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.462+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=LCMELGIG3UD0 type=del 2024-09-14T11:04:24.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.464+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~P867GL1ODW7H.0 size=735063 2024-09-14T11:04:24.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.464+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=P867GL1ODW7H tag=6L0980W8W6GI type=write size=1783639 2024-09-14T11:04:24.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.467+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=DFADDQ3OVQOL type=del 2024-09-14T11:04:24.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.468+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=HLYYI538YLNE type=del size=3055368 2024-09-14T11:04:24.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.470+0000 7f907bbdf780 1 < suggested remove operation key=HM2GVOA72HHR tag=31NCIABIYNSS type=del 2024-09-14T11:04:24.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.472+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.0 size=1048576 2024-09-14T11:04:24.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.473+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.1 size=1048576 2024-09-14T11:04:24.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.474+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.2 size=835318 2024-09-14T11:04:24.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.474+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=Z92T0FHL3BD6 tag=R9S880LIBZ8V type=write size=3981046 2024-09-14T11:04:24.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.477+0000 7f907bbdf780 1 < suggested remove operation key=T81OF13I2JVH tag=0UMD1P2FH5LO type=del 2024-09-14T11:04:24.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.478+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=UXUMYVGAQCUV type=del size=542617 2024-09-14T11:04:24.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.479+0000 7f907bbdf780 -1 < failed to complete operation key=8NO5BA4HL03L tag=A1UKJB0B23QI type=del size=3179818: (22) Invalid argument 2024-09-14T11:04:24.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.481+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~2JC34ZE07QX7.0 size=395789 2024-09-14T11:04:24.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.481+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=2JC34ZE07QX7 tag=GE6LI8DPENM9 type=write size=1444365 2024-09-14T11:04:24.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.483+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~0D5QLI1YRN20.0 size=783325 2024-09-14T11:04:24.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.485+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=0D5QLI1YRN20 tag=G7PKYSYJAJPH type=write size=1831901 2024-09-14T11:04:24.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.486+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=O950J24YCEG7 type=del size=4192118 2024-09-14T11:04:24.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.487+0000 7f907bbdf780 -1 < failed to complete operation key=T81OF13I2JVH tag=B57YPLJKCXB3 type=write size=51554: (22) Invalid argument 2024-09-14T11:04:24.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.488+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=8WVU8NDGLZUV type=del size=1121219 2024-09-14T11:04:24.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.490+0000 7f907bbdf780 1 < canceled operation key=8NO5BA4HL03L tag=VGSFQ5LZ2TKB type=del size=2497971 2024-09-14T11:04:24.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.491+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=W1PNUZQRXNB4 type=del size=2402566 2024-09-14T11:04:24.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.493+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.0 size=1048576 2024-09-14T11:04:24.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.494+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.1 size=1048576 2024-09-14T11:04:24.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.495+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~UHVK9QQXJ2VG.2 size=355226 2024-09-14T11:04:24.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.497+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=UHVK9QQXJ2VG tag=OCS68NLJ5YSX type=write size=3500954 2024-09-14T11:04:24.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.499+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~T9KQCFIX0V5A.0 size=690688 2024-09-14T11:04:24.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.499+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=T9KQCFIX0V5A tag=P9BIXSPYCH4S type=write size=1739264 2024-09-14T11:04:24.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.500+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=D0M13Y92YY0B type=del 2024-09-14T11:04:24.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.501+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=1DFMHGFKBDIH type=del size=2834205 2024-09-14T11:04:24.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.502+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=D8XBG7OJN3CI type=del 2024-09-14T11:04:24.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.504+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=1T6RUR0YL4HS type=del size=3271397 2024-09-14T11:04:24.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.506+0000 7f907bbdf780 1 < suggested remove operation key=Y3KOCA4072NM tag=H8HMWOSI4VR6 type=del 2024-09-14T11:04:24.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.507+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=FWVCZH6369NH type=del size=3652587 2024-09-14T11:04:24.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.508+0000 7f907bbdf780 1 < completed write operation key=5C8LLJF5MSVP tag=KQ116ZP1C736 type=write size=70786 2024-09-14T11:04:24.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.510+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~PMRZNYBFDLFZ.0 size=1048576 2024-09-14T11:04:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.511+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~PMRZNYBFDLFZ.1 size=781365 2024-09-14T11:04:24.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.511+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=PMRZNYBFDLFZ tag=IU38RHITVROX type=write size=2878517 2024-09-14T11:04:24.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.513+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=SVUQJC3T555C type=del 2024-09-14T11:04:24.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.514+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=27ZBRG0RDAT0 type=del size=1592958 2024-09-14T11:04:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.516+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~3Q2FFVBXEFPG.0 size=593529 2024-09-14T11:04:24.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.518+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=3Q2FFVBXEFPG tag=C3XSYN6329IA type=write size=1642105 2024-09-14T11:04:24.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.522+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.0 size=1048576 2024-09-14T11:04:24.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.523+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.1 size=1048576 2024-09-14T11:04:24.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.524+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.2 size=835677 2024-09-14T11:04:24.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.524+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=EC8G5BQ84GZB tag=B7AWU9KG5D1K type=write size=3981405 2024-09-14T11:04:24.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.525+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=4RRIZ9IMQV2J type=del 2024-09-14T11:04:24.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.526+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=YIE0Z0NFEKAC type=del size=2590992 2024-09-14T11:04:24.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.527+0000 7f907bbdf780 1 < canceled part key=_multipart_ZFF333CYOK5P.2~P867GL1ODW7H.0 size=735063 2024-09-14T11:04:24.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.529+0000 7f907bbdf780 1 < canceled multipart upload key=ZFF333CYOK5P upload=P867GL1ODW7H tag=6L0980W8W6GI type=write size=1783639 2024-09-14T11:04:24.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.530+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=6OS7TXOHGARU type=write size=765013 2024-09-14T11:04:24.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.532+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=HLYYI538YLNE type=del 2024-09-14T11:04:24.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.533+0000 7f907bbdf780 1 > prepared operation key=S8RIEED24PUM tag=XGZ38KLXQ7CN type=del size=933438 2024-09-14T11:04:24.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.534+0000 7f907bbdf780 1 < canceled part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.0 size=1048576 2024-09-14T11:04:24.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.535+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.1 size=1048576 2024-09-14T11:04:24.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.536+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~Z92T0FHL3BD6.2 size=835318 2024-09-14T11:04:24.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.538+0000 7f907bbdf780 1 < canceled multipart upload key=FTYIOOQROLG6 upload=Z92T0FHL3BD6 tag=R9S880LIBZ8V type=write size=3981046 2024-09-14T11:04:24.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.540+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=9BKZ3J9AZP4R type=del size=3732837 2024-09-14T11:04:24.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.541+0000 7f907bbdf780 1 < completed delete operation key=S8RIEED24PUM tag=UXUMYVGAQCUV type=del 2024-09-14T11:04:24.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.542+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=1QHBOFYQ7029 type=del size=2595457 2024-09-14T11:04:24.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.544+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~2JC34ZE07QX7.0 size=395789 2024-09-14T11:04:24.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.546+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=2JC34ZE07QX7 tag=GE6LI8DPENM9 type=write size=1444365 2024-09-14T11:04:24.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.547+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=I32NMHEP2ZB3 type=del size=2839666 2024-09-14T11:04:24.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.548+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=O950J24YCEG7 type=del 2024-09-14T11:04:24.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.550+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.0 size=1048576 2024-09-14T11:04:24.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.551+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.1 size=1048576 2024-09-14T11:04:24.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.552+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.2 size=340039 2024-09-14T11:04:24.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.552+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=C1H08BED0GM5 tag=0PTXFFWYXEH1 type=write size=3485767 2024-09-14T11:04:24.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.553+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=8WVU8NDGLZUV type=del 2024-09-14T11:04:24.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.555+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=G6Z8AI3GPKMV type=del size=3127890 2024-09-14T11:04:24.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.557+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=W1PNUZQRXNB4 type=del 2024-09-14T11:04:24.556 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.558+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=ERVT8OMB88YZ type=del size=2644342 2024-09-14T11:04:24.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.559+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~T9KQCFIX0V5A.0 size=690688 2024-09-14T11:04:24.559 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.561+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=T9KQCFIX0V5A tag=P9BIXSPYCH4S type=write size=1739264 2024-09-14T11:04:24.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.563+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=6I495IUEVPXJ type=del size=1999939 2024-09-14T11:04:24.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.564+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=1DFMHGFKBDIH type=del 2024-09-14T11:04:24.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.565+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=YB1EYOGLO4M7 type=del size=761538 2024-09-14T11:04:24.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.567+0000 7f907bbdf780 -1 < failed to complete operation key=Y3KOCA4072NM tag=1T6RUR0YL4HS type=del size=3271397: (22) Invalid argument 2024-09-14T11:04:24.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.568+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=SGXTWH0Y2O1D type=write size=488750 2024-09-14T11:04:24.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.570+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=FWVCZH6369NH type=del 2024-09-14T11:04:24.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.572+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~ZDDN3XPUNFQR.0 size=1048576 2024-09-14T11:04:24.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.573+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~ZDDN3XPUNFQR.1 size=909304 2024-09-14T11:04:24.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.573+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=ZDDN3XPUNFQR tag=SWV0TPLG0884 type=write size=3006456 2024-09-14T11:04:24.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.574+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~PMRZNYBFDLFZ.0 size=1048576 2024-09-14T11:04:24.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.574+0000 7f907bbdf780 1 < canceled part key=_multipart_LQNZKMX52SWO.2~PMRZNYBFDLFZ.1 size=781365 2024-09-14T11:04:24.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.576+0000 7f907bbdf780 1 < canceled multipart upload key=LQNZKMX52SWO upload=PMRZNYBFDLFZ tag=IU38RHITVROX type=write size=2878517 2024-09-14T11:04:24.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.577+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=70CT3YX3Q7Z9 type=write size=24966 2024-09-14T11:04:24.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.579+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=27ZBRG0RDAT0 type=del 2024-09-14T11:04:24.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.581+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.0 size=1048576 2024-09-14T11:04:24.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.582+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.1 size=1048576 2024-09-14T11:04:24.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.583+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.2 size=38210 2024-09-14T11:04:24.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.583+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=XU2HKYOTZT7W tag=BW56IJL0NWAC type=write size=3183938 2024-09-14T11:04:24.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.585+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.0 size=1048576 2024-09-14T11:04:24.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.586+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.1 size=1048576 2024-09-14T11:04:24.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.587+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~EC8G5BQ84GZB.2 size=835677 2024-09-14T11:04:24.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.589+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=EC8G5BQ84GZB tag=B7AWU9KG5D1K type=write size=3981405 2024-09-14T11:04:24.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.590+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=TDLVUY8IYAFO type=del size=3479791 2024-09-14T11:04:24.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.591+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=YIE0Z0NFEKAC type=del 2024-09-14T11:04:24.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.592+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=NMWKFZIJEKBU type=del size=1242068 2024-09-14T11:04:24.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.593+0000 7f907bbdf780 1 < completed write operation key=59WHXDR0S8DM tag=6OS7TXOHGARU type=write size=765013 2024-09-14T11:04:24.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.595+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~YRVWLDEUI9PO.0 size=679498 2024-09-14T11:04:24.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.595+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=YRVWLDEUI9PO tag=FA3F19OAF0V6 type=write size=1728074 2024-09-14T11:04:24.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.597+0000 7f907bbdf780 1 < canceled operation key=S8RIEED24PUM tag=XGZ38KLXQ7CN type=del size=933438 2024-09-14T11:04:24.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.598+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=1UV97102UHCD type=del size=1270425 2024-09-14T11:04:24.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.599+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=9BKZ3J9AZP4R type=del 2024-09-14T11:04:24.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.602+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~66HJ7ZM0IZDV.0 size=1048576 2024-09-14T11:04:24.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.603+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~66HJ7ZM0IZDV.1 size=763282 2024-09-14T11:04:24.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.603+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=66HJ7ZM0IZDV tag=YHCNSA6YCSF0 type=write size=2860434 2024-09-14T11:04:24.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.604+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=1QHBOFYQ7029 type=del 2024-09-14T11:04:24.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.606+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.0 size=1048576 2024-09-14T11:04:24.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.607+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.1 size=1048576 2024-09-14T11:04:24.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.608+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.2 size=772900 2024-09-14T11:04:24.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.608+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=ZC8ZCRV8PN8U tag=51WEEW38CQTW type=write size=3918628 2024-09-14T11:04:24.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.609+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=I32NMHEP2ZB3 type=del size=2839666: (22) Invalid argument 2024-09-14T11:04:24.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.612+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~YXNKWA15QR6L.0 size=926331 2024-09-14T11:04:24.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.612+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=YXNKWA15QR6L tag=YEPDHFOU2DCE type=write size=1974907 2024-09-14T11:04:24.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.613+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.0 size=1048576 2024-09-14T11:04:24.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.614+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.1 size=1048576 2024-09-14T11:04:24.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.615+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~C1H08BED0GM5.2 size=340039 2024-09-14T11:04:24.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.618+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=C1H08BED0GM5 tag=0PTXFFWYXEH1 type=write size=3485767 2024-09-14T11:04:24.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.619+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=KP3KOBB0TFR8 type=del size=365636 2024-09-14T11:04:24.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.621+0000 7f907bbdf780 1 < suggested remove operation key=6AWG2GM1ZP31 tag=G6Z8AI3GPKMV type=del 2024-09-14T11:04:24.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.623+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~0JIV9BGOHREP.0 size=690484 2024-09-14T11:04:24.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.623+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=0JIV9BGOHREP tag=BXBQBO9P0SQL type=write size=1739060 2024-09-14T11:04:24.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.624+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=ERVT8OMB88YZ type=del 2024-09-14T11:04:24.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.625+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=2PNX1607B2RU type=del size=850345 2024-09-14T11:04:24.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.626+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=6I495IUEVPXJ type=del 2024-09-14T11:04:24.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.628+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=AZ2URQFPZNBQ type=del size=2841532 2024-09-14T11:04:24.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.629+0000 7f907bbdf780 1 < canceled operation key=LJ720PV3SQ8L tag=YB1EYOGLO4M7 type=del size=761538 2024-09-14T11:04:24.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.631+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.0 size=1048576 2024-09-14T11:04:24.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.632+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.1 size=1048576 2024-09-14T11:04:24.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.633+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.2 size=746006 2024-09-14T11:04:24.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.633+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=TYO8U9AR6BUL tag=YFCJSB0106Y2 type=write size=3891734 2024-09-14T11:04:24.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.636+0000 7f907bbdf780 1 < suggested update operation key=VRQ0ZNN9FG4C tag=SGXTWH0Y2O1D type=write size=488750 2024-09-14T11:04:24.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.637+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=2AOYJTE6TSQO type=del size=2972767 2024-09-14T11:04:24.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.638+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~ZDDN3XPUNFQR.0 size=1048576 2024-09-14T11:04:24.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.640+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~ZDDN3XPUNFQR.1 size=909304 2024-09-14T11:04:24.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.642+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=ZDDN3XPUNFQR tag=SWV0TPLG0884 type=write size=3006456 2024-09-14T11:04:24.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.643+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=BHKIPEZVD80I type=del size=1491254 2024-09-14T11:04:24.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.644+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=70CT3YX3Q7Z9 type=write size=24966 2024-09-14T11:04:24.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.646+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.0 size=1048576 2024-09-14T11:04:24.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.647+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.1 size=1048576 2024-09-14T11:04:24.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.648+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.2 size=999398 2024-09-14T11:04:24.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.648+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=GSHIT541748B tag=UB78XKDYEEXE type=write size=4145126 2024-09-14T11:04:24.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.649+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.0 size=1048576 2024-09-14T11:04:24.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.650+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.1 size=1048576 2024-09-14T11:04:24.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.651+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~XU2HKYOTZT7W.2 size=38210 2024-09-14T11:04:24.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.653+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=XU2HKYOTZT7W tag=BW56IJL0NWAC type=write size=3183938 2024-09-14T11:04:24.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.655+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~LZMBU1AV8091.0 size=921510 2024-09-14T11:04:24.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.655+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=LZMBU1AV8091 tag=ERI0TVSJKO7S type=write size=1970086 2024-09-14T11:04:24.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.656+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=TDLVUY8IYAFO type=del 2024-09-14T11:04:24.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.658+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=JN41UPK3LFIY type=del size=1669705 2024-09-14T11:04:24.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.659+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=NMWKFZIJEKBU type=del 2024-09-14T11:04:24.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.660+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=OKI00PWC7QX7 type=del size=3568924 2024-09-14T11:04:24.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.661+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~YRVWLDEUI9PO.0 size=679498 2024-09-14T11:04:24.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.663+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=YRVWLDEUI9PO tag=FA3F19OAF0V6 type=write size=1728074 2024-09-14T11:04:24.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.664+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=C4A6SBC7ZKUY type=del size=3398370 2024-09-14T11:04:24.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.666+0000 7f907bbdf780 1 < canceled operation key=77H37YF6MJEO tag=1UV97102UHCD type=del size=1270425 2024-09-14T11:04:24.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.668+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.0 size=1048576 2024-09-14T11:04:24.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.669+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.1 size=1048576 2024-09-14T11:04:24.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.670+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.2 size=694873 2024-09-14T11:04:24.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.670+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=11AKGWHNK560 tag=YR4P5MRGQ7R3 type=write size=3840601 2024-09-14T11:04:24.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.671+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~66HJ7ZM0IZDV.0 size=1048576 2024-09-14T11:04:24.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.672+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~66HJ7ZM0IZDV.1 size=763282 2024-09-14T11:04:24.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.673+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=66HJ7ZM0IZDV tag=YHCNSA6YCSF0 type=write size=2860434 2024-09-14T11:04:24.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.676+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~011JN3NYP9AW.0 size=1048576 2024-09-14T11:04:24.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.676+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~011JN3NYP9AW.1 size=992480 2024-09-14T11:04:24.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.676+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=011JN3NYP9AW tag=7UCB9W06HKZR type=write size=3089632 2024-09-14T11:04:24.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.678+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.0 size=1048576 2024-09-14T11:04:24.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.678+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.1 size=1048576 2024-09-14T11:04:24.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.679+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~ZC8ZCRV8PN8U.2 size=772900 2024-09-14T11:04:24.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.681+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=ZC8ZCRV8PN8U tag=51WEEW38CQTW type=write size=3918628 2024-09-14T11:04:24.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.683+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~9PL916IZO4H2.0 size=1019224 2024-09-14T11:04:24.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.683+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=9PL916IZO4H2 tag=Q03KKMS62JX6 type=write size=2067800 2024-09-14T11:04:24.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.684+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~YXNKWA15QR6L.0 size=926331 2024-09-14T11:04:24.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.686+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=YXNKWA15QR6L tag=YEPDHFOU2DCE type=write size=1974907 2024-09-14T11:04:24.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.687+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=6RH9FL1A63PX type=del size=2947413 2024-09-14T11:04:24.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.689+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=KP3KOBB0TFR8 type=del 2024-09-14T11:04:24.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.691+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.0 size=1048576 2024-09-14T11:04:24.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.692+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.1 size=1048576 2024-09-14T11:04:24.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.693+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.2 size=891318 2024-09-14T11:04:24.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.693+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=UUIF4823D08D tag=AMZWIN0DL15J type=write size=4037046 2024-09-14T11:04:24.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.694+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~0JIV9BGOHREP.0 size=690484 2024-09-14T11:04:24.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.696+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=0JIV9BGOHREP tag=BXBQBO9P0SQL type=write size=1739060 2024-09-14T11:04:24.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.697+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=B0BHGK6PTX1O type=write size=231997 2024-09-14T11:04:24.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.698+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=2PNX1607B2RU type=del 2024-09-14T11:04:24.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.700+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=S85JK8RWPCZU type=del size=2423876 2024-09-14T11:04:24.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.701+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=AZ2URQFPZNBQ type=del 2024-09-14T11:04:24.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.702+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=PI58KKP96AVM type=del size=3582080 2024-09-14T11:04:24.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.703+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.0 size=1048576 2024-09-14T11:04:24.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.704+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.1 size=1048576 2024-09-14T11:04:24.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.704+0000 7f907bbdf780 1 < canceled part key=_multipart_5C8LLJF5MSVP.2~TYO8U9AR6BUL.2 size=746006 2024-09-14T11:04:24.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.706+0000 7f907bbdf780 1 < canceled multipart upload key=5C8LLJF5MSVP upload=TYO8U9AR6BUL tag=YFCJSB0106Y2 type=write size=3891734 2024-09-14T11:04:24.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.708+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=SRKCJWZF22SX type=write size=179376 2024-09-14T11:04:24.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.709+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=2AOYJTE6TSQO type=del 2024-09-14T11:04:24.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.710+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=HNF3ZUUWGLP1 type=del size=2102671 2024-09-14T11:04:24.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.712+0000 7f907bbdf780 1 < suggested update operation key=FTYIOOQROLG6 tag=BHKIPEZVD80I type=del size=1491254 2024-09-14T11:04:24.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.715+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~V7DDAFZP1AO9.0 size=261711 2024-09-14T11:04:24.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.715+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=V7DDAFZP1AO9 tag=46GVGT6DE7OZ type=write size=1310287 2024-09-14T11:04:24.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.716+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.0 size=1048576 2024-09-14T11:04:24.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.717+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.1 size=1048576 2024-09-14T11:04:24.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.718+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~GSHIT541748B.2 size=999398 2024-09-14T11:04:24.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.720+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=GSHIT541748B tag=UB78XKDYEEXE type=write size=4145126 2024-09-14T11:04:24.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.721+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=EEA0RHHDEVG6 type=del size=1958156 2024-09-14T11:04:24.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.722+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~LZMBU1AV8091.0 size=921510 2024-09-14T11:04:24.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.724+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=LZMBU1AV8091 tag=ERI0TVSJKO7S type=write size=1970086 2024-09-14T11:04:24.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.726+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~16JBH3RC8W81.0 size=1048576 2024-09-14T11:04:24.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.727+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~16JBH3RC8W81.1 size=448181 2024-09-14T11:04:24.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.727+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=16JBH3RC8W81 tag=U6QTRHACBAX7 type=write size=2545333 2024-09-14T11:04:24.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.729+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=JN41UPK3LFIY type=del 2024-09-14T11:04:24.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.730+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=LRDYWPHN1AK5 type=del size=708311 2024-09-14T11:04:24.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.731+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=OKI00PWC7QX7 type=del 2024-09-14T11:04:24.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.732+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=73A5FYR1SHG8 type=write size=1032167 2024-09-14T11:04:24.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.734+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=C4A6SBC7ZKUY type=del 2024-09-14T11:04:24.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.735+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=4TEZT4T3735L type=del size=1420692 2024-09-14T11:04:24.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.736+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.0 size=1048576 2024-09-14T11:04:24.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.737+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.1 size=1048576 2024-09-14T11:04:24.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.737+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~11AKGWHNK560.2 size=694873 2024-09-14T11:04:24.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.739+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=11AKGWHNK560 tag=YR4P5MRGQ7R3 type=write size=3840601 2024-09-14T11:04:24.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.741+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~FX0TNJ43OELB.0 size=140222 2024-09-14T11:04:24.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.741+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=FX0TNJ43OELB tag=J2W7R3HOP5NR type=write size=1188798 2024-09-14T11:04:24.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.743+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~011JN3NYP9AW.0 size=1048576 2024-09-14T11:04:24.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.744+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~011JN3NYP9AW.1 size=992480 2024-09-14T11:04:24.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.746+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=011JN3NYP9AW tag=7UCB9W06HKZR type=write size=3089632 2024-09-14T11:04:24.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.747+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=PU9XQZMICNJZ type=write size=570160 2024-09-14T11:04:24.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.749+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~9PL916IZO4H2.0 size=1019224 2024-09-14T11:04:24.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.751+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=9PL916IZO4H2 tag=Q03KKMS62JX6 type=write size=2067800 2024-09-14T11:04:24.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.753+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~KUUY338IANC6.0 size=1048576 2024-09-14T11:04:24.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.754+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~KUUY338IANC6.1 size=719083 2024-09-14T11:04:24.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.754+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=KUUY338IANC6 tag=0EM1RG31JR1N type=write size=2816235 2024-09-14T11:04:24.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.755+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=6RH9FL1A63PX type=del 2024-09-14T11:04:24.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.757+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=3C6IR841YDHP type=del size=2662688 2024-09-14T11:04:24.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.758+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.0 size=1048576 2024-09-14T11:04:24.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.759+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.1 size=1048576 2024-09-14T11:04:24.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.759+0000 7f907bbdf780 1 < canceled part key=_multipart_6AWG2GM1ZP31.2~UUIF4823D08D.2 size=891318 2024-09-14T11:04:24.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.761+0000 7f907bbdf780 1 < canceled multipart upload key=6AWG2GM1ZP31 upload=UUIF4823D08D tag=AMZWIN0DL15J type=write size=4037046 2024-09-14T11:04:24.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.763+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~9V2NO9IK4UM9.0 size=1048576 2024-09-14T11:04:24.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.764+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~9V2NO9IK4UM9.1 size=842146 2024-09-14T11:04:24.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.764+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=9V2NO9IK4UM9 tag=6VEMQ1127TJ1 type=write size=2939298 2024-09-14T11:04:24.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.765+0000 7f907bbdf780 1 < canceled operation key=JEXUT5F7AKZ1 tag=B0BHGK6PTX1O type=write size=231997 2024-09-14T11:04:24.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.766+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=VG0K2D2BJJJ3 type=del size=1290104 2024-09-14T11:04:24.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.768+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=S85JK8RWPCZU type=del 2024-09-14T11:04:24.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.769+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=ZRKVLOH8KMLB type=del size=704802 2024-09-14T11:04:24.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.770+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=PI58KKP96AVM type=del 2024-09-14T11:04:24.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.771+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=7KD0S203XXCE type=del size=1971957 2024-09-14T11:04:24.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.772+0000 7f907bbdf780 1 < completed write operation key=E3OIUTR3JCQY tag=SRKCJWZF22SX type=write size=179376 2024-09-14T11:04:24.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.774+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=5KELV647R0RK type=del size=1070365 2024-09-14T11:04:24.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.775+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=HNF3ZUUWGLP1 type=del 2024-09-14T11:04:24.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.777+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~OYRW370XZA1K.0 size=534307 2024-09-14T11:04:24.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.777+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=OYRW370XZA1K tag=ZEDDNVB4PFYQ type=write size=1582883 2024-09-14T11:04:24.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.778+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~V7DDAFZP1AO9.0 size=261711 2024-09-14T11:04:24.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.780+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=V7DDAFZP1AO9 tag=46GVGT6DE7OZ type=write size=1310287 2024-09-14T11:04:24.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.781+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=WGYJZIX3ZGFK type=del size=3309039 2024-09-14T11:04:24.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.782+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=EEA0RHHDEVG6 type=del 2024-09-14T11:04:24.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.784+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~S2VZFTJCLM65.0 size=1048576 2024-09-14T11:04:24.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.785+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~S2VZFTJCLM65.1 size=51319 2024-09-14T11:04:24.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.785+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=S2VZFTJCLM65 tag=XZZEJP3FS3DJ type=write size=2148471 2024-09-14T11:04:24.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.787+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~16JBH3RC8W81.0 size=1048576 2024-09-14T11:04:24.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.788+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~16JBH3RC8W81.1 size=448181 2024-09-14T11:04:24.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.790+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=16JBH3RC8W81 tag=U6QTRHACBAX7 type=write size=2545333 2024-09-14T11:04:24.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.791+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=EIIRV0IMEABS type=del size=2153853 2024-09-14T11:04:24.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.792+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=LRDYWPHN1AK5 type=del 2024-09-14T11:04:24.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.794+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=QBOPIKS6ZVI9 type=del size=1376031 2024-09-14T11:04:24.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.796+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=73A5FYR1SHG8 type=write size=1032167 2024-09-14T11:04:24.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.797+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=RFBTXAIJMEY2 type=del size=2580581 2024-09-14T11:04:24.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.798+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=4TEZT4T3735L type=del 2024-09-14T11:04:24.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.801+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~ILPHIO3MOKUQ.0 size=1048576 2024-09-14T11:04:24.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.802+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~ILPHIO3MOKUQ.1 size=330399 2024-09-14T11:04:24.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.802+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=ILPHIO3MOKUQ tag=Q9DHWTV24DYC type=write size=2427551 2024-09-14T11:04:24.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.803+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~FX0TNJ43OELB.0 size=140222 2024-09-14T11:04:24.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.805+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=FX0TNJ43OELB tag=J2W7R3HOP5NR type=write size=1188798 2024-09-14T11:04:24.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.808+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.0 size=1048576 2024-09-14T11:04:24.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.808+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.1 size=1048576 2024-09-14T11:04:24.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.809+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.2 size=498457 2024-09-14T11:04:24.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.809+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=WUI3OYZL3LLX tag=YH8GAOBEFP9Y type=write size=3644185 2024-09-14T11:04:24.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.811+0000 7f907bbdf780 1 < canceled operation key=KQBX4UP53FV1 tag=PU9XQZMICNJZ type=write size=570160 2024-09-14T11:04:24.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.813+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.0 size=1048576 2024-09-14T11:04:24.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.814+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.1 size=1048576 2024-09-14T11:04:24.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.815+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.2 size=986441 2024-09-14T11:04:24.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.815+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=HTRSO6FMF3KR tag=XJ73RNAJVBTM type=write size=4132169 2024-09-14T11:04:24.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.816+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~KUUY338IANC6.0 size=1048576 2024-09-14T11:04:24.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.817+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~KUUY338IANC6.1 size=719083 2024-09-14T11:04:24.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.819+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=KUUY338IANC6 tag=0EM1RG31JR1N type=write size=2816235 2024-09-14T11:04:24.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.820+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=5FOVXXIRGZO1 type=del size=1986510 2024-09-14T11:04:24.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.821+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=3C6IR841YDHP type=del 2024-09-14T11:04:24.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.824+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.0 size=1048576 2024-09-14T11:04:24.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.825+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.1 size=1048576 2024-09-14T11:04:24.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.826+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.2 size=764006 2024-09-14T11:04:24.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.826+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=1PXNPQAV59L8 tag=66T3IB2PEKUD type=write size=3909734 2024-09-14T11:04:24.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.826+0000 7f907bbdf780 1 < canceled part key=_multipart_AI0W2MEG08HF.2~9V2NO9IK4UM9.0 size=1048576 2024-09-14T11:04:24.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.827+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~9V2NO9IK4UM9.1 size=842146 2024-09-14T11:04:24.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.829+0000 7f907bbdf780 1 < canceled multipart upload key=AI0W2MEG08HF upload=9V2NO9IK4UM9 tag=6VEMQ1127TJ1 type=write size=2939298 2024-09-14T11:04:24.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.830+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=MNUXVKQ82LHD type=del size=3739758 2024-09-14T11:04:24.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.831+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=VG0K2D2BJJJ3 type=del 2024-09-14T11:04:24.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.833+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=35IFUZKM58DC type=del size=3270662 2024-09-14T11:04:24.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.835+0000 7f907bbdf780 1 < suggested remove operation key=E3OIUTR3JCQY tag=ZRKVLOH8KMLB type=del 2024-09-14T11:04:24.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.837+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~GJ7PIFY63K9E.0 size=157089 2024-09-14T11:04:24.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.837+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=GJ7PIFY63K9E tag=AP7Z0RW5Y42R type=write size=1205665 2024-09-14T11:04:24.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.838+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=7KD0S203XXCE type=del 2024-09-14T11:04:24.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.841+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.0 size=1048576 2024-09-14T11:04:24.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.841+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.1 size=1048576 2024-09-14T11:04:24.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.842+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.2 size=564743 2024-09-14T11:04:24.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.842+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=SL2JJ2IJXLG1 tag=1I7N7IPNF3LE type=write size=3710471 2024-09-14T11:04:24.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.845+0000 7f907bbdf780 1 < suggested update operation key=HHXUGVBHQ2US tag=5KELV647R0RK type=del size=1070365 2024-09-14T11:04:24.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.846+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=13FO5EX8I60L type=write size=742484 2024-09-14T11:04:24.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.847+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~OYRW370XZA1K.0 size=534307 2024-09-14T11:04:24.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.849+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=OYRW370XZA1K tag=ZEDDNVB4PFYQ type=write size=1582883 2024-09-14T11:04:24.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.850+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=CWKBM9JDGRJV type=del size=3762681 2024-09-14T11:04:24.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.851+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=WGYJZIX3ZGFK type=del 2024-09-14T11:04:24.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.852+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=856CPS3YQANL type=del size=292238 2024-09-14T11:04:24.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.854+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~S2VZFTJCLM65.0 size=1048576 2024-09-14T11:04:24.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.854+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~S2VZFTJCLM65.1 size=51319 2024-09-14T11:04:24.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.856+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=S2VZFTJCLM65 tag=XZZEJP3FS3DJ type=write size=2148471 2024-09-14T11:04:24.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.857+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=1TIDU77X5YJD type=del size=252060 2024-09-14T11:04:24.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.859+0000 7f907bbdf780 1 < canceled operation key=5MFLA6XFV3Y5 tag=EIIRV0IMEABS type=del size=2153853 2024-09-14T11:04:24.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.861+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=APJXR9O9EDBT type=del size=2335661 2024-09-14T11:04:24.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.862+0000 7f907bbdf780 1 < completed delete operation key=77H37YF6MJEO tag=QBOPIKS6ZVI9 type=del 2024-09-14T11:04:24.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.863+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=KDWXNDOIK8A5 type=del size=266434 2024-09-14T11:04:24.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.865+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=RFBTXAIJMEY2 type=del 2024-09-14T11:04:24.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.866+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=59GSYD9NI3WG type=del size=1903578 2024-09-14T11:04:24.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.867+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~ILPHIO3MOKUQ.0 size=1048576 2024-09-14T11:04:24.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.867+0000 7f907bbdf780 1 < canceled part key=_multipart_HHXUGVBHQ2US.2~ILPHIO3MOKUQ.1 size=330399 2024-09-14T11:04:24.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.869+0000 7f907bbdf780 1 < canceled multipart upload key=HHXUGVBHQ2US upload=ILPHIO3MOKUQ tag=Q9DHWTV24DYC type=write size=2427551 2024-09-14T11:04:24.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.870+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=OFCBCBFTR0EQ type=del size=1761102 2024-09-14T11:04:24.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.871+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.0 size=1048576 2024-09-14T11:04:24.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.872+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.1 size=1048576 2024-09-14T11:04:24.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.873+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~WUI3OYZL3LLX.2 size=498457 2024-09-14T11:04:24.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.875+0000 7f907bbdf780 1 < completed multipart upload key=E3OIUTR3JCQY upload=WUI3OYZL3LLX tag=YH8GAOBEFP9Y type=write size=3644185 2024-09-14T11:04:24.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.877+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~MA9RLMUVWV7R.0 size=1048576 2024-09-14T11:04:24.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.878+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~MA9RLMUVWV7R.1 size=525879 2024-09-14T11:04:24.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.878+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=MA9RLMUVWV7R tag=4OFJF90PTX5L type=write size=2623031 2024-09-14T11:04:24.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.879+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.0 size=1048576 2024-09-14T11:04:24.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.880+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.1 size=1048576 2024-09-14T11:04:24.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.881+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~HTRSO6FMF3KR.2 size=986441 2024-09-14T11:04:24.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.883+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=HTRSO6FMF3KR tag=XJ73RNAJVBTM type=write size=4132169 2024-09-14T11:04:24.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.884+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=8WFT3MSNM1DE type=del size=4038646 2024-09-14T11:04:24.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.885+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=5FOVXXIRGZO1 type=del 2024-09-14T11:04:24.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.887+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~7XBCA1ZBZGBP.0 size=713144 2024-09-14T11:04:24.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.887+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=7XBCA1ZBZGBP tag=3AF92OX9QYHZ type=write size=1761720 2024-09-14T11:04:24.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.889+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.0 size=1048576 2024-09-14T11:04:24.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.889+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.1 size=1048576 2024-09-14T11:04:24.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.890+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1PXNPQAV59L8.2 size=764006 2024-09-14T11:04:24.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.892+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=1PXNPQAV59L8 tag=66T3IB2PEKUD type=write size=3909734 2024-09-14T11:04:24.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.893+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=H677HKJLPIT7 type=del size=3206932 2024-09-14T11:04:24.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.895+0000 7f907bbdf780 1 < completed delete operation key=KQBX4UP53FV1 tag=MNUXVKQ82LHD type=del 2024-09-14T11:04:24.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.896+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=14845X8VUEIH type=del size=1707334 2024-09-14T11:04:24.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.897+0000 7f907bbdf780 1 < canceled operation key=5MFLA6XFV3Y5 tag=35IFUZKM58DC type=del size=3270662 2024-09-14T11:04:24.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.899+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=62BXACM3450O type=del size=2088479 2024-09-14T11:04:24.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.900+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~GJ7PIFY63K9E.0 size=157089 2024-09-14T11:04:24.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.902+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=GJ7PIFY63K9E tag=AP7Z0RW5Y42R type=write size=1205665 2024-09-14T11:04:24.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.904+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~KCYIBGGJOU8J.0 size=1048576 2024-09-14T11:04:24.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.905+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~KCYIBGGJOU8J.1 size=73842 2024-09-14T11:04:24.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.905+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=KCYIBGGJOU8J tag=870JOAH9L0UF type=write size=2170994 2024-09-14T11:04:24.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.906+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.0 size=1048576 2024-09-14T11:04:24.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.907+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.1 size=1048576 2024-09-14T11:04:24.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.908+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~SL2JJ2IJXLG1.2 size=564743 2024-09-14T11:04:24.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.910+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=SL2JJ2IJXLG1 tag=1I7N7IPNF3LE type=write size=3710471 2024-09-14T11:04:24.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.911+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=OGHSE9F1GMBG type=del size=450860 2024-09-14T11:04:24.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.914+0000 7f907bbdf780 1 < suggested update operation key=WZ064RU647Y7 tag=13FO5EX8I60L type=write size=742484 2024-09-14T11:04:24.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.916+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.0 size=1048576 2024-09-14T11:04:24.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.917+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.1 size=1048576 2024-09-14T11:04:24.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.918+0000 7f907bbdf780 1 > prepared part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.2 size=692764 2024-09-14T11:04:24.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.918+0000 7f907bbdf780 1 > prepared multipart upload key=T79IR10S3HAB upload=88JTQGVSF20D tag=CUOMJ2AMS42K type=write size=3838492 2024-09-14T11:04:24.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.920+0000 7f907bbdf780 1 < suggested update operation key=WAFH5BKM2P23 tag=CWKBM9JDGRJV type=del size=3762681 2024-09-14T11:04:24.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.921+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=CP5PGZ1O9GX2 type=del size=4095349 2024-09-14T11:04:24.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.923+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=856CPS3YQANL type=del 2024-09-14T11:04:24.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.925+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.0 size=1048576 2024-09-14T11:04:24.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.925+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.1 size=1048576 2024-09-14T11:04:24.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.926+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.2 size=140941 2024-09-14T11:04:24.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.926+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=QH7AW0ZMM921 tag=56X1MKNJA7Y5 type=write size=3286669 2024-09-14T11:04:24.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.929+0000 7f907bbdf780 1 < suggested remove operation key=WAFH5BKM2P23 tag=1TIDU77X5YJD type=del 2024-09-14T11:04:24.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.931+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~OQ6D0DG87Z4U.0 size=1048576 2024-09-14T11:04:24.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.931+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~OQ6D0DG87Z4U.1 size=130272 2024-09-14T11:04:24.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.931+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=OQ6D0DG87Z4U tag=EFBRN8TKJU06 type=write size=2227424 2024-09-14T11:04:24.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.933+0000 7f907bbdf780 1 < canceled operation key=HHXUGVBHQ2US tag=APJXR9O9EDBT type=del size=2335661 2024-09-14T11:04:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.935+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~AQFGI9CQ2Z3T.0 size=1048576 2024-09-14T11:04:24.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.936+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~AQFGI9CQ2Z3T.1 size=779129 2024-09-14T11:04:24.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.936+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=AQFGI9CQ2Z3T tag=TSSKYH096WQI type=write size=2876281 2024-09-14T11:04:24.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.937+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=KDWXNDOIK8A5 type=del size=266434 2024-09-14T11:04:24.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.939+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=XXUEIEOPK35G type=del size=3258603 2024-09-14T11:04:24.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.940+0000 7f907bbdf780 1 < canceled operation key=ZFF333CYOK5P tag=59GSYD9NI3WG type=del size=1903578 2024-09-14T11:04:24.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.941+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=3HGLDEZ6JRG4 type=write size=32127 2024-09-14T11:04:24.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.943+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=OFCBCBFTR0EQ type=del 2024-09-14T11:04:24.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.946+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~EXZX9KJXIHFM.0 size=1048576 2024-09-14T11:04:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.947+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~EXZX9KJXIHFM.1 size=571523 2024-09-14T11:04:24.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.947+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=EXZX9KJXIHFM tag=9FK19ZMUBB9O type=write size=2668675 2024-09-14T11:04:24.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.948+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~MA9RLMUVWV7R.0 size=1048576 2024-09-14T11:04:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.950+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~MA9RLMUVWV7R.1 size=525879 2024-09-14T11:04:24.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.952+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=MA9RLMUVWV7R tag=4OFJF90PTX5L type=write size=2623031 2024-09-14T11:04:24.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.953+0000 7f907bbdf780 1 > prepared operation key=KQBX4UP53FV1 tag=FEOL2M4GUFTL type=write size=920693 2024-09-14T11:04:24.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.956+0000 7f907bbdf780 1 < suggested update operation key=ZFF333CYOK5P tag=8WFT3MSNM1DE type=del size=4038646 2024-09-14T11:04:24.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.958+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=NCG2SKTF771O type=del size=2719351 2024-09-14T11:04:24.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.959+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~7XBCA1ZBZGBP.0 size=713144 2024-09-14T11:04:24.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.961+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=7XBCA1ZBZGBP tag=3AF92OX9QYHZ type=write size=1761720 2024-09-14T11:04:24.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.963+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=XGNS3HPUZVAH type=del size=3290631 2024-09-14T11:04:24.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.965+0000 7f907bbdf780 1 < suggested update operation key=Y3KOCA4072NM tag=H677HKJLPIT7 type=del size=3206932 2024-09-14T11:04:24.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.968+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.0 size=1048576 2024-09-14T11:04:24.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.969+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.1 size=1048576 2024-09-14T11:04:24.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.970+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.2 size=993491 2024-09-14T11:04:24.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.970+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=4QWU5FXX0ODO tag=488M027AUWVL type=write size=4139219 2024-09-14T11:04:24.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.971+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=14845X8VUEIH type=del 2024-09-14T11:04:24.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.972+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=142LY7MKCVCC type=del size=2214850 2024-09-14T11:04:24.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.973+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=62BXACM3450O type=del 2024-09-14T11:04:24.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.976+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=JUJTEAIOJXI2 type=del size=4008170 2024-09-14T11:04:24.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.977+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~KCYIBGGJOU8J.0 size=1048576 2024-09-14T11:04:24.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.978+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~KCYIBGGJOU8J.1 size=73842 2024-09-14T11:04:24.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.980+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=KCYIBGGJOU8J tag=870JOAH9L0UF type=write size=2170994 2024-09-14T11:04:24.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.981+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=C0R59RE53UDQ type=del size=1407508 2024-09-14T11:04:24.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.983+0000 7f907bbdf780 1 < canceled operation key=91RL2KD0XCSI tag=OGHSE9F1GMBG type=del size=450860 2024-09-14T11:04:24.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.984+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=QAD4PI1HMRD9 type=del size=534698 2024-09-14T11:04:24.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.985+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.0 size=1048576 2024-09-14T11:04:24.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.986+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.1 size=1048576 2024-09-14T11:04:24.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.987+0000 7f907bbdf780 1 < completed part key=_multipart_T79IR10S3HAB.2~88JTQGVSF20D.2 size=692764 2024-09-14T11:04:24.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.989+0000 7f907bbdf780 1 < completed multipart upload key=T79IR10S3HAB upload=88JTQGVSF20D tag=CUOMJ2AMS42K type=write size=3838492 2024-09-14T11:04:24.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.991+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~G516TXQWXOON.0 size=1048576 2024-09-14T11:04:24.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.992+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~G516TXQWXOON.1 size=23472 2024-09-14T11:04:24.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.992+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=G516TXQWXOON tag=T21PUCOBIPLP type=write size=2120624 2024-09-14T11:04:24.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.994+0000 7f907bbdf780 1 < completed delete operation key=P546JCSFB00N tag=CP5PGZ1O9GX2 type=del 2024-09-14T11:04:24.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.995+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=V5IWDB8GM68B type=del size=2738062 2024-09-14T11:04:24.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.996+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.0 size=1048576 2024-09-14T11:04:24.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.997+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.1 size=1048576 2024-09-14T11:04:24.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:24.998+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~QH7AW0ZMM921.2 size=140941 2024-09-14T11:04:24.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.000+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=QH7AW0ZMM921 tag=56X1MKNJA7Y5 type=write size=3286669 2024-09-14T11:04:24.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.001+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=2M0N04NJBRYW type=del size=821666 2024-09-14T11:04:24.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.001+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~OQ6D0DG87Z4U.0 size=1048576 2024-09-14T11:04:25.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.002+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~OQ6D0DG87Z4U.1 size=130272 2024-09-14T11:04:25.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.004+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=OQ6D0DG87Z4U tag=EFBRN8TKJU06 type=write size=2227424 2024-09-14T11:04:25.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.006+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~LG7FZ5LNCFTK.0 size=779054 2024-09-14T11:04:25.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.006+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=LG7FZ5LNCFTK tag=PG4YQZXT47ZR type=write size=1827630 2024-09-14T11:04:25.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.007+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~AQFGI9CQ2Z3T.0 size=1048576 2024-09-14T11:04:25.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.008+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~AQFGI9CQ2Z3T.1 size=779129 2024-09-14T11:04:25.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.010+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=AQFGI9CQ2Z3T tag=TSSKYH096WQI type=write size=2876281 2024-09-14T11:04:25.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.011+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=SGGAXWJ6F6VG type=del size=2252527 2024-09-14T11:04:25.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.013+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=XXUEIEOPK35G type=del 2024-09-14T11:04:25.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.014+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=43UH0CMR6E2T type=del size=3931901 2024-09-14T11:04:25.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.015+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=3HGLDEZ6JRG4 type=write size=32127 2024-09-14T11:04:25.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.017+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~J2GE9C1LG1GM.0 size=1048576 2024-09-14T11:04:25.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.018+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~J2GE9C1LG1GM.1 size=669947 2024-09-14T11:04:25.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.018+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=J2GE9C1LG1GM tag=K19XQ9BEYXI4 type=write size=2767099 2024-09-14T11:04:25.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.019+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~EXZX9KJXIHFM.0 size=1048576 2024-09-14T11:04:25.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.020+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~EXZX9KJXIHFM.1 size=571523 2024-09-14T11:04:25.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.022+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=EXZX9KJXIHFM tag=9FK19ZMUBB9O type=write size=2668675 2024-09-14T11:04:25.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.024+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=1GELRF09VOGH type=del size=1993566 2024-09-14T11:04:25.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.025+0000 7f907bbdf780 1 < completed write operation key=KQBX4UP53FV1 tag=FEOL2M4GUFTL type=write size=920693 2024-09-14T11:04:25.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.027+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.0 size=1048576 2024-09-14T11:04:25.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.028+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.1 size=1048576 2024-09-14T11:04:25.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.029+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.2 size=253747 2024-09-14T11:04:25.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.029+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=Y9MLKZM8BRKK tag=JSCHJ39Z4XYB type=write size=3399475 2024-09-14T11:04:25.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.030+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=NCG2SKTF771O type=del 2024-09-14T11:04:25.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.033+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~9S9TG6OVB0ZX.0 size=674534 2024-09-14T11:04:25.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.033+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=9S9TG6OVB0ZX tag=G5Y68N7JNQZA type=write size=1723110 2024-09-14T11:04:25.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.035+0000 7f907bbdf780 1 < suggested update operation key=9OKQI3W8M5GA tag=XGNS3HPUZVAH type=del size=3290631 2024-09-14T11:04:25.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.037+0000 7f907bbdf780 1 > prepared part key=_multipart_T81OF13I2JVH.2~OC5B3UYZ0U8N.0 size=129076 2024-09-14T11:04:25.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.037+0000 7f907bbdf780 1 > prepared multipart upload key=T81OF13I2JVH upload=OC5B3UYZ0U8N tag=L34H3HIFFXI0 type=write size=1177652 2024-09-14T11:04:25.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.039+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.0 size=1048576 2024-09-14T11:04:25.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.040+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.1 size=1048576 2024-09-14T11:04:25.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.041+0000 7f907bbdf780 1 < completed part key=_multipart_8C398XZ7XKU7.2~4QWU5FXX0ODO.2 size=993491 2024-09-14T11:04:25.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.042+0000 7f907bbdf780 1 < completed multipart upload key=8C398XZ7XKU7 upload=4QWU5FXX0ODO tag=488M027AUWVL type=write size=4139219 2024-09-14T11:04:25.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.045+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~YBVWIY0ZXB29.0 size=1000309 2024-09-14T11:04:25.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.045+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=YBVWIY0ZXB29 tag=V8EJCO8RHBJH type=write size=2048885 2024-09-14T11:04:25.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.046+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=142LY7MKCVCC type=del size=2214850 2024-09-14T11:04:25.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.047+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=D3APADPM6G1J type=write size=639174 2024-09-14T11:04:25.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.049+0000 7f907bbdf780 1 < suggested remove operation key=9OKQI3W8M5GA tag=JUJTEAIOJXI2 type=del 2024-09-14T11:04:25.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.052+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~65LPDVDGHKRU.0 size=1048576 2024-09-14T11:04:25.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.052+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~65LPDVDGHKRU.1 size=957288 2024-09-14T11:04:25.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.052+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=65LPDVDGHKRU tag=CMIR8S0Q03G6 type=write size=3054440 2024-09-14T11:04:25.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.054+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=C0R59RE53UDQ type=del 2024-09-14T11:04:25.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.055+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=1F3699788ZTC type=del size=731474 2024-09-14T11:04:25.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.056+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=QAD4PI1HMRD9 type=del 2024-09-14T11:04:25.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.058+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=135VD5M24X5V type=del size=3023257 2024-09-14T11:04:25.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.059+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~G516TXQWXOON.0 size=1048576 2024-09-14T11:04:25.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.060+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~G516TXQWXOON.1 size=23472 2024-09-14T11:04:25.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.062+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=G516TXQWXOON tag=T21PUCOBIPLP type=write size=2120624 2024-09-14T11:04:25.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.063+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=5OTEA434YWMP type=write size=597273 2024-09-14T11:04:25.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.065+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=V5IWDB8GM68B type=del 2024-09-14T11:04:25.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.067+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.0 size=1048576 2024-09-14T11:04:25.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.068+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.1 size=1048576 2024-09-14T11:04:25.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.069+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.2 size=203186 2024-09-14T11:04:25.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.069+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=RW1PDYIK0CH0 tag=TOOB7XMAFBLW type=write size=3348914 2024-09-14T11:04:25.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.071+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=2M0N04NJBRYW type=del 2024-09-14T11:04:25.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.073+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=T5G19FTAQJXD type=del size=3780972 2024-09-14T11:04:25.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.074+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~LG7FZ5LNCFTK.0 size=779054 2024-09-14T11:04:25.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.076+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=LG7FZ5LNCFTK tag=PG4YQZXT47ZR type=write size=1827630 2024-09-14T11:04:25.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.078+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~NBQSH1244G2L.0 size=667093 2024-09-14T11:04:25.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.078+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=NBQSH1244G2L tag=E428WDRKLNQK type=write size=1715669 2024-09-14T11:04:25.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.079+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=SGGAXWJ6F6VG type=del 2024-09-14T11:04:25.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.081+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~G0HGZ8VA40Q9.0 size=1048576 2024-09-14T11:04:25.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.082+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~G0HGZ8VA40Q9.1 size=765317 2024-09-14T11:04:25.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.082+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=G0HGZ8VA40Q9 tag=2T3V30F4FYXG type=write size=2862469 2024-09-14T11:04:25.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.083+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=43UH0CMR6E2T type=del 2024-09-14T11:04:25.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.084+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=93WU7VJG775V type=write size=74930 2024-09-14T11:04:25.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.086+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~J2GE9C1LG1GM.0 size=1048576 2024-09-14T11:04:25.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.087+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~J2GE9C1LG1GM.1 size=669947 2024-09-14T11:04:25.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.089+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=J2GE9C1LG1GM tag=K19XQ9BEYXI4 type=write size=2767099 2024-09-14T11:04:25.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.091+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=2U5QTMFY4DKO type=del size=1574487 2024-09-14T11:04:25.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.092+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=1GELRF09VOGH type=del 2024-09-14T11:04:25.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.094+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~DB0068NYND1W.0 size=745017 2024-09-14T11:04:25.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.094+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=DB0068NYND1W tag=N5LQTY1C53MS type=write size=1793593 2024-09-14T11:04:25.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.094+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.0 size=1048576 2024-09-14T11:04:25.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.095+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.1 size=1048576 2024-09-14T11:04:25.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.095+0000 7f907bbdf780 1 < canceled part key=_multipart_S8RIEED24PUM.2~Y9MLKZM8BRKK.2 size=253747 2024-09-14T11:04:25.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.097+0000 7f907bbdf780 1 < canceled multipart upload key=S8RIEED24PUM upload=Y9MLKZM8BRKK tag=JSCHJ39Z4XYB type=write size=3399475 2024-09-14T11:04:25.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.099+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.0 size=1048576 2024-09-14T11:04:25.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.100+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.1 size=1048576 2024-09-14T11:04:25.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.101+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.2 size=305168 2024-09-14T11:04:25.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.101+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=GE83DEKC6RP1 tag=6E2GU4C6PT1K type=write size=3450896 2024-09-14T11:04:25.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.101+0000 7f907bbdf780 1 < canceled part key=_multipart_8FRZW4YC3ATE.2~9S9TG6OVB0ZX.0 size=674534 2024-09-14T11:04:25.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.103+0000 7f907bbdf780 1 < canceled multipart upload key=8FRZW4YC3ATE upload=9S9TG6OVB0ZX tag=G5Y68N7JNQZA type=write size=1723110 2024-09-14T11:04:25.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.105+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~YQ84XE6QCXTC.0 size=1048576 2024-09-14T11:04:25.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.106+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~YQ84XE6QCXTC.1 size=109194 2024-09-14T11:04:25.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.106+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=YQ84XE6QCXTC tag=5W8971S8YEQY type=write size=2206346 2024-09-14T11:04:25.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.108+0000 7f907bbdf780 1 < completed part key=_multipart_T81OF13I2JVH.2~OC5B3UYZ0U8N.0 size=129076 2024-09-14T11:04:25.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.110+0000 7f907bbdf780 1 < completed multipart upload key=T81OF13I2JVH upload=OC5B3UYZ0U8N tag=L34H3HIFFXI0 type=write size=1177652 2024-09-14T11:04:25.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.112+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.0 size=1048576 2024-09-14T11:04:25.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.113+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.1 size=1048576 2024-09-14T11:04:25.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.114+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.2 size=201475 2024-09-14T11:04:25.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.114+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=12XDA2TGFFF0 tag=9EP059IFL5XP type=write size=3347203 2024-09-14T11:04:25.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.115+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~YBVWIY0ZXB29.0 size=1000309 2024-09-14T11:04:25.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.117+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=YBVWIY0ZXB29 tag=V8EJCO8RHBJH type=write size=2048885 2024-09-14T11:04:25.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.118+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=DV1DK3L39DQM type=write size=249661 2024-09-14T11:04:25.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.119+0000 7f907bbdf780 1 < completed write operation key=Y3KOCA4072NM tag=D3APADPM6G1J type=write size=639174 2024-09-14T11:04:25.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.120+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=5ESRW339GI5R type=del size=438259 2024-09-14T11:04:25.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.122+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~65LPDVDGHKRU.0 size=1048576 2024-09-14T11:04:25.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.123+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~65LPDVDGHKRU.1 size=957288 2024-09-14T11:04:25.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.125+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=65LPDVDGHKRU tag=CMIR8S0Q03G6 type=write size=3054440 2024-09-14T11:04:25.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.127+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~E0U52LRA3JBO.0 size=1048576 2024-09-14T11:04:25.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.128+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~E0U52LRA3JBO.1 size=184947 2024-09-14T11:04:25.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.128+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=E0U52LRA3JBO tag=PD3DIDASDGK3 type=write size=2282099 2024-09-14T11:04:25.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.129+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=1F3699788ZTC type=del 2024-09-14T11:04:25.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.130+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=7EO7HSGZS3XG type=del size=2481614 2024-09-14T11:04:25.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.131+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=135VD5M24X5V type=del 2024-09-14T11:04:25.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.132+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=49FIHKOXFLHW type=del size=3505594 2024-09-14T11:04:25.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.134+0000 7f907bbdf780 1 < completed write operation key=8FRZW4YC3ATE tag=5OTEA434YWMP type=write size=597273 2024-09-14T11:04:25.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.135+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=E3NDYV3DGJPQ type=write size=94951 2024-09-14T11:04:25.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.136+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.0 size=1048576 2024-09-14T11:04:25.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.137+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.1 size=1048576 2024-09-14T11:04:25.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.138+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~RW1PDYIK0CH0.2 size=203186 2024-09-14T11:04:25.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.140+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=RW1PDYIK0CH0 tag=TOOB7XMAFBLW type=write size=3348914 2024-09-14T11:04:25.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.141+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=R1XQLYDQR8NA type=write size=3885 2024-09-14T11:04:25.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.142+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=T5G19FTAQJXD type=del 2024-09-14T11:04:25.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.144+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=OJZ4RIU3FBJS type=del size=1547966 2024-09-14T11:04:25.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.145+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~NBQSH1244G2L.0 size=667093 2024-09-14T11:04:25.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.147+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=NBQSH1244G2L tag=E428WDRKLNQK type=write size=1715669 2024-09-14T11:04:25.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.148+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=8GU1D3XOBC2V type=del size=2011690 2024-09-14T11:04:25.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.149+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~G0HGZ8VA40Q9.0 size=1048576 2024-09-14T11:04:25.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.150+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~G0HGZ8VA40Q9.1 size=765317 2024-09-14T11:04:25.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.152+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=G0HGZ8VA40Q9 tag=2T3V30F4FYXG type=write size=2862469 2024-09-14T11:04:25.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.153+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=IGKXV6JFQUK2 type=del size=1381019 2024-09-14T11:04:25.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.154+0000 7f907bbdf780 1 < canceled operation key=P546JCSFB00N tag=93WU7VJG775V type=write size=74930 2024-09-14T11:04:25.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.155+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=P34MKLCIDKH0 type=write size=37867 2024-09-14T11:04:25.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.157+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=2U5QTMFY4DKO type=del 2024-09-14T11:04:25.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.159+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~HE5RPHH1XVRF.0 size=367518 2024-09-14T11:04:25.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.159+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=HE5RPHH1XVRF tag=KFUIK3BBUR3K type=write size=1416094 2024-09-14T11:04:25.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.160+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~DB0068NYND1W.0 size=745017 2024-09-14T11:04:25.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.162+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=DB0068NYND1W tag=N5LQTY1C53MS type=write size=1793593 2024-09-14T11:04:25.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.163+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=LRYTV5Q3K6NR type=del size=2126263 2024-09-14T11:04:25.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.165+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.0 size=1048576 2024-09-14T11:04:25.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.166+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.1 size=1048576 2024-09-14T11:04:25.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.166+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~GE83DEKC6RP1.2 size=305168 2024-09-14T11:04:25.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.168+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=GE83DEKC6RP1 tag=6E2GU4C6PT1K type=write size=3450896 2024-09-14T11:04:25.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.171+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.0 size=1048576 2024-09-14T11:04:25.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.172+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.1 size=1048576 2024-09-14T11:04:25.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.172+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.2 size=584272 2024-09-14T11:04:25.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.172+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=GNKXZ35BF5KH tag=F3FSV48ZSQUY type=write size=3730000 2024-09-14T11:04:25.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.174+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~YQ84XE6QCXTC.0 size=1048576 2024-09-14T11:04:25.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.175+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~YQ84XE6QCXTC.1 size=109194 2024-09-14T11:04:25.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.176+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=YQ84XE6QCXTC tag=5W8971S8YEQY type=write size=2206346 2024-09-14T11:04:25.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.178+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=3SKN27O2YQU2 type=del size=2413777 2024-09-14T11:04:25.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.179+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.0 size=1048576 2024-09-14T11:04:25.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.179+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.1 size=1048576 2024-09-14T11:04:25.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.180+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~12XDA2TGFFF0.2 size=201475 2024-09-14T11:04:25.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.182+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=12XDA2TGFFF0 tag=9EP059IFL5XP type=write size=3347203 2024-09-14T11:04:25.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.184+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~5BI6EXN2C9NU.0 size=1048576 2024-09-14T11:04:25.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.185+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~5BI6EXN2C9NU.1 size=565479 2024-09-14T11:04:25.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.185+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=5BI6EXN2C9NU tag=N9GJ3OB0Z4BJ type=write size=2662631 2024-09-14T11:04:25.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.186+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=DV1DK3L39DQM type=write size=249661 2024-09-14T11:04:25.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.187+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=NOL6WXES6TF5 type=del size=2804485 2024-09-14T11:04:25.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.189+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=5ESRW339GI5R type=del 2024-09-14T11:04:25.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.191+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~OXITLUBR1AXV.0 size=1048576 2024-09-14T11:04:25.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.192+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~OXITLUBR1AXV.1 size=937274 2024-09-14T11:04:25.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.192+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=OXITLUBR1AXV tag=ZOZKIV4BNOEE type=write size=3034426 2024-09-14T11:04:25.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.193+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~E0U52LRA3JBO.0 size=1048576 2024-09-14T11:04:25.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.194+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~E0U52LRA3JBO.1 size=184947 2024-09-14T11:04:25.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.198+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=E0U52LRA3JBO tag=PD3DIDASDGK3 type=write size=2282099 2024-09-14T11:04:25.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.199+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=UANSA4LMFY01 type=del size=3040841 2024-09-14T11:04:25.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.201+0000 7f907bbdf780 1 < suggested update operation key=5C8LLJF5MSVP tag=7EO7HSGZS3XG type=del size=2481614 2024-09-14T11:04:25.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.203+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~PM36Y8E6DHJA.0 size=347598 2024-09-14T11:04:25.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.203+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=PM36Y8E6DHJA tag=O15HFRBWA69T type=write size=1396174 2024-09-14T11:04:25.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.204+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=49FIHKOXFLHW type=del 2024-09-14T11:04:25.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.206+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~YT5P4VTQ5582.0 size=852462 2024-09-14T11:04:25.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.206+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=YT5P4VTQ5582 tag=6XKTEVDOYD7R type=write size=1901038 2024-09-14T11:04:25.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.208+0000 7f907bbdf780 1 < completed write operation key=LJ720PV3SQ8L tag=E3NDYV3DGJPQ type=write size=94951 2024-09-14T11:04:25.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.209+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=UD73KWT8DN45 type=del size=1174103 2024-09-14T11:04:25.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.210+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=R1XQLYDQR8NA type=write size=3885 2024-09-14T11:04:25.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.211+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=QG6F0RMM8VHL type=del size=1886137 2024-09-14T11:04:25.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.214+0000 7f907bbdf780 1 < suggested update operation key=WAFH5BKM2P23 tag=OJZ4RIU3FBJS type=del size=1547966 2024-09-14T11:04:25.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.215+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=8J02X6ZI5SNG type=del size=3885134 2024-09-14T11:04:25.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.216+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=8GU1D3XOBC2V type=del 2024-09-14T11:04:25.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.217+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=EGOLWF9U1BDP type=write size=515766 2024-09-14T11:04:25.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.218+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=IGKXV6JFQUK2 type=del 2024-09-14T11:04:25.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.221+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~ZSYYA6S19LY8.0 size=515450 2024-09-14T11:04:25.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.221+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=ZSYYA6S19LY8 tag=W4GPSAWVWO3W type=write size=1564026 2024-09-14T11:04:25.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.222+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=P34MKLCIDKH0 type=write size=37867 2024-09-14T11:04:25.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.224+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.0 size=1048576 2024-09-14T11:04:25.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.225+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.1 size=1048576 2024-09-14T11:04:25.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.226+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.2 size=124863 2024-09-14T11:04:25.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.226+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=ZAI9Z5L0OC1Z tag=541BPLXQEVXS type=write size=3270591 2024-09-14T11:04:25.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.227+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~HE5RPHH1XVRF.0 size=367518 2024-09-14T11:04:25.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.229+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=HE5RPHH1XVRF tag=KFUIK3BBUR3K type=write size=1416094 2024-09-14T11:04:25.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.231+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DPMH3TKAF2R6.0 size=1048576 2024-09-14T11:04:25.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.232+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~DPMH3TKAF2R6.1 size=116158 2024-09-14T11:04:25.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.232+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=DPMH3TKAF2R6 tag=TI3ID7S53TJW type=write size=2213310 2024-09-14T11:04:25.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.234+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=LRYTV5Q3K6NR type=del 2024-09-14T11:04:25.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.235+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=SG5UFIRPQ4JA type=del size=629280 2024-09-14T11:04:25.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.236+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.0 size=1048576 2024-09-14T11:04:25.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.236+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.1 size=1048576 2024-09-14T11:04:25.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.237+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~GNKXZ35BF5KH.2 size=584272 2024-09-14T11:04:25.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.239+0000 7f907bbdf780 1 < canceled multipart upload key=59WHXDR0S8DM upload=GNKXZ35BF5KH tag=F3FSV48ZSQUY type=write size=3730000 2024-09-14T11:04:25.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.241+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~BBRQ24RJ77ZP.0 size=227924 2024-09-14T11:04:25.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.241+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=BBRQ24RJ77ZP tag=7KAO4M10USMR type=write size=1276500 2024-09-14T11:04:25.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.242+0000 7f907bbdf780 1 < canceled operation key=WZ064RU647Y7 tag=3SKN27O2YQU2 type=del size=2413777 2024-09-14T11:04:25.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.244+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=Y9EARNIG2ZBZ type=del size=3982769 2024-09-14T11:04:25.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.245+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~5BI6EXN2C9NU.0 size=1048576 2024-09-14T11:04:25.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.246+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~5BI6EXN2C9NU.1 size=565479 2024-09-14T11:04:25.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.248+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=5BI6EXN2C9NU tag=N9GJ3OB0Z4BJ type=write size=2662631 2024-09-14T11:04:25.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.250+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~BT33L109PFYN.0 size=317570 2024-09-14T11:04:25.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.250+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=BT33L109PFYN tag=OFNP6QSHLT11 type=write size=1366146 2024-09-14T11:04:25.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.252+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=NOL6WXES6TF5 type=del 2024-09-14T11:04:25.251 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.253+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=HG71E8MOJ1MN type=del size=2775284 2024-09-14T11:04:25.252 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.254+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~OXITLUBR1AXV.0 size=1048576 2024-09-14T11:04:25.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.255+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~OXITLUBR1AXV.1 size=937274 2024-09-14T11:04:25.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.257+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=OXITLUBR1AXV tag=ZOZKIV4BNOEE type=write size=3034426 2024-09-14T11:04:25.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.260+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~JO5T54FFN1KB.0 size=1014882 2024-09-14T11:04:25.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.260+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=JO5T54FFN1KB tag=7AE93C7B2O4T type=write size=2063458 2024-09-14T11:04:25.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.261+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=UANSA4LMFY01 type=del 2024-09-14T11:04:25.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.263+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~UU75JGV0MGXS.0 size=1048576 2024-09-14T11:04:25.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.264+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~UU75JGV0MGXS.1 size=583938 2024-09-14T11:04:25.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.264+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=UU75JGV0MGXS tag=1PHTTBP3DKCY type=write size=2681090 2024-09-14T11:04:25.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.266+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~PM36Y8E6DHJA.0 size=347598 2024-09-14T11:04:25.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.268+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=PM36Y8E6DHJA tag=O15HFRBWA69T type=write size=1396174 2024-09-14T11:04:25.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.270+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.0 size=1048576 2024-09-14T11:04:25.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.271+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.1 size=1048576 2024-09-14T11:04:25.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.272+0000 7f907bbdf780 1 > prepared part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.2 size=799579 2024-09-14T11:04:25.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.272+0000 7f907bbdf780 1 > prepared multipart upload key=JEXUT5F7AKZ1 upload=1DVF34FVONX5 tag=N2A8G6RZ1YOA type=write size=3945307 2024-09-14T11:04:25.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.273+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~YT5P4VTQ5582.0 size=852462 2024-09-14T11:04:25.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.275+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=YT5P4VTQ5582 tag=6XKTEVDOYD7R type=write size=1901038 2024-09-14T11:04:25.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.277+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=DRM1M1JB1J9Y type=del size=3934114 2024-09-14T11:04:25.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.278+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=UD73KWT8DN45 type=del 2024-09-14T11:04:25.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.279+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=28XYQGLIKOY9 type=del size=3706954 2024-09-14T11:04:25.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.281+0000 7f907bbdf780 1 < suggested update operation key=ZFF333CYOK5P tag=QG6F0RMM8VHL type=del size=1886137 2024-09-14T11:04:25.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.283+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=DFNMQDOTX0W1 type=del size=3704678 2024-09-14T11:04:25.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.284+0000 7f907bbdf780 1 < canceled operation key=91RL2KD0XCSI tag=8J02X6ZI5SNG type=del size=3885134 2024-09-14T11:04:25.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.285+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=N8MH0EHQ7K9Q type=del size=1753994 2024-09-14T11:04:25.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.286+0000 7f907bbdf780 1 < completed write operation key=FTYIOOQROLG6 tag=EGOLWF9U1BDP type=write size=515766 2024-09-14T11:04:25.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.289+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~HBUZKARDBITZ.0 size=214541 2024-09-14T11:04:25.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.289+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=HBUZKARDBITZ tag=S7HYCKSWZ7GO type=write size=1263117 2024-09-14T11:04:25.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.290+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~ZSYYA6S19LY8.0 size=515450 2024-09-14T11:04:25.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.292+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=ZSYYA6S19LY8 tag=W4GPSAWVWO3W type=write size=1564026 2024-09-14T11:04:25.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.293+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=3ZTGOL6WG2TB type=del size=1822142 2024-09-14T11:04:25.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.294+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.0 size=1048576 2024-09-14T11:04:25.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.295+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.1 size=1048576 2024-09-14T11:04:25.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.295+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~ZAI9Z5L0OC1Z.2 size=124863 2024-09-14T11:04:25.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.297+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=ZAI9Z5L0OC1Z tag=541BPLXQEVXS type=write size=3270591 2024-09-14T11:04:25.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.298+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=8MXY7L2C0EJ1 type=del size=2353412 2024-09-14T11:04:25.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.300+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DPMH3TKAF2R6.0 size=1048576 2024-09-14T11:04:25.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.301+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~DPMH3TKAF2R6.1 size=116158 2024-09-14T11:04:25.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.303+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=DPMH3TKAF2R6 tag=TI3ID7S53TJW type=write size=2213310 2024-09-14T11:04:25.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.304+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=MC5O3EFIQJVG type=del size=2551127 2024-09-14T11:04:25.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.305+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=SG5UFIRPQ4JA type=del 2024-09-14T11:04:25.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.308+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~A121ICQHRBQM.0 size=1048576 2024-09-14T11:04:25.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.309+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~A121ICQHRBQM.1 size=329871 2024-09-14T11:04:25.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.309+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=A121ICQHRBQM tag=VBMRLDZNTL0N type=write size=2427023 2024-09-14T11:04:25.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.311+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~BBRQ24RJ77ZP.0 size=227924 2024-09-14T11:04:25.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.313+0000 7f907bbdf780 1 < completed multipart upload key=5C8LLJF5MSVP upload=BBRQ24RJ77ZP tag=7KAO4M10USMR type=write size=1276500 2024-09-14T11:04:25.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.316+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~WWY31OG0JIQX.0 size=700069 2024-09-14T11:04:25.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.316+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=WWY31OG0JIQX tag=21ZB1LMZR47I type=write size=1748645 2024-09-14T11:04:25.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.317+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=Y9EARNIG2ZBZ type=del 2024-09-14T11:04:25.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.319+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~EYU2FB4OO03K.0 size=245828 2024-09-14T11:04:25.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.319+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=EYU2FB4OO03K tag=CJ0UP1E27ADG type=write size=1294404 2024-09-14T11:04:25.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.320+0000 7f907bbdf780 1 < completed part key=_multipart_FTYIOOQROLG6.2~BT33L109PFYN.0 size=317570 2024-09-14T11:04:25.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.323+0000 7f907bbdf780 1 < completed multipart upload key=FTYIOOQROLG6 upload=BT33L109PFYN tag=OFNP6QSHLT11 type=write size=1366146 2024-09-14T11:04:25.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.324+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=RXNGSGMY6TOS type=del size=1787385 2024-09-14T11:04:25.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.326+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=HG71E8MOJ1MN type=del 2024-09-14T11:04:25.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.328+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.0 size=1048576 2024-09-14T11:04:25.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.329+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.1 size=1048576 2024-09-14T11:04:25.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.330+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.2 size=632034 2024-09-14T11:04:25.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.330+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=YKUAYMCNJLY5 tag=Y5T8AF22SCYE type=write size=3777762 2024-09-14T11:04:25.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.332+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~JO5T54FFN1KB.0 size=1014882 2024-09-14T11:04:25.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.334+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=JO5T54FFN1KB tag=7AE93C7B2O4T type=write size=2063458 2024-09-14T11:04:25.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.335+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=605ZBW48LWSY type=del size=610793 2024-09-14T11:04:25.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.336+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~UU75JGV0MGXS.0 size=1048576 2024-09-14T11:04:25.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.337+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~UU75JGV0MGXS.1 size=583938 2024-09-14T11:04:25.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.339+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=UU75JGV0MGXS tag=1PHTTBP3DKCY type=write size=2681090 2024-09-14T11:04:25.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.340+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=P8K2G0QMM76N type=write size=766210 2024-09-14T11:04:25.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.342+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.0 size=1048576 2024-09-14T11:04:25.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.343+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.1 size=1048576 2024-09-14T11:04:25.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.344+0000 7f907bbdf780 1 < completed part key=_multipart_JEXUT5F7AKZ1.2~1DVF34FVONX5.2 size=799579 2024-09-14T11:04:25.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.346+0000 7f907bbdf780 1 < completed multipart upload key=JEXUT5F7AKZ1 upload=1DVF34FVONX5 tag=N2A8G6RZ1YOA type=write size=3945307 2024-09-14T11:04:25.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.348+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~TNWAJKNV01W1.0 size=1048576 2024-09-14T11:04:25.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.349+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~TNWAJKNV01W1.1 size=547103 2024-09-14T11:04:25.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.349+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=TNWAJKNV01W1 tag=71MUHTYY5B74 type=write size=2644255 2024-09-14T11:04:25.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.350+0000 7f907bbdf780 1 < canceled operation key=T79IR10S3HAB tag=DRM1M1JB1J9Y type=del size=3934114 2024-09-14T11:04:25.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.351+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=L6K4OCYCIKWA type=del size=866352 2024-09-14T11:04:25.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.353+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=28XYQGLIKOY9 type=del 2024-09-14T11:04:25.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.355+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~DJTWMQKQ273G.0 size=1048576 2024-09-14T11:04:25.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.356+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~DJTWMQKQ273G.1 size=216191 2024-09-14T11:04:25.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.356+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=DJTWMQKQ273G tag=L4TL6VG0VRD0 type=write size=2313343 2024-09-14T11:04:25.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.357+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=DFNMQDOTX0W1 type=del 2024-09-14T11:04:25.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.359+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~JAHIEKW5XQYI.0 size=1048576 2024-09-14T11:04:25.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.360+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~JAHIEKW5XQYI.1 size=822346 2024-09-14T11:04:25.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.360+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=JAHIEKW5XQYI tag=0L0442J9IQGV type=write size=2919498 2024-09-14T11:04:25.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.362+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=N8MH0EHQ7K9Q type=del 2024-09-14T11:04:25.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.363+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=3RQS0X5GOAGV type=write size=552474 2024-09-14T11:04:25.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.364+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~HBUZKARDBITZ.0 size=214541 2024-09-14T11:04:25.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.366+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=HBUZKARDBITZ tag=S7HYCKSWZ7GO type=write size=1263117 2024-09-14T11:04:25.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.368+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~S96ZBBSJ91BU.0 size=1048576 2024-09-14T11:04:25.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.369+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~S96ZBBSJ91BU.1 size=895810 2024-09-14T11:04:25.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.369+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=S96ZBBSJ91BU tag=QG2XW1PBVLZ4 type=write size=2992962 2024-09-14T11:04:25.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.370+0000 7f907bbdf780 1 < completed delete operation key=T79IR10S3HAB tag=3ZTGOL6WG2TB type=del 2024-09-14T11:04:25.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.371+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=7XEGGMI0HYLE type=del size=1772635 2024-09-14T11:04:25.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.374+0000 7f907bbdf780 1 < suggested remove operation key=ZFF333CYOK5P tag=8MXY7L2C0EJ1 type=del 2024-09-14T11:04:25.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.376+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.0 size=1048576 2024-09-14T11:04:25.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.377+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.1 size=1048576 2024-09-14T11:04:25.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.378+0000 7f907bbdf780 1 > prepared part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.2 size=32417 2024-09-14T11:04:25.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.378+0000 7f907bbdf780 1 > prepared multipart upload key=5C8LLJF5MSVP upload=9DA1O3PHRQVS tag=D0P5TOE5YE3B type=write size=3178145 2024-09-14T11:04:25.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.380+0000 7f907bbdf780 1 < suggested remove operation key=JEXUT5F7AKZ1 tag=MC5O3EFIQJVG type=del 2024-09-14T11:04:25.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.381+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=AO1IK59AOECI type=del size=1082227 2024-09-14T11:04:25.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.383+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~A121ICQHRBQM.0 size=1048576 2024-09-14T11:04:25.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.384+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~A121ICQHRBQM.1 size=329871 2024-09-14T11:04:25.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.386+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=A121ICQHRBQM tag=VBMRLDZNTL0N type=write size=2427023 2024-09-14T11:04:25.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.388+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~SGZN20ROXEDJ.0 size=1048576 2024-09-14T11:04:25.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.389+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~SGZN20ROXEDJ.1 size=533099 2024-09-14T11:04:25.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.389+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=SGZN20ROXEDJ tag=OF4KSB5RZZET type=write size=2630251 2024-09-14T11:04:25.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.389+0000 7f907bbdf780 1 < canceled part key=_multipart_LQNZKMX52SWO.2~WWY31OG0JIQX.0 size=700069 2024-09-14T11:04:25.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.392+0000 7f907bbdf780 1 < canceled multipart upload key=LQNZKMX52SWO upload=WWY31OG0JIQX tag=21ZB1LMZR47I type=write size=1748645 2024-09-14T11:04:25.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.394+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.0 size=1048576 2024-09-14T11:04:25.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.395+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.1 size=1048576 2024-09-14T11:04:25.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.396+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.2 size=37812 2024-09-14T11:04:25.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.396+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=22MKAVMGIJYC tag=2015DHGNBNJH type=write size=3183540 2024-09-14T11:04:25.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.397+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~EYU2FB4OO03K.0 size=245828 2024-09-14T11:04:25.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.399+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=EYU2FB4OO03K tag=CJ0UP1E27ADG type=write size=1294404 2024-09-14T11:04:25.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.401+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~I1GTXF9H9LVS.0 size=1048576 2024-09-14T11:04:25.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.402+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~I1GTXF9H9LVS.1 size=819566 2024-09-14T11:04:25.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.402+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=I1GTXF9H9LVS tag=4V48Y5FICRB6 type=write size=2916718 2024-09-14T11:04:25.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.404+0000 7f907bbdf780 1 < completed delete operation key=Y3KOCA4072NM tag=RXNGSGMY6TOS type=del 2024-09-14T11:04:25.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.406+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.0 size=1048576 2024-09-14T11:04:25.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.407+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.1 size=1048576 2024-09-14T11:04:25.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.408+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.2 size=812172 2024-09-14T11:04:25.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.408+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=JSED29I8PC18 tag=RVVIBKOX4AMW type=write size=3957900 2024-09-14T11:04:25.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.409+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.0 size=1048576 2024-09-14T11:04:25.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.410+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.1 size=1048576 2024-09-14T11:04:25.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.411+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~YKUAYMCNJLY5.2 size=632034 2024-09-14T11:04:25.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.414+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=YKUAYMCNJLY5 tag=Y5T8AF22SCYE type=write size=3777762 2024-09-14T11:04:25.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.416+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XVO9QTQR8SYM.0 size=1048576 2024-09-14T11:04:25.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.418+0000 7f907bbdf780 1 > prepared part key=_multipart_AGMKZ7PGPUAM.2~XVO9QTQR8SYM.1 size=625546 2024-09-14T11:04:25.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.418+0000 7f907bbdf780 1 > prepared multipart upload key=AGMKZ7PGPUAM upload=XVO9QTQR8SYM tag=NATLS2LBHQB7 type=write size=2722698 2024-09-14T11:04:25.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.419+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=605ZBW48LWSY type=del 2024-09-14T11:04:25.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.420+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=A64L7D4W8OOU type=del size=877004 2024-09-14T11:04:25.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.421+0000 7f907bbdf780 1 < completed write operation key=LQNZKMX52SWO tag=P8K2G0QMM76N type=write size=766210 2024-09-14T11:04:25.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.422+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=4IS08RQRMTNS type=del size=2276593 2024-09-14T11:04:25.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.425+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~TNWAJKNV01W1.0 size=1048576 2024-09-14T11:04:25.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.426+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~TNWAJKNV01W1.1 size=547103 2024-09-14T11:04:25.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.428+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=TNWAJKNV01W1 tag=71MUHTYY5B74 type=write size=2644255 2024-09-14T11:04:25.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.430+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=3X287P3RKY1B type=del size=1988480 2024-09-14T11:04:25.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.431+0000 7f907bbdf780 1 < completed delete operation key=HHXUGVBHQ2US tag=L6K4OCYCIKWA type=del 2024-09-14T11:04:25.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.432+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=YP7IIL1NMJPG type=del size=1182778 2024-09-14T11:04:25.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.434+0000 7f907bbdf780 1 < completed part key=_multipart_E3OIUTR3JCQY.2~DJTWMQKQ273G.0 size=1048576 2024-09-14T11:04:25.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.434+0000 7f907bbdf780 1 < canceled part key=_multipart_E3OIUTR3JCQY.2~DJTWMQKQ273G.1 size=216191 2024-09-14T11:04:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.436+0000 7f907bbdf780 1 < canceled multipart upload key=E3OIUTR3JCQY upload=DJTWMQKQ273G tag=L4TL6VG0VRD0 type=write size=2313343 2024-09-14T11:04:25.435 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.437+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=PCBT19AQPG5F type=write size=471064 2024-09-14T11:04:25.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.438+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~JAHIEKW5XQYI.0 size=1048576 2024-09-14T11:04:25.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.439+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~JAHIEKW5XQYI.1 size=822346 2024-09-14T11:04:25.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.441+0000 7f907bbdf780 1 < completed multipart upload key=9OKQI3W8M5GA upload=JAHIEKW5XQYI tag=0L0442J9IQGV type=write size=2919498 2024-09-14T11:04:25.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.443+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~ZBUGZ440AGJ3.0 size=929739 2024-09-14T11:04:25.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.443+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=ZBUGZ440AGJ3 tag=PL4EOWDRGI3A type=write size=1978315 2024-09-14T11:04:25.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.445+0000 7f907bbdf780 -1 < failed to complete operation key=ZFF333CYOK5P tag=3RQS0X5GOAGV type=write size=552474: (22) Invalid argument 2024-09-14T11:04:25.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.446+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=HMN0NTZ98LTX type=del size=3659475 2024-09-14T11:04:25.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.447+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~S96ZBBSJ91BU.0 size=1048576 2024-09-14T11:04:25.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.448+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~S96ZBBSJ91BU.1 size=895810 2024-09-14T11:04:25.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.450+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=S96ZBBSJ91BU tag=QG2XW1PBVLZ4 type=write size=2992962 2024-09-14T11:04:25.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.452+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~8FC7GYB3QJ3G.0 size=1048576 2024-09-14T11:04:25.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.453+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~8FC7GYB3QJ3G.1 size=335258 2024-09-14T11:04:25.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.453+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=8FC7GYB3QJ3G tag=9YXIWXH7B71X type=write size=2432410 2024-09-14T11:04:25.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.455+0000 7f907bbdf780 1 < completed delete operation key=8C398XZ7XKU7 tag=7XEGGMI0HYLE type=del 2024-09-14T11:04:25.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.456+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=6CU67S57XJ50 type=del size=1776632 2024-09-14T11:04:25.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.457+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.0 size=1048576 2024-09-14T11:04:25.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.458+0000 7f907bbdf780 1 < completed part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.1 size=1048576 2024-09-14T11:04:25.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.458+0000 7f907bbdf780 1 < canceled part key=_multipart_5C8LLJF5MSVP.2~9DA1O3PHRQVS.2 size=32417 2024-09-14T11:04:25.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.460+0000 7f907bbdf780 1 < canceled multipart upload key=5C8LLJF5MSVP upload=9DA1O3PHRQVS tag=D0P5TOE5YE3B type=write size=3178145 2024-09-14T11:04:25.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.463+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~OS649HP4C88O.0 size=1048576 2024-09-14T11:04:25.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.464+0000 7f907bbdf780 1 > prepared part key=_multipart_HM2GVOA72HHR.2~OS649HP4C88O.1 size=93560 2024-09-14T11:04:25.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.464+0000 7f907bbdf780 1 > prepared multipart upload key=HM2GVOA72HHR upload=OS649HP4C88O tag=QSE7F6MGXZPO type=write size=2190712 2024-09-14T11:04:25.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.466+0000 7f907bbdf780 1 < suggested remove operation key=VRQ0ZNN9FG4C tag=AO1IK59AOECI type=del 2024-09-14T11:04:25.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.468+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=WKYS3F4IV0ID type=del size=2778071 2024-09-14T11:04:25.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.469+0000 7f907bbdf780 1 < completed part key=_multipart_9OKQI3W8M5GA.2~SGZN20ROXEDJ.0 size=1048576 2024-09-14T11:04:25.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.469+0000 7f907bbdf780 1 < canceled part key=_multipart_9OKQI3W8M5GA.2~SGZN20ROXEDJ.1 size=533099 2024-09-14T11:04:25.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.471+0000 7f907bbdf780 1 < canceled multipart upload key=9OKQI3W8M5GA upload=SGZN20ROXEDJ tag=OF4KSB5RZZET type=write size=2630251 2024-09-14T11:04:25.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.472+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=GI8NKY7YMH9N type=write size=823781 2024-09-14T11:04:25.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.474+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.0 size=1048576 2024-09-14T11:04:25.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.474+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.1 size=1048576 2024-09-14T11:04:25.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.475+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~22MKAVMGIJYC.2 size=37812 2024-09-14T11:04:25.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.477+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=22MKAVMGIJYC tag=2015DHGNBNJH type=write size=3183540 2024-09-14T11:04:25.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.478+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=MSSP4DVHCZE7 type=del size=3270662 2024-09-14T11:04:25.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.479+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~I1GTXF9H9LVS.0 size=1048576 2024-09-14T11:04:25.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.480+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~I1GTXF9H9LVS.1 size=819566 2024-09-14T11:04:25.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.482+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=I1GTXF9H9LVS tag=4V48Y5FICRB6 type=write size=2916718 2024-09-14T11:04:25.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.483+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=WJDQDI9WE0CX type=del size=1604107 2024-09-14T11:04:25.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.484+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.0 size=1048576 2024-09-14T11:04:25.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.485+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.1 size=1048576 2024-09-14T11:04:25.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.486+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~JSED29I8PC18.2 size=812172 2024-09-14T11:04:25.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.488+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=JSED29I8PC18 tag=RVVIBKOX4AMW type=write size=3957900 2024-09-14T11:04:25.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.489+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=5SOJQLHB6SQG type=del size=2205584 2024-09-14T11:04:25.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.491+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XVO9QTQR8SYM.0 size=1048576 2024-09-14T11:04:25.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.492+0000 7f907bbdf780 1 < completed part key=_multipart_AGMKZ7PGPUAM.2~XVO9QTQR8SYM.1 size=625546 2024-09-14T11:04:25.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.494+0000 7f907bbdf780 1 < completed multipart upload key=AGMKZ7PGPUAM upload=XVO9QTQR8SYM tag=NATLS2LBHQB7 type=write size=2722698 2024-09-14T11:04:25.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.495+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=BRRGT64BD7JD type=del size=2035871 2024-09-14T11:04:25.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.496+0000 7f907bbdf780 1 < canceled operation key=LQNZKMX52SWO tag=A64L7D4W8OOU type=del size=877004 2024-09-14T11:04:25.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.497+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=KLIXWHRL7SDA type=del size=1134954 2024-09-14T11:04:25.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.499+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=4IS08RQRMTNS type=del 2024-09-14T11:04:25.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.501+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~XW24JJN5WUMW.0 size=1048576 2024-09-14T11:04:25.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.502+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~XW24JJN5WUMW.1 size=572482 2024-09-14T11:04:25.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.502+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=XW24JJN5WUMW tag=F80VAMRUGNPR type=write size=2669634 2024-09-14T11:04:25.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.503+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=3X287P3RKY1B type=del 2024-09-14T11:04:25.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.505+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.0 size=1048576 2024-09-14T11:04:25.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.506+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.1 size=1048576 2024-09-14T11:04:25.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.507+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.2 size=645161 2024-09-14T11:04:25.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.507+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=QY9TSBJWF7RQ tag=FFRZC4XHTPJU type=write size=3790889 2024-09-14T11:04:25.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.508+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=YP7IIL1NMJPG type=del 2024-09-14T11:04:25.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.510+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=NZF2EMJ497EZ type=write size=744098 2024-09-14T11:04:25.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.511+0000 7f907bbdf780 1 < completed write operation key=5MFLA6XFV3Y5 tag=PCBT19AQPG5F type=write size=471064 2024-09-14T11:04:25.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.513+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~MC3N06FW7GW7.0 size=1048576 2024-09-14T11:04:25.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.514+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~MC3N06FW7GW7.1 size=770706 2024-09-14T11:04:25.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.514+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=MC3N06FW7GW7 tag=AB1RBNU2TMWI type=write size=2867858 2024-09-14T11:04:25.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.515+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~ZBUGZ440AGJ3.0 size=929739 2024-09-14T11:04:25.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.517+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=ZBUGZ440AGJ3 tag=PL4EOWDRGI3A type=write size=1978315 2024-09-14T11:04:25.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.519+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.0 size=1048576 2024-09-14T11:04:25.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.520+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.1 size=1048576 2024-09-14T11:04:25.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.521+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.2 size=925696 2024-09-14T11:04:25.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.521+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=XPZSTG4NDPA3 tag=0X0AI7AB8M0C type=write size=4071424 2024-09-14T11:04:25.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.522+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=HMN0NTZ98LTX type=del 2024-09-14T11:04:25.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.523+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=YCZZWRNSIB78 type=write size=26638 2024-09-14T11:04:25.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.525+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~8FC7GYB3QJ3G.0 size=1048576 2024-09-14T11:04:25.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.526+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~8FC7GYB3QJ3G.1 size=335258 2024-09-14T11:04:25.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.528+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=8FC7GYB3QJ3G tag=9YXIWXH7B71X type=write size=2432410 2024-09-14T11:04:25.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.529+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=37F0V8OOUUQB type=write size=161585 2024-09-14T11:04:25.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.531+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=6CU67S57XJ50 type=del 2024-09-14T11:04:25.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.534+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~5VOVH3VCP4MD.0 size=343123 2024-09-14T11:04:25.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.534+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=5VOVH3VCP4MD tag=27JFR3W1FPDT type=write size=1391699 2024-09-14T11:04:25.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.535+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~OS649HP4C88O.0 size=1048576 2024-09-14T11:04:25.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.536+0000 7f907bbdf780 1 < completed part key=_multipart_HM2GVOA72HHR.2~OS649HP4C88O.1 size=93560 2024-09-14T11:04:25.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.539+0000 7f907bbdf780 1 < completed multipart upload key=HM2GVOA72HHR upload=OS649HP4C88O tag=QSE7F6MGXZPO type=write size=2190712 2024-09-14T11:04:25.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.540+0000 7f907bbdf780 1 > prepared operation key=FTYIOOQROLG6 tag=VOM27VY8VL3J type=del size=471418 2024-09-14T11:04:25.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.542+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=WKYS3F4IV0ID type=del 2024-09-14T11:04:25.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.543+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=7A1OY3OPUGDR type=del size=194869 2024-09-14T11:04:25.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.544+0000 7f907bbdf780 1 < completed write operation key=9OKQI3W8M5GA tag=GI8NKY7YMH9N type=write size=823781 2024-09-14T11:04:25.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.546+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~2D8U6IDALX0W.0 size=30798 2024-09-14T11:04:25.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.546+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=2D8U6IDALX0W tag=129GZ4RRAF1C type=write size=1079374 2024-09-14T11:04:25.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.547+0000 7f907bbdf780 1 < completed delete operation key=9OKQI3W8M5GA tag=MSSP4DVHCZE7 type=del 2024-09-14T11:04:25.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.548+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=4G23WWBOR888 type=del size=2951865 2024-09-14T11:04:25.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.550+0000 7f907bbdf780 1 < completed delete operation key=FTYIOOQROLG6 tag=WJDQDI9WE0CX type=del 2024-09-14T11:04:25.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.552+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~EY6JKJ928R0F.0 size=1048576 2024-09-14T11:04:25.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.553+0000 7f907bbdf780 1 > prepared part key=_multipart_AI0W2MEG08HF.2~EY6JKJ928R0F.1 size=444767 2024-09-14T11:04:25.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.553+0000 7f907bbdf780 1 > prepared multipart upload key=AI0W2MEG08HF upload=EY6JKJ928R0F tag=KDE64XI7EC0E type=write size=2541919 2024-09-14T11:04:25.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.554+0000 7f907bbdf780 1 < completed delete operation key=YH0YMRDQERBF tag=5SOJQLHB6SQG type=del 2024-09-14T11:04:25.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.556+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~0GO799WHMAZL.0 size=495764 2024-09-14T11:04:25.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.556+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=0GO799WHMAZL tag=CPSL8L1HRH0N type=write size=1544340 2024-09-14T11:04:25.556 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.558+0000 7f907bbdf780 1 < suggested remove operation key=5C8LLJF5MSVP tag=BRRGT64BD7JD type=del 2024-09-14T11:04:25.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.561+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~W4X8ROWZ8UP0.0 size=982832 2024-09-14T11:04:25.558 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.561+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=W4X8ROWZ8UP0 tag=7XH2W2QJHDME type=write size=2031408 2024-09-14T11:04:25.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.563+0000 7f907bbdf780 1 < suggested update operation key=6AWG2GM1ZP31 tag=KLIXWHRL7SDA type=del size=1134954 2024-09-14T11:04:25.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.564+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=C2DN1TR24I5A type=del size=3370459 2024-09-14T11:04:25.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.565+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~XW24JJN5WUMW.0 size=1048576 2024-09-14T11:04:25.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.565+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~XW24JJN5WUMW.1 size=572482 2024-09-14T11:04:25.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.567+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=XW24JJN5WUMW tag=F80VAMRUGNPR type=write size=2669634 2024-09-14T11:04:25.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.568+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=U1BMDU11XTWX type=del size=523924 2024-09-14T11:04:25.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.570+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.0 size=1048576 2024-09-14T11:04:25.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.571+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.1 size=1048576 2024-09-14T11:04:25.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.572+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~QY9TSBJWF7RQ.2 size=645161 2024-09-14T11:04:25.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.574+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=QY9TSBJWF7RQ tag=FFRZC4XHTPJU type=write size=3790889 2024-09-14T11:04:25.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.576+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~3OM963OCSOGI.0 size=677001 2024-09-14T11:04:25.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.576+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=3OM963OCSOGI tag=KDORWCMLM88O type=write size=1725577 2024-09-14T11:04:25.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.578+0000 7f907bbdf780 1 < canceled operation key=WZ064RU647Y7 tag=NZF2EMJ497EZ type=write size=744098 2024-09-14T11:04:25.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.579+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=AW51XY9A777T type=del size=148299 2024-09-14T11:04:25.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.579+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~MC3N06FW7GW7.0 size=1048576 2024-09-14T11:04:25.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.580+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~MC3N06FW7GW7.1 size=770706 2024-09-14T11:04:25.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.583+0000 7f907bbdf780 1 < canceled multipart upload key=59WHXDR0S8DM upload=MC3N06FW7GW7 tag=AB1RBNU2TMWI type=write size=2867858 2024-09-14T11:04:25.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.585+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~EM6JP3PUSHJN.0 size=1012162 2024-09-14T11:04:25.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.585+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=EM6JP3PUSHJN tag=VLWSBWUMK1PB type=write size=2060738 2024-09-14T11:04:25.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.586+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.0 size=1048576 2024-09-14T11:04:25.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.587+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.1 size=1048576 2024-09-14T11:04:25.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.588+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~XPZSTG4NDPA3.2 size=925696 2024-09-14T11:04:25.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.590+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=XPZSTG4NDPA3 tag=0X0AI7AB8M0C type=write size=4071424 2024-09-14T11:04:25.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.592+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.0 size=1048576 2024-09-14T11:04:25.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.593+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.1 size=1048576 2024-09-14T11:04:25.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.594+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.2 size=956975 2024-09-14T11:04:25.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.594+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=715Z1W55EFD7 tag=6632U60AQAZ1 type=write size=4102703 2024-09-14T11:04:25.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.596+0000 7f907bbdf780 1 < completed write operation key=AGMKZ7PGPUAM tag=YCZZWRNSIB78 type=write size=26638 2024-09-14T11:04:25.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.597+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=KKIYHWJEA037 type=del size=282445 2024-09-14T11:04:25.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.598+0000 7f907bbdf780 1 < completed write operation key=9OKQI3W8M5GA tag=37F0V8OOUUQB type=write size=161585 2024-09-14T11:04:25.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.600+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~R26FVTKP881E.0 size=1023356 2024-09-14T11:04:25.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.600+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=R26FVTKP881E tag=272TL4D8W2EM type=write size=2071932 2024-09-14T11:04:25.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.601+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~5VOVH3VCP4MD.0 size=343123 2024-09-14T11:04:25.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.603+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=5VOVH3VCP4MD tag=27JFR3W1FPDT type=write size=1391699 2024-09-14T11:04:25.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.605+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=MC04JOE6902A type=del size=2828526 2024-09-14T11:04:25.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.606+0000 7f907bbdf780 1 < canceled operation key=FTYIOOQROLG6 tag=VOM27VY8VL3J type=del size=471418 2024-09-14T11:04:25.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.607+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=24S10DDWF34D type=del size=3593570 2024-09-14T11:04:25.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.609+0000 7f907bbdf780 1 < completed delete operation key=HM2GVOA72HHR tag=7A1OY3OPUGDR type=del 2024-09-14T11:04:25.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.610+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=H7QDRPOYMI51 type=del size=3474357 2024-09-14T11:04:25.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.611+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~2D8U6IDALX0W.0 size=30798 2024-09-14T11:04:25.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.613+0000 7f907bbdf780 1 < completed multipart upload key=91RL2KD0XCSI upload=2D8U6IDALX0W tag=129GZ4RRAF1C type=write size=1079374 2024-09-14T11:04:25.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.614+0000 7f907bbdf780 1 > prepared operation key=T79IR10S3HAB tag=W2719MWKOLIN type=del size=4016347 2024-09-14T11:04:25.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.615+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=4G23WWBOR888 type=del 2024-09-14T11:04:25.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.617+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=9N2RXHZTMWMS type=del size=1298561 2024-09-14T11:04:25.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.618+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~EY6JKJ928R0F.0 size=1048576 2024-09-14T11:04:25.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.619+0000 7f907bbdf780 1 < completed part key=_multipart_AI0W2MEG08HF.2~EY6JKJ928R0F.1 size=444767 2024-09-14T11:04:25.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.621+0000 7f907bbdf780 1 < completed multipart upload key=AI0W2MEG08HF upload=EY6JKJ928R0F tag=KDE64XI7EC0E type=write size=2541919 2024-09-14T11:04:25.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.623+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=0PGQIT3N2FGJ type=del size=4029104 2024-09-14T11:04:25.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.624+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~0GO799WHMAZL.0 size=495764 2024-09-14T11:04:25.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.626+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=0GO799WHMAZL tag=CPSL8L1HRH0N type=write size=1544340 2024-09-14T11:04:25.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.627+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=H9U1K4J80SLA type=del size=661165 2024-09-14T11:04:25.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.628+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~W4X8ROWZ8UP0.0 size=982832 2024-09-14T11:04:25.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.630+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=W4X8ROWZ8UP0 tag=7XH2W2QJHDME type=write size=2031408 2024-09-14T11:04:25.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.631+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=H2K1IW32K2TM type=del size=3528166 2024-09-14T11:04:25.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.634+0000 7f907bbdf780 1 < suggested update operation key=VRQ0ZNN9FG4C tag=C2DN1TR24I5A type=del size=3370459 2024-09-14T11:04:25.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.636+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~8ONRS19BHJK9.0 size=466100 2024-09-14T11:04:25.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.636+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=8ONRS19BHJK9 tag=1RWVVKHSJJ4K type=write size=1514676 2024-09-14T11:04:25.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.637+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=U1BMDU11XTWX type=del 2024-09-14T11:04:25.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.639+0000 7f907bbdf780 1 > prepared part key=_multipart_8C398XZ7XKU7.2~1P70EEKWBLZV.0 size=916618 2024-09-14T11:04:25.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.639+0000 7f907bbdf780 1 > prepared multipart upload key=8C398XZ7XKU7 upload=1P70EEKWBLZV tag=9XAOUMH6W5ZD type=write size=1965194 2024-09-14T11:04:25.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.640+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~3OM963OCSOGI.0 size=677001 2024-09-14T11:04:25.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.642+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=3OM963OCSOGI tag=KDORWCMLM88O type=write size=1725577 2024-09-14T11:04:25.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.644+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=5L6RGL7EY4J8 type=del size=635157 2024-09-14T11:04:25.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.646+0000 7f907bbdf780 1 < suggested update operation key=HM2GVOA72HHR tag=AW51XY9A777T type=del size=148299 2024-09-14T11:04:25.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.647+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=30FUCVYLOCX4 type=del size=1165568 2024-09-14T11:04:25.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.648+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~EM6JP3PUSHJN.0 size=1012162 2024-09-14T11:04:25.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.650+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=EM6JP3PUSHJN tag=VLWSBWUMK1PB type=write size=2060738 2024-09-14T11:04:25.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.653+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=15QCRN1Q2G8Q type=del size=18510 2024-09-14T11:04:25.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.653+0000 7f907bbdf780 1 < canceled part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.0 size=1048576 2024-09-14T11:04:25.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.654+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.1 size=1048576 2024-09-14T11:04:25.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.655+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~715Z1W55EFD7.2 size=956975 2024-09-14T11:04:25.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.657+0000 7f907bbdf780 1 < canceled multipart upload key=WAFH5BKM2P23 upload=715Z1W55EFD7 tag=6632U60AQAZ1 type=write size=4102703 2024-09-14T11:04:25.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.658+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=QRKGXJF9YVSX type=write size=416759 2024-09-14T11:04:25.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.660+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=KKIYHWJEA037 type=del 2024-09-14T11:04:25.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.662+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.0 size=1048576 2024-09-14T11:04:25.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.663+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.1 size=1048576 2024-09-14T11:04:25.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.663+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.2 size=274238 2024-09-14T11:04:25.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.663+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=GTBJO4QF4UAB tag=VVLOCINLIY7I type=write size=3419966 2024-09-14T11:04:25.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.665+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~R26FVTKP881E.0 size=1023356 2024-09-14T11:04:25.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.667+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=R26FVTKP881E tag=272TL4D8W2EM type=write size=2071932 2024-09-14T11:04:25.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.669+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~1KPYI2731A2B.0 size=1048576 2024-09-14T11:04:25.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.670+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~1KPYI2731A2B.1 size=59376 2024-09-14T11:04:25.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.670+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=1KPYI2731A2B tag=ERNDOWP0QIAY type=write size=2156528 2024-09-14T11:04:25.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.671+0000 7f907bbdf780 1 < completed delete operation key=AGMKZ7PGPUAM tag=MC04JOE6902A type=del 2024-09-14T11:04:25.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.672+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=3YR9UOX9L72X type=del size=935908 2024-09-14T11:04:25.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.673+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=24S10DDWF34D type=del 2024-09-14T11:04:25.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.674+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=I7XSX9NR1TSP type=del size=2847411 2024-09-14T11:04:25.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.675+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=H7QDRPOYMI51 type=del 2024-09-14T11:04:25.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.676+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=4EW14MZ86QZC type=del size=2514013 2024-09-14T11:04:25.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.679+0000 7f907bbdf780 1 < suggested remove operation key=T79IR10S3HAB tag=W2719MWKOLIN type=del 2024-09-14T11:04:25.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.680+0000 7f907bbdf780 1 > prepared operation key=LJ720PV3SQ8L tag=Y942ALM1LWTY type=del size=1943692 2024-09-14T11:04:25.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.682+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=9N2RXHZTMWMS type=del 2024-09-14T11:04:25.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.683+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=5JWK4F320MTW type=del size=691578 2024-09-14T11:04:25.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.684+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=0PGQIT3N2FGJ type=del 2024-09-14T11:04:25.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.686+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.0 size=1048576 2024-09-14T11:04:25.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.687+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.1 size=1048576 2024-09-14T11:04:25.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.688+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.2 size=105284 2024-09-14T11:04:25.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.688+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=7BSYG6Y6K4JO tag=0PYC68ZY6VY7 type=write size=3251012 2024-09-14T11:04:25.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.690+0000 7f907bbdf780 -1 < failed to complete operation key=VRQ0ZNN9FG4C tag=H9U1K4J80SLA type=del size=661165: (22) Invalid argument 2024-09-14T11:04:25.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.691+0000 7f907bbdf780 1 > prepared operation key=WZ064RU647Y7 tag=2CIQH0TUTZUU type=del size=3549409 2024-09-14T11:04:25.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.692+0000 7f907bbdf780 1 < canceled operation key=77H37YF6MJEO tag=H2K1IW32K2TM type=del size=3528166 2024-09-14T11:04:25.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.695+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~8P2CDLU1EVVP.0 size=725736 2024-09-14T11:04:25.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.695+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=8P2CDLU1EVVP tag=K6FYNWRDC1LC type=write size=1774312 2024-09-14T11:04:25.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.696+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~8ONRS19BHJK9.0 size=466100 2024-09-14T11:04:25.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.699+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=8ONRS19BHJK9 tag=1RWVVKHSJJ4K type=write size=1514676 2024-09-14T11:04:25.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.700+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=ONWW69I0H99J type=write size=639623 2024-09-14T11:04:25.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.700+0000 7f907bbdf780 1 < canceled part key=_multipart_8C398XZ7XKU7.2~1P70EEKWBLZV.0 size=916618 2024-09-14T11:04:25.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.702+0000 7f907bbdf780 1 < canceled multipart upload key=8C398XZ7XKU7 upload=1P70EEKWBLZV tag=9XAOUMH6W5ZD type=write size=1965194 2024-09-14T11:04:25.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.703+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=0JLNSY6043WY type=del size=2778619 2024-09-14T11:04:25.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.705+0000 7f907bbdf780 -1 < failed to complete operation key=HM2GVOA72HHR tag=5L6RGL7EY4J8 type=del size=635157: (22) Invalid argument 2024-09-14T11:04:25.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.706+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=EL8UK3U9YR2G type=del size=3452390 2024-09-14T11:04:25.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.707+0000 7f907bbdf780 1 < canceled operation key=8C398XZ7XKU7 tag=30FUCVYLOCX4 type=del size=1165568 2024-09-14T11:04:25.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.709+0000 7f907bbdf780 1 > prepared part key=_multipart_WAFH5BKM2P23.2~9L6PH2HDQXCW.0 size=1032936 2024-09-14T11:04:25.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.709+0000 7f907bbdf780 1 > prepared multipart upload key=WAFH5BKM2P23 upload=9L6PH2HDQXCW tag=1X2HG0F43E6M type=write size=2081512 2024-09-14T11:04:25.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.710+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=15QCRN1Q2G8Q type=del 2024-09-14T11:04:25.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.711+0000 7f907bbdf780 1 > prepared operation key=LQNZKMX52SWO tag=LW1Y2R3OHVGU type=del size=1589446 2024-09-14T11:04:25.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.713+0000 7f907bbdf780 1 < completed write operation key=E3OIUTR3JCQY tag=QRKGXJF9YVSX type=write size=416759 2024-09-14T11:04:25.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.714+0000 7f907bbdf780 1 > prepared operation key=HM2GVOA72HHR tag=EGK4J5T6PXQE type=write size=848973 2024-09-14T11:04:25.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.715+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.0 size=1048576 2024-09-14T11:04:25.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.716+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.1 size=1048576 2024-09-14T11:04:25.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.717+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~GTBJO4QF4UAB.2 size=274238 2024-09-14T11:04:25.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.719+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=GTBJO4QF4UAB tag=VVLOCINLIY7I type=write size=3419966 2024-09-14T11:04:25.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.721+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~GHFM0CSYXCJ8.0 size=1048576 2024-09-14T11:04:25.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.722+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~GHFM0CSYXCJ8.1 size=94106 2024-09-14T11:04:25.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.722+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=GHFM0CSYXCJ8 tag=N60W9WR3DAR9 type=write size=2191258 2024-09-14T11:04:25.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.723+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~1KPYI2731A2B.0 size=1048576 2024-09-14T11:04:25.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.724+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~1KPYI2731A2B.1 size=59376 2024-09-14T11:04:25.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.726+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=1KPYI2731A2B tag=ERNDOWP0QIAY type=write size=2156528 2024-09-14T11:04:25.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.729+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~7RWCS9CU545F.0 size=1048576 2024-09-14T11:04:25.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.730+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~7RWCS9CU545F.1 size=572929 2024-09-14T11:04:25.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.730+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=7RWCS9CU545F tag=QYZINLCVCVHY type=write size=2670081 2024-09-14T11:04:25.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.731+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=3YR9UOX9L72X type=del 2024-09-14T11:04:25.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.732+0000 7f907bbdf780 1 > prepared operation key=JEXUT5F7AKZ1 tag=W31I5VGYJRFU type=del size=273608 2024-09-14T11:04:25.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.735+0000 7f907bbdf780 1 < suggested remove operation key=AI0W2MEG08HF tag=I7XSX9NR1TSP type=del 2024-09-14T11:04:25.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.736+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=T5V8VJZZLKIJ type=del size=2373366 2024-09-14T11:04:25.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.737+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=4EW14MZ86QZC type=del 2024-09-14T11:04:25.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.738+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=IW24WH2I4D5Y type=del size=2809139 2024-09-14T11:04:25.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.740+0000 7f907bbdf780 1 < completed delete operation key=LJ720PV3SQ8L tag=Y942ALM1LWTY type=del 2024-09-14T11:04:25.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.742+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~I5KP2V5HH4HL.0 size=1048576 2024-09-14T11:04:25.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.743+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~I5KP2V5HH4HL.1 size=205921 2024-09-14T11:04:25.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.743+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=I5KP2V5HH4HL tag=WZPQ0VSDFP65 type=write size=2303073 2024-09-14T11:04:25.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.744+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=5JWK4F320MTW type=del 2024-09-14T11:04:25.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.746+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~4QIAD2A6FVQO.0 size=80312 2024-09-14T11:04:25.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.746+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=4QIAD2A6FVQO tag=HELHPAYCQVMJ type=write size=1128888 2024-09-14T11:04:25.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.747+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.0 size=1048576 2024-09-14T11:04:25.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.748+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.1 size=1048576 2024-09-14T11:04:25.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.749+0000 7f907bbdf780 1 < completed part key=_multipart_P0701O36E1JI.2~7BSYG6Y6K4JO.2 size=105284 2024-09-14T11:04:25.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.752+0000 7f907bbdf780 1 < completed multipart upload key=P0701O36E1JI upload=7BSYG6Y6K4JO tag=0PYC68ZY6VY7 type=write size=3251012 2024-09-14T11:04:25.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.753+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=A34FG59QAOVK type=del size=1718749 2024-09-14T11:04:25.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.754+0000 7f907bbdf780 1 < completed delete operation key=WZ064RU647Y7 tag=2CIQH0TUTZUU type=del 2024-09-14T11:04:25.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.757+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~EBUO39M6U8QQ.0 size=1048576 2024-09-14T11:04:25.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.758+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~EBUO39M6U8QQ.1 size=252642 2024-09-14T11:04:25.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.758+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=EBUO39M6U8QQ tag=UDCLIWFY2546 type=write size=2349794 2024-09-14T11:04:25.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.759+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~8P2CDLU1EVVP.0 size=725736 2024-09-14T11:04:25.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.762+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=8P2CDLU1EVVP tag=K6FYNWRDC1LC type=write size=1774312 2024-09-14T11:04:25.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.764+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~R2ZYV44K39NF.0 size=1048576 2024-09-14T11:04:25.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.765+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~R2ZYV44K39NF.1 size=875313 2024-09-14T11:04:25.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.765+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=R2ZYV44K39NF tag=DKONRDMEESYV type=write size=2972465 2024-09-14T11:04:25.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.767+0000 7f907bbdf780 1 < completed write operation key=8NO5BA4HL03L tag=ONWW69I0H99J type=write size=639623 2024-09-14T11:04:25.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.770+0000 7f907bbdf780 1 > prepared operation key=AGMKZ7PGPUAM tag=QH1LLOYKBAM9 type=write size=253350 2024-09-14T11:04:25.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.772+0000 7f907bbdf780 1 < suggested remove operation key=GC52N456IYD7 tag=0JLNSY6043WY type=del 2024-09-14T11:04:25.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.775+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~74PPXG4EL6UA.0 size=1048576 2024-09-14T11:04:25.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.776+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~74PPXG4EL6UA.1 size=125133 2024-09-14T11:04:25.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.776+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=74PPXG4EL6UA tag=PGDWQFK7TL4S type=write size=2222285 2024-09-14T11:04:25.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.778+0000 7f907bbdf780 1 < completed delete operation key=5MFLA6XFV3Y5 tag=EL8UK3U9YR2G type=del 2024-09-14T11:04:25.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.780+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~33Z71JTQE7Q1.0 size=570374 2024-09-14T11:04:25.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.780+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=33Z71JTQE7Q1 tag=9N1Q2TJSZT25 type=write size=1618950 2024-09-14T11:04:25.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.782+0000 7f907bbdf780 1 < completed part key=_multipart_WAFH5BKM2P23.2~9L6PH2HDQXCW.0 size=1032936 2024-09-14T11:04:25.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.784+0000 7f907bbdf780 1 < completed multipart upload key=WAFH5BKM2P23 upload=9L6PH2HDQXCW tag=1X2HG0F43E6M type=write size=2081512 2024-09-14T11:04:25.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.786+0000 7f907bbdf780 1 > prepared part key=_multipart_LQNZKMX52SWO.2~VDRVWKSDOXQS.0 size=80357 2024-09-14T11:04:25.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.786+0000 7f907bbdf780 1 > prepared multipart upload key=LQNZKMX52SWO upload=VDRVWKSDOXQS tag=RZ3BTS0JINDM type=write size=1128933 2024-09-14T11:04:25.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.788+0000 7f907bbdf780 1 < completed delete operation key=LQNZKMX52SWO tag=LW1Y2R3OHVGU type=del 2024-09-14T11:04:25.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.790+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~541GZG6RIG9K.0 size=779606 2024-09-14T11:04:25.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.790+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=541GZG6RIG9K tag=0RSXST9OZAS4 type=write size=1828182 2024-09-14T11:04:25.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.791+0000 7f907bbdf780 1 < completed write operation key=HM2GVOA72HHR tag=EGK4J5T6PXQE type=write size=848973 2024-09-14T11:04:25.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.793+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EYCBMMUSI98F.0 size=581218 2024-09-14T11:04:25.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.793+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=EYCBMMUSI98F tag=LRI4X4MMH7RR type=write size=1629794 2024-09-14T11:04:25.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.794+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~GHFM0CSYXCJ8.0 size=1048576 2024-09-14T11:04:25.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.795+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~GHFM0CSYXCJ8.1 size=94106 2024-09-14T11:04:25.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.797+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=GHFM0CSYXCJ8 tag=N60W9WR3DAR9 type=write size=2191258 2024-09-14T11:04:25.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.800+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~LU7COFK3SEV6.0 size=792739 2024-09-14T11:04:25.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.800+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=LU7COFK3SEV6 tag=IKN85PCI01KF type=write size=1841315 2024-09-14T11:04:25.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.801+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~7RWCS9CU545F.0 size=1048576 2024-09-14T11:04:25.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.802+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~7RWCS9CU545F.1 size=572929 2024-09-14T11:04:25.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.804+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=7RWCS9CU545F tag=QYZINLCVCVHY type=write size=2670081 2024-09-14T11:04:25.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.805+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=0CG80NQU4P24 type=del size=74501 2024-09-14T11:04:25.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.806+0000 7f907bbdf780 1 < completed delete operation key=JEXUT5F7AKZ1 tag=W31I5VGYJRFU type=del 2024-09-14T11:04:25.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.808+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=JW74VTMN8EGT type=del size=389513 2024-09-14T11:04:25.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.809+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=T5V8VJZZLKIJ type=del 2024-09-14T11:04:25.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.811+0000 7f907bbdf780 1 > prepared part key=_multipart_59WHXDR0S8DM.2~RE5ZOFSIY252.0 size=616893 2024-09-14T11:04:25.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.811+0000 7f907bbdf780 1 > prepared multipart upload key=59WHXDR0S8DM upload=RE5ZOFSIY252 tag=N5D1SWUOL6QT type=write size=1665469 2024-09-14T11:04:25.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.812+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=IW24WH2I4D5Y type=del 2024-09-14T11:04:25.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.813+0000 7f907bbdf780 1 > prepared operation key=8NO5BA4HL03L tag=KG8Y2BOJW9MU type=del size=1605570 2024-09-14T11:04:25.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.815+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~I5KP2V5HH4HL.0 size=1048576 2024-09-14T11:04:25.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.816+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~I5KP2V5HH4HL.1 size=205921 2024-09-14T11:04:25.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.818+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=I5KP2V5HH4HL tag=WZPQ0VSDFP65 type=write size=2303073 2024-09-14T11:04:25.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.819+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=0V3X3939R76O type=write size=94170 2024-09-14T11:04:25.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.820+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~4QIAD2A6FVQO.0 size=80312 2024-09-14T11:04:25.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.822+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=4QIAD2A6FVQO tag=HELHPAYCQVMJ type=write size=1128888 2024-09-14T11:04:25.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.823+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=1K5CP7P3MMKA type=del size=554196 2024-09-14T11:04:25.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.824+0000 7f907bbdf780 1 < completed delete operation key=VRQ0ZNN9FG4C tag=A34FG59QAOVK type=del 2024-09-14T11:04:25.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.826+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=EKC76KOYUC2N type=del size=1205813 2024-09-14T11:04:25.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.827+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~EBUO39M6U8QQ.0 size=1048576 2024-09-14T11:04:25.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.828+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~EBUO39M6U8QQ.1 size=252642 2024-09-14T11:04:25.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.830+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=EBUO39M6U8QQ tag=UDCLIWFY2546 type=write size=2349794 2024-09-14T11:04:25.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.832+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.0 size=1048576 2024-09-14T11:04:25.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.833+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.1 size=1048576 2024-09-14T11:04:25.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.834+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.2 size=84178 2024-09-14T11:04:25.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.834+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=4UJ1IFYQ7KA8 tag=MBO0A7XPZ936 type=write size=3229906 2024-09-14T11:04:25.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.835+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~R2ZYV44K39NF.0 size=1048576 2024-09-14T11:04:25.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.836+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~R2ZYV44K39NF.1 size=875313 2024-09-14T11:04:25.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.838+0000 7f907bbdf780 1 < completed multipart upload key=WZ064RU647Y7 upload=R2ZYV44K39NF tag=DKONRDMEESYV type=write size=2972465 2024-09-14T11:04:25.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.839+0000 7f907bbdf780 1 > prepared operation key=59WHXDR0S8DM tag=ZNQ70C56UUZ9 type=del size=2425992 2024-09-14T11:04:25.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.842+0000 7f907bbdf780 1 < suggested remove operation key=AGMKZ7PGPUAM tag=QH1LLOYKBAM9 type=write 2024-09-14T11:04:25.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.844+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.0 size=1048576 2024-09-14T11:04:25.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.845+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.1 size=1048576 2024-09-14T11:04:25.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.846+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.2 size=1022811 2024-09-14T11:04:25.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.846+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=L9ANXG2QRNGZ tag=RFESSH89VSS1 type=write size=4168539 2024-09-14T11:04:25.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.847+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~74PPXG4EL6UA.0 size=1048576 2024-09-14T11:04:25.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.848+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~74PPXG4EL6UA.1 size=125133 2024-09-14T11:04:25.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.850+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=74PPXG4EL6UA tag=PGDWQFK7TL4S type=write size=2222285 2024-09-14T11:04:25.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.851+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=VH9668314PA6 type=del size=2595741 2024-09-14T11:04:25.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.852+0000 7f907bbdf780 1 < canceled part key=_multipart_59WHXDR0S8DM.2~33Z71JTQE7Q1.0 size=570374 2024-09-14T11:04:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.853+0000 7f907bbdf780 1 < canceled multipart upload key=59WHXDR0S8DM upload=33Z71JTQE7Q1 tag=9N1Q2TJSZT25 type=write size=1618950 2024-09-14T11:04:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.855+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=8RQC0OODROZE type=del size=1823464 2024-09-14T11:04:25.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.856+0000 7f907bbdf780 1 < completed part key=_multipart_LQNZKMX52SWO.2~VDRVWKSDOXQS.0 size=80357 2024-09-14T11:04:25.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.858+0000 7f907bbdf780 1 < completed multipart upload key=LQNZKMX52SWO upload=VDRVWKSDOXQS tag=RZ3BTS0JINDM type=write size=1128933 2024-09-14T11:04:25.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.859+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=E3D3DOOVNNJB type=write size=265900 2024-09-14T11:04:25.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.860+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~541GZG6RIG9K.0 size=779606 2024-09-14T11:04:25.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.862+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=541GZG6RIG9K tag=0RSXST9OZAS4 type=write size=1828182 2024-09-14T11:04:25.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.864+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=43QIXXJYLEBN type=del size=2108100 2024-09-14T11:04:25.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.865+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~EYCBMMUSI98F.0 size=581218 2024-09-14T11:04:25.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.867+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=EYCBMMUSI98F tag=LRI4X4MMH7RR type=write size=1629794 2024-09-14T11:04:25.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.869+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NHFBM7JVW66K.0 size=1048576 2024-09-14T11:04:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.870+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~NHFBM7JVW66K.1 size=164561 2024-09-14T11:04:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.870+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=NHFBM7JVW66K tag=WMFRUFBU64G5 type=write size=2261713 2024-09-14T11:04:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.872+0000 7f907bbdf780 1 < completed part key=_multipart_S8RIEED24PUM.2~LU7COFK3SEV6.0 size=792739 2024-09-14T11:04:25.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.874+0000 7f907bbdf780 1 < completed multipart upload key=S8RIEED24PUM upload=LU7COFK3SEV6 tag=IKN85PCI01KF type=write size=1841315 2024-09-14T11:04:25.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.875+0000 7f907bbdf780 1 > prepared operation key=YH0YMRDQERBF tag=HRRK38VJXK60 type=write size=353131 2024-09-14T11:04:25.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.877+0000 7f907bbdf780 1 < suggested remove operation key=91RL2KD0XCSI tag=0CG80NQU4P24 type=del 2024-09-14T11:04:25.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.879+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~MCSCPJEK2068.0 size=1048576 2024-09-14T11:04:25.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.880+0000 7f907bbdf780 1 > prepared part key=_multipart_YH0YMRDQERBF.2~MCSCPJEK2068.1 size=950870 2024-09-14T11:04:25.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.880+0000 7f907bbdf780 1 > prepared multipart upload key=YH0YMRDQERBF upload=MCSCPJEK2068 tag=L9I0D5FO13QB type=write size=3048022 2024-09-14T11:04:25.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.881+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=JW74VTMN8EGT type=del 2024-09-14T11:04:25.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.884+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=D9OTPF9OHFHZ type=del size=3345083 2024-09-14T11:04:25.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.885+0000 7f907bbdf780 1 < completed part key=_multipart_59WHXDR0S8DM.2~RE5ZOFSIY252.0 size=616893 2024-09-14T11:04:25.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.887+0000 7f907bbdf780 1 < completed multipart upload key=59WHXDR0S8DM upload=RE5ZOFSIY252 tag=N5D1SWUOL6QT type=write size=1665469 2024-09-14T11:04:25.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.889+0000 7f907bbdf780 1 > prepared part key=_multipart_HHXUGVBHQ2US.2~C1L7Q9PGDA9N.0 size=482648 2024-09-14T11:04:25.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.889+0000 7f907bbdf780 1 > prepared multipart upload key=HHXUGVBHQ2US upload=C1L7Q9PGDA9N tag=TZ95KPPSF139 type=write size=1531224 2024-09-14T11:04:25.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.890+0000 7f907bbdf780 1 < completed delete operation key=8NO5BA4HL03L tag=KG8Y2BOJW9MU type=del 2024-09-14T11:04:25.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.892+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.0 size=1048576 2024-09-14T11:04:25.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.893+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.1 size=1048576 2024-09-14T11:04:25.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.894+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.2 size=858240 2024-09-14T11:04:25.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.894+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=A1OZI5V4E9XL tag=JNNMTCCWXGQD type=write size=4003968 2024-09-14T11:04:25.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.895+0000 7f907bbdf780 1 < completed write operation key=HHXUGVBHQ2US tag=0V3X3939R76O type=write size=94170 2024-09-14T11:04:25.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.896+0000 7f907bbdf780 1 > prepared operation key=91RL2KD0XCSI tag=U406NJ5WH8IM type=del size=109110 2024-09-14T11:04:25.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.897+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=1K5CP7P3MMKA type=del 2024-09-14T11:04:25.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.899+0000 7f907bbdf780 1 > prepared part key=_multipart_Y3KOCA4072NM.2~Q02U1S9TNCYN.0 size=25524 2024-09-14T11:04:25.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.899+0000 7f907bbdf780 1 > prepared multipart upload key=Y3KOCA4072NM upload=Q02U1S9TNCYN tag=59UCCNKTSP3T type=write size=1074100 2024-09-14T11:04:25.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.900+0000 7f907bbdf780 -1 < failed to complete operation key=91RL2KD0XCSI tag=EKC76KOYUC2N type=del size=1205813: (22) Invalid argument 2024-09-14T11:04:25.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.902+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.0 size=1048576 2024-09-14T11:04:25.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.903+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.1 size=1048576 2024-09-14T11:04:25.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.904+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.2 size=1006471 2024-09-14T11:04:25.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.904+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=VT81VIN3LHE7 tag=6801TEQYQ2HR type=write size=4152199 2024-09-14T11:04:25.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.905+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.0 size=1048576 2024-09-14T11:04:25.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.906+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.1 size=1048576 2024-09-14T11:04:25.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.907+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~4UJ1IFYQ7KA8.2 size=84178 2024-09-14T11:04:25.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.909+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=4UJ1IFYQ7KA8 tag=MBO0A7XPZ936 type=write size=3229906 2024-09-14T11:04:25.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.910+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=F5IP2F117279 type=del size=944342 2024-09-14T11:04:25.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.911+0000 7f907bbdf780 1 < completed delete operation key=59WHXDR0S8DM tag=ZNQ70C56UUZ9 type=del 2024-09-14T11:04:25.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.913+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.0 size=1048576 2024-09-14T11:04:25.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.914+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.1 size=1048576 2024-09-14T11:04:25.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.915+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.2 size=938681 2024-09-14T11:04:25.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.915+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=TE5YUGVB6QCH tag=PL22J6H8HRRG type=write size=4084409 2024-09-14T11:04:25.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.916+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.0 size=1048576 2024-09-14T11:04:25.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.917+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.1 size=1048576 2024-09-14T11:04:25.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.918+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~L9ANXG2QRNGZ.2 size=1022811 2024-09-14T11:04:25.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.920+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=L9ANXG2QRNGZ tag=RFESSH89VSS1 type=write size=4168539 2024-09-14T11:04:25.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.923+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~J0ORJN22T1W0.0 size=551960 2024-09-14T11:04:25.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.923+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=J0ORJN22T1W0 tag=K1L2L37FCLPQ type=write size=1600536 2024-09-14T11:04:25.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.924+0000 7f907bbdf780 1 < completed delete operation key=6AWG2GM1ZP31 tag=VH9668314PA6 type=del 2024-09-14T11:04:25.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.925+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=GYH2XZMI8I27 type=del size=3106441 2024-09-14T11:04:25.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.926+0000 7f907bbdf780 1 < completed delete operation key=P0701O36E1JI tag=8RQC0OODROZE type=del 2024-09-14T11:04:25.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.927+0000 7f907bbdf780 1 > prepared operation key=8C398XZ7XKU7 tag=AW6S40YPPYT5 type=del size=287306 2024-09-14T11:04:25.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.928+0000 7f907bbdf780 1 < canceled operation key=Y3KOCA4072NM tag=E3D3DOOVNNJB type=write size=265900 2024-09-14T11:04:25.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.930+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=TSXOQ0IWJCMG type=write size=881274 2024-09-14T11:04:25.929 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.931+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=43QIXXJYLEBN type=del 2024-09-14T11:04:25.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.932+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=9P3X75SOWSED type=del size=2474004 2024-09-14T11:04:25.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.933+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NHFBM7JVW66K.0 size=1048576 2024-09-14T11:04:25.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.934+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~NHFBM7JVW66K.1 size=164561 2024-09-14T11:04:25.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.936+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=NHFBM7JVW66K tag=WMFRUFBU64G5 type=write size=2261713 2024-09-14T11:04:25.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.939+0000 7f907bbdf780 1 > prepared part key=_multipart_VRQ0ZNN9FG4C.2~QXO7BF483TF3.0 size=29026 2024-09-14T11:04:25.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.939+0000 7f907bbdf780 1 > prepared multipart upload key=VRQ0ZNN9FG4C upload=QXO7BF483TF3 tag=JNVLGWIQDTK9 type=write size=1077602 2024-09-14T11:04:25.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.940+0000 7f907bbdf780 1 < completed write operation key=YH0YMRDQERBF tag=HRRK38VJXK60 type=write size=353131 2024-09-14T11:04:25.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.941+0000 7f907bbdf780 1 > prepared operation key=P546JCSFB00N tag=IJDIO8WLXAE1 type=del size=67320 2024-09-14T11:04:25.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.942+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~MCSCPJEK2068.0 size=1048576 2024-09-14T11:04:25.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.943+0000 7f907bbdf780 1 < completed part key=_multipart_YH0YMRDQERBF.2~MCSCPJEK2068.1 size=950870 2024-09-14T11:04:25.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.945+0000 7f907bbdf780 1 < completed multipart upload key=YH0YMRDQERBF upload=MCSCPJEK2068 tag=L9I0D5FO13QB type=write size=3048022 2024-09-14T11:04:25.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.948+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~85XP6IR3Q08A.0 size=1048576 2024-09-14T11:04:25.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.949+0000 7f907bbdf780 1 > prepared part key=_multipart_6AWG2GM1ZP31.2~85XP6IR3Q08A.1 size=365355 2024-09-14T11:04:25.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.949+0000 7f907bbdf780 1 > prepared multipart upload key=6AWG2GM1ZP31 upload=85XP6IR3Q08A tag=60ABG6LVLAMA type=write size=2462507 2024-09-14T11:04:25.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.951+0000 7f907bbdf780 1 < suggested remove operation key=P546JCSFB00N tag=D9OTPF9OHFHZ type=del 2024-09-14T11:04:25.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.953+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~XC28XCUA6K23.0 size=1048576 2024-09-14T11:04:25.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.954+0000 7f907bbdf780 1 > prepared part key=_multipart_GC52N456IYD7.2~XC28XCUA6K23.1 size=334647 2024-09-14T11:04:25.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.954+0000 7f907bbdf780 1 > prepared multipart upload key=GC52N456IYD7 upload=XC28XCUA6K23 tag=DP9L3FHM3KCU type=write size=2431799 2024-09-14T11:04:25.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.955+0000 7f907bbdf780 1 < completed part key=_multipart_HHXUGVBHQ2US.2~C1L7Q9PGDA9N.0 size=482648 2024-09-14T11:04:25.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.957+0000 7f907bbdf780 1 < completed multipart upload key=HHXUGVBHQ2US upload=C1L7Q9PGDA9N tag=TZ95KPPSF139 type=write size=1531224 2024-09-14T11:04:25.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.960+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.0 size=1048576 2024-09-14T11:04:25.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.961+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.1 size=1048576 2024-09-14T11:04:25.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.962+0000 7f907bbdf780 1 > prepared part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.2 size=53499 2024-09-14T11:04:25.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.962+0000 7f907bbdf780 1 > prepared multipart upload key=5MFLA6XFV3Y5 upload=SNTW6W3ZNJKG tag=HMIQ1V66B0R9 type=write size=3199227 2024-09-14T11:04:25.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.963+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.0 size=1048576 2024-09-14T11:04:25.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.963+0000 7f907bbdf780 1 < canceled part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.1 size=1048576 2024-09-14T11:04:25.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.964+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~A1OZI5V4E9XL.2 size=858240 2024-09-14T11:04:25.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.966+0000 7f907bbdf780 1 < canceled multipart upload key=WZ064RU647Y7 upload=A1OZI5V4E9XL tag=JNNMTCCWXGQD type=write size=4003968 2024-09-14T11:04:25.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.968+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.0 size=1048576 2024-09-14T11:04:25.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.969+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.1 size=1048576 2024-09-14T11:04:25.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.970+0000 7f907bbdf780 1 > prepared part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.2 size=367278 2024-09-14T11:04:25.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.970+0000 7f907bbdf780 1 > prepared multipart upload key=8NO5BA4HL03L upload=0BHCSMJSETWM tag=91NP0LJDDZ1J type=write size=3513006 2024-09-14T11:04:25.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.971+0000 7f907bbdf780 1 < completed delete operation key=91RL2KD0XCSI tag=U406NJ5WH8IM type=del 2024-09-14T11:04:25.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.974+0000 7f907bbdf780 1 > prepared part key=_multipart_P546JCSFB00N.2~DFA447EVS6M7.0 size=1000388 2024-09-14T11:04:25.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.974+0000 7f907bbdf780 1 > prepared multipart upload key=P546JCSFB00N upload=DFA447EVS6M7 tag=6N1H4LB1RS5Z type=write size=2048964 2024-09-14T11:04:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.975+0000 7f907bbdf780 1 < completed part key=_multipart_Y3KOCA4072NM.2~Q02U1S9TNCYN.0 size=25524 2024-09-14T11:04:25.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.977+0000 7f907bbdf780 1 < completed multipart upload key=Y3KOCA4072NM upload=Q02U1S9TNCYN tag=59UCCNKTSP3T type=write size=1074100 2024-09-14T11:04:25.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.979+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.0 size=1048576 2024-09-14T11:04:25.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.980+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.1 size=1048576 2024-09-14T11:04:25.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.981+0000 7f907bbdf780 1 > prepared part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.2 size=295995 2024-09-14T11:04:25.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.981+0000 7f907bbdf780 1 > prepared multipart upload key=ZFF333CYOK5P upload=2CUB8YW31Q8W tag=B8WXHI1DGAYA type=write size=3441723 2024-09-14T11:04:25.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.982+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.0 size=1048576 2024-09-14T11:04:25.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.983+0000 7f907bbdf780 1 < completed part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.1 size=1048576 2024-09-14T11:04:25.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.983+0000 7f907bbdf780 1 < canceled part key=_multipart_WZ064RU647Y7.2~VT81VIN3LHE7.2 size=1006471 2024-09-14T11:04:25.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.985+0000 7f907bbdf780 1 < canceled multipart upload key=WZ064RU647Y7 upload=VT81VIN3LHE7 tag=6801TEQYQ2HR type=write size=4152199 2024-09-14T11:04:25.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.986+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=IN21HVIK2V0R type=del size=4192226 2024-09-14T11:04:25.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.987+0000 7f907bbdf780 1 < completed delete operation key=8FRZW4YC3ATE tag=F5IP2F117279 type=del 2024-09-14T11:04:25.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.988+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=633PW296WHFO type=del size=2220281 2024-09-14T11:04:25.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.990+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.0 size=1048576 2024-09-14T11:04:25.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.991+0000 7f907bbdf780 1 < completed part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.1 size=1048576 2024-09-14T11:04:25.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.991+0000 7f907bbdf780 1 < canceled part key=_multipart_91RL2KD0XCSI.2~TE5YUGVB6QCH.2 size=938681 2024-09-14T11:04:25.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.993+0000 7f907bbdf780 1 < canceled multipart upload key=91RL2KD0XCSI upload=TE5YUGVB6QCH tag=PL22J6H8HRRG type=write size=4084409 2024-09-14T11:04:25.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.995+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.0 size=1048576 2024-09-14T11:04:25.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.996+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.1 size=1048576 2024-09-14T11:04:25.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.997+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.2 size=65330 2024-09-14T11:04:25.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.997+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=P0JJJZ8RYDI2 tag=4S0BEMAI84LV type=write size=3211058 2024-09-14T11:04:25.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:25.999+0000 7f907bbdf780 1 < completed part key=_multipart_P546JCSFB00N.2~J0ORJN22T1W0.0 size=551960 2024-09-14T11:04:25.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.000+0000 7f907bbdf780 1 < completed multipart upload key=P546JCSFB00N upload=J0ORJN22T1W0 tag=K1L2L37FCLPQ type=write size=1600536 2024-09-14T11:04:26.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.003+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.0 size=1048576 2024-09-14T11:04:26.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.004+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.1 size=1048576 2024-09-14T11:04:26.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.005+0000 7f907bbdf780 1 > prepared part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.2 size=606686 2024-09-14T11:04:26.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.005+0000 7f907bbdf780 1 > prepared multipart upload key=LJ720PV3SQ8L upload=BY1OIDQPAG6M tag=AV8DMCDZH8CC type=write size=3752414 2024-09-14T11:04:26.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.006+0000 7f907bbdf780 1 < completed delete operation key=5C8LLJF5MSVP tag=GYH2XZMI8I27 type=del 2024-09-14T11:04:26.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.007+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=AEJIAXPSAPND type=del size=802200 2024-09-14T11:04:26.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.009+0000 7f907bbdf780 1 < suggested remove operation key=8C398XZ7XKU7 tag=AW6S40YPPYT5 type=del 2024-09-14T11:04:26.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.010+0000 7f907bbdf780 1 > prepared operation key=Y3KOCA4072NM tag=4ASD517Z5OQ6 type=del size=3612738 2024-09-14T11:04:26.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.011+0000 7f907bbdf780 1 < completed write operation key=T81OF13I2JVH tag=TSXOQ0IWJCMG type=write size=881274 2024-09-14T11:04:26.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.012+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=C2HSL6TVJGPQ type=del size=1498548 2024-09-14T11:04:26.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.015+0000 7f907bbdf780 1 < suggested update operation key=GC52N456IYD7 tag=9P3X75SOWSED type=del size=2474004 2024-09-14T11:04:26.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.017+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.0 size=1048576 2024-09-14T11:04:26.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.017+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.1 size=1048576 2024-09-14T11:04:26.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.019+0000 7f907bbdf780 1 > prepared part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.2 size=385568 2024-09-14T11:04:26.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.019+0000 7f907bbdf780 1 > prepared multipart upload key=KQBX4UP53FV1 upload=H942IRWCB17I tag=D3Z01TVLXPUC type=write size=3531296 2024-09-14T11:04:26.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.020+0000 7f907bbdf780 1 < completed part key=_multipart_VRQ0ZNN9FG4C.2~QXO7BF483TF3.0 size=29026 2024-09-14T11:04:26.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.022+0000 7f907bbdf780 1 < completed multipart upload key=VRQ0ZNN9FG4C upload=QXO7BF483TF3 tag=JNVLGWIQDTK9 type=write size=1077602 2024-09-14T11:04:26.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.023+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=6GOKHMRYY91C type=del size=3402595 2024-09-14T11:04:26.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.024+0000 7f907bbdf780 -1 < failed to complete operation key=P546JCSFB00N tag=IJDIO8WLXAE1 type=del size=67320: (22) Invalid argument 2024-09-14T11:04:26.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.025+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=O6HXR4L2755P type=write size=855778 2024-09-14T11:04:26.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.026+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~85XP6IR3Q08A.0 size=1048576 2024-09-14T11:04:26.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.027+0000 7f907bbdf780 1 < completed part key=_multipart_6AWG2GM1ZP31.2~85XP6IR3Q08A.1 size=365355 2024-09-14T11:04:26.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.029+0000 7f907bbdf780 1 < completed multipart upload key=6AWG2GM1ZP31 upload=85XP6IR3Q08A tag=60ABG6LVLAMA type=write size=2462507 2024-09-14T11:04:26.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.031+0000 7f907bbdf780 1 > prepared operation key=5C8LLJF5MSVP tag=80312RA12KUD type=write size=825273 2024-09-14T11:04:26.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.032+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~XC28XCUA6K23.0 size=1048576 2024-09-14T11:04:26.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.033+0000 7f907bbdf780 1 < completed part key=_multipart_GC52N456IYD7.2~XC28XCUA6K23.1 size=334647 2024-09-14T11:04:26.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.035+0000 7f907bbdf780 1 < completed multipart upload key=GC52N456IYD7 upload=XC28XCUA6K23 tag=DP9L3FHM3KCU type=write size=2431799 2024-09-14T11:04:26.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.036+0000 7f907bbdf780 1 > prepared operation key=P0701O36E1JI tag=42MELEJLKYN0 type=del size=1461827 2024-09-14T11:04:26.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.037+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.0 size=1048576 2024-09-14T11:04:26.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.038+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.1 size=1048576 2024-09-14T11:04:26.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.039+0000 7f907bbdf780 1 < completed part key=_multipart_5MFLA6XFV3Y5.2~SNTW6W3ZNJKG.2 size=53499 2024-09-14T11:04:26.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.041+0000 7f907bbdf780 1 < completed multipart upload key=5MFLA6XFV3Y5 upload=SNTW6W3ZNJKG tag=HMIQ1V66B0R9 type=write size=3199227 2024-09-14T11:04:26.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.043+0000 7f907bbdf780 1 > prepared operation key=6AWG2GM1ZP31 tag=IJZPRYG3TC1P type=del size=40328 2024-09-14T11:04:26.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.044+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.0 size=1048576 2024-09-14T11:04:26.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.045+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.1 size=1048576 2024-09-14T11:04:26.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.046+0000 7f907bbdf780 1 < completed part key=_multipart_8NO5BA4HL03L.2~0BHCSMJSETWM.2 size=367278 2024-09-14T11:04:26.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.048+0000 7f907bbdf780 1 < completed multipart upload key=8NO5BA4HL03L upload=0BHCSMJSETWM tag=91NP0LJDDZ1J type=write size=3513006 2024-09-14T11:04:26.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.049+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=EEXI0YFPOO2J type=del size=1838343 2024-09-14T11:04:26.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.049+0000 7f907bbdf780 1 < canceled part key=_multipart_P546JCSFB00N.2~DFA447EVS6M7.0 size=1000388 2024-09-14T11:04:26.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.051+0000 7f907bbdf780 1 < canceled multipart upload key=P546JCSFB00N upload=DFA447EVS6M7 tag=6N1H4LB1RS5Z type=write size=2048964 2024-09-14T11:04:26.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.053+0000 7f907bbdf780 1 > prepared operation key=AI0W2MEG08HF tag=3T6A1MMFFNME type=del size=3140315 2024-09-14T11:04:26.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.054+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.0 size=1048576 2024-09-14T11:04:26.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.055+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.1 size=1048576 2024-09-14T11:04:26.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.056+0000 7f907bbdf780 1 < completed part key=_multipart_ZFF333CYOK5P.2~2CUB8YW31Q8W.2 size=295995 2024-09-14T11:04:26.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.058+0000 7f907bbdf780 1 < completed multipart upload key=ZFF333CYOK5P upload=2CUB8YW31Q8W tag=B8WXHI1DGAYA type=write size=3441723 2024-09-14T11:04:26.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.059+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=BB7MTICK9DH3 type=del size=2505964 2024-09-14T11:04:26.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.060+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=IN21HVIK2V0R type=del size=4192226 2024-09-14T11:04:26.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.062+0000 7f907bbdf780 1 > prepared operation key=E3OIUTR3JCQY tag=TDOQZ8LEULBA type=del size=398780 2024-09-14T11:04:26.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.063+0000 7f907bbdf780 1 < completed delete operation key=WAFH5BKM2P23 tag=633PW296WHFO type=del 2024-09-14T11:04:26.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.065+0000 7f907bbdf780 1 > prepared operation key=T81OF13I2JVH tag=79UPB2FDUVM3 type=del size=527433 2024-09-14T11:04:26.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.066+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.0 size=1048576 2024-09-14T11:04:26.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.067+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.1 size=1048576 2024-09-14T11:04:26.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.068+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~P0JJJZ8RYDI2.2 size=65330 2024-09-14T11:04:26.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.071+0000 7f907bbdf780 1 < completed multipart upload key=LJ720PV3SQ8L upload=P0JJJZ8RYDI2 tag=4S0BEMAI84LV type=write size=3211058 2024-09-14T11:04:26.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.072+0000 7f907bbdf780 1 > prepared operation key=8FRZW4YC3ATE tag=D9RJW77IOV6W type=del size=205059 2024-09-14T11:04:26.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.073+0000 7f907bbdf780 1 < canceled part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.0 size=1048576 2024-09-14T11:04:26.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.074+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.1 size=1048576 2024-09-14T11:04:26.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.075+0000 7f907bbdf780 1 < completed part key=_multipart_LJ720PV3SQ8L.2~BY1OIDQPAG6M.2 size=606686 2024-09-14T11:04:26.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.077+0000 7f907bbdf780 1 < canceled multipart upload key=LJ720PV3SQ8L upload=BY1OIDQPAG6M tag=AV8DMCDZH8CC type=write size=3752414 2024-09-14T11:04:26.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.078+0000 7f907bbdf780 1 > prepared operation key=ZFF333CYOK5P tag=TJSS30MAMPDV type=del size=3693156 2024-09-14T11:04:26.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.080+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=AEJIAXPSAPND type=del 2024-09-14T11:04:26.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.082+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~EQHX1J6ELL3Z.0 size=1048576 2024-09-14T11:04:26.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.083+0000 7f907bbdf780 1 > prepared part key=_multipart_8FRZW4YC3ATE.2~EQHX1J6ELL3Z.1 size=231807 2024-09-14T11:04:26.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.083+0000 7f907bbdf780 1 > prepared multipart upload key=8FRZW4YC3ATE upload=EQHX1J6ELL3Z tag=U6PWHPGVDH1C type=write size=2328959 2024-09-14T11:04:26.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.085+0000 7f907bbdf780 1 < suggested update operation key=Y3KOCA4072NM tag=4ASD517Z5OQ6 type=del size=3612738 2024-09-14T11:04:26.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.088+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.0 size=1048576 2024-09-14T11:04:26.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.089+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.1 size=1048576 2024-09-14T11:04:26.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.090+0000 7f907bbdf780 1 > prepared part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.2 size=846375 2024-09-14T11:04:26.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.090+0000 7f907bbdf780 1 > prepared multipart upload key=77H37YF6MJEO upload=JSQEP9MFI315 tag=0EZGC84Y61ZC type=write size=3992103 2024-09-14T11:04:26.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.091+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=C2HSL6TVJGPQ type=del 2024-09-14T11:04:26.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.094+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~YGO20KUWL4FO.0 size=1048576 2024-09-14T11:04:26.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.095+0000 7f907bbdf780 1 > prepared part key=_multipart_FTYIOOQROLG6.2~YGO20KUWL4FO.1 size=1022644 2024-09-14T11:04:26.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.095+0000 7f907bbdf780 1 > prepared multipart upload key=FTYIOOQROLG6 upload=YGO20KUWL4FO tag=4Z71Q4I6ZKK6 type=write size=3119796 2024-09-14T11:04:26.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.096+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.0 size=1048576 2024-09-14T11:04:26.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.097+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.1 size=1048576 2024-09-14T11:04:26.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.098+0000 7f907bbdf780 1 < completed part key=_multipart_KQBX4UP53FV1.2~H942IRWCB17I.2 size=385568 2024-09-14T11:04:26.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.100+0000 7f907bbdf780 1 < completed multipart upload key=KQBX4UP53FV1 upload=H942IRWCB17I tag=D3Z01TVLXPUC type=write size=3531296 2024-09-14T11:04:26.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.102+0000 7f907bbdf780 1 > prepared part key=_multipart_P0701O36E1JI.2~QWNS9OLK8UOY.0 size=578125 2024-09-14T11:04:26.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.102+0000 7f907bbdf780 1 > prepared multipart upload key=P0701O36E1JI upload=QWNS9OLK8UOY tag=CFWYGS53P9V3 type=write size=1626701 2024-09-14T11:04:26.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.105+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=6GOKHMRYY91C type=del 2024-09-14T11:04:26.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.106+0000 7f907bbdf780 1 > prepared operation key=WAFH5BKM2P23 tag=LOV2VEI19MZP type=del size=4065196 2024-09-14T11:04:26.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.107+0000 7f907bbdf780 1 < completed write operation key=AI0W2MEG08HF tag=O6HXR4L2755P type=write size=855778 2024-09-14T11:04:26.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.109+0000 7f907bbdf780 1 > prepared operation key=77H37YF6MJEO tag=RH2KVKFPGHG6 type=del size=1320284 2024-09-14T11:04:26.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.111+0000 7f907bbdf780 1 < suggested update operation key=5C8LLJF5MSVP tag=80312RA12KUD type=write size=825273 2024-09-14T11:04:26.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.112+0000 7f907bbdf780 1 > prepared operation key=5MFLA6XFV3Y5 tag=HFRJ76DFSSSA type=del size=782395 2024-09-14T11:04:26.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.114+0000 7f907bbdf780 1 < canceled operation key=P0701O36E1JI tag=42MELEJLKYN0 type=del size=1461827 2024-09-14T11:04:26.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.116+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~5LD8HWGC54AB.0 size=1048576 2024-09-14T11:04:26.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.117+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~5LD8HWGC54AB.1 size=1048576 2024-09-14T11:04:26.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.118+0000 7f907bbdf780 1 > prepared part key=_multipart_E3OIUTR3JCQY.2~5LD8HWGC54AB.2 size=469244 2024-09-14T11:04:26.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.118+0000 7f907bbdf780 1 > prepared multipart upload key=E3OIUTR3JCQY upload=5LD8HWGC54AB tag=85ORUBSVR99Q type=write size=3614972 2024-09-14T11:04:26.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.120+0000 7f907bbdf780 1 < suggested remove operation key=6AWG2GM1ZP31 tag=IJZPRYG3TC1P type=del 2024-09-14T11:04:26.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.122+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~UJU31LQH4FOW.0 size=1048576 2024-09-14T11:04:26.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.123+0000 7f907bbdf780 1 > prepared part key=_multipart_WZ064RU647Y7.2~UJU31LQH4FOW.1 size=212834 2024-09-14T11:04:26.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.123+0000 7f907bbdf780 1 > prepared multipart upload key=WZ064RU647Y7 upload=UJU31LQH4FOW tag=Q184WW2D59V2 type=write size=2309986 2024-09-14T11:04:26.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.125+0000 7f907bbdf780 1 < suggested remove operation key=5MFLA6XFV3Y5 tag=EEXI0YFPOO2J type=del 2024-09-14T11:04:26.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.127+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=EUK9XR63TBV9 type=del size=4082116 2024-09-14T11:04:26.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.128+0000 7f907bbdf780 1 < completed delete operation key=AI0W2MEG08HF tag=3T6A1MMFFNME type=del 2024-09-14T11:04:26.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.130+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EPV5UDR3EGND.0 size=1048576 2024-09-14T11:04:26.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.131+0000 7f907bbdf780 1 > prepared part key=_multipart_S8RIEED24PUM.2~EPV5UDR3EGND.1 size=540153 2024-09-14T11:04:26.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.131+0000 7f907bbdf780 1 > prepared multipart upload key=S8RIEED24PUM upload=EPV5UDR3EGND tag=Q6CT40B4W4WV type=write size=2637305 2024-09-14T11:04:26.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.132+0000 7f907bbdf780 1 < completed delete operation key=GC52N456IYD7 tag=BB7MTICK9DH3 type=del 2024-09-14T11:04:26.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.133+0000 7f907bbdf780 1 > prepared operation key=9OKQI3W8M5GA tag=8H3Y002VOKOY type=del size=2056362 2024-09-14T11:04:26.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.134+0000 7f907bbdf780 1 < completed delete operation key=E3OIUTR3JCQY tag=TDOQZ8LEULBA type=del 2024-09-14T11:04:26.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.136+0000 7f907bbdf780 1 > prepared part key=_multipart_9OKQI3W8M5GA.2~48FXF1UM207V.0 size=733638 2024-09-14T11:04:26.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.136+0000 7f907bbdf780 1 > prepared multipart upload key=9OKQI3W8M5GA upload=48FXF1UM207V tag=6KHUX48M1QUP type=write size=1782214 2024-09-14T11:04:26.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.138+0000 7f907bbdf780 1 < completed delete operation key=T81OF13I2JVH tag=79UPB2FDUVM3 type=del 2024-09-14T11:04:26.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.139+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=GS733FQG6FY2 type=del size=764686 2024-09-14T11:04:26.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.141+0000 7f907bbdf780 1 < suggested update operation key=8FRZW4YC3ATE tag=D9RJW77IOV6W type=del size=205059 2024-09-14T11:04:26.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.143+0000 7f907bbdf780 1 > prepared operation key=HHXUGVBHQ2US tag=G0RYZLG6QGCX type=del size=3902432 2024-09-14T11:04:26.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.144+0000 7f907bbdf780 1 < completed delete operation key=ZFF333CYOK5P tag=TJSS30MAMPDV type=del 2024-09-14T11:04:26.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.146+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~NB60URD75J44.0 size=1048576 2024-09-14T11:04:26.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.147+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~NB60URD75J44.1 size=1048576 2024-09-14T11:04:26.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.148+0000 7f907bbdf780 1 > prepared part key=_multipart_91RL2KD0XCSI.2~NB60URD75J44.2 size=897068 2024-09-14T11:04:26.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.148+0000 7f907bbdf780 1 > prepared multipart upload key=91RL2KD0XCSI upload=NB60URD75J44 tag=D2HUBA5K7YA7 type=write size=4042796 2024-09-14T11:04:26.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.150+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~EQHX1J6ELL3Z.0 size=1048576 2024-09-14T11:04:26.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.150+0000 7f907bbdf780 1 < completed part key=_multipart_8FRZW4YC3ATE.2~EQHX1J6ELL3Z.1 size=231807 2024-09-14T11:04:26.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.153+0000 7f907bbdf780 1 < completed multipart upload key=8FRZW4YC3ATE upload=EQHX1J6ELL3Z tag=U6PWHPGVDH1C type=write size=2328959 2024-09-14T11:04:26.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.154+0000 7f907bbdf780 1 > prepared operation key=GC52N456IYD7 tag=QA65D2SLAVS6 type=del size=672669 2024-09-14T11:04:26.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.155+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.0 size=1048576 2024-09-14T11:04:26.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.156+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.1 size=1048576 2024-09-14T11:04:26.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.157+0000 7f907bbdf780 1 < completed part key=_multipart_77H37YF6MJEO.2~JSQEP9MFI315.2 size=846375 2024-09-14T11:04:26.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.159+0000 7f907bbdf780 1 < completed multipart upload key=77H37YF6MJEO upload=JSQEP9MFI315 tag=0EZGC84Y61ZC type=write size=3992103 2024-09-14T11:04:26.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:04:26.161+0000 7f907bbdf780 1 > prepared operation key=VRQ0ZNN9FG4C tag=ENF5YZ5LI2Z8 type=del size=2928178 2024-09-14T11:04:26.159 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] cls_rgw_stats.simulate (8895 ms) 2024-09-14T11:04:26.159 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 1 test from cls_rgw_stats (8895 ms total) 2024-09-14T11:04:26.159 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:04:26.159 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:26.624 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 1 test from 1 test suite ran. (11254 ms total) 2024-09-14T11:04:26.624 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 1 test. 2024-09-14T11:04:26.628 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:04:26.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:04:26.711 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:04:26.712 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:04:26.712 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:04:26.798 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:04:26.798 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:04:26.798 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:28.637 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:04:28.637 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:04:28.655 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (19 ms) 2024-09-14T11:04:28.656 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:04:28.665 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (10 ms) 2024-09-14T11:04:28.666 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:04:28.669 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-09-14T11:04:28.669 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:04:28.673 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-14T11:04:28.673 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:04:28.681 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T11:04:28.681 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:04:28.687 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_u64 (7 ms) 2024-09-14T11:04:28.687 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:04:28.690 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-14T11:04:28.690 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:04:28.694 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (4 ms) 2024-09-14T11:04:28.694 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:04:28.698 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:04:28.698 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:04:28.703 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (5 ms) 2024-09-14T11:04:28.703 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:04:28.704 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:04:28.704 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:04:28.705 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T11:04:28.705 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:04:28.712 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-14T11:04:28.712 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:04:28.719 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (6 ms) 2024-09-14T11:04:28.719 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:04:28.725 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (7 ms) 2024-09-14T11:04:28.725 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:04:28.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T11:04:28.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:04:28.740 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-14T11:04:28.740 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:04:28.748 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T11:04:28.748 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:04:28.751 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:04:28.751 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:04:28.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (2 ms) 2024-09-14T11:04:28.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:04:28.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:04:28.755 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:04:28.755 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-14T11:04:28.755 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:04:28.762 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-14T11:04:28.762 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:04:28.769 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-14T11:04:28.769 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:04:28.776 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:04:28.776 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:04:28.784 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (8 ms) 2024-09-14T11:04:28.784 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:04:28.786 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:04:28.786 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:04:28.789 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T11:04:28.789 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:04:28.790 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:04:28.790 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:04:28.790 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-14T11:04:28.791 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:04:28.797 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-14T11:04:28.797 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 31 tests from CmpOmap (161 ms total) 2024-09-14T11:04:28.798 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:04:28.798 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:29.643 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 31 tests from 1 test suite ran. (2844 ms total) 2024-09-14T11:04:29.643 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 31 tests. 2024-09-14T11:04:29.647 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:04:29.647 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:04:29.692 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:04:29.693 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:04:29.694 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:04:29.744 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:04:29.744 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:04:29.744 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:29.744 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:04:29.745 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:04:32.659 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2915 ms) 2024-09-14T11:04:32.659 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:04:35.665 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3005 ms) 2024-09-14T11:04:35.665 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:04:38.682 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.Reserve (3018 ms) 2024-09-14T11:04:38.683 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:04:41.696 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3014 ms) 2024-09-14T11:04:41.697 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:04:44.711 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.Commit (3015 ms) 2024-09-14T11:04:44.712 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:04:47.735 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.Stats (3024 ms) 2024-09-14T11:04:47.735 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:04:51.757 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4021 ms) 2024-09-14T11:04:51.757 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:04:54.781 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.Abort (3024 ms) 2024-09-14T11:04:54.781 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:04:57.796 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.ReserveError (3013 ms) 2024-09-14T11:04:57.796 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:05:00.815 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.CommitError (3022 ms) 2024-09-14T11:05:00.816 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:05:03.831 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.AbortError (3015 ms) 2024-09-14T11:05:03.831 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:05:06.845 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3015 ms) 2024-09-14T11:05:06.845 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:05:09.877 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3031 ms) 2024-09-14T11:05:09.877 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:05:12.892 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3015 ms) 2024-09-14T11:05:12.892 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:05:15.909 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3018 ms) 2024-09-14T11:05:15.909 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:05:18.935 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3026 ms) 2024-09-14T11:05:18.935 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:05:21.949 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3014 ms) 2024-09-14T11:05:21.949 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:05:24.967 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.Cleanup (3017 ms) 2024-09-14T11:05:24.967 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:05:35.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.MultiProducer (10081 ms) 2024-09-14T11:05:35.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:05:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3014 ms) 2024-09-14T11:05:38.062 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:05:51.095 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13032 ms) 2024-09-14T11:05:51.095 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:05:55.120 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4026 ms) 2024-09-14T11:05:55.121 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:06:01.140 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6019 ms) 2024-09-14T11:06:01.140 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:06:06.164 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5025 ms) 2024-09-14T11:06:06.165 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from TestCls2PCQueue (96420 ms total) 2024-09-14T11:06:06.165 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:06.165 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:06.165 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 24 tests from 1 test suite ran. (96420 ms total) 2024-09-14T11:06:06.165 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 24 tests. 2024-09-14T11:06:06.168 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:06:06.168 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:06:06.215 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:06:06.217 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:06:06.217 DEBUG:teuthology.orchestra.run.smithi029:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:06:06.276 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:06.276 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:06.276 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:06:06.276 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:08.178 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:06:08.178 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:06:08.201 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsAccount.add (24 ms) 2024-09-14T11:06:08.201 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:06:08.206 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:06:08.206 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:06:09.068 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsAccount.rm (862 ms) 2024-09-14T11:06:09.069 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:06:09.089 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] ClsAccount.list (21 ms) 2024-09-14T11:06:09.089 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from ClsAccount (912 ms total) 2024-09-14T11:06:09.089 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:09.089 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:09.191 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 4 tests from 1 test suite ran. (2915 ms total) 2024-09-14T11:06:09.191 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 4 tests. 2024-09-14T11:06:09.194 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:06:09.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:06:09.240 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:06:09.242 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:06:09.242 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:06:09.305 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:09.305 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:09.305 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:06:09.305 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:11.193 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:06:11.193 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:06:11.215 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.init_existing_queue (22 ms) 2024-09-14T11:06:11.215 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:06:11.218 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-14T11:06:11.218 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:06:11.221 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:06:11.221 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:06:11.222 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-14T11:06:11.222 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:06:11.225 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T11:06:11.225 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:06:11.227 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:06:11.227 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 6 tests from rgw_gc_log (35 ms total) 2024-09-14T11:06:11.227 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:11.227 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:12.196 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 6 tests from 1 test suite ran. (2891 ms total) 2024-09-14T11:06:12.197 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 6 tests. 2024-09-14T11:06:12.200 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:06:12.200 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:06:12.244 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:06:12.245 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:06:12.245 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:06:12.343 INFO:tasks.workunit.client.0.smithi029.stdout:Running main() from gmock_main.cc 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i= 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i= 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.344 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i= 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.345 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.346 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.347 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.348 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.349 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i= 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i= 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj 2024-09-14T11:06:12.350 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i= 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.351 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.352 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.353 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.354 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.355 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i=v1 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i=v1 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns= i=v1 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.356 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.357 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.358 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.359 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.360 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.361 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: _obj[v1] 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.362 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.363 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.364 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.365 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.366 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_obj", 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.367 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i= 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i= 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i= 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.368 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.369 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.370 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.371 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.372 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.373 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i= 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i= 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i= 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.374 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.375 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.376 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.377 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.378 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.379 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i=v1 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i=v1 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns= i=v1 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.380 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.381 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.382 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.383 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.384 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.385 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:parsed: obj[v1] 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout: "obj1": { 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.386 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.387 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "obj2": { 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.388 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3": { 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.389 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "obj3-2": { 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.390 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "obj", 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "v1", 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:06:12.391 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.392 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.393 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker_myobj", 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.394 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.395 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.396 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.397 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.398 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker_myobj", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.399 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.400 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.401 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.402 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.403 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.404 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.405 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.406 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.407 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.408 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.409 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.410 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.411 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.412 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.413 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.414 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.415 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.416 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.417 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.418 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.419 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.420 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.421 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.422 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.423 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.424 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.425 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.426 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.427 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj", 2024-09-14T11:06:12.428 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.429 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.430 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.431 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.432 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.433 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.434 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.435 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.436 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.437 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.438 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.439 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.440 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.441 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.442 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.443 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.444 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.445 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.446 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.447 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.448 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.449 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.450 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.451 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.452 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.453 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.454 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.455 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.456 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.457 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.458 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.459 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.460 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.461 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj_", 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.462 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.463 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.464 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.465 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj_", 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.466 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.467 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.468 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.469 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:06:12.470 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.471 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.472 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.473 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.474 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.475 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.476 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.477 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.478 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.479 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.480 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.481 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.482 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.483 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.484 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.485 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.486 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.487 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": "default-placement.data", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "test", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.488 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": "", 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": "" 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.489 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "obj": { 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.490 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.491 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.492 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.493 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker_myobj", 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.494 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.495 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker_myobj", 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.496 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.497 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.498 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.499 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.500 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.501 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.502 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.503 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.504 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.505 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.506 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.507 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.508 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.509 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "myobj", 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj", 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.510 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.511 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj", 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.512 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.513 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.514 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.515 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.516 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.517 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.518 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.519 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj" 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.520 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:06:12.521 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.522 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.523 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.524 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj", 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj_", 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.525 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.526 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker___myobj_", 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.527 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.528 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.529 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.530 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.531 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "", 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.532 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.533 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:06:12.534 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "marker__myobj_" 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.535 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "" 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.536 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj": { 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj": { 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.537 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "raw_obj2": { 2024-09-14T11:06:12.538 INFO:tasks.workunit.client.0.smithi029.stdout: "pool": ".data-pool", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "loc": "" 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "new_obj2": { 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket": { 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "ebtest", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "marker": "marker", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_id": "bucket-id", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "tenant": "", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "explicit_placement": { 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "data_pool": ".data-pool", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "data_extra_pool": "", 2024-09-14T11:06:12.539 INFO:tasks.workunit.client.0.smithi029.stdout: "index_pool": ".index-pool" 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: "key": { 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: "name": "_myobj_", 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: "instance": "inst", 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: "ns": "ns" 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:12.540 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:06:12.541 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 4 tests. 2024-09-14T11:06:12.541 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:06:12.541 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:06:12.584 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:06:12.585 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:06:12.585 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:06:12.730 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:12.730 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:12.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.781+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.782+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.782+0000 7f9f22922800 20 realm 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.782+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.783+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.783+0000 7f9f22922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.783+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.783+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:12.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.783+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:12.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.784+0000 7f9f22922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:12.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.784+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:12.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.785+0000 7f9f22922800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:06:12.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.785+0000 7f9f22922800 20 searching for the correct realm 2024-09-14T11:06:12.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.793+0000 7f9f1edd3640 0 -- 172.21.15.29:0/81740986 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9f180713c0 msgr2=0x7f9f18066b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:12.999+0000 7f9f1ddd1640 0 -- 172.21.15.29:0/81740986 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9f18024880 msgr2=0x7f9f1806c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:06:13.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.207+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 zone default found 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 4 Realm: () 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 zonegroup default 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.208+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.209+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.209+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.209+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.209+0000 7f9f22922800 20 started sync module instance, tier type = 2024-09-14T11:06:13.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.209+0000 7f9f22922800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:06:13.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=0 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=1 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=2 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=3 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=4 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=5 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=6 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 20 add_watcher() i=7 2024-09-14T11:06:13.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.220+0000 7f9f22922800 2 all 8 watchers are set, enabling cache 2024-09-14T11:06:13.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.222+0000 7f9dd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.222+0000 7f9f22922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.222+0000 7f9f22922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9f22922800 5 note: GC not initialized 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9d4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9f22922800 20 init_complete bucket index max shards: 11 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9f22922800 20 Filter name: none 2024-09-14T11:06:13.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9d4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:06:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9f22922800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:06:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.223+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache get: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= : miss 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 20 rados->read ofs=0 len=0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= info.flags=0x0 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 adding default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= to cache LRU end 2024-09-14T11:06:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache get: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= : hit (negative entry) 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.224+0000 7f9f22922800 10 cache get: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= : hit (negative entry) 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9f22922800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9f22922800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9e01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94609444916992 notifier 5306 bl.length()=697 2024-09-14T11:06:13.224 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9e01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:06:13.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.226+0000 7f9e01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:06:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.229+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:06:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.229+0000 7f9f22922800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:06:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.229+0000 7f9f22922800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:06:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.230+0000 7f9e01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856704 cookie 94609444910672 notifier 5306 bl.length()=194 2024-09-14T11:06:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.230+0000 7f9e01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:06:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.230+0000 7f9e01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:06:13.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.234+0000 7f9f22922800 10 cache put: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= info.flags=0x7 2024-09-14T11:06:13.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.234+0000 7f9f22922800 10 moving default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= to cache LRU end 2024-09-14T11:06:13.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.234+0000 7f9f22922800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:Cv1PaqeygCW7VlC47pUaF3JWSIQ=, ofs0, ns] 2024-09-14T11:06:13.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.234+0000 7f9e01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856706 cookie 94609444908464 notifier 5306 bl.length()=203 2024-09-14T11:06:13.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.235+0000 7f9e01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= info.flags=0x7 2024-09-14T11:06:13.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.235+0000 7f9e01ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+Cv1PaqeygCW7VlC47pUaF3JWSIQ= to cache LRU end 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "display_name": "librgw test user", 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "email": "librgw@example.com", 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "suspended": 0, 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "subusers": [], 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "keys": [ 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: { 2024-09-14T11:06:13.234 INFO:tasks.workunit.client.0.smithi029.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "access_key": "Cv1PaqeygCW7VlC47pUaF3JWSIQ=", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "secret_key": "oxXDZyejJuymMwlm/LRKp0dTYnSCb/0swWbReoxEKEQ8s1q9/Cx/kA==", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "active": true, 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:06:13.225340Z" 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: ], 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "swift_keys": [], 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "caps": [], 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "default_placement": "", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "placement_tags": [], 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_quota": { 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:06:13.235 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "user_quota": { 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "type": "rgw", 2024-09-14T11:06:13.236 INFO:tasks.workunit.client.0.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: "account_id": "", 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: "path": "/", 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:06:13.225328Z", 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: "tags": [], 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: "group_ids": [] 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:06:13.237 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:13.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.237+0000 7f9dd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:06:13.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.240+0000 7f9f22922800 20 remove_watcher() i=0 2024-09-14T11:06:13.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.240+0000 7f9f22922800 2 removed watcher, disabling cache 2024-09-14T11:06:13.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.241+0000 7f9f22922800 20 remove_watcher() i=1 2024-09-14T11:06:13.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.242+0000 7f9f22922800 20 remove_watcher() i=2 2024-09-14T11:06:13.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.243+0000 7f9f22922800 20 remove_watcher() i=3 2024-09-14T11:06:13.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.244+0000 7f9f22922800 20 remove_watcher() i=4 2024-09-14T11:06:13.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.245+0000 7f9f22922800 20 remove_watcher() i=5 2024-09-14T11:06:13.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.246+0000 7f9f22922800 20 remove_watcher() i=6 2024-09-14T11:06:13.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:13.247+0000 7f9f22922800 20 remove_watcher() i=7 2024-09-14T11:06:13.258 INFO:tasks.workunit.client.0.smithi029.stdout:phase 1.1 2024-09-14T11:06:13.280 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:06:13.280 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:13.280 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:06:13.281 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:06:13.291 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:13.291 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:13.672 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (391 ms) 2024-09-14T11:06:13.672 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:06:13.673 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:06:13.673 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:06:13.673 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:06:13.674 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:06:13.685 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:06:13.690 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/f1 2024-09-14T11:06:13.693 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/f2 2024-09-14T11:06:13.696 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:06:13.699 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:06:13.702 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:06:13.705 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:06:13.708 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:06:13.711 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:06:13.714 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:06:13.717 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:06:13.722 INFO:tasks.workunit.client.0.smithi029.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:06:13.726 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_HIER1 (52 ms) 2024-09-14T11:06:13.726 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:06:13.839 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_DIRS1 (114 ms) 2024-09-14T11:06:13.839 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:06:13.839 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:06:13.839 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:06:13.857 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (18 ms) 2024-09-14T11:06:13.857 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:06:13.907 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (50 ms) 2024-09-14T11:06:13.907 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:06:13.907 INFO:tasks.workunit.client.0.smithi029.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:06:13.914 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-14T11:06:13.914 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:06:13.914 INFO:tasks.workunit.client.0.smithi029.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:06:13.921 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:06:13.922 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:06:13.923 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:06:13.923 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:06:13.924 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:06:13.924 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:06:13.924 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:06:13.925 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:06:13.925 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:06:13.927 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:06:13.927 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:06:13.927 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:06:13.928 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:06:13.928 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:06:13.930 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:06:13.930 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READ_DIRS1 (8 ms) 2024-09-14T11:06:13.930 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:06:14.111 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:06:14.112 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:06:14.113 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:06:14.113 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:06:14.120 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:06:14.120 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:06:14.123 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:06:14.125 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:06:14.128 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:06:14.129 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:06:14.129 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:06:14.130 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:06:14.131 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:06:14.131 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:06:14.132 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:06:14.134 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.HIER1 (24 ms) 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:06:14.135 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:14.136+0000 7f222213b8c0 -1 shutting down 2024-09-14T11:06:14.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:14.137+0000 7f20fa13c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64487, si_uid : 1000, si_addr0x3e80000fbe7, si_status0 2024-09-14T11:06:43.916 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (29782 ms) 2024-09-14T11:06:43.917 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW (30636 ms total) 2024-09-14T11:06:43.917 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:06:43.917 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:43.917 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 24 tests from 1 test suite ran. (30636 ms total) 2024-09-14T11:06:43.917 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 24 tests. 2024-09-14T11:06:43.923 INFO:tasks.workunit.client.0.smithi029.stdout:phase 1.2 2024-09-14T11:06:43.948 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:06:43.949 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:43.949 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:06:43.949 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:06:43.957 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:43.957 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:44.555 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (606 ms) 2024-09-14T11:06:44.555 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:06:44.557 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:06:44.558 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:06:44.558 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:06:44.558 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:06:44.558 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:06:44.558 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:06:44.559 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:06:44.559 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:06:44.559 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:06:44.559 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:06:44.559 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:06:44.560 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:06:44.561 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:06:44.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:44.558+0000 7fb2c41528c0 -1 shutting down 2024-09-14T11:06:44.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:06:44.559+0000 7fb19de91640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65109, si_uid : 1000, si_addr0x3e80000fe55, si_status0 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30193 ms) 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW (30801 ms total) 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 24 tests from 1 test suite ran. (30801 ms total) 2024-09-14T11:07:14.750 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 24 tests. 2024-09-14T11:07:14.756 INFO:tasks.workunit.client.0.smithi029.stdout:phase 1.3 2024-09-14T11:07:14.781 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:07:14.782 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:07:14.782 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:07:14.782 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:07:14.792 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:14.792 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:15.391 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (610 ms) 2024-09-14T11:07:15.391 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:07:15.392 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:07:15.392 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:07:15.392 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:07:15.393 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:07:15.398 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-14T11:07:15.398 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETUP_DIRS1 (65 ms) 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:07:15.464 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:07:15.465 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:07:15.466 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:07:15.467 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:07:15.467 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:07:15.467 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:07:15.467 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:07:15.469 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:07:15.469 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:07:15.470 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:07:15.470 INFO:tasks.workunit.client.0.smithi029.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:07:15.470 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:07:15.471 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:07:15.471 INFO:tasks.workunit.client.0.smithi029.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:07:15.473 INFO:tasks.workunit.client.0.smithi029.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:07:15.473 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-14T11:07:15.473 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:07:15.473 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:07:15.474 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:07:15.475 INFO:tasks.workunit.client.0.smithi029.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:07:15.475 INFO:tasks.workunit.client.0.smithi029.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:07:15.475 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:07:15.475 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:07:15.481 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:07:15.482 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:07:15.484 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:07:15.486 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:07:15.489 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:07:15.489 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:07:15.490 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:07:15.490 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:07:15.491 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:07:15.491 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:07:15.492 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:07:15.494 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:07:15.494 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:07:15.494 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:07:15.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:07:15.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:07:15.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:07:15.496+0000 7f67e78538c0 -1 shutting down 2024-09-14T11:07:15.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:07:15.497+0000 7f66c1592640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65728, si_uid : 1000, si_addr0x3e8000100c0, si_status0 2024-09-14T11:07:45.809 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30314 ms) 2024-09-14T11:07:45.809 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 24 tests from LibRGW (31027 ms total) 2024-09-14T11:07:45.809 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:07:45.810 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:07:45.810 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 24 tests from 1 test suite ran. (31027 ms total) 2024-09-14T11:07:45.810 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 24 tests. 2024-09-14T11:07:45.816 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2.1 2024-09-14T11:07:45.842 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:07:45.842 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:07:45.842 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:07:45.842 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:07:45.852 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:45.852 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:46.452 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (609 ms) 2024-09-14T11:07:46.452 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:07:46.453 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:07:46.453 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:07:46.465 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-14T11:07:46.466 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:07:46.466 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:07:46.466 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:07:46.476 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave0 2024-09-14T11:07:46.487 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave1 2024-09-14T11:07:46.497 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave2 2024-09-14T11:07:46.509 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave3 2024-09-14T11:07:46.522 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave4 2024-09-14T11:07:46.534 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave5 2024-09-14T11:07:46.544 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave6 2024-09-14T11:07:46.554 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave7 2024-09-14T11:07:46.565 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave8 2024-09-14T11:07:46.576 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave9 2024-09-14T11:07:46.576 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (111 ms) 2024-09-14T11:07:46.576 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (308 ms) 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:07:46.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:07:46.887+0000 7f1b5af2b8c0 -1 shutting down 2024-09-14T11:07:46.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:07:46.888+0000 7f1a32ea4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66352, si_uid : 1000, si_addr0x3e800010330, si_status0 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (29936 ms) 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from LibRGW (30978 ms total) 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 9 tests from 1 test suite ran. (30978 ms total) 2024-09-14T11:08:16.822 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 9 tests. 2024-09-14T11:08:16.828 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2.2 2024-09-14T11:08:16.854 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:08:16.855 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:08:16.855 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:08:16.855 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:08:16.864 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:16.864 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:17.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (193 ms) 2024-09-14T11:08:17.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:08:17.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:08:17.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:08:17.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:08:17.049 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:08:17.085 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (37 ms) 2024-09-14T11:08:17.085 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:08:17.099 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave0 2024-09-14T11:08:17.110 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave1 2024-09-14T11:08:17.121 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave2 2024-09-14T11:08:17.131 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave3 2024-09-14T11:08:17.140 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave4 2024-09-14T11:08:17.151 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave5 2024-09-14T11:08:17.164 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave6 2024-09-14T11:08:17.177 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave7 2024-09-14T11:08:17.187 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave8 2024-09-14T11:08:17.197 INFO:tasks.workunit.client.0.smithi029.stdout:created: sorrydave9 2024-09-14T11:08:17.198 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (112 ms) 2024-09-14T11:08:17.198 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (303 ms) 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:08:17.501 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:08:17.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:08:17.502+0000 7f506df3d8c0 -1 shutting down 2024-09-14T11:08:17.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:08:17.503+0000 7f4f45f3c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66971, si_uid : 1000, si_addr0x3e80001059b, si_status0 2024-09-14T11:08:47.116 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (29616 ms) 2024-09-14T11:08:47.117 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 9 tests from LibRGW (30262 ms total) 2024-09-14T11:08:47.117 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:08:47.117 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:08:47.117 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 9 tests from 1 test suite ran. (30262 ms total) 2024-09-14T11:08:47.117 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 9 tests. 2024-09-14T11:08:47.123 INFO:tasks.workunit.client.0.smithi029.stdout:phase 3.1 2024-09-14T11:08:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:08:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:08:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:08:47.453 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:08:47.462 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:47.462 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:48.043 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-09-14T11:08:48.044 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:08:48.044 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:08:48.044 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:08:48.057 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (13 ms) 2024-09-14T11:08:48.057 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:08:48.062 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-14T11:08:48.062 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:08:48.064 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:08:48.064 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:08:48.117 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LARGE1 (52 ms) 2024-09-14T11:08:48.117 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:08:48.170 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LARGE2 (53 ms) 2024-09-14T11:08:48.170 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:08:48.170 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:08:48.171 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:08:48.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:08:48.172+0000 7fbf802538c0 -1 shutting down 2024-09-14T11:08:48.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:08:48.174+0000 7fbe59f92640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67590, si_uid : 1000, si_addr0x3e800010806, si_status0 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30148 ms) 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 13 tests from LibRGW (30865 ms total) 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 13 tests from 1 test suite ran. (30865 ms total) 2024-09-14T11:09:18.319 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 13 tests. 2024-09-14T11:09:18.326 INFO:tasks.workunit.client.0.smithi029.stdout:phase 3.2 2024-09-14T11:09:18.657 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:09:18.657 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:09:18.657 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:09:18.657 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:09:18.665 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:18.665 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:19.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (597 ms) 2024-09-14T11:09:19.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:09:19.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:09:19.255 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:09:19.256 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:09:19.256 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:09:19.261 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:09:19.261 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:09:19.265 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:09:19.265 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:09:19.321 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LARGE1 (56 ms) 2024-09-14T11:09:19.322 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:09:19.322 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:09:19.322 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:09:19.322 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:09:19.322 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:09:19.326 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:09:19.326 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:09:19.357 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (31 ms) 2024-09-14T11:09:19.357 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:09:19.357 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:09:19.357 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:09:19.357 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:09:19.358 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:09:19.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:09:19.359+0000 7fa21f4c18c0 -1 shutting down 2024-09-14T11:09:19.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:09:19.360+0000 7fa0f64c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68209, si_uid : 1000, si_addr0x3e800010a71, si_status0 2024-09-14T11:09:49.378 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30021 ms) 2024-09-14T11:09:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 13 tests from LibRGW (30721 ms total) 2024-09-14T11:09:49.379 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:09:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:09:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 13 tests from 1 test suite ran. (30721 ms total) 2024-09-14T11:09:49.379 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 13 tests. 2024-09-14T11:09:49.386 INFO:tasks.workunit.client.0.smithi029.stdout:phase 4.1 2024-09-14T11:09:49.412 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:read i1: 64001 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:read s1: blunderbuss 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:09:49.413 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:09:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:50.025 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (612 ms) 2024-09-14T11:09:50.025 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:09:50.025 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:09:50.025 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:09:50.048 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (22 ms) 2024-09-14T11:09:50.049 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:09:50.669 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_0 2024-09-14T11:09:50.669 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_1 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_2 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_3 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_4 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_5 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_6 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_7 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_8 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_9 2024-09-14T11:09:50.670 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_10 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_11 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_12 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_13 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_14 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_15 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_16 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_17 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_18 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_19 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_20 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_21 2024-09-14T11:09:50.671 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_22 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_23 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_24 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_25 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_26 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_27 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_28 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_29 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_30 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_31 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_32 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_33 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_34 2024-09-14T11:09:50.672 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_35 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_36 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_37 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_38 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_39 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_40 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_41 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_42 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_43 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_44 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_45 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_46 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_47 2024-09-14T11:09:50.673 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_48 2024-09-14T11:09:50.674 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_49 2024-09-14T11:09:50.674 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_50 2024-09-14T11:09:50.674 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_51 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_52 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_53 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_54 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_55 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_56 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_57 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_58 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_59 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_60 2024-09-14T11:09:50.676 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_61 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_62 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_63 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_64 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_65 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_66 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_67 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_68 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_69 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_70 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_71 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_72 2024-09-14T11:09:50.677 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_73 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_74 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_75 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_76 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_77 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_78 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_79 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_80 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_81 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_82 2024-09-14T11:09:50.678 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_83 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_84 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_85 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_86 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_87 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_88 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_89 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_90 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_91 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_92 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_93 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_94 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_95 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_96 2024-09-14T11:09:50.679 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_97 2024-09-14T11:09:50.680 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_98 2024-09-14T11:09:50.680 INFO:tasks.workunit.client.0.smithi029.stdout:created: dmarker:f_99 2024-09-14T11:09:50.680 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (622 ms) 2024-09-14T11:09:50.680 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:09:50.682 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:09:50.683 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:09:50.684 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:09:50.685 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:09:50.686 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:09:50.687 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:09:50.688 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:09:50.689 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:09:50.690 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:09:50.691 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:09:50.692 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:09:50.693 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:09:50.693 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:09:50.693 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:09:50.693 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:09:50.693 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:09:50.694 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:09:50.694 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:09:50.694 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:09:50.694 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:09:50.694 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:09:50.695 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:09:50.696 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:09:50.697 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:09:50.698 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:09:50.699 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-14T11:09:50.700 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:09:50.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:09:50.676+0000 7f8e4cb248c0 -1 shutting down 2024-09-14T11:09:50.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:09:50.677+0000 7f8d24a9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68828, si_uid : 1000, si_addr0x3e800010cdc, si_status0 2024-09-14T11:10:20.092 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (29417 ms) 2024-09-14T11:10:20.092 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from LibRGW (30679 ms total) 2024-09-14T11:10:20.093 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:10:20.093 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:10:20.093 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 11 tests from 1 test suite ran. (30679 ms total) 2024-09-14T11:10:20.093 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 11 tests. 2024-09-14T11:10:20.099 INFO:tasks.workunit.client.0.smithi029.stdout:phase 4.2 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:read i1: 64001 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:read s1: blunderbuss 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:10:20.125 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:10:20.133 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:20.134 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:20.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (607 ms) 2024-09-14T11:10:20.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:10:20.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:10:20.732 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (11 ms) 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:10:20.744 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:10:20.746 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:10:20.746 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:10:20.747 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:10:20.748 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:10:20.749 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:10:20.750 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:10:20.751 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:10:20.752 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:10:20.753 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:10:20.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:10:20.748+0000 7f0e813358c0 -1 shutting down 2024-09-14T11:10:20.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:10:20.749+0000 7f0d59219640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69447, si_uid : 1000, si_addr0x3e800010f47, si_status0 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30195 ms) 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 11 tests from LibRGW (30817 ms total) 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 11 tests from 1 test suite ran. (30817 ms total) 2024-09-14T11:10:50.945 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 11 tests. 2024-09-14T11:10:50.948 INFO:tasks.workunit.client.0.smithi029.stdout:phase 5.1 2024-09-14T11:10:50.983 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:10:50.983 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:10:50.983 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:10:50.983 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:10:50.993 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:50.994 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:51.587 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (604 ms) 2024-09-14T11:10:51.587 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:10:51.587 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:10:51.588 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:10:51.599 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-14T11:10:51.599 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:10:51.603 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:10:51.603 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:10:51.603 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:10:51.603 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:10:51.605 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:10:51.605 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:10:51.605 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:10:51.605 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:10:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T11:10:51.610 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:10:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.GET_OBJECT (3 ms) 2024-09-14T11:10:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:10:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:10:51.613 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:10:51.614 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:10:51.615 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:10:51.615 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:10:51.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:10:51.615+0000 7fddd251f8c0 -1 shutting down 2024-09-14T11:10:51.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:10:51.616+0000 7fdca9a9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70068, si_uid : 1000, si_addr0x3e8000111b4, si_status0 2024-09-14T11:11:21.850 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30236 ms) 2024-09-14T11:11:21.851 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 19 tests from LibRGW (30867 ms total) 2024-09-14T11:11:21.851 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:11:21.851 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:11:21.851 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 19 tests from 1 test suite ran. (30867 ms total) 2024-09-14T11:11:21.851 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 19 tests. 2024-09-14T11:11:21.856 INFO:tasks.workunit.client.0.smithi029.stdout:phase 5.2 2024-09-14T11:11:21.890 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:11:21.890 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:11:21.890 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:11:21.890 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:11:21.897 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:21.898 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:22.488 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (598 ms) 2024-09-14T11:11:22.488 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:11:22.488 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:11:22.489 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:11:22.489 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:11:22.489 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:11:22.495 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:11:22.496 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:11:22.500 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:11:22.500 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:11:22.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:11:22.531+0000 7f14a25368c0 -1 shutting down 2024-09-14T11:11:22.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:11:22.533+0000 7f137a4af640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70688, si_uid : 1000, si_addr0x3e800011420, si_status0 2024-09-14T11:11:52.755 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (30225 ms) 2024-09-14T11:11:52.755 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 19 tests from LibRGW (30865 ms total) 2024-09-14T11:11:52.756 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:11:52.756 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:11:52.756 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 19 tests from 1 test suite ran. (30865 ms total) 2024-09-14T11:11:52.756 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 19 tests. 2024-09-14T11:11:52.761 INFO:tasks.workunit.client.0.smithi029.stdout:phase 6.1 2024-09-14T11:11:52.788 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:11:52.788 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment set-up. 2024-09-14T11:11:52.788 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:11:52.788 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:11:52.796 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:52.796 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:53.403 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.INIT (615 ms) 2024-09-14T11:11:53.404 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:11:53.404 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:11:53.404 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:11:53.430 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CREATE_BUCKETS (26 ms) 2024-09-14T11:11:53.430 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:11:53.438 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-14T11:11:53.438 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:11:53.459 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.TOPDIR_RENAME (21 ms) 2024-09-14T11:11:53.459 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:11:53.482 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SUBDIR_RENAME (23 ms) 2024-09-14T11:11:53.482 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:11:53.509 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (27 ms) 2024-09-14T11:11:53.509 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:11:53.509 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:11:53.509 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:11:53.509 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:11:53.510 INFO:tasks.workunit.client.0.smithi029.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:11:53.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:11:53.510+0000 7fbf852ab8c0 -1 shutting down 2024-09-14T11:11:53.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:11:53.511+0000 7fbe5efea640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71307, si_uid : 1000, si_addr0x3e80001168b, si_status0 2024-09-14T11:12:23.506 INFO:tasks.workunit.client.0.smithi029.stdout:[ OK ] LibRGW.SHUTDOWN (29996 ms) 2024-09-14T11:12:23.507 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] 10 tests from LibRGW (30717 ms total) 2024-09-14T11:12:23.507 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:12:23.507 INFO:tasks.workunit.client.0.smithi029.stdout:[----------] Global test environment tear-down 2024-09-14T11:12:23.507 INFO:tasks.workunit.client.0.smithi029.stdout:[==========] 10 tests from 1 test suite ran. (30717 ms total) 2024-09-14T11:12:23.507 INFO:tasks.workunit.client.0.smithi029.stdout:[ PASSED ] 10 tests. 2024-09-14T11:12:23.514 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:12:23.514 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:12:23.560 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:12:23.561 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:12:23.561 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:12:23.597 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -z ']' 2024-09-14T11:12:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:12:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:12:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:12:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:12:23.598 INFO:tasks.workunit.client.0.smithi029.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:12:23.635 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:23.635 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:23.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.678+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 realm 2024-09-14T11:12:23.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:23.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.680+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.681+0000 7faf1491f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.681+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.682+0000 7faf1491f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.682+0000 7faf1491f800 20 searching for the correct realm 2024-09-14T11:12:23.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.682+0000 7faf1058b640 0 -- 172.21.15.29:0/3896002175 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x555e70c964e0 msgr2=0x555e70c989a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:23.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:23.887+0000 7faf1058b640 0 -- 172.21.15.29:0/3896002175 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x555e70a50090 msgr2=0x7faf080c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:24.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.096+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 zone default found 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 4 Realm: () 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 zonegroup default 2024-09-14T11:12:24.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.097+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 started sync module instance, tier type = 2024-09-14T11:12:24.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.098+0000 7faf1491f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=0 2024-09-14T11:12:24.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=1 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=2 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=3 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=4 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=5 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.109+0000 7faf1491f800 20 add_watcher() i=6 2024-09-14T11:12:24.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.110+0000 7faf1491f800 20 add_watcher() i=7 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.110+0000 7faf1491f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:24.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.111+0000 7fadc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:24.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 5 note: GC not initialized 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7fadc5fdb640 20 reqs_thread_entry: start 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 20 init_complete bucket index max shards: 11 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 20 Filter name: none 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7fad377fe640 20 reqs_thread_entry: start 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:12:24.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.112+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:12:24.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 20 rados->read ofs=0 len=0 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.113+0000 7faf1491f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.114+0000 7faf1491f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.114+0000 7faf1491f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:12:24.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:12:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7faf1491f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:12:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7faf1491f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:12:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7fade77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856711 cookie 93864107573536 notifier 5775 bl.length()=677 2024-09-14T11:12:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7fade77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:12:24.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.115+0000 7fade77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7faf1491f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7faf1491f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7fade6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856712 cookie 93864107557968 notifier 5775 bl.length()=187 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7fade6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:12:24.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.119+0000 7fade6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7faf1491f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7faf1491f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7faf1491f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7fade6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1069446856713 cookie 93864107557968 notifier 5775 bl.length()=197 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7fade6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:12:24.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.122+0000 7fade6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:12:24.121 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:12:24.121 INFO:tasks.workunit.client.0.smithi029.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:12:24.121 INFO:tasks.workunit.client.0.smithi029.stdout: "display_name": "maven test user", 2024-09-14T11:12:24.121 INFO:tasks.workunit.client.0.smithi029.stdout: "email": "sigv4@example.com", 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "suspended": 0, 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "subusers": [], 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "keys": [ 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: { 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "user": "ceph-test-maven", 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "active": true, 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:12:24.114785Z" 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: ], 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "swift_keys": [], 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "caps": [], 2024-09-14T11:12:24.122 INFO:tasks.workunit.client.0.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "default_placement": "", 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "placement_tags": [], 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_quota": { 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "user_quota": { 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:12:24.123 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "type": "rgw", 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "account_id": "", 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "path": "/", 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:12:24.114766Z", 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "tags": [], 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: "group_ids": [] 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:12:24.124 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:12:24.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.124+0000 7fadc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:24.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.127+0000 7faf1491f800 20 remove_watcher() i=0 2024-09-14T11:12:24.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.127+0000 7faf1491f800 2 removed watcher, disabling cache 2024-09-14T11:12:24.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.128+0000 7faf1491f800 20 remove_watcher() i=1 2024-09-14T11:12:24.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.129+0000 7faf1491f800 20 remove_watcher() i=2 2024-09-14T11:12:24.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.131+0000 7faf1491f800 20 remove_watcher() i=3 2024-09-14T11:12:24.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.132+0000 7faf1491f800 20 remove_watcher() i=4 2024-09-14T11:12:24.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.133+0000 7faf1491f800 20 remove_watcher() i=5 2024-09-14T11:12:24.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.134+0000 7faf1491f800 20 remove_watcher() i=6 2024-09-14T11:12:24.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:12:24.135+0000 7faf1491f800 20 remove_watcher() i=7 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -z ']' 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:12:24.145 INFO:tasks.workunit.client.0.smithi029.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi029.front.sepia.ceph.com:80 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi029.front.sepia.ceph.com:80 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:12:24.146 INFO:tasks.workunit.client.0.smithi029.stderr:+ ./mvnw clean package 2024-09-14T11:12:24.165 INFO:tasks.workunit.client.0.smithi029.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:12:26.146 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Scanning for projects... 2024-09-14T11:12:26.273 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:12:26.356 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-14T11:12:26.370 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:12:26.411 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.1 MB/s) 2024-09-14T11:12:26.423 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:12:26.443 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-14T11:12:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:12:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:12:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] from pom.xml 2024-09-14T11:12:26.475 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:12:26.478 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:12:26.493 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:12:26.500 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:12:26.515 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T11:12:26.518 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:12:26.533 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 3.0 MB/s) 2024-09-14T11:12:26.538 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:12:26.554 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.4 MB/s) 2024-09-14T11:12:26.565 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:12:26.580 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T11:12:26.587 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:12:26.602 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 583 kB/s) 2024-09-14T11:12:26.604 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:12:26.619 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:12:26.621 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:12:26.636 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-14T11:12:26.640 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:12:26.655 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:12:26.660 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:12:26.675 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-14T11:12:26.681 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:12:26.695 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:12:26.701 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:12:26.717 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-14T11:12:26.723 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:12:26.738 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 380 kB/s) 2024-09-14T11:12:26.740 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:12:26.756 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.5 MB/s) 2024-09-14T11:12:26.759 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:12:26.776 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15/50 kB Progress (1): 31/50 kB Progress (1): 48/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:12:26.780 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:12:26.794 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:12:26.800 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:12:26.815 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 402 kB/s) 2024-09-14T11:12:26.818 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:12:26.833 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 3.0 MB/s) 2024-09-14T11:12:26.840 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:12:26.855 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:12:26.857 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:12:26.871 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-14T11:12:26.874 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:12:26.889 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-14T11:12:26.892 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:12:26.906 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.5 MB/s) 2024-09-14T11:12:26.911 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:12:26.927 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.7 MB/s) 2024-09-14T11:12:26.940 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:12:26.955 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:12:26.958 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:12:26.972 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:12:26.977 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:12:26.992 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:12:26.999 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:12:27.014 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 286 kB/s) 2024-09-14T11:12:27.016 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:12:27.030 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 111 kB/s) 2024-09-14T11:12:27.032 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:12:27.047 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 149 kB/s) 2024-09-14T11:12:27.051 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:12:27.066 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 260 kB/s) 2024-09-14T11:12:27.070 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:12:27.084 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 230 kB/s) 2024-09-14T11:12:27.089 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:12:27.104 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:12:27.108 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:12:27.123 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 112 kB/s) 2024-09-14T11:12:27.128 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:12:27.143 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-14T11:12:27.147 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:12:27.162 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 351 kB/s) 2024-09-14T11:12:27.165 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:12:27.179 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-14T11:12:27.182 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:12:27.196 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:12:27.198 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:12:27.212 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 986 kB/s) 2024-09-14T11:12:27.215 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:12:27.229 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 262 kB/s) 2024-09-14T11:12:27.233 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:12:27.247 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 175 kB/s) 2024-09-14T11:12:27.251 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:12:27.266 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:12:27.270 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:12:27.284 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-14T11:12:27.288 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:12:27.302 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T11:12:27.306 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:12:27.320 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 249 kB/s) 2024-09-14T11:12:27.325 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:12:27.341 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-14T11:12:27.344 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:12:27.358 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:12:27.362 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:12:27.376 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:12:27.380 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:12:27.395 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 433 kB/s) 2024-09-14T11:12:27.399 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:12:27.413 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 198 kB/s) 2024-09-14T11:12:27.416 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:12:27.430 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-14T11:12:27.434 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:12:27.448 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 292 kB/s) 2024-09-14T11:12:27.450 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:12:27.464 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:12:27.469 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:12:27.484 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-14T11:12:27.486 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:12:27.501 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.2 MB/s) 2024-09-14T11:12:27.503 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:12:27.517 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-14T11:12:27.521 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:12:27.535 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.3 MB/s) 2024-09-14T11:12:27.538 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:12:27.552 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:12:27.554 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:12:27.569 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-14T11:12:27.573 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:12:27.589 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 931 kB/s) 2024-09-14T11:12:27.591 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:12:27.608 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.2 MB/s) 2024-09-14T11:12:27.614 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:12:27.628 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T11:12:27.632 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:12:27.648 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.7/15 kB Progress (1): 15/15 kB Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-14T11:12:27.650 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:12:27.666 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:12:27.670 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:12:27.685 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-14T11:12:27.690 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:12:27.706 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-14T11:12:27.709 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:12:27.725 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.9 MB/s) 2024-09-14T11:12:27.730 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:12:27.745 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-14T11:12:27.747 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:12:27.762 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-14T11:12:27.764 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:12:27.779 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:12:27.781 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:12:27.794 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 245 kB/s) 2024-09-14T11:12:27.796 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:12:27.811 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-14T11:12:27.813 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:12:27.827 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:12:27.832 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:12:27.844 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 109 kB/s) 2024-09-14T11:12:27.846 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:12:27.861 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-14T11:12:27.863 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:12:27.877 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:12:27.880 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:12:27.894 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:12:27.896 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:12:27.910 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:12:27.913 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:12:27.928 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:12:27.930 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:12:27.944 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:12:27.946 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:12:27.960 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:12:27.963 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:12:27.977 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:12:27.979 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:12:27.993 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:12:27.995 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:12:28.009 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:12:28.026 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:12:28.107 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-14T11:12:28.108 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:12:28.109 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:12:28.109 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:12:28.109 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:12:28.109 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:12:28.128 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 3.4 MB/s) 2024-09-14T11:12:28.128 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:12:28.143 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 486 kB/s) 2024-09-14T11:12:28.143 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:12:28.164 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (2): 5.5/16 kB | 1.4/98 kB Progress (2): 6.9/16 kB | 1.4/98 kB Progress (2): 6.9/16 kB | 2.8/98 kB Progress (3): 6.9/16 kB | 2.8/98 kB | 1.4/49 kB Progress (3): 6.9/16 kB | 4.1/98 kB | 1.4/49 kB Progress (3): 8.3/16 kB | 4.1/98 kB | 1.4/49 kB Progress (3): 8.3/16 kB | 5.5/98 kB | 1.4/49 kB Progress (3): 9.7/16 kB | 5.5/98 kB | 1.4/49 kB Progress (4): 9.7/16 kB | 5.5/98 kB | 1.4/49 kB | 1.4/35 kB Progress (4): 9.7/16 kB | 5.5/98 kB | 2.8/49 kB | 1.4/35 kB Progress (4): 11/16 kB | 5.5/98 kB | 2.8/49 kB | 1.4/35 kB Progress (4): 11/16 kB | 6.9/98 kB | 2.8/49 kB | 1.4/35 kB Progress (4): 11/16 kB | 6.9/98 kB | 4.1/49 kB | 1.4/35 kB Progress (4): 11/16 kB | 6.9/98 kB | 4.1/49 kB | 2.8/35 kB Progress (4): 11/16 kB | 6.9/98 kB | 5.5/49 kB | 2.8/35 kB Progress (4): 11/16 kB | 8.3/98 kB | 5.5/49 kB | 2.8/35 kB Progress (4): 12/16 kB | 8.3/98 kB | 5.5/49 kB | 2.8/35 kB Progress (4): 12/16 kB | 9.7/98 kB | 5.5/49 kB | 2.8/35 kB Progress (4): 12/16 kB | 9.7/98 kB | 6.9/49 kB | 2.8/35 kB Progress (4): 12/16 kB | 9.7/98 kB | 6.9/49 kB | 4.1/35 kB Progress (4): 12/16 kB | 9.7/98 kB | 8.3/49 kB | 4.1/35 kB Progress (4): 12/16 kB | 11/98 kB | 8.3/49 kB | 4.1/35 kB Progress (4): 14/16 kB | 11/98 kB | 8.3/49 kB | 4.1/35 kB Progress (4): 14/16 kB | 12/98 kB | 8.3/49 kB | 4.1/35 kB Progress (4): 15/16 kB | 12/98 kB | 8.3/49 kB | 4.1/35 kB Progress (4): 15/16 kB | 12/98 kB | 9.7/49 kB | 4.1/35 kB Progress (4): 16 kB | 12/98 kB | 9.7/49 kB | 4.1/35 kB Progress (4): 16 kB | 12/98 kB | 9.7/49 kB | 5.5/35 kB Progress (4): 16 kB | 12/98 kB | 11/49 kB | 5.5/35 kB Progress (4): 16 kB | 12/98 kB | 11/49 kB | 6.9/35 kB Progress (4): 16 kB | 14/98 kB | 11/49 kB | 6.9/35 kB Progress (4): 16 kB | 14/98 kB | 11/49 kB | 8.3/35 kB Progress (4): 16 kB | 14/98 kB | 12/49 kB | 8.3/35 kB Progress (5): 16 kB | 14/98 kB | 12/49 kB | 8.3/35 kB | 16/782 kB Progress (5): 16 kB | 14/98 kB | 12/49 kB | 9.7/35 kB | 16/782 kB Progress (5): 16 kB | 15/98 kB | 12/49 kB | 9.7/35 kB | 16/782 kB Progress (5): 16 kB | 15/98 kB | 12/49 kB | 11/35 kB | 16/782 kB Progress (5): 16 kB | 15/98 kB | 14/49 kB | 11/35 kB | 16/782 kB Progress (5): 16 kB | 15/98 kB | 14/49 kB | 11/35 kB | 33/782 kB Progress (5): 16 kB | 15/98 kB | 14/49 kB | 12/35 kB | 33/782 kB Progress (5): 16 kB | 16/98 kB | 14/49 kB | 12/35 kB | 33/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 322 kB/s) 2024-09-14T11:12:28.164 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 16/98 kB | 14/49 kB | 12/35 kB | 49/782 kB Progress (4): 18/98 kB | 14/49 kB | 12/35 kB | 49/782 kB Progress (4): 18/98 kB | 14/49 kB | 14/35 kB | 49/782 kB Progress (4): 18/98 kB | 15/49 kB | 14/35 kB | 49/782 kB Progress (4): 18/98 kB | 15/49 kB | 15/35 kB | 49/782 kB Progress (4): 18/98 kB | 16/49 kB | 15/35 kB | 49/782 kB Progress (4): 18/98 kB | 16/49 kB | 15/35 kB | 65/782 kB Progress (4): 19/98 kB | 16/49 kB | 15/35 kB | 65/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:12:28.171 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 19/98 kB | 17/49 kB | 15/35 kB | 65/782 kB Progress (4): 19/98 kB | 17/49 kB | 16/35 kB | 65/782 kB Progress (4): 19/98 kB | 19/49 kB | 16/35 kB | 65/782 kB Progress (4): 19/98 kB | 19/49 kB | 18/35 kB | 65/782 kB Progress (4): 19/98 kB | 19/49 kB | 18/35 kB | 82/782 kB Progress (4): 21/98 kB | 19/49 kB | 18/35 kB | 82/782 kB Progress (4): 21/98 kB | 19/49 kB | 19/35 kB | 82/782 kB Progress (4): 21/98 kB | 20/49 kB | 19/35 kB | 82/782 kB Progress (4): 21/98 kB | 20/49 kB | 21/35 kB | 82/782 kB Progress (4): 21/98 kB | 20/49 kB | 21/35 kB | 98/782 kB Progress (4): 22/98 kB | 20/49 kB | 21/35 kB | 98/782 kB Progress (4): 22/98 kB | 20/49 kB | 22/35 kB | 98/782 kB Progress (4): 22/98 kB | 21/49 kB | 22/35 kB | 98/782 kB Progress (4): 23/98 kB | 21/49 kB | 22/35 kB | 98/782 kB Progress (4): 23/98 kB | 23/49 kB | 22/35 kB | 98/782 kB Progress (4): 23/98 kB | 23/49 kB | 23/35 kB | 98/782 kB Progress (4): 23/98 kB | 24/49 kB | 23/35 kB | 98/782 kB Progress (4): 25/98 kB | 24/49 kB | 23/35 kB | 98/782 kB Progress (4): 25/98 kB | 24/49 kB | 23/35 kB | 115/782 kB Progress (4): 26/98 kB | 24/49 kB | 23/35 kB | 115/782 kB Progress (4): 26/98 kB | 25/49 kB | 23/35 kB | 115/782 kB Progress (4): 26/98 kB | 25/49 kB | 25/35 kB | 115/782 kB Progress (4): 26/98 kB | 27/49 kB | 25/35 kB | 115/782 kB Progress (4): 27/98 kB | 27/49 kB | 25/35 kB | 115/782 kB Progress (4): 27/98 kB | 27/49 kB | 25/35 kB | 131/782 kB Progress (4): 27/98 kB | 28/49 kB | 25/35 kB | 131/782 kB Progress (4): 27/98 kB | 28/49 kB | 26/35 kB | 131/782 kB Progress (4): 27/98 kB | 30/49 kB | 26/35 kB | 131/782 kB Progress (4): 29/98 kB | 30/49 kB | 26/35 kB | 131/782 kB Progress (4): 29/98 kB | 30/49 kB | 26/35 kB | 147/782 kB Progress (4): 29/98 kB | 30/49 kB | 27/35 kB | 147/782 kB Progress (4): 30/98 kB | 30/49 kB | 27/35 kB | 147/782 kB Progress (4): 30/98 kB | 30/49 kB | 29/35 kB | 147/782 kB Progress (4): 30/98 kB | 30/49 kB | 29/35 kB | 164/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 164/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 180/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 197/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 213/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 229/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 246/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 262/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 278/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 295/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 311/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 328/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 344/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 360/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 377/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 393/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 410/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 426/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 442/782 kB Progress (4): 30/98 kB | 30/49 kB | 30/35 kB | 459/782 kB Progress (4): 30/98 kB | 31/49 kB | 30/35 kB | 459/782 kB Progress (4): 30/98 kB | 32/49 kB | 30/35 kB | 459/782 kB Progress (4): 30/98 kB | 32/49 kB | 30/35 kB | 475/782 kB Progress (4): 30/98 kB | 34/49 kB | 30/35 kB | 475/782 kB Progress (4): 30/98 kB | 35/49 kB | 30/35 kB | 475/782 kB Progress (4): 32/98 kB | 35/49 kB | 30/35 kB | 475/782 kB Progress (4): 32/98 kB | 37/49 kB | 30/35 kB | 475/782 kB Progress (4): 32/98 kB | 37/49 kB | 30/35 kB | 491/782 kB Progress (4): 32/98 kB | 38/49 kB | 30/35 kB | 491/782 kB Progress (4): 33/98 kB | 38/49 kB | 30/35 kB | 491/782 kB Progress (4): 34/98 kB | 38/49 kB | 30/35 kB | 491/782 kB Progress (4): 36/98 kB | 38/49 kB | 30/35 kB | 491/782 kB Progress (4): 36/98 kB | 38/49 kB | 30/35 kB | 508/782 kB Progress (4): 37/98 kB | 38/49 kB | 30/35 kB | 508/782 kB Progress (4): 37/98 kB | 38/49 kB | 32/35 kB | 508/782 kB Progress (4): 38/98 kB | 38/49 kB | 32/35 kB | 508/782 kB Progress (4): 38/98 kB | 38/49 kB | 33/35 kB | 508/782 kB Progress (4): 38/98 kB | 38/49 kB | 33/35 kB | 524/782 kB Progress (4): 38/98 kB | 38/49 kB | 34/35 kB | 524/782 kB Progress (4): 38/98 kB | 39/49 kB | 34/35 kB | 524/782 kB Progress (4): 38/98 kB | 39/49 kB | 35 kB | 524/782 kB Progress (4): 40/98 kB | 39/49 kB | 35 kB | 524/782 kB Progress (4): 40/98 kB | 39/49 kB | 35 kB | 541/782 kB Progress (4): 40/98 kB | 41/49 kB | 35 kB | 541/782 kB Progress (4): 41/98 kB | 41/49 kB | 35 kB | 541/782 kB Progress (4): 41/98 kB | 42/49 kB | 35 kB | 541/782 kB Progress (4): 43/98 kB | 42/49 kB | 35 kB | 541/782 kB Progress (4): 43/98 kB | 43/49 kB | 35 kB | 541/782 kB Progress (4): 44/98 kB | 43/49 kB | 35 kB | 541/782 kB Progress (4): 44/98 kB | 45/49 kB | 35 kB | 541/782 kB Progress (4): 45/98 kB | 45/49 kB | 35 kB | 541/782 kB Progress (4): 45/98 kB | 46/49 kB | 35 kB | 541/782 kB Progress (4): 47/98 kB | 46/49 kB | 35 kB | 541/782 kB Progress (4): 47/98 kB | 46/49 kB | 35 kB | 557/782 kB Progress (4): 48/98 kB | 46/49 kB | 35 kB | 557/782 kB Progress (4): 49/98 kB | 46/49 kB | 35 kB | 557/782 kB Progress (4): 49/98 kB | 46/49 kB | 35 kB | 573/782 kB Progress (4): 51/98 kB | 46/49 kB | 35 kB | 573/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 586 kB/s) 2024-09-14T11:12:28.171 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 52/98 kB | 46/49 kB | 573/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:12:28.171 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 52/98 kB | 48/49 kB | 573/782 kB Progress (3): 54/98 kB | 48/49 kB | 573/782 kB Progress (3): 54/98 kB | 49/49 kB | 573/782 kB Progress (3): 54/98 kB | 49/49 kB | 590/782 kB Progress (3): 54/98 kB | 49/49 kB | 590/782 kB Progress (3): 54/98 kB | 49 kB | 590/782 kB Progress (3): 54/98 kB | 49 kB | 606/782 kB Progress (3): 54/98 kB | 49 kB | 623/782 kB Progress (3): 56/98 kB | 49 kB | 623/782 kB Progress (3): 57/98 kB | 49 kB | 623/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 807 kB/s) 2024-09-14T11:12:28.172 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 59/98 kB | 623/782 kB Progress (2): 59/98 kB | 639/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:12:28.174 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 60/98 kB | 639/782 kB Progress (2): 61/98 kB | 639/782 kB Progress (2): 61/98 kB | 655/782 kB Progress (2): 61/98 kB | 672/782 kB Progress (2): 61/98 kB | 688/782 kB Progress (2): 61/98 kB | 704/782 kB Progress (2): 61/98 kB | 721/782 kB Progress (2): 61/98 kB | 737/782 kB Progress (2): 61/98 kB | 754/782 kB Progress (2): 61/98 kB | 770/782 kB Progress (3): 61/98 kB | 770/782 kB | 1.4/11 kB Progress (3): 61/98 kB | 770/782 kB | 2.8/11 kB Progress (3): 61/98 kB | 770/782 kB | 4.1/11 kB Progress (3): 61/98 kB | 782 kB | 4.1/11 kB Progress (3): 61/98 kB | 782 kB | 5.5/11 kB Progress (3): 61/98 kB | 782 kB | 6.9/11 kB Progress (3): 61/98 kB | 782 kB | 8.3/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-14T11:12:28.174 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 61/98 kB | 9.7/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:12:28.174 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 61/98 kB | 11/11 kB Progress (2): 61/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 175 kB/s) 2024-09-14T11:12:28.174 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:12:28.181 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 63/98 kB Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.3 MB/s) 2024-09-14T11:12:28.181 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:12:28.186 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 1.4/30 kB Progress (2): 16/205 kB | 2.8/30 kB Progress (2): 16/205 kB | 4.1/30 kB Progress (2): 16/205 kB | 5.5/30 kB Progress (2): 16/205 kB | 6.9/30 kB Progress (2): 16/205 kB | 8.3/30 kB Progress (2): 16/205 kB | 9.7/30 kB Progress (2): 16/205 kB | 11/30 kB Progress (2): 16/205 kB | 12/30 kB Progress (2): 16/205 kB | 14/30 kB Progress (2): 16/205 kB | 15/30 kB Progress (2): 33/205 kB | 15/30 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 49/205 kB | 16/30 kB Progress (2): 49/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 403 kB/s) 2024-09-14T11:12:28.186 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:12:28.189 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 49/205 kB | 16/81 kB Progress (2): 49/205 kB | 33/81 kB Progress (2): 49/205 kB | 49/81 kB Progress (3): 49/205 kB | 49/81 kB | 1.4/798 kB Progress (3): 49/205 kB | 49/81 kB | 2.8/798 kB Progress (3): 49/205 kB | 49/81 kB | 4.1/798 kB Progress (3): 49/205 kB | 64/81 kB | 4.1/798 kB Progress (3): 49/205 kB | 80/81 kB | 4.1/798 kB Progress (3): 49/205 kB | 80/81 kB | 5.5/798 kB Progress (3): 49/205 kB | 81 kB | 5.5/798 kB Progress (3): 49/205 kB | 81 kB | 6.9/798 kB Progress (3): 49/205 kB | 81 kB | 8.3/798 kB Progress (3): 49/205 kB | 81 kB | 9.7/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 1.0 MB/s) 2024-09-14T11:12:28.189 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:12:28.195 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 49/205 kB | 11/798 kB Progress (2): 49/205 kB | 12/798 kB Progress (2): 49/205 kB | 14/798 kB Progress (2): 49/205 kB | 15/798 kB Progress (2): 49/205 kB | 16/798 kB Progress (2): 66/205 kB | 16/798 kB Progress (3): 66/205 kB | 16/798 kB | 13 kB Progress (3): 82/205 kB | 16/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 158 kB/s) 2024-09-14T11:12:28.195 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:12:28.206 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 98/205 kB | 16/798 kB Progress (2): 114/205 kB | 16/798 kB Progress (2): 131/205 kB | 16/798 kB Progress (2): 147/205 kB | 16/798 kB Progress (2): 163/205 kB | 16/798 kB Progress (2): 163/205 kB | 33/798 kB Progress (2): 180/205 kB | 33/798 kB Progress (2): 180/205 kB | 49/798 kB Progress (3): 180/205 kB | 49/798 kB | 16/182 kB Progress (3): 180/205 kB | 49/798 kB | 33/182 kB Progress (3): 180/205 kB | 62/798 kB | 33/182 kB Progress (4): 180/205 kB | 62/798 kB | 33/182 kB | 16/151 kB Progress (4): 180/205 kB | 62/798 kB | 33/182 kB | 33/151 kB Progress (4): 180/205 kB | 62/798 kB | 33/182 kB | 49/151 kB Progress (4): 180/205 kB | 62/798 kB | 49/182 kB | 49/151 kB Progress (4): 180/205 kB | 62/798 kB | 49/182 kB | 62/151 kB Progress (4): 180/205 kB | 78/798 kB | 49/182 kB | 62/151 kB Progress (4): 180/205 kB | 78/798 kB | 49/182 kB | 79/151 kB Progress (4): 180/205 kB | 78/798 kB | 49/182 kB | 95/151 kB Progress (4): 180/205 kB | 78/798 kB | 66/182 kB | 95/151 kB Progress (4): 180/205 kB | 78/798 kB | 66/182 kB | 111/151 kB Progress (4): 180/205 kB | 78/798 kB | 66/182 kB | 128/151 kB Progress (4): 196/205 kB | 78/798 kB | 66/182 kB | 128/151 kB Progress (4): 205 kB | 78/798 kB | 66/182 kB | 128/151 kB Progress (4): 205 kB | 78/798 kB | 66/182 kB | 144/151 kB Progress (4): 205 kB | 95/798 kB | 66/182 kB | 144/151 kB Progress (4): 205 kB | 95/798 kB | 66/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-14T11:12:28.206 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:12:28.206 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.6 MB/s) 2024-09-14T11:12:28.206 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:12:28.210 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 95/798 kB | 66/182 kB | 16/27 kB Progress (3): 95/798 kB | 66/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 276 kB/s) 2024-09-14T11:12:28.210 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:12:28.218 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 111/798 kB | 66/182 kB Progress (2): 111/798 kB | 78/182 kB Progress (2): 128/798 kB | 78/182 kB Progress (2): 144/798 kB | 78/182 kB Progress (2): 144/798 kB | 94/182 kB Progress (2): 144/798 kB | 111/182 kB Progress (2): 160/798 kB | 111/182 kB Progress (2): 160/798 kB | 127/182 kB Progress (2): 177/798 kB | 127/182 kB Progress (2): 193/798 kB | 127/182 kB Progress (2): 193/798 kB | 143/182 kB Progress (2): 193/798 kB | 160/182 kB Progress (2): 209/798 kB | 160/182 kB Progress (2): 226/798 kB | 160/182 kB Progress (2): 226/798 kB | 176/182 kB Progress (2): 226/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:12:28.218 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:12:28.221 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 226/798 kB | 16/385 kB Progress (3): 226/798 kB | 16/385 kB | 16/30 kB Progress (3): 226/798 kB | 33/385 kB | 16/30 kB Progress (3): 226/798 kB | 49/385 kB | 16/30 kB Progress (3): 226/798 kB | 49/385 kB | 30 kB Progress (3): 226/798 kB | 65/385 kB | 30 kB Progress (3): 226/798 kB | 82/385 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 276 kB/s) 2024-09-14T11:12:28.221 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:12:28.225 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 226/798 kB | 98/385 kB Progress (2): 226/798 kB | 114/385 kB Progress (2): 226/798 kB | 131/385 kB Progress (2): 226/798 kB | 147/385 kB Progress (2): 226/798 kB | 164/385 kB Progress (2): 226/798 kB | 180/385 kB Progress (2): 242/798 kB | 180/385 kB Progress (2): 242/798 kB | 196/385 kB Progress (2): 259/798 kB | 196/385 kB Progress (2): 259/798 kB | 213/385 kB Progress (2): 275/798 kB | 213/385 kB Progress (2): 275/798 kB | 229/385 kB Progress (2): 291/798 kB | 229/385 kB Progress (2): 291/798 kB | 245/385 kB Progress (3): 291/798 kB | 245/385 kB | 13 kB Progress (3): 308/798 kB | 245/385 kB | 13 kB Progress (3): 308/798 kB | 262/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 117 kB/s) 2024-09-14T11:12:28.225 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 324/798 kB | 262/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:12:28.233 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 341/798 kB | 262/385 kB Progress (2): 357/798 kB | 262/385 kB Progress (2): 373/798 kB | 262/385 kB Progress (2): 390/798 kB | 262/385 kB Progress (2): 406/798 kB | 262/385 kB Progress (2): 422/798 kB | 262/385 kB Progress (2): 439/798 kB | 262/385 kB Progress (2): 455/798 kB | 262/385 kB Progress (2): 472/798 kB | 262/385 kB Progress (2): 488/798 kB | 262/385 kB Progress (2): 504/798 kB | 262/385 kB Progress (2): 521/798 kB | 262/385 kB Progress (2): 521/798 kB | 278/385 kB Progress (2): 521/798 kB | 295/385 kB Progress (2): 521/798 kB | 311/385 kB Progress (2): 521/798 kB | 327/385 kB Progress (2): 521/798 kB | 344/385 kB Progress (2): 521/798 kB | 360/385 kB Progress (2): 521/798 kB | 376/385 kB Progress (3): 521/798 kB | 376/385 kB | 16/75 kB Progress (3): 521/798 kB | 385 kB | 16/75 kB Progress (3): 521/798 kB | 385 kB | 33/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.2 MB/s) 2024-09-14T11:12:28.233 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:12:28.234 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 521/798 kB | 49/75 kB Progress (2): 521/798 kB | 61/75 kB Progress (2): 521/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 611 kB/s) 2024-09-14T11:12:28.234 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:12:28.241 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 537/798 kB Progress (2): 537/798 kB | 15/780 kB Progress (2): 554/798 kB | 15/780 kB Progress (2): 554/798 kB | 31/780 kB Progress (2): 570/798 kB | 31/780 kB Progress (2): 570/798 kB | 48/780 kB Progress (2): 586/798 kB | 48/780 kB Progress (2): 586/798 kB | 64/780 kB Progress (2): 603/798 kB | 64/780 kB Progress (2): 603/798 kB | 81/780 kB Progress (2): 603/798 kB | 97/780 kB Progress (2): 619/798 kB | 97/780 kB Progress (2): 619/798 kB | 111/780 kB Progress (2): 635/798 kB | 111/780 kB Progress (2): 635/798 kB | 127/780 kB Progress (2): 652/798 kB | 127/780 kB Progress (2): 652/798 kB | 144/780 kB Progress (2): 652/798 kB | 160/780 kB Progress (2): 668/798 kB | 160/780 kB Progress (2): 668/798 kB | 176/780 kB Progress (2): 685/798 kB | 176/780 kB Progress (2): 685/798 kB | 193/780 kB Progress (2): 701/798 kB | 193/780 kB Progress (2): 701/798 kB | 209/780 kB Progress (2): 717/798 kB | 209/780 kB Progress (2): 717/798 kB | 225/780 kB Progress (2): 734/798 kB | 225/780 kB Progress (2): 734/798 kB | 242/780 kB Progress (2): 734/798 kB | 258/780 kB Progress (2): 750/798 kB | 258/780 kB Progress (2): 750/798 kB | 275/780 kB Progress (2): 766/798 kB | 275/780 kB Progress (2): 766/798 kB | 291/780 kB Progress (2): 783/798 kB | 291/780 kB Progress (2): 783/798 kB | 307/780 kB Progress (2): 798 kB | 307/780 kB Progress (2): 798 kB | 324/780 kB Progress (2): 798 kB | 340/780 kB Progress (2): 798 kB | 356/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.2 MB/s) 2024-09-14T11:12:28.241 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:12:28.249 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 373/780 kB Progress (1): 389/780 kB Progress (1): 406/780 kB Progress (1): 422/780 kB Progress (2): 422/780 kB | 16/329 kB Progress (2): 438/780 kB | 16/329 kB Progress (2): 455/780 kB | 16/329 kB Progress (2): 455/780 kB | 33/329 kB Progress (2): 471/780 kB | 33/329 kB Progress (2): 488/780 kB | 33/329 kB Progress (2): 504/780 kB | 33/329 kB Progress (2): 504/780 kB | 49/329 kB Progress (2): 520/780 kB | 49/329 kB Progress (2): 520/780 kB | 66/329 kB Progress (2): 537/780 kB | 66/329 kB Progress (2): 553/780 kB | 66/329 kB Progress (2): 569/780 kB | 66/329 kB Progress (2): 569/780 kB | 82/329 kB Progress (2): 586/780 kB | 82/329 kB Progress (2): 602/780 kB | 82/329 kB Progress (2): 602/780 kB | 97/329 kB Progress (2): 619/780 kB | 97/329 kB Progress (2): 635/780 kB | 97/329 kB Progress (2): 651/780 kB | 97/329 kB Progress (2): 668/780 kB | 97/329 kB Progress (2): 684/780 kB | 97/329 kB Progress (2): 701/780 kB | 97/329 kB Progress (3): 701/780 kB | 97/329 kB | 16/501 kB Progress (3): 717/780 kB | 97/329 kB | 16/501 kB Progress (4): 717/780 kB | 97/329 kB | 16/501 kB | 16/354 kB Progress (4): 717/780 kB | 97/329 kB | 33/501 kB | 16/354 kB Progress (4): 733/780 kB | 97/329 kB | 33/501 kB | 16/354 kB Progress (4): 733/780 kB | 97/329 kB | 33/501 kB | 33/354 kB Progress (4): 733/780 kB | 97/329 kB | 49/501 kB | 33/354 kB Progress (4): 750/780 kB | 97/329 kB | 49/501 kB | 33/354 kB Progress (4): 750/780 kB | 97/329 kB | 49/501 kB | 49/354 kB Progress (4): 750/780 kB | 97/329 kB | 66/501 kB | 49/354 kB Progress (4): 766/780 kB | 97/329 kB | 66/501 kB | 49/354 kB Progress (4): 766/780 kB | 97/329 kB | 79/501 kB | 49/354 kB Progress (4): 780 kB | 97/329 kB | 79/501 kB | 49/354 kB Progress (4): 780 kB | 97/329 kB | 79/501 kB | 61/354 kB Progress (4): 780 kB | 97/329 kB | 96/501 kB | 61/354 kB Progress (4): 780 kB | 97/329 kB | 96/501 kB | 78/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.7 MB/s) 2024-09-14T11:12:28.249 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 97/329 kB | 112/501 kB | 78/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:12:28.256 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 97/329 kB | 128/501 kB | 78/354 kB Progress (3): 97/329 kB | 128/501 kB | 94/354 kB Progress (3): 97/329 kB | 145/501 kB | 94/354 kB Progress (3): 97/329 kB | 145/501 kB | 111/354 kB Progress (3): 97/329 kB | 161/501 kB | 111/354 kB Progress (3): 97/329 kB | 177/501 kB | 111/354 kB Progress (3): 97/329 kB | 177/501 kB | 127/354 kB Progress (3): 97/329 kB | 194/501 kB | 127/354 kB Progress (3): 97/329 kB | 194/501 kB | 143/354 kB Progress (3): 97/329 kB | 210/501 kB | 143/354 kB Progress (3): 97/329 kB | 227/501 kB | 143/354 kB Progress (3): 97/329 kB | 227/501 kB | 160/354 kB Progress (3): 97/329 kB | 243/501 kB | 160/354 kB Progress (3): 97/329 kB | 243/501 kB | 176/354 kB Progress (3): 97/329 kB | 259/501 kB | 176/354 kB Progress (3): 97/329 kB | 259/501 kB | 193/354 kB Progress (3): 97/329 kB | 276/501 kB | 193/354 kB Progress (3): 97/329 kB | 292/501 kB | 193/354 kB Progress (3): 97/329 kB | 292/501 kB | 209/354 kB Progress (3): 97/329 kB | 309/501 kB | 209/354 kB Progress (3): 114/329 kB | 309/501 kB | 209/354 kB Progress (3): 114/329 kB | 309/501 kB | 225/354 kB Progress (3): 114/329 kB | 325/501 kB | 225/354 kB Progress (3): 130/329 kB | 325/501 kB | 225/354 kB Progress (3): 130/329 kB | 341/501 kB | 225/354 kB Progress (3): 130/329 kB | 341/501 kB | 242/354 kB Progress (3): 146/329 kB | 341/501 kB | 242/354 kB Progress (3): 146/329 kB | 358/501 kB | 242/354 kB Progress (3): 146/329 kB | 374/501 kB | 242/354 kB Progress (4): 146/329 kB | 374/501 kB | 242/354 kB | 16/41 kB Progress (4): 146/329 kB | 390/501 kB | 242/354 kB | 16/41 kB Progress (4): 163/329 kB | 390/501 kB | 242/354 kB | 16/41 kB Progress (4): 163/329 kB | 407/501 kB | 242/354 kB | 16/41 kB Progress (4): 163/329 kB | 407/501 kB | 242/354 kB | 32/41 kB Progress (4): 179/329 kB | 407/501 kB | 242/354 kB | 32/41 kB Progress (4): 179/329 kB | 423/501 kB | 242/354 kB | 32/41 kB Progress (4): 179/329 kB | 423/501 kB | 242/354 kB | 41 kB Progress (4): 179/329 kB | 440/501 kB | 242/354 kB | 41 kB Progress (4): 179/329 kB | 456/501 kB | 242/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 288 kB/s) 2024-09-14T11:12:28.256 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 179/329 kB | 472/501 kB | 242/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:12:28.257 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 195/329 kB | 472/501 kB | 242/354 kB Progress (3): 195/329 kB | 489/501 kB | 242/354 kB Progress (3): 195/329 kB | 501 kB | 242/354 kB Progress (3): 212/329 kB | 501 kB | 242/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.5 MB/s) 2024-09-14T11:12:28.257 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 228/329 kB | 242/354 kB Progress (2): 245/329 kB | 242/354 kB Progress (2): 261/329 kB | 242/354 kB Progress (2): 277/329 kB | 242/354 kB Progress (2): 294/329 kB | 242/354 kB Progress (2): 310/329 kB | 242/354 kB Progress (2): 310/329 kB | 258/354 kB Progress (2): 326/329 kB | 258/354 kB Progress (2): 329 kB | 258/354 kB Progress (2): 329 kB | 274/354 kB Progress (2): 329 kB | 291/354 kB Progress (3): 329 kB | 291/354 kB | 6.4 kB Progress (3): 329 kB | 307/354 kB | 6.4 kB Progress (4): 329 kB | 307/354 kB | 6.4 kB | 16/586 kB Progress (5): 329 kB | 307/354 kB | 6.4 kB | 16/586 kB | 16/211 kB Progress (5): 329 kB | 307/354 kB | 6.4 kB | 33/586 kB | 16/211 kB Progress (5): 329 kB | 324/354 kB | 6.4 kB | 33/586 kB | 16/211 kB Progress (5): 329 kB | 324/354 kB | 6.4 kB | 33/586 kB | 33/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 329 kB | 324/354 kB | 49/586 kB | 33/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.9 MB/s) 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 340/354 kB | 49/586 kB | 33/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 340/354 kB | 62/586 kB | 33/211 kB Progress (3): 340/354 kB | 62/586 kB | 49/211 kB Progress (3): 354 kB | 62/586 kB | 49/211 kB Progress (3): 354 kB | 78/586 kB | 49/211 kB Progress (3): 354 kB | 78/586 kB | 66/211 kB Progress (3): 354 kB | 95/586 kB | 66/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-14T11:12:28.288 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:12:28.293 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 95/586 kB | 82/211 kB Progress (2): 111/586 kB | 82/211 kB Progress (2): 111/586 kB | 98/211 kB Progress (2): 127/586 kB | 98/211 kB Progress (2): 144/586 kB | 98/211 kB Progress (2): 144/586 kB | 114/211 kB Progress (2): 160/586 kB | 114/211 kB Progress (2): 176/586 kB | 114/211 kB Progress (2): 176/586 kB | 131/211 kB Progress (2): 193/586 kB | 131/211 kB Progress (2): 193/586 kB | 147/211 kB Progress (2): 209/586 kB | 147/211 kB Progress (2): 226/586 kB | 147/211 kB Progress (2): 226/586 kB | 163/211 kB Progress (2): 242/586 kB | 163/211 kB Progress (2): 258/586 kB | 163/211 kB Progress (2): 258/586 kB | 180/211 kB Progress (2): 275/586 kB | 180/211 kB Progress (2): 275/586 kB | 196/211 kB Progress (2): 291/586 kB | 196/211 kB Progress (2): 308/586 kB | 196/211 kB Progress (2): 308/586 kB | 211 kB Progress (2): 324/586 kB | 211 kB Progress (2): 340/586 kB | 211 kB Progress (2): 357/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:12:28.293 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 373/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:12:28.296 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 389/586 kB Progress (1): 406/586 kB Progress (1): 422/586 kB Progress (1): 439/586 kB Progress (1): 455/586 kB Progress (1): 471/586 kB Progress (1): 488/586 kB Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:12:28.296 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:12:28.300 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 76 kB/s) 2024-09-14T11:12:28.300 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:12:28.302 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 36 kB/s) 2024-09-14T11:12:28.302 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:12:28.304 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 553 kB/s) 2024-09-14T11:12:28.304 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:12:28.313 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15/245 kB Progress (1): 31/245 kB Progress (1): 48/245 kB Progress (1): 64/245 kB Progress (1): 81/245 kB Progress (1): 97/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (2): 161/245 kB | 16/205 kB Progress (2): 177/245 kB | 16/205 kB Progress (2): 177/245 kB | 33/205 kB Progress (2): 177/245 kB | 49/205 kB Progress (2): 194/245 kB | 49/205 kB Progress (2): 194/245 kB | 66/205 kB Progress (2): 194/245 kB | 82/205 kB Progress (2): 210/245 kB | 82/205 kB Progress (2): 210/245 kB | 98/205 kB Progress (2): 226/245 kB | 98/205 kB Progress (2): 226/245 kB | 115/205 kB Progress (2): 226/245 kB | 131/205 kB Progress (2): 243/245 kB | 131/205 kB Progress (2): 245 kB | 131/205 kB Progress (2): 245 kB | 147/205 kB Progress (2): 245 kB | 164/205 kB Progress (2): 245 kB | 180/205 kB Progress (2): 245 kB | 197/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-14T11:12:28.313 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:12:28.314 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-14T11:12:28.314 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:12:28.315 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 75 kB/s) 2024-09-14T11:12:28.315 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:12:28.316 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 81 kB/s) 2024-09-14T11:12:28.316 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:12:28.318 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 31 kB/s) 2024-09-14T11:12:28.329 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/23 kB Progress (2): 16/23 kB | 16/24 kB Progress (2): 23 kB | 16/24 kB Progress (3): 23 kB | 16/24 kB | 16/17 kB Progress (3): 23 kB | 24 kB | 16/17 kB Progress (3): 23 kB | 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 104 kB/s) 2024-09-14T11:12:28.329 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 111 kB/s) 2024-09-14T11:12:28.329 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 80 kB/s) 2024-09-14T11:12:28.333 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 839 kB/s) 2024-09-14T11:12:28.359 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:28.359 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:12:28.365 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:12:28.384 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 307 kB/s) 2024-09-14T11:12:28.386 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:12:28.401 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:12:28.403 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:12:28.417 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:12:28.421 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:12:28.436 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:12:28.441 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:12:28.457 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 63/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:12:28.457 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:12:28.474 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 13 MB/s) 2024-09-14T11:12:28.511 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:28.511 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:12:28.514 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:12:28.528 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:12:28.529 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:12:28.544 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-14T11:12:28.546 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:12:28.560 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:12:28.562 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:12:28.576 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:12:28.579 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:12:28.593 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:12:28.595 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:12:28.608 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:12:28.612 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:12:28.625 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 44 kB/s) 2024-09-14T11:12:28.627 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:12:28.640 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 211 kB/s) 2024-09-14T11:12:28.642 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:12:28.655 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:12:28.657 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:12:28.671 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:12:28.673 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:12:28.687 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:12:28.689 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:12:28.702 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:12:28.705 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:12:28.718 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:12:28.720 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:12:28.734 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.5 MB/s) 2024-09-14T11:12:28.738 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:12:28.751 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 392 kB/s) 2024-09-14T11:12:28.753 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:12:28.768 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-14T11:12:28.772 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:12:28.788 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-14T11:12:28.792 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:12:28.807 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 6.1 MB/s) 2024-09-14T11:12:28.807 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:12:28.808 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:12:28.808 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:12:28.808 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:12:28.808 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:12:28.822 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/41 kB Progress (3): 2.5 kB | 16/41 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 192 kB/s) 2024-09-14T11:12:28.822 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 33/41 kB | 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:12:28.822 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 33/41 kB | 33/55 kB Progress (3): 33/41 kB | 33/55 kB | 8.5 kB Progress (3): 41 kB | 33/55 kB | 8.5 kB Progress (3): 41 kB | 49/55 kB | 8.5 kB Progress (3): 41 kB | 55 kB | 8.5 kB Progress (4): 41 kB | 55 kB | 8.5 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-14T11:12:28.822 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.9 MB/s) 2024-09-14T11:12:28.823 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:12:28.823 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 55 kB | 32/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.7 MB/s) 2024-09-14T11:12:28.828 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 49/269 kB Progress (1): 49/269 kB Progress (1): 63/269 kB Progress (1): 80/269 kB Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-14T11:12:28.840 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 66/327 kB | 16/587 kB Progress (2): 66/327 kB | 33/587 kB Progress (2): 82/327 kB | 33/587 kB Progress (2): 82/327 kB | 49/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 98/327 kB | 64/587 kB Progress (2): 114/327 kB | 64/587 kB Progress (2): 114/327 kB | 81/587 kB Progress (2): 130/327 kB | 81/587 kB Progress (2): 130/327 kB | 97/587 kB Progress (2): 147/327 kB | 97/587 kB Progress (2): 147/327 kB | 113/587 kB Progress (2): 163/327 kB | 113/587 kB Progress (2): 163/327 kB | 130/587 kB Progress (2): 179/327 kB | 130/587 kB Progress (2): 179/327 kB | 146/587 kB Progress (2): 196/327 kB | 146/587 kB Progress (2): 196/327 kB | 163/587 kB Progress (2): 212/327 kB | 163/587 kB Progress (2): 212/327 kB | 179/587 kB Progress (2): 229/327 kB | 179/587 kB Progress (2): 229/327 kB | 195/587 kB Progress (2): 245/327 kB | 195/587 kB Progress (2): 261/327 kB | 195/587 kB Progress (2): 261/327 kB | 212/587 kB Progress (2): 278/327 kB | 212/587 kB Progress (2): 278/327 kB | 228/587 kB Progress (2): 294/327 kB | 228/587 kB Progress (2): 294/327 kB | 244/587 kB Progress (2): 311/327 kB | 244/587 kB Progress (2): 311/327 kB | 261/587 kB Progress (2): 327/327 kB | 261/587 kB Progress (2): 327 kB | 261/587 kB Progress (2): 327 kB | 277/587 kB Progress (2): 327 kB | 294/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 10 MB/s) 2024-09-14T11:12:28.844 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 310/587 kB Progress (1): 326/587 kB Progress (1): 343/587 kB Progress (1): 359/587 kB Progress (1): 376/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 425/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 507/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 556/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 16 MB/s) 2024-09-14T11:12:28.878 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:12:28.878 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:28.879 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:12:28.883 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:12:28.898 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:12:28.900 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:12:28.915 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:12:28.917 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:12:28.931 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:12:28.935 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:12:28.948 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:12:28.952 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:12:28.966 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:12:28.968 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:12:28.982 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 326 kB/s) 2024-09-14T11:12:28.983 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:12:28.997 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:12:29.001 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:12:29.015 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:12:29.017 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:12:29.032 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T11:12:29.034 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:12:29.048 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:12:29.050 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:12:29.064 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-14T11:12:29.067 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:12:29.081 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:12:29.083 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:12:29.097 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:12:29.100 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:12:29.115 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:12:29.117 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:12:29.130 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T11:12:29.132 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:12:29.146 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-14T11:12:29.149 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:12:29.162 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 433 kB/s) 2024-09-14T11:12:29.165 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:12:29.179 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:12:29.182 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:12:29.196 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 59 kB/s) 2024-09-14T11:12:29.197 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:12:29.211 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-14T11:12:29.212 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:12:29.227 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-14T11:12:29.230 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:12:29.243 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:12:29.245 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:12:29.258 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-14T11:12:29.264 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:12:29.277 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T11:12:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:12:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:12:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:12:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:12:29.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:12:29.294 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/122 kB Progress (2): 16/122 kB | 16/55 kB Progress (3): 16/122 kB | 16/55 kB | 16/334 kB Progress (4): 16/122 kB | 16/55 kB | 16/334 kB | 16/27 kB Progress (4): 33/122 kB | 16/55 kB | 16/334 kB | 16/27 kB Progress (5): 33/122 kB | 16/55 kB | 16/334 kB | 16/27 kB | 4.2 kB Progress (5): 33/122 kB | 16/55 kB | 32/334 kB | 16/27 kB | 4.2 kB Progress (5): 33/122 kB | 33/55 kB | 32/334 kB | 16/27 kB | 4.2 kB Progress (5): 49/122 kB | 33/55 kB | 32/334 kB | 16/27 kB | 4.2 kB Progress (5): 49/122 kB | 33/55 kB | 32/334 kB | 27 kB | 4.2 kB Progress (5): 49/122 kB | 33/55 kB | 49/334 kB | 27 kB | 4.2 kB Progress (5): 66/122 kB | 33/55 kB | 49/334 kB | 27 kB | 4.2 kB Progress (5): 66/122 kB | 49/55 kB | 49/334 kB | 27 kB | 4.2 kB Progress (5): 66/122 kB | 55 kB | 49/334 kB | 27 kB | 4.2 kB Progress (5): 82/122 kB | 55 kB | 49/334 kB | 27 kB | 4.2 kB Progress (5): 82/122 kB | 55 kB | 65/334 kB | 27 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-14T11:12:29.294 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-14T11:12:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:12:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:12:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 82/122 kB | 55 kB | 81/334 kB Progress (3): 98/122 kB | 55 kB | 81/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-14T11:12:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:12:29.295 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 98/122 kB | 98/334 kB Progress (2): 115/122 kB | 98/334 kB Progress (2): 115/122 kB | 114/334 kB Progress (2): 122 kB | 114/334 kB Progress (2): 122 kB | 130/334 kB Progress (2): 122 kB | 147/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-14T11:12:29.297 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-14T11:12:29.306 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Progress (2): 4.7 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 172 kB/s) 2024-09-14T11:12:29.307 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 80/267 kB Progress (1): 96/267 kB Progress (2): 96/267 kB | 16/23 kB Progress (2): 96/267 kB | 23 kB Progress (2): 112/267 kB | 23 kB Progress (2): 129/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-14T11:12:29.309 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-14T11:12:29.362 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:12:29.363 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:12:30.034 INFO:tasks.workunit.client.0.smithi029.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:12:30.034 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:30.034 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:30.038 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:12:30.046 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:12:30.268 INFO:tasks.workunit.client.0.smithi029.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:12:30.269 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:30.269 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:12:30.274 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:12:30.288 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:12:30.292 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:12:30.307 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:12:30.312 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:12:30.327 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-14T11:12:30.331 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:12:30.346 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:12:30.350 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:12:30.365 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:12:30.368 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:12:30.383 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-14T11:12:30.387 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:12:30.400 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:12:30.404 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:12:30.419 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-14T11:12:30.420 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:12:30.435 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:12:30.438 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:12:30.452 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:12:30.454 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:12:30.469 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:12:30.472 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:12:30.486 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:12:30.487 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:12:30.501 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-14T11:12:30.503 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:12:30.518 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:12:30.520 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:12:30.533 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:12:30.536 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:12:30.550 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:12:30.552 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:12:30.566 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:12:30.569 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:12:30.583 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:12:30.586 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:12:30.600 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-14T11:12:30.603 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:12:30.617 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:12:30.619 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:12:30.633 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:12:30.634 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:12:30.648 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:12:30.649 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:12:30.663 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-14T11:12:30.665 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:12:30.678 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:12:30.679 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:12:30.693 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T11:12:30.695 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:12:30.709 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:12:30.710 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:12:30.724 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:12:30.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:12:30.738 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:12:30.740 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:12:30.754 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:12:30.756 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:12:30.771 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-14T11:12:30.776 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:12:30.790 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-14T11:12:30.795 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:12:30.809 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T11:12:30.811 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:12:30.825 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:12:30.828 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:12:30.842 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:12:30.844 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:12:30.857 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-14T11:12:30.860 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:12:30.874 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-09-14T11:12:30.876 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:12:30.890 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-14T11:12:30.893 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:12:30.907 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:12:30.909 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:12:30.925 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 925 kB/s) 2024-09-14T11:12:30.928 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:12:30.941 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 58 kB/s) 2024-09-14T11:12:30.943 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:12:30.957 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 370 kB/s) 2024-09-14T11:12:30.959 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:12:30.972 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 609 kB/s) 2024-09-14T11:12:30.975 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:12:30.989 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:12:30.992 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:12:31.006 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:12:31.009 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:12:31.023 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:12:31.025 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:12:31.039 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:12:31.041 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:12:31.055 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:12:31.057 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:12:31.071 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:12:31.073 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:12:31.086 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-14T11:12:31.089 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:12:31.102 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-14T11:12:31.103 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:12:31.117 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-14T11:12:31.118 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:12:31.132 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-14T11:12:31.134 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:12:31.147 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 371 kB/s) 2024-09-14T11:12:31.149 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:12:31.163 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-14T11:12:31.165 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:12:31.180 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-14T11:12:31.182 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:12:31.196 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T11:12:31.199 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:12:31.214 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:12:31.216 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:12:31.229 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 435 kB/s) 2024-09-14T11:12:31.231 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:12:31.245 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T11:12:31.246 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:12:31.260 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-14T11:12:31.261 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:12:31.275 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:12:31.278 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:12:31.291 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T11:12:31.297 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:12:31.316 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-14T11:12:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:12:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:12:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:12:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:12:31.317 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:12:31.333 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/171 kB Progress (1): 33/171 kB Progress (1): 49/171 kB Progress (1): 64/171 kB Progress (1): 81/171 kB Progress (2): 81/171 kB | 14 kB Progress (3): 81/171 kB | 14 kB | 16/26 kB Progress (3): 97/171 kB | 14 kB | 16/26 kB Progress (3): 97/171 kB | 14 kB | 26 kB Progress (4): 97/171 kB | 14 kB | 26 kB | 8.2 kB Progress (5): 97/171 kB | 14 kB | 26 kB | 8.2 kB | 16/118 kB Progress (5): 113/171 kB | 14 kB | 26 kB | 8.2 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-14T11:12:31.334 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:12:31.334 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 113/171 kB | 26 kB | 8.2 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-14T11:12:31.334 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 130/171 kB | 8.2 kB | 33/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 545 kB/s) 2024-09-14T11:12:31.334 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:12:31.334 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:12:31.335 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 130/171 kB | 49/118 kB Progress (2): 146/171 kB | 49/118 kB Progress (2): 146/171 kB | 66/118 kB Progress (2): 163/171 kB | 66/118 kB Progress (2): 163/171 kB | 82/118 kB Progress (2): 171 kB | 82/118 kB Progress (2): 171 kB | 98/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T11:12:31.335 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:12:31.335 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 115/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-14T11:12:31.335 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:12:31.351 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/136 kB Progress (2): 33/146 kB | 16/136 kB Progress (2): 33/146 kB | 33/136 kB Progress (2): 49/146 kB | 33/136 kB Progress (2): 49/146 kB | 49/136 kB Progress (2): 66/146 kB | 49/136 kB Progress (2): 66/146 kB | 65/136 kB Progress (2): 79/146 kB | 65/136 kB Progress (2): 95/146 kB | 65/136 kB Progress (2): 95/146 kB | 81/136 kB Progress (2): 95/146 kB | 98/136 kB Progress (2): 112/146 kB | 98/136 kB Progress (3): 112/146 kB | 98/136 kB | 16/501 kB Progress (4): 112/146 kB | 98/136 kB | 16/501 kB | 11/61 kB Progress (4): 128/146 kB | 98/136 kB | 16/501 kB | 11/61 kB Progress (4): 128/146 kB | 114/136 kB | 16/501 kB | 11/61 kB Progress (4): 128/146 kB | 114/136 kB | 16/501 kB | 21/61 kB Progress (4): 128/146 kB | 114/136 kB | 33/501 kB | 21/61 kB Progress (4): 128/146 kB | 114/136 kB | 33/501 kB | 23/61 kB Progress (5): 128/146 kB | 114/136 kB | 33/501 kB | 23/61 kB | 16/58 kB Progress (5): 128/146 kB | 130/136 kB | 33/501 kB | 23/61 kB | 16/58 kB Progress (5): 144/146 kB | 130/136 kB | 33/501 kB | 23/61 kB | 16/58 kB Progress (5): 146 kB | 130/136 kB | 33/501 kB | 23/61 kB | 16/58 kB Progress (5): 146 kB | 130/136 kB | 49/501 kB | 23/61 kB | 16/58 kB Progress (5): 146 kB | 130/136 kB | 49/501 kB | 23/61 kB | 31/58 kB Progress (5): 146 kB | 130/136 kB | 65/501 kB | 23/61 kB | 31/58 kB Progress (5): 146 kB | 130/136 kB | 65/501 kB | 23/61 kB | 48/58 kB Progress (5): 146 kB | 130/136 kB | 65/501 kB | 26/61 kB | 48/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.6 MB/s) 2024-09-14T11:12:31.351 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:12:31.351 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 130/136 kB | 81/501 kB | 26/61 kB | 48/58 kB Progress (4): 136 kB | 81/501 kB | 26/61 kB | 48/58 kB Progress (4): 136 kB | 81/501 kB | 26/61 kB | 58 kB Progress (4): 136 kB | 81/501 kB | 42/61 kB | 58 kB Progress (4): 136 kB | 97/501 kB | 42/61 kB | 58 kB Progress (4): 136 kB | 97/501 kB | 47/61 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-14T11:12:31.351 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 114/501 kB | 47/61 kB | 58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:12:31.351 INFO:tasks.workunit.client.0.smithi029.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-14T11:12:31.352 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 130/501 kB | 47/61 kB Progress (2): 130/501 kB | 61 kB Progress (2): 147/501 kB | 61 kB Progress (2): 163/501 kB | 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-14T11:12:31.357 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 179/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 261/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:12:31.365 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 49/124 kB | 0/2.4 MB Progress (2): 65/124 kB | 0/2.4 MB Progress (2): 65/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0/2.4 MB Progress (2): 82/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 98/124 kB | 0.1/2.4 MB Progress (2): 114/124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Progress (2): 124 kB | 0.1/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-14T11:12:31.401 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 29 MB/s) 2024-09-14T11:12:31.486 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:31.486 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:12:31.489 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:12:31.504 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-14T11:12:31.506 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:12:31.520 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:12:31.522 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:12:31.536 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.2 MB/s) 2024-09-14T11:12:31.539 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:12:31.553 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:12:31.556 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:12:31.571 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-14T11:12:31.574 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:12:31.588 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T11:12:31.591 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:12:31.605 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:12:31.607 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:12:31.621 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 482 kB/s) 2024-09-14T11:12:31.623 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:12:31.636 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.5 MB/s) 2024-09-14T11:12:31.640 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:12:31.655 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 969 kB/s) 2024-09-14T11:12:31.657 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:12:31.670 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 157 kB/s) 2024-09-14T11:12:31.673 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:12:31.686 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:12:31.688 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:12:31.703 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-14T11:12:31.709 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:12:31.724 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:12:31.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:12:31.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:12:31.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:12:31.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:12:31.725 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:12:31.739 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (3): 16/26 kB | 16/79 kB | 16/211 kB Progress (4): 16/26 kB | 16/79 kB | 16/211 kB | 16/58 kB Progress (4): 26 kB | 16/79 kB | 16/211 kB | 16/58 kB Progress (4): 26 kB | 33/79 kB | 16/211 kB | 16/58 kB Progress (5): 26 kB | 33/79 kB | 16/211 kB | 16/58 kB | 0/1.0 MB Progress (5): 26 kB | 33/79 kB | 33/211 kB | 16/58 kB | 0/1.0 MB Progress (5): 26 kB | 33/79 kB | 33/211 kB | 33/58 kB | 0/1.0 MB Progress (5): 26 kB | 49/79 kB | 33/211 kB | 33/58 kB | 0/1.0 MB Progress (5): 26 kB | 49/79 kB | 33/211 kB | 33/58 kB | 0/1.0 MB Progress (5): 26 kB | 49/79 kB | 49/211 kB | 33/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-14T11:12:31.740 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:12:31.741 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (4): 49/79 kB | 49/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 49/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 49/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 66/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 66/79 kB | 66/211 kB | 49/58 kB | 0.1/1.0 MB Progress (4): 66/79 kB | 66/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 66/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 79/211 kB | 58 kB | 0.1/1.0 MB Progress (4): 79 kB | 95/211 kB | 58 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-14T11:12:31.741 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:12:31.741 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 79 kB | 95/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 112/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 112/211 kB | 0.1/1.0 MB Progress (3): 79 kB | 128/211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-14T11:12:31.744 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 210/211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-14T11:12:31.759 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 16/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 33/116 kB Progress (2): 0.6/1.0 MB | 49/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 66/116 kB Progress (2): 0.6/1.0 MB | 82/116 kB Progress (2): 0.6/1.0 MB | 95/116 kB Progress (2): 0.7/1.0 MB | 95/116 kB Progress (3): 0.7/1.0 MB | 95/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 111/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 111/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.7/1.0 MB | 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-14T11:12:31.759 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 0.7/1.0 MB | 49/267 kB Progress (2): 0.7/1.0 MB | 66/267 kB Progress (2): 0.7/1.0 MB | 79/267 kB Progress (2): 0.7/1.0 MB | 79/267 kB Progress (2): 0.7/1.0 MB | 96/267 kB Progress (2): 0.7/1.0 MB | 96/267 kB Progress (2): 0.7/1.0 MB | 112/267 kB Progress (2): 0.7/1.0 MB | 128/267 kB Progress (2): 0.8/1.0 MB | 128/267 kB Progress (2): 0.8/1.0 MB | 145/267 kB Progress (2): 0.8/1.0 MB | 145/267 kB Progress (2): 0.8/1.0 MB | 161/267 kB Progress (2): 0.8/1.0 MB | 161/267 kB Progress (2): 0.8/1.0 MB | 178/267 kB Progress (2): 0.8/1.0 MB | 194/267 kB Progress (2): 0.8/1.0 MB | 194/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 210/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 227/267 kB Progress (2): 0.8/1.0 MB | 243/267 kB Progress (2): 0.8/1.0 MB | 260/267 kB Progress (2): 0.8/1.0 MB | 260/267 kB Progress (2): 0.8/1.0 MB | 267 kB Progress (2): 0.9/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.9 MB/s) 2024-09-14T11:12:31.762 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 27 MB/s) 2024-09-14T11:12:31.887 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:12:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:12:31.925 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:12:31.926 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:12:31.926 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Total time: 5.814 s 2024-09-14T11:12:31.926 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Finished at: 2024-09-14T11:12:31Z 2024-09-14T11:12:31.926 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:12:31.939 INFO:tasks.workunit.client.0.smithi029.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:12:31.948 INFO:tasks.workunit.client.0.smithi029.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:12:32.944 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Scanning for projects... 2024-09-14T11:12:33.020 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.021 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:12:33.021 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:12:33.021 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] from pom.xml 2024-09-14T11:12:33.021 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:12:33.276 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.276 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:12:33.375 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:12:33.376 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.376 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:12:33.503 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:12:33.503 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.503 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:12:33.506 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:12:33.506 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.506 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:12:33.512 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:12:33.513 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:33.513 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:12:33.716 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:12:33.908 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:12:34.095 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:12:34.104 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:12:34.121 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T11:12:34.127 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:12:34.144 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:12:34.148 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:12:34.165 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:12:34.167 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:12:34.183 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:12:34.185 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:12:34.206 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 80 kB/s) 2024-09-14T11:12:34.209 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:12:34.226 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-14T11:12:34.231 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:12:34.255 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-14T11:12:34.256 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:12:34.257 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:12:34.257 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:12:34.258 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:12:34.258 INFO:tasks.workunit.client.0.smithi029.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:12:34.277 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 798 kB/s) 2024-09-14T11:12:34.313 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 1.4/169 kB Progress (2): 1.4/169 kB | 1.4/189 kB Progress (3): 1.4/169 kB | 1.4/189 kB | 1.4/7.7 kB Progress (3): 2.8/169 kB | 1.4/189 kB | 1.4/7.7 kB Progress (3): 2.8/169 kB | 2.8/189 kB | 1.4/7.7 kB Progress (4): 2.8/169 kB | 2.8/189 kB | 1.4/7.7 kB | 16/103 kB Progress (4): 4.1/169 kB | 2.8/189 kB | 1.4/7.7 kB | 16/103 kB Progress (4): 4.1/169 kB | 2.8/189 kB | 2.8/7.7 kB | 16/103 kB Progress (4): 5.5/169 kB | 2.8/189 kB | 2.8/7.7 kB | 16/103 kB Progress (4): 5.5/169 kB | 4.1/189 kB | 2.8/7.7 kB | 16/103 kB Progress (4): 6.9/169 kB | 4.1/189 kB | 2.8/7.7 kB | 16/103 kB Progress (4): 6.9/169 kB | 4.1/189 kB | 4.1/7.7 kB | 16/103 kB Progress (4): 8.3/169 kB | 4.1/189 kB | 4.1/7.7 kB | 16/103 kB Progress (4): 8.3/169 kB | 5.5/189 kB | 4.1/7.7 kB | 16/103 kB Progress (4): 9.7/169 kB | 5.5/189 kB | 4.1/7.7 kB | 16/103 kB Progress (4): 9.7/169 kB | 5.5/189 kB | 5.5/7.7 kB | 16/103 kB Progress (4): 11/169 kB | 5.5/189 kB | 5.5/7.7 kB | 16/103 kB Progress (4): 11/169 kB | 6.9/189 kB | 5.5/7.7 kB | 16/103 kB Progress (4): 12/169 kB | 6.9/189 kB | 5.5/7.7 kB | 16/103 kB Progress (4): 12/169 kB | 6.9/189 kB | 6.9/7.7 kB | 16/103 kB Progress (4): 14/169 kB | 6.9/189 kB | 6.9/7.7 kB | 16/103 kB Progress (4): 14/169 kB | 8.3/189 kB | 6.9/7.7 kB | 16/103 kB Progress (4): 15/169 kB | 8.3/189 kB | 6.9/7.7 kB | 16/103 kB Progress (4): 15/169 kB | 8.3/189 kB | 7.7 kB | 16/103 kB Progress (4): 16/169 kB | 8.3/189 kB | 7.7 kB | 16/103 kB Progress (4): 16/169 kB | 9.7/189 kB | 7.7 kB | 16/103 kB Progress (4): 16/169 kB | 11/189 kB | 7.7 kB | 16/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-14T11:12:34.329 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (3): 16/169 kB | 12/189 kB | 16/103 kB Progress (3): 16/169 kB | 14/189 kB | 16/103 kB Progress (3): 16/169 kB | 15/189 kB | 16/103 kB Progress (3): 16/169 kB | 16/189 kB | 16/103 kB Progress (3): 16/169 kB | 16/189 kB | 33/103 kB Progress (3): 16/169 kB | 18/189 kB | 33/103 kB Progress (3): 16/169 kB | 19/189 kB | 33/103 kB Progress (3): 16/169 kB | 21/189 kB | 33/103 kB Progress (3): 33/169 kB | 21/189 kB | 33/103 kB Progress (3): 33/169 kB | 21/189 kB | 49/103 kB Progress (3): 33/169 kB | 22/189 kB | 49/103 kB Progress (3): 33/169 kB | 23/189 kB | 49/103 kB Progress (3): 33/169 kB | 25/189 kB | 49/103 kB Progress (3): 49/169 kB | 25/189 kB | 49/103 kB Progress (3): 49/169 kB | 26/189 kB | 49/103 kB Progress (3): 49/169 kB | 27/189 kB | 49/103 kB Progress (3): 49/169 kB | 29/189 kB | 49/103 kB Progress (3): 49/169 kB | 30/189 kB | 49/103 kB Progress (3): 49/169 kB | 32/189 kB | 49/103 kB Progress (3): 49/169 kB | 33/189 kB | 49/103 kB Progress (3): 49/169 kB | 34/189 kB | 49/103 kB Progress (3): 49/169 kB | 36/189 kB | 49/103 kB Progress (3): 49/169 kB | 37/189 kB | 49/103 kB Progress (3): 49/169 kB | 38/189 kB | 49/103 kB Progress (3): 49/169 kB | 40/189 kB | 49/103 kB Progress (3): 49/169 kB | 41/189 kB | 49/103 kB Progress (3): 49/169 kB | 43/189 kB | 49/103 kB Progress (3): 49/169 kB | 44/189 kB | 49/103 kB Progress (3): 49/169 kB | 45/189 kB | 49/103 kB Progress (3): 49/169 kB | 47/189 kB | 49/103 kB Progress (3): 49/169 kB | 48/189 kB | 49/103 kB Progress (3): 49/169 kB | 49/189 kB | 49/103 kB Progress (3): 49/169 kB | 51/189 kB | 49/103 kB Progress (3): 49/169 kB | 52/189 kB | 49/103 kB Progress (3): 49/169 kB | 54/189 kB | 49/103 kB Progress (3): 49/169 kB | 55/189 kB | 49/103 kB Progress (3): 49/169 kB | 56/189 kB | 49/103 kB Progress (3): 49/169 kB | 58/189 kB | 49/103 kB Progress (3): 49/169 kB | 58/189 kB | 66/103 kB Progress (3): 49/169 kB | 59/189 kB | 66/103 kB Progress (3): 49/169 kB | 61/189 kB | 66/103 kB Progress (3): 49/169 kB | 62/189 kB | 66/103 kB Progress (3): 66/169 kB | 62/189 kB | 66/103 kB Progress (3): 66/169 kB | 62/189 kB | 82/103 kB Progress (3): 66/169 kB | 63/189 kB | 82/103 kB Progress (3): 78/169 kB | 63/189 kB | 82/103 kB Progress (3): 78/169 kB | 63/189 kB | 98/103 kB Progress (3): 78/169 kB | 79/189 kB | 98/103 kB Progress (3): 78/169 kB | 79/189 kB | 103 kB Progress (3): 94/169 kB | 79/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.4 MB/s) 2024-09-14T11:12:34.340 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (2): 111/169 kB | 79/189 kB Progress (2): 127/169 kB | 79/189 kB Progress (2): 143/169 kB | 79/189 kB Progress (2): 143/169 kB | 96/189 kB Progress (2): 160/169 kB | 96/189 kB Progress (2): 169 kB | 96/189 kB Progress (2): 169 kB | 112/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 2.0 MB/s) 2024-09-14T11:12:34.351 INFO:tasks.workunit.client.0.smithi029.stdout:Progress (1): 128/189 kB Progress (1): 145/189 kB Progress (1): 161/189 kB Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.0 MB/s) 2024-09-14T11:12:34.366 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:12:34.366 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:12:34.366 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] T E S T S 2024-09-14T11:12:34.366 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:12:34.806 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:12:34.940 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjects.java: starting test run: 2024-09-14T11:12:34.940 INFO:tasks.workunit.client.0.smithi029.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:12:34.941 INFO:tasks.workunit.client.0.smithi029.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:12:34.941 INFO:tasks.workunit.client.0.smithi029.stdout: EndpointUrl=http://smithi029.front.sepia.ceph.com:80 2024-09-14T11:12:34.941 INFO:tasks.workunit.client.0.smithi029.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:12:35.038 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Environment Variables Read 2024-09-14T11:12:35.339 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:12:35.339 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.339 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.339 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.439 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.439 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generating File 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: File Generated 2024-09-14T11:12:35.440 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Generated Big Files 2024-09-14T11:12:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:HeadBucketResponse() 2024-09-14T11:12:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:sheik is ready 2024-09-14T11:12:35.697 INFO:tasks.workunit.client.0.smithi029.stdout:DEBUG: Test Bucket Created 2024-09-14T11:12:35.739 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:12:35.939 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:12:36.039 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:12:36.240 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:12:36.340 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:12:36.440 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:12:36.741 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:12:36.841 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:12:37.141 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:12:37.642 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:12:40.547 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:12:42.850 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:13:00.978 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-0b 2024-09-14T11:13:00.979 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-8b 2024-09-14T11:13:00.980 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-200b 2024-09-14T11:13:00.981 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-21983b 2024-09-14T11:13:00.985 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-5519b 2024-09-14T11:13:00.985 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-204329b 2024-09-14T11:13:00.985 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-256k 2024-09-14T11:13:00.985 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-1m 2024-09-14T11:13:00.986 INFO:tasks.workunit.client.0.smithi029.stdout:arg: file-1038757b 2024-09-14T11:13:01.074 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:13:01.132 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.174 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:13:01.258 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.274 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:13:01.374 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.475 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:13:01.575 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.675 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:13:01.675 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.775 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:13:01.875 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:01.975 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:13:02.034 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:02.075 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:13:02.476 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:02.576 INFO:tasks.workunit.client.0.smithi029.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:13:02.876 INFO:tasks.workunit.client.0.smithi029.stdout:PutObjectResponse 2024-09-14T11:13:02.977 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:13:05.479 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:13:07.982 INFO:tasks.workunit.client.0.smithi029.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:13:36.563 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 61.74 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:13:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:13:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Results: 2024-09-14T11:13:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:13:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:13:36.574 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] 2024-09-14T11:13:36.575 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:13:36.575 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:13:36.575 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:13:36.576 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Total time: 01:03 min 2024-09-14T11:13:36.576 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] Finished at: 2024-09-14T11:13:36Z 2024-09-14T11:13:36.576 INFO:tasks.workunit.client.0.smithi029.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:13:36.588 INFO:tasks.workunit.client.0.smithi029.stderr:+ exit 2024-09-14T11:13:36.589 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:13:36.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:13:36.668 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:13:36.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:13:37.074 DEBUG:teuthology.parallel:result is None 2024-09-14T11:13:37.074 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:37.113 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:37.113 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:37.182 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:13:37.182 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:13:37.193 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:37.193 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:13:37.193 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:37.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:13:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:13:37.253 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:37.322 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:13:37.322 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:13:37.391 INFO:tasks.workunit:timeout=3h 2024-09-14T11:13:37.392 INFO:tasks.workunit:cleanup=True 2024-09-14T11:13:37.392 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:13:37.462 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:14:34.492 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 94% (12143/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:14:34.948 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:14:34.949 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:14:35.019 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:14:35.021 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:35.021 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:14:35.070 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:14:35.120 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:14:35.160 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:14:35.162 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:35.162 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:14:35.202 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:14:35.206 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:14:35.206 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:14:35.276 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:14:35.277 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:14:35.277 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:14:35.352 INFO:tasks.workunit.client.0.smithi029.stdout:INFO: fully qualified domain name: smithi029.front.sepia.ceph.com 2024-09-14T11:14:35.352 INFO:tasks.workunit.client.0.smithi029.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:14:35.352 INFO:tasks.workunit.client.0.smithi029.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-14T11:14:38.064 INFO:tasks.workunit.client.0.smithi029.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:14:38.251 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting pip 2024-09-14T11:14:38.257 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:14:38.304 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: pip 2024-09-14T11:14:38.304 INFO:tasks.workunit.client.0.smithi029.stdout: Attempting uninstall: pip 2024-09-14T11:14:38.304 INFO:tasks.workunit.client.0.smithi029.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:14:38.473 INFO:tasks.workunit.client.0.smithi029.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:14:38.478 INFO:tasks.workunit.client.0.smithi029.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:14:39.270 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed pip-24.2 2024-09-14T11:14:40.124 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting boto3 2024-09-14T11:14:40.126 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:14:40.680 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:14:40.681 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:14:40.725 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:14:40.727 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:14:40.780 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:14:40.782 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:14:40.832 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:40.834 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:14:40.913 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:40.914 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:14:41.082 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:14:41.083 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:14:41.088 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:14:41.089 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:14:41.098 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:14:41.099 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:14:41.101 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:14:41.102 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:14:41.103 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:14:41.181 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:14:42.290 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:14:42.940 INFO:tasks.workunit.client.0.smithi029.stdout:INFO: creating user 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout:{ 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout: "user_id": "testid", 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout: "display_name": "M. Tester", 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout: "email": "tester@ceph.com", 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout: "suspended": 0, 2024-09-14T11:14:43.059 INFO:tasks.workunit.client.0.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "subusers": [], 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "keys": [ 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: { 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "user": "testid", 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "active": true, 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:14:43.053003Z" 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: } 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: ], 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "swift_keys": [], 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "caps": [], 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:14:43.060 INFO:tasks.workunit.client.0.smithi029.stdout: "default_placement": "", 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "placement_tags": [], 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "bucket_quota": { 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "user_quota": { 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "enabled": false, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:43.061 INFO:tasks.workunit.client.0.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: }, 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "type": "rgw", 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "account_id": "", 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "path": "/", 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "create_date": "2024-09-14T11:14:43.052986Z", 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "tags": [], 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: "group_ids": [] 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout:} 2024-09-14T11:14:43.062 INFO:tasks.workunit.client.0.smithi029.stdout: 2024-09-14T11:14:43.355 INFO:tasks.workunit.client.0.smithi029.stderr:5+0 records in 2024-09-14T11:14:43.355 INFO:tasks.workunit.client.0.smithi029.stderr:5+0 records out 2024-09-14T11:14:43.355 INFO:tasks.workunit.client.0.smithi029.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142119 s, 369 MB/s 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:bucket nams is reupload-bkt-105982 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:endpoint is http://smithi029.front.sepia.ceph.com:80 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:start UploadId=2~9NoMjEFS5QMmUrn-d-uHJ8UIm0y7sKy 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 1 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 1 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 2} 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.714 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:phase 2 uploaded part {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1} 2024-09-14T11:14:52.715 INFO:tasks.workunit.client.0.smithi029.stdout:aborting multipart upload, parts=[{'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 1}, {'ETag': '"97c733b3f5b2cf33918d67a0d02c7deb"', 'PartNumber': 2}] 2024-09-14T11:14:54.603 INFO:tasks.workunit.client.0.smithi029.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:14:54.666 INFO:tasks.workunit.client.0.smithi029.stdout:rados ls: 2024-09-14T11:14:54.670 INFO:tasks.workunit.client.0.smithi029.stdout:== PASSED == 2024-09-14T11:14:54.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:14:54.670 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:14:54.750 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:14:54.750 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:14:55.163 DEBUG:teuthology.parallel:result is None 2024-09-14T11:14:55.164 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:55.204 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:55.204 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:14:55.275 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:14:55.275 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:14:55.292 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:14:55.292 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:14:55.292 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:14:55.292 DEBUG:teuthology.orchestra.run.smithi029:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:14:55.344 INFO:teuthology.orchestra.run.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:14:55.374 INFO:teuthology.orchestra.run.smithi029.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:14:55.375 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:14:55.376 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:14:55.377 DEBUG:teuthology.orchestra.run.smithi029:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:14:55.447 INFO:teuthology.orchestra.run.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:14:55.641 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:14:55.642 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:14:55.642 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key JQOXXIJICKAMALTAZGZV --secret fD1RQ0vXY7Lp2EOromAWAlaAkDbxPHWGPrbI8l8fK3XflcnOaXYMMw== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:14:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:55.751 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:55.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.791+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.792+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.792+0000 7fdbcef19800 20 realm 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.792+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.793+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.793+0000 7fdbcef19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.793+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:55.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.793+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:55.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.793+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:55.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.794+0000 7fdbcef19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:55.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.794+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:55.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.795+0000 7fdbcef19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:55.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.795+0000 7fdbcef19800 20 searching for the correct realm 2024-09-14T11:14:55.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:55.797+0000 7fdbcd204640 0 -- 172.21.15.29:0/3020724586 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fdbc4061040 msgr2=0x7fdbc407c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:56.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.003+0000 7fdbcc202640 0 -- 172.21.15.29:0/3020724586 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fdbc409aaa0 msgr2=0x7fdbc4055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:56.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.209+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:56.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 zone default found 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 4 Realm: () 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:56.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 zonegroup default 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.210+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 started sync module instance, tier type = 2024-09-14T11:14:56.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.211+0000 7fdbcef19800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=0 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=1 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=2 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=3 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=4 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=5 2024-09-14T11:14:56.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.221+0000 7fdbcef19800 20 add_watcher() i=6 2024-09-14T11:14:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.222+0000 7fdbcef19800 20 add_watcher() i=7 2024-09-14T11:14:56.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.222+0000 7fdbcef19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:56.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fda82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fdbcef19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fdbcef19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fdbcef19800 5 note: GC not initialized 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fda81fe3640 20 reqs_thread_entry: start 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fdbcef19800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.224+0000 7fdbcef19800 20 Filter name: none 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fd9f37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:14:56.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 10 cache get: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV : miss 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.225+0000 7fdbcef19800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.226+0000 7fdbcef19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.226+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV info.flags=0x0 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.226+0000 7fdbcef19800 10 adding default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV to cache LRU end 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.226+0000 7fdbcef19800 10 cache get: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV : hit (negative entry) 2024-09-14T11:14:56.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.226+0000 7fdbcef19800 10 cache get: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV : hit (negative entry) 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdbcef19800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdbcef19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdaa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758616 cookie 94890812747104 notifier 5633 bl.length()=675 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdaa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:14:56.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.227+0000 7fdaa3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdbcef19800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdbcef19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdaa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758602 cookie 94890812740752 notifier 5633 bl.length()=202 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdaa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:14:56.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.231+0000 7fdaa3fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdbcef19800 10 cache put: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV info.flags=0x7 2024-09-14T11:14:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdbcef19800 10 moving default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV to cache LRU end 2024-09-14T11:14:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdbcef19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:JQOXXIJICKAMALTAZGZV, ofs0, ns] 2024-09-14T11:14:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdaa3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758603 cookie 94890812740752 notifier 5633 bl.length()=190 2024-09-14T11:14:56.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdaa3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV info.flags=0x7 2024-09-14T11:14:56.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.234+0000 7fdaa3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JQOXXIJICKAMALTAZGZV to cache LRU end 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "ragweed.client.0", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "JQOXXIJICKAMALTAZGZV", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "fD1RQ0vXY7Lp2EOromAWAlaAkDbxPHWGPrbI8l8fK3XflcnOaXYMMw==", 2024-09-14T11:14:56.235 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:14:56.227859Z" 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:56.236 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:14:56.237 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:14:56.227846Z", 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.237+0000 7fda82fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.239+0000 7fdbcef19800 20 remove_watcher() i=0 2024-09-14T11:14:56.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.239+0000 7fdbcef19800 2 removed watcher, disabling cache 2024-09-14T11:14:56.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.241+0000 7fdbcef19800 20 remove_watcher() i=1 2024-09-14T11:14:56.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.242+0000 7fdbcef19800 20 remove_watcher() i=2 2024-09-14T11:14:56.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.243+0000 7fdbcef19800 20 remove_watcher() i=3 2024-09-14T11:14:56.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.244+0000 7fdbcef19800 20 remove_watcher() i=4 2024-09-14T11:14:56.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.245+0000 7fdbcef19800 20 remove_watcher() i=5 2024-09-14T11:14:56.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.246+0000 7fdbcef19800 20 remove_watcher() i=6 2024-09-14T11:14:56.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.247+0000 7fdbcef19800 20 remove_watcher() i=7 2024-09-14T11:14:56.258 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:14:56.258 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key YCDLLWNYYDUVGLFGYKFK --secret UY4btNi4Xukg75OAHnMbbisKrmiPZMZFXRrdJz3g3L4fRUfkdzpt+w== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:14:56.327 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:56.327 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:56.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.364+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.365+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.365+0000 7fb73312e800 20 realm 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.365+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.366+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.366+0000 7fb73312e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.366+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.366+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.366+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.367+0000 7fb73312e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:56.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.367+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.367+0000 7fb73312e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:56.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.367+0000 7fb73312e800 20 searching for the correct realm 2024-09-14T11:14:56.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.369+0000 7fb72f6de640 0 -- 172.21.15.29:0/2473027788 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x560435b0ea90 msgr2=0x560435b10e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:56.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.373+0000 7fb72f6de640 0 -- 172.21.15.29:0/2473027788 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7fb5f8085c90 msgr2=0x7fb5f80880c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:56.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:56.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:56.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:56.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 zone default found 2024-09-14T11:14:56.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 4 Realm: () 2024-09-14T11:14:56.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 zonegroup default 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.379+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 started sync module instance, tier type = 2024-09-14T11:14:56.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.380+0000 7fb73312e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:14:56.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=0 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=1 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=2 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=3 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=4 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=5 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.389+0000 7fb73312e800 20 add_watcher() i=6 2024-09-14T11:14:56.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.390+0000 7fb73312e800 20 add_watcher() i=7 2024-09-14T11:14:56.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.390+0000 7fb73312e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb5e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb73312e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb73312e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb73312e800 5 note: GC not initialized 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb55ffff640 20 reqs_thread_entry: start 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb73312e800 20 init_complete bucket index max shards: 11 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb73312e800 20 Filter name: none 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.392+0000 7fb55dffb640 20 reqs_thread_entry: start 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:14:56.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:14:56.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:14:56.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:14:56.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache get: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK : miss 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK info.flags=0x0 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 adding default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK to cache LRU end 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache get: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK : hit (negative entry) 2024-09-14T11:14:56.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.393+0000 7fb73312e800 10 cache get: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK : hit (negative entry) 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb73312e800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb73312e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb6127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758604 cookie 94576080682144 notifier 5907 bl.length()=675 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb6127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:14:56.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.395+0000 7fb6127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:14:56.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:14:56.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb73312e800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb73312e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:14:56.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb6127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758617 cookie 94576080688928 notifier 5907 bl.length()=202 2024-09-14T11:14:56.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb6127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:14:56.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.398+0000 7fb6127fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:14:56.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb73312e800 10 cache put: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK info.flags=0x7 2024-09-14T11:14:56.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb73312e800 10 moving default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK to cache LRU end 2024-09-14T11:14:56.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb73312e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:YCDLLWNYYDUVGLFGYKFK, ofs0, ns] 2024-09-14T11:14:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb6127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1082331758605 cookie 94576080682144 notifier 5907 bl.length()=190 2024-09-14T11:14:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb6127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK info.flags=0x7 2024-09-14T11:14:56.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.401+0000 7fb6127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YCDLLWNYYDUVGLFGYKFK to cache LRU end 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:14:56.402 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "sysuser.client.0", 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "YCDLLWNYYDUVGLFGYKFK", 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "UY4btNi4Xukg75OAHnMbbisKrmiPZMZFXRrdJz3g3L4fRUfkdzpt+w==", 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:14:56.395684Z" 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "system": true, 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:14:56.403 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:14:56.404 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:14:56.395672Z", 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:14:56.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.404+0000 7fb5e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:56.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.407+0000 7fb73312e800 20 remove_watcher() i=0 2024-09-14T11:14:56.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.407+0000 7fb73312e800 2 removed watcher, disabling cache 2024-09-14T11:14:56.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.408+0000 7fb73312e800 20 remove_watcher() i=1 2024-09-14T11:14:56.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.409+0000 7fb73312e800 20 remove_watcher() i=2 2024-09-14T11:14:56.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.410+0000 7fb73312e800 20 remove_watcher() i=3 2024-09-14T11:14:56.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.411+0000 7fb73312e800 20 remove_watcher() i=4 2024-09-14T11:14:56.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.412+0000 7fb73312e800 20 remove_watcher() i=5 2024-09-14T11:14:56.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.413+0000 7fb73312e800 20 remove_watcher() i=6 2024-09-14T11:14:56.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:14:56.414+0000 7fb73312e800 20 remove_watcher() i=7 2024-09-14T11:14:56.424 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:14:56.424 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:14:56.424 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:14:56.453 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:14:56.454 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:14:56.454 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:14:56.523 DEBUG:teuthology.orchestra.run.smithi029:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:14:56.714 INFO:teuthology.orchestra.run.smithi029.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:14:56.889 INFO:teuthology.orchestra.run.smithi029.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:14:57.525 INFO:teuthology.orchestra.run.smithi029.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:15:04.550 INFO:teuthology.orchestra.run.smithi029.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:15:08.138 INFO:teuthology.orchestra.run.smithi029.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=2e7576b24865be593aac1de37200dd7a89ecd8285a50d7acc2e9f934ebbde39b,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:15:08.138 INFO:teuthology.orchestra.run.smithi029.stdout:py run-test-pre: PYTHONHASHSEED='3309407744' 2024-09-14T11:15:08.138 INFO:teuthology.orchestra.run.smithi029.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:15:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:============================= test session starts ============================== 2024-09-14T11:15:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:15:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:15:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:15:08.354 INFO:teuthology.orchestra.run.smithi029.stdout:configfile: pytest.ini 2024-09-14T11:15:08.464 INFO:teuthology.orchestra.run.smithi029.stdout:collecting ... collected 9 items 2024-09-14T11:15:08.464 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:15:10.810 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:15:13.266 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:15:15.219 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:15:17.781 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:15:20.332 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:15:28.892 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:15:33.690 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:15:38.581 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:15:48.453 INFO:teuthology.orchestra.run.smithi029.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:15:48.453 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:15:48.453 INFO:teuthology.orchestra.run.smithi029.stdout:=============================== warnings summary =============================== 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout: import imp 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:15:48.454 INFO:teuthology.orchestra.run.smithi029.stdout:======================== 9 passed, 1 warning in 40.10s ========================= 2024-09-14T11:15:48.484 INFO:teuthology.orchestra.run.smithi029.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:15:48.484 INFO:teuthology.orchestra.run.smithi029.stdout: py: commands succeeded 2024-09-14T11:15:48.484 INFO:teuthology.orchestra.run.smithi029.stdout: congratulations :) 2024-09-14T11:15:48.503 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:15:48.503 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:15:48.533 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:15:48.632 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:48.632 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:48.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.669+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:48.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:48.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 realm 2024-09-14T11:15:48.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:48.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.671+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.672+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:48.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.672+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:48.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.673+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:48.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.673+0000 7f52a7da9800 20 searching for the correct realm 2024-09-14T11:15:48.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.675+0000 7f52a6094640 0 -- 172.21.15.29:0/3461912215 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f52a0084bb0 msgr2=0x7f52a0061360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:48.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:48.881+0000 7f52a5092640 0 -- 172.21.15.29:0/3461912215 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f52a0063910 msgr2=0x7f52a007c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:15:49.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.088+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 zone default found 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 4 Realm: () 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 zonegroup default 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.089+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.090+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.090+0000 7f52a7da9800 20 started sync module instance, tier type = 2024-09-14T11:15:49.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.090+0000 7f52a7da9800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:15:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=0 2024-09-14T11:15:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=1 2024-09-14T11:15:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=2 2024-09-14T11:15:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=3 2024-09-14T11:15:49.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=4 2024-09-14T11:15:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=5 2024-09-14T11:15:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.100+0000 7f52a7da9800 20 add_watcher() i=6 2024-09-14T11:15:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.101+0000 7f52a7da9800 20 add_watcher() i=7 2024-09-14T11:15:49.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.101+0000 7f52a7da9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.103+0000 7f51577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.103+0000 7f52a7da9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:49.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.103+0000 7f52a7da9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:49.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f51567fc640 20 reqs_thread_entry: start 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f52a7da9800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f52a7da9800 20 Filter name: none 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f50c7fff640 20 reqs_thread_entry: start 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.142+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.143+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:15:49.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.143+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.143+0000 7f52a7da9800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.143+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5 : miss 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5 info.flags=0x17 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5 to cache LRU end 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.144+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5 2024-09-14T11:15:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.145+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:15:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.145+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:15:49.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.145+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:15:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.146+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:15:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.146+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:15:49.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.146+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:15:49.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.147+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:15:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.147+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:15:49.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.148+0000 7f52a7da9800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:15:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a0074040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5568c7e9a738 s->prefetch_data=0 2024-09-14T11:15:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 10 manifest: total_size = 7799 2024-09-14T11:15:49.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.15342372364609467885 2024-09-14T11:15:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a0074040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x5568c7e9a738 s->prefetch_data=0 2024-09-14T11:15:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a738 2024-09-14T11:15:49.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.149+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.1 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=7799 stripe_ofs=7799 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15342372364609467885 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.opz-nUpLSp3exuIO1wole_gMTgpL9PV_0 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.152+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15342372364609467885 2024-09-14T11:15:49.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.153+0000 7f51897fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:15:49.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.153+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a0074040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5568c7e9a1e8 s->prefetch_data=0 2024-09-14T11:15:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.154+0000 7f52a7da9800 10 manifest: total_size = 12812 2024-09-14T11:15:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.154+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.2793629875307540804 2024-09-14T11:15:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.154+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a0074040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x5568c7e9a1e8 s->prefetch_data=0 2024-09-14T11:15:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.154+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a1e8 2024-09-14T11:15:49.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.154+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.2 2024-09-14T11:15:49.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=12812 stripe_ofs=12812 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2793629875307540804 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.W1fDKuBxXHSRQqyurtlZHF2hqfk-FFm_0 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.156+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2793629875307540804 2024-09-14T11:15:49.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9c4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5568c7e9a1e8 s->prefetch_data=0 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 10 manifest: total_size = 5257 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.14262609321459975233 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9c4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x5568c7e9a1e8 s->prefetch_data=0 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a1e8 2024-09-14T11:15:49.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.158+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.2 2024-09-14T11:15:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5257 stripe_ofs=5257 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14262609321459975233 2024-09-14T11:15:49.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.RvakpKX2RE_Zm1JzyuiUEsSwM3uMnqK_0 2024-09-14T11:15:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.161+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14262609321459975233 2024-09-14T11:15:49.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.162+0000 7f51897fa640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:15:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b6b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 10 manifest: total_size = 13087 2024-09-14T11:15:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.9122147305171069131 2024-09-14T11:15:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b6b0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.164+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.3 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=13087 stripe_ofs=13087 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9122147305171069131 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.ElJs2nfmjdtUTdZ7qQ_AzC0JZmCjwko_0 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.167+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9122147305171069131 2024-09-14T11:15:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.168+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:15:49.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.168+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.169+0000 7f52a7da9800 10 manifest: total_size = 7657 2024-09-14T11:15:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.169+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.4979055716873992486 2024-09-14T11:15:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.169+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.169+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.169+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.4 2024-09-14T11:15:49.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=7657 stripe_ofs=7657 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4979055716873992486 2024-09-14T11:15:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.6Ye0FLjDduB9tBwG7JuJ_5erCcGgr7a_0 2024-09-14T11:15:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.171+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4979055716873992486 2024-09-14T11:15:49.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f51897fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:15:49.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e23dc0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 10 manifest: total_size = 4947 2024-09-14T11:15:49.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.441545903855536585 2024-09-14T11:15:49.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e23dc0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.173+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.4 2024-09-14T11:15:49.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4947 stripe_ofs=4947 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.441545903855536585 2024-09-14T11:15:49.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.AIYUsB-xK6BmxsnfHyfZZI21WVoLy5E_0 2024-09-14T11:15:49.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:15:49.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.176+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.441545903855536585 2024-09-14T11:15:49.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.177+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:15:49.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.177+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e25f20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.178+0000 7f52a7da9800 10 manifest: total_size = 4873 2024-09-14T11:15:49.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.178+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.15205123856141964784 2024-09-14T11:15:49.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.178+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e25f20 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.178+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.178+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.5 2024-09-14T11:15:49.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4873 stripe_ofs=4873 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15205123856141964784 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.ZhKd6VFOxlTc7Nkvx2a1KZLhnRgJ1BX_0 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.180+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15205123856141964784 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f51897fa640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e25f20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 10 manifest: total_size = 5393 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.2357010794909085216 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e25f20 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.182+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.7 2024-09-14T11:15:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5393 stripe_ofs=5393 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2357010794909085216 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.WbJgeBh-5-8qUseux9AuaoFldVkWou4_0 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.184+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2357010794909085216 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 10 manifest: total_size = 5419 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.2643203964754534635 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x5568c7e9a158 s->prefetch_data=0 2024-09-14T11:15:49.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e9a158 2024-09-14T11:15:49.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.186+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.5.8 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5419 stripe_ofs=5419 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2643203964754534635 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.fqI2b2a7OnrCSKWmKMGItZekoJTpl9L_0 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.190+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2643203964754534635 2024-09-14T11:15:49.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.191+0000 7f51897fa640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:15:49.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.191+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.191+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.192+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.192+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.192+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.192+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.192+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[11989569-703c-4397-b0f1-7ddb0279a491.4517.5])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.194+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:15:49.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.194+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.195+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:15:49.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.195+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:15:49.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.195+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:15:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.196+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:15:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.196+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:15:49.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.196+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562401 cookie 93908518169712 notifier 5943 bl.length()=162 2024-09-14T11:15:49.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.199+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5 from cache 2024-09-14T11:15:49.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.199+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:11989569-703c-4397-b0f1-7ddb0279a491.4517.5, ofs0, ns] 2024-09-14T11:15:49.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.200+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562402 cookie 93908518186240 notifier 5943 bl.length()=219 2024-09-14T11:15:49.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.203+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/11989569-703c-4397-b0f1-7ddb0279a491.4517.5 : miss 2024-09-14T11:15:49.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.203+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.203+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.203+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/11989569-703c-4397-b0f1-7ddb0279a491.4517.5 info.flags=0x0 2024-09-14T11:15:49.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.203+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/11989569-703c-4397-b0f1-7ddb0279a491.4517.5 to cache LRU end 2024-09-14T11:15:49.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.205+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12 : miss 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.205+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12 info.flags=0x17 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12 to cache LRU end 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.206+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c067ae0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5568c7e334d8 s->prefetch_data=0 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 10 manifest: total_size = 886297 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.3763186178080446661 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c067ae0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x5568c7e334d8 s->prefetch_data=0 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e334d8 2024-09-14T11:15:49.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.210+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.12.10 2024-09-14T11:15:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-14T11:15:49.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3763186178080446661 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.1 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.2 2024-09-14T11:15:49.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.3 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.4 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.213+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3763186178080446661 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.214+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.214+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.214+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.215+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.215+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.215+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.215+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.215+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.217+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:15:49.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.217+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.218+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:15:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.218+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:15:49.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.218+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:15:49.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.219+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:15:49.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.219+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:15:49.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.219+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562423 cookie 93908518171920 notifier 5943 bl.length()=191 2024-09-14T11:15:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.222+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12 from cache 2024-09-14T11:15:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.222+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.12, ofs0, ns] 2024-09-14T11:15:49.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.222+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562436 cookie 93908518191280 notifier 5943 bl.length()=249 2024-09-14T11:15:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.227+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.12 : miss 2024-09-14T11:15:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.227+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.227+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.227+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.12 info.flags=0x0 2024-09-14T11:15:49.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.227+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.12 to cache LRU end 2024-09-14T11:15:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13 : miss 2024-09-14T11:15:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:15:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13 info.flags=0x17 2024-09-14T11:15:49.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13 to cache LRU end 2024-09-14T11:15:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.229+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980c3480 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5568c7e334d8 s->prefetch_data=0 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 10 manifest: total_size = 886297 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.11021977134490571169 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980c3480 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x5568c7e334d8 s->prefetch_data=0 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e334d8 2024-09-14T11:15:49.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.234+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.13.10 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:15:49.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11021977134490571169 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.1 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.2 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.3 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.4 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.236+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11021977134490571169 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.238+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.238+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.238+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.239+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.239+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.239+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.239+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.239+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.240+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:15:49.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.240+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.241+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:15:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.241+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:15:49.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.241+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:15:49.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.242+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:15:49.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.242+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:15:49.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.242+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562386 cookie 93908518180896 notifier 5943 bl.length()=198 2024-09-14T11:15:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.245+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13 from cache 2024-09-14T11:15:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.245+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.13, ofs0, ns] 2024-09-14T11:15:49.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.245+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562378 cookie 93908518183536 notifier 5943 bl.length()=256 2024-09-14T11:15:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.249+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.13 : miss 2024-09-14T11:15:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.249+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.249+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.249+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.13 info.flags=0x0 2024-09-14T11:15:49.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.249+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.13 to cache LRU end 2024-09-14T11:15:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.251+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11 : miss 2024-09-14T11:15:49.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.251+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11 info.flags=0x17 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11 to cache LRU end 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.252+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.255+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo[vWybt5LcGEtEgrNB-ohEpFS9P3GqDN6] 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.255+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.256+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7decb00 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5568c7c82be8 s->prefetch_data=0 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.256+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 7795j3buapvljtio34rup4cs2r6znbhr 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.256+0000 7f52a7da9800 20 get_obj_state_impl: setting s->olh_tag to mikkjvnibhkqu9a1g4rz5ywpdwheqqzp 2024-09-14T11:15:49.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.256+0000 7f52a7da9800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mikkjvnibhkqu9a1g4rz5ywpdwheqqzp 2024-09-14T11:15:49.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.258+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.259+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.259+0000 7f52a7da9800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:15:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.259+0000 7f52a7da9800 20 olh_log_entry: epoch=3 op=3 key=foo[vWybt5LcGEtEgrNB-ohEpFS9P3GqDN6] 2024-09-14T11:15:49.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.259+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7decb00 obj=test-client.0-r-test-multipart-index-versioning.1:_:vWybt5LcGEtEgrNB-ohEpFS9P3GqDN6_foo state=0x5568c7e2d238 s->prefetch_data=0 2024-09-14T11:15:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.260+0000 7f52a7da9800 10 manifest: total_size = 1667 2024-09-14T11:15:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.260+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.3160922869332881102 2024-09-14T11:15:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.260+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7decb00 obj=test-client.0-r-test-multipart-index-versioning.1:_:vWybt5LcGEtEgrNB-ohEpFS9P3GqDN6_foo state=0x5568c7e2d238 s->prefetch_data=0 2024-09-14T11:15:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.260+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2d238 2024-09-14T11:15:49.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.260+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:15:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-14T11:15:49.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=516 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4191756 part_ofs=1548 rule->part_size=119 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3160922869332881102 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.1 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:15:49.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.2 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.3 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.4 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.262+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3160922869332881102 2024-09-14T11:15:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.263+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo[vWybt5LcGEtEgrNB-ohEpFS9P3GqDN6] 2024-09-14T11:15:49.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.265+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7decb00 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x5568c7c82be8 s->prefetch_data=0 2024-09-14T11:15:49.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.266+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.267+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.11.10 2024-09-14T11:15:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.267+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.267+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.268+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.268+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.268+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.268+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.268+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.270+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:15:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.270+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.270+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:15:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.270+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:15:49.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.270+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:15:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.271+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:15:49.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.271+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:15:49.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.272+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562387 cookie 93908518180896 notifier 5943 bl.length()=193 2024-09-14T11:15:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.274+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11 from cache 2024-09-14T11:15:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.274+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.11, ofs0, ns] 2024-09-14T11:15:49.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.275+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562424 cookie 93908518171920 notifier 5943 bl.length()=251 2024-09-14T11:15:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.278+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.11 : miss 2024-09-14T11:15:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.278+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.279+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.279+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.11 info.flags=0x0 2024-09-14T11:15:49.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.279+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.11 to cache LRU end 2024-09-14T11:15:49.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10 : miss 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=449 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10 info.flags=0x17 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10 to cache LRU end 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.281+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10 2024-09-14T11:15:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:15:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e330e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5568c7c82be8 s->prefetch_data=0 2024-09-14T11:15:49.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 10 manifest: total_size = 18874368 2024-09-14T11:15:49.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.610457940694169268 2024-09-14T11:15:49.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e330e0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x5568c7c82be8 s->prefetch_data=0 2024-09-14T11:15:49.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7c82be8 2024-09-14T11:15:49.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.285+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.10.10 2024-09-14T11:15:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=14675968 stripe_ofs=14675968 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=18866176 part_ofs=10485760 rule->part_size=5242880 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:15:49.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=19918848 part_ofs=15728640 rule->part_size=3145728 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.610457940694169268 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.1 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.1_1 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.2 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 835 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.2_1 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1079 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.3 2024-09-14T11:15:49.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1325 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.3_1 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1569 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.4 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1815 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.288+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.610457940694169268 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.289+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.289+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.289+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.290+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.290+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.290+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.290+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.290+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.291+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.291+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.292+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=227 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.292+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.292+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:15:49.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.293+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:15:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.293+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:15:49.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.293+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562403 cookie 93908518186240 notifier 5943 bl.length()=183 2024-09-14T11:15:49.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.296+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10 from cache 2024-09-14T11:15:49.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.296+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.10, ofs0, ns] 2024-09-14T11:15:49.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.296+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562382 cookie 93908518177296 notifier 5943 bl.length()=241 2024-09-14T11:15:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.299+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.10 : miss 2024-09-14T11:15:49.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.299+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.299+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.299+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.10 info.flags=0x0 2024-09-14T11:15:49.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.299+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.10 to cache LRU end 2024-09-14T11:15:49.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.301+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16 : miss 2024-09-14T11:15:49.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.301+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16 info.flags=0x17 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16 to cache LRU end 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16 2024-09-14T11:15:49.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.302+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:15:49.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.303+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:15:49.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.303+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:15:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.304+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:15:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.304+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:15:49.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.304+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:15:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.305+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:15:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.305+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:15:49.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.305+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:15:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.305+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:15:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.305+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:15:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.306+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:15:49.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.306+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9c670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.307+0000 7f52a7da9800 10 manifest: total_size = 22651 2024-09-14T11:15:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.307+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _tUsi6U8_O0ajGVkQ_ARgmV0iXYnVD0n 2024-09-14T11:15:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.307+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9c670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.307+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.307+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.0 2024-09-14T11:15:49.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _tUsi6U8_O0ajGVkQ_ARgmV0iXYnVD0n 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.X7blNr_KZU4XscCn__bmYo8_P10d1lE_0 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.309+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _tUsi6U8_O0ajGVkQ_ARgmV0iXYnVD0n 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.310+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.310+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e26850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.311+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.311+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _ItoVNEOzKaEkUVBfPl3mRWWviozqR3K 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.311+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e26850 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.311+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.311+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.2 2024-09-14T11:15:49.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _ItoVNEOzKaEkUVBfPl3mRWWviozqR3K 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.v64F4hzX64awD7jEt5ZzBTdiEmgLOou_0 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.v64F4hzX64awD7jEt5ZzBTdiEmgLOou_1 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.313+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _ItoVNEOzKaEkUVBfPl3mRWWviozqR3K 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.314+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c06f180 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.7918321075621213498 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c06f180 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.315+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.3 2024-09-14T11:15:49.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.7918321075621213498 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_0 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_1 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.317+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.7918321075621213498 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.318+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c06f180 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _aK4LYu2fRcdHjZMylG7cxm8bjx7VNdd 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c06f180 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.319+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.5 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _aK4LYu2fRcdHjZMylG7cxm8bjx7VNdd 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.QKkCdUHo9lDqg44IvrEEoB_RTFKPQaQ_0 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:15:49.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.QKkCdUHo9lDqg44IvrEEoB_RTFKPQaQ_1 2024-09-14T11:15:49.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:15:49.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.322+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _aK4LYu2fRcdHjZMylG7cxm8bjx7VNdd 2024-09-14T11:15:49.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.323+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:15:49.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.323+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.324+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.324+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _wBpoFW4fHGx49gD7cim6nkaqzSYJvsr 2024-09-14T11:15:49.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.324+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.324+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.324+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.5 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _wBpoFW4fHGx49gD7cim6nkaqzSYJvsr 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.4jyomfC44GbfrD3eQ5O4xr48ktj6vwp_0 2024-09-14T11:15:49.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.4jyomfC44GbfrD3eQ5O4xr48ktj6vwp_1 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.326+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _wBpoFW4fHGx49gD7cim6nkaqzSYJvsr 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.327+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980e6460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.327+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:15:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.328+0000 7f52a7da9800 10 manifest: total_size = 22651 2024-09-14T11:15:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.328+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.3988697292329232415 2024-09-14T11:15:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.328+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980e6460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.328+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.328+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.5 2024-09-14T11:15:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3988697292329232415 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.3SKiKWvzNKdV-ixUckEYu53OP-Mulzr_0 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.330+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3988697292329232415 2024-09-14T11:15:49.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:15:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980b2190 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _EHNdYN-MiOVzbtBvErkzOw2JH9DDsiw 2024-09-14T11:15:49.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980b2190 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.332+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.7 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _EHNdYN-MiOVzbtBvErkzOw2JH9DDsiw 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.Z5Qjd8CqD2argOnqnIMJPH5Z8wXc7W4_0 2024-09-14T11:15:49.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:15:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.Z5Qjd8CqD2argOnqnIMJPH5Z8wXc7W4_1 2024-09-14T11:15:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:15:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.335+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _EHNdYN-MiOVzbtBvErkzOw2JH9DDsiw 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2faa0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.1250295081314970775 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2faa0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.336+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.7 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1250295081314970775 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_0 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.338+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.339+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_1 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.339+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.339+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.339+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1250295081314970775 2024-09-14T11:15:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:15:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980e6460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 10 manifest: total_size = 22651 2024-09-14T11:15:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.3737533619442658273 2024-09-14T11:15:49.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980e6460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.340+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.7 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3737533619442658273 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.3SKiKWvzNKdV-ixUckEYu53OP-Mulzr_0 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.342+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3737533619442658273 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.12886648011228890183 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.344+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.8 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12886648011228890183 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_0 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_1 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.347+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12886648011228890183 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 10 manifest: total_size = 22651 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _KposS2-atjOXw1DkHBfnWLRsOT2sV1K 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.348+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.8 2024-09-14T11:15:49.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _KposS2-atjOXw1DkHBfnWLRsOT2sV1K 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.s3fkMVHer3AdSi5Gg3brblRy0OlZaqc_0 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.350+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: _KposS2-atjOXw1DkHBfnWLRsOT2sV1K 2024-09-14T11:15:49.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.351+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2faa0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 10 manifest: total_size = 5242880 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.11750277953507586978 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2faa0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x5568c7e21058 s->prefetch_data=0 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e21058 2024-09-14T11:15:49.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.352+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.16.9 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11750277953507586978 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_0 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_1 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.354+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11750277953507586978 2024-09-14T11:15:49.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:15:49.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.356+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.358+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:15:49.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.358+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.359+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:15:49.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.359+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:15:49.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.359+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:15:49.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.360+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:15:49.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.360+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:15:49.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.360+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562388 cookie 93908518180896 notifier 5943 bl.length()=189 2024-09-14T11:15:49.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.363+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16 from cache 2024-09-14T11:15:49.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.363+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.16, ofs0, ns] 2024-09-14T11:15:49.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.363+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562425 cookie 93908518171920 notifier 5943 bl.length()=247 2024-09-14T11:15:49.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.367+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.16 : miss 2024-09-14T11:15:49.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.367+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.367+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.367+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.16 info.flags=0x0 2024-09-14T11:15:49.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.367+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.16 to cache LRU end 2024-09-14T11:15:49.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.369+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17 : miss 2024-09-14T11:15:49.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.369+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17 info.flags=0x17 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17 to cache LRU end 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17 2024-09-14T11:15:49.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.370+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:15:49.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.371+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:15:49.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.371+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:15:49.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.372+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:15:49.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.372+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:15:49.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.372+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:15:49.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.373+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:15:49.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.373+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:15:49.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.373+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:15:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.374+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:15:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.374+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:15:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.374+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:15:49.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.374+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e326e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.375+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.375+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _riVzlm3zMyNJN7o1jMP3FOaZ1qy1lIG 2024-09-14T11:15:49.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.375+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e326e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.375+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.375+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.0 2024-09-14T11:15:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _riVzlm3zMyNJN7o1jMP3FOaZ1qy1lIG 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_0 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_1 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_2 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.377+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _riVzlm3zMyNJN7o1jMP3FOaZ1qy1lIG 2024-09-14T11:15:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:15:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980ad690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _qApoOVPhwqV2JWcuSFDjm3JbCEvXGy7 2024-09-14T11:15:49.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52980ad690 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.379+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.2 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _qApoOVPhwqV2JWcuSFDjm3JbCEvXGy7 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_0 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_1 2024-09-14T11:15:49.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_2 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.381+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _qApoOVPhwqV2JWcuSFDjm3JbCEvXGy7 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c0430e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.1006836564891715346 2024-09-14T11:15:49.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c0430e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.383+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.3 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1006836564891715346 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1_1 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2 2024-09-14T11:15:49.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2_1 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.3 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.385+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1006836564891715346 2024-09-14T11:15:49.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _85UOsX_ANaL_FJEXg-japepLBNAMO91 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.387+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.5 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _85UOsX_ANaL_FJEXg-japepLBNAMO91 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_0 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:15:49.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_1 2024-09-14T11:15:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:15:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_2 2024-09-14T11:15:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:15:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.390+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _85UOsX_ANaL_FJEXg-japepLBNAMO91 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.391+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.391+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.392+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.392+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _W6rIGnlAROIPexHZ_o8KEu7GiUJlo38 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.392+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c00c6d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.392+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.392+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.5 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _W6rIGnlAROIPexHZ_o8KEu7GiUJlo38 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_0 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_1 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_2 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.394+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _W6rIGnlAROIPexHZ_o8KEu7GiUJlo38 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.395+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.395+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e30e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.396+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.396+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.3471375875052266689 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.396+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e30e20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.396+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.396+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.5 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3471375875052266689 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1_1 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2 2024-09-14T11:15:49.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2_1 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.3 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.399+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.3471375875052266689 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _Z0qWsooWJC07HsrVbvbs-oJxPK67GEn 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.400+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.7 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _Z0qWsooWJC07HsrVbvbs-oJxPK67GEn 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_0 2024-09-14T11:15:49.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_1 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_2 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 761 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.403+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _Z0qWsooWJC07HsrVbvbs-oJxPK67GEn 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.11916139927665145690 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.404+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.7 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11916139927665145690 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1_1 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2 2024-09-14T11:15:49.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2_1 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.3 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.407+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.11916139927665145690 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e3d930 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.14624120322987792268 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e3d930 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.409+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.7 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14624120322987792268 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1_1 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-14T11:15:49.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2_1 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1153 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.3 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1417 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.411+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14624120322987792268 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.412+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.412+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.413+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.413+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.6542947418151656858 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.413+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c068230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.413+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.413+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.8 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6542947418151656858 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1_1 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:15:49.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2_1 2024-09-14T11:15:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:15:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.3 2024-09-14T11:15:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:15:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.415+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6542947418151656858 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.416+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.416+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.417+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.417+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to _mISLgFodAABk5sQiP9hK2NVi85DVyhz 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.417+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.417+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.417+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.8 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: _mISLgFodAABk5sQiP9hK2NVi85DVyhz 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_0 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_1 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:15:49.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_2 2024-09-14T11:15:49.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:15:49.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.419+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _mISLgFodAABk5sQiP9hK2NVi85DVyhz 2024-09-14T11:15:49.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.420+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.420+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.421+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.421+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.804531901037094335 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.421+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x5568c7e2e8b8 s->prefetch_data=0 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.421+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2e8b8 2024-09-14T11:15:49.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.421+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.17.9 2024-09-14T11:15:49.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.804531901037094335 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1_1 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2_1 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.3 2024-09-14T11:15:49.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-14T11:15:49.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.423+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.804531901037094335 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.424+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.425+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.17])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.427+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.427+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.428+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.428+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.428+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.428+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.428+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:15:49.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.429+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562379 cookie 93908518183536 notifier 5943 bl.length()=199 2024-09-14T11:15:49.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.432+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17 from cache 2024-09-14T11:15:49.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.432+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.17, ofs0, ns] 2024-09-14T11:15:49.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.432+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562404 cookie 93908518186240 notifier 5943 bl.length()=257 2024-09-14T11:15:49.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.435+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.17 : miss 2024-09-14T11:15:49.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.435+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.435+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.435+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.17 info.flags=0x0 2024-09-14T11:15:49.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.435+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.17 to cache LRU end 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15 : miss 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15 info.flags=0x17 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15 to cache LRU end 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.438+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15 2024-09-14T11:15:49.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.440+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:15:49.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.440+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:15:49.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.441+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:15:49.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e34130 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.1376136108177957437 2024-09-14T11:15:49.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e34130 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e1e1c8 2024-09-14T11:15:49.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.442+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.15.3 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1376136108177957437 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.1 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.1_1 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.2 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.2_1 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.3 2024-09-14T11:15:49.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.445+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1376136108177957437 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 10 manifest: total_size = 1087 2024-09-14T11:15:49.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.16240050270278232145 2024-09-14T11:15:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c05f150 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e1e1c8 2024-09-14T11:15:49.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.447+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.15.5 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-14T11:15:49.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16240050270278232145 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.1 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.2 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.3 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.450+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.16240050270278232145 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.451+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.451+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c0430e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.452+0000 7f52a7da9800 10 manifest: total_size = 11534336 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.452+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.1223196277759506436 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.452+0000 7f52a7da9800 20 get_obj_state: octx=0x7f529c0430e0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x5568c7e1e1c8 s->prefetch_data=0 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.452+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e1e1c8 2024-09-14T11:15:49.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.452+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.15.7 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1223196277759506436 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.1 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.1_1 2024-09-14T11:15:49.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.2 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.2_1 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.3 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.455+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.1223196277759506436 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.456+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.456+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.456+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.457+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.457+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.457+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.457+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.457+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.459+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:15:49.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.459+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.459+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:15:49.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.459+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:15:49.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.459+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:15:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.460+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:15:49.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.460+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:15:49.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.460+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562437 cookie 93908518188944 notifier 5943 bl.length()=194 2024-09-14T11:15:49.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.463+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15 from cache 2024-09-14T11:15:49.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.463+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.15, ofs0, ns] 2024-09-14T11:15:49.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.464+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562405 cookie 93908518186240 notifier 5943 bl.length()=252 2024-09-14T11:15:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.467+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.15 : miss 2024-09-14T11:15:49.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.467+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.468+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.468+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.15 info.flags=0x0 2024-09-14T11:15:49.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.468+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.15 to cache LRU end 2024-09-14T11:15:49.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.469+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14 : miss 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.469+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14 info.flags=0x17 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14 to cache LRU end 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.470+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14 2024-09-14T11:15:49.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.471+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:15:49.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.472+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:15:49.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.473+0000 7f52a7da9800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:15:49.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2f1c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5568c7e1f8e8 s->prefetch_data=0 2024-09-14T11:15:49.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 10 manifest: total_size = 10485760 2024-09-14T11:15:49.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.13096635357954589262 2024-09-14T11:15:49.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2f1c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x5568c7e1f8e8 s->prefetch_data=0 2024-09-14T11:15:49.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e1f8e8 2024-09-14T11:15:49.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.474+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.14.3 2024-09-14T11:15:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13096635357954589262 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_0 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_1 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_2 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.477+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.13096635357954589262 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.478+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.478+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2f1c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5568c7be8d78 s->prefetch_data=0 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.479+0000 7f52a7da9800 10 manifest: total_size = 44258 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.479+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.4180392404142704991 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.479+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e2f1c0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x5568c7be8d78 s->prefetch_data=0 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.479+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7be8d78 2024-09-14T11:15:49.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.479+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.14.5 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=44258 stripe_ofs=44258 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4180392404142704991 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.cbkKuDyXEJdz5EGhLD5eqEbwcJSnpe7_0 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-14T11:15:49.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.481+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4180392404142704991 2024-09-14T11:15:49.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.482+0000 7f51897fa640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:15:49.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.482+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b220 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5568c7be8d78 s->prefetch_data=0 2024-09-14T11:15:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.483+0000 7f52a7da9800 10 manifest: total_size = 10485760 2024-09-14T11:15:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.483+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.8969558653354213573 2024-09-14T11:15:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.483+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b220 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x5568c7be8d78 s->prefetch_data=0 2024-09-14T11:15:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.483+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7be8d78 2024-09-14T11:15:49.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.483+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.14.7 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8969558653354213573 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_0 2024-09-14T11:15:49.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_1 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_2 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.485+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8969558653354213573 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.487+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.487+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.487+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.487+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.487+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.488+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.488+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.488+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.489+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:15:49.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.489+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.490+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:15:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.490+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:15:49.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.490+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:15:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.491+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:15:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.491+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:15:49.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.491+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562389 cookie 93908518180896 notifier 5943 bl.length()=184 2024-09-14T11:15:49.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.494+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14 from cache 2024-09-14T11:15:49.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.494+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.14, ofs0, ns] 2024-09-14T11:15:49.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.494+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562380 cookie 93908518183536 notifier 5943 bl.length()=242 2024-09-14T11:15:49.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.497+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.14 : miss 2024-09-14T11:15:49.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.497+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.498+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.498+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.14 info.flags=0x0 2024-09-14T11:15:49.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.498+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.14 to cache LRU end 2024-09-14T11:15:49.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7 : miss 2024-09-14T11:15:49.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7 info.flags=0x17 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7 to cache LRU end 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.501+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7 2024-09-14T11:15:49.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.502+0000 7f52a7da9800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:15:49.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.503+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:15:49.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.504+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:15:49.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.504+0000 7f52a7da9800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:15:49.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.505+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.506+0000 7f52a7da9800 10 manifest: total_size = 0 2024-09-14T11:15:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.506+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.2253534198545094750 2024-09-14T11:15:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.506+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:___ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.506+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.506+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.7.2 2024-09-14T11:15:49.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.508+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.509+0000 7f52a7da9800 10 manifest: total_size = 0 2024-09-14T11:15:49.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.509+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.15547464984419856505 2024-09-14T11:15:49.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.509+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.509+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.509+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.7.3 2024-09-14T11:15:49.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.510+0000 7f51897fa640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:15:49.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.511+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f52a7da9800 10 manifest: total_size = 0 2024-09-14T11:15:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.11970150139591527876 2024-09-14T11:15:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:__ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.7.6 2024-09-14T11:15:49.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.512+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:15:49.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.514+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.515+0000 7f52a7da9800 10 manifest: total_size = 0 2024-09-14T11:15:49.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.515+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.10308335918076818958 2024-09-14T11:15:49.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.515+0000 7f52a7da9800 20 get_obj_state: octx=0x5568c7e9b870 obj=test-client.0-r-test-small-obj-data.1:obj state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.515+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.515+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.7.8 2024-09-14T11:15:49.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.516+0000 7f51897fa640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:15:49.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.517+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.517+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f51897fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:15:49.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.521+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[11989569-703c-4397-b0f1-7ddb0279a491.4517.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.523+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:15:49.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.523+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.523+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:15:49.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.523+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:15:49.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.523+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:15:49.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.524+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:15:49.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.524+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:15:49.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.525+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562426 cookie 93908518171920 notifier 5943 bl.length()=181 2024-09-14T11:15:49.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.527+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7 from cache 2024-09-14T11:15:49.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.527+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:11989569-703c-4397-b0f1-7ddb0279a491.4517.7, ofs0, ns] 2024-09-14T11:15:49.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.527+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562383 cookie 93908518177296 notifier 5943 bl.length()=238 2024-09-14T11:15:49.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.531+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.7 : miss 2024-09-14T11:15:49.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.531+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.531+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.531+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.7 info.flags=0x0 2024-09-14T11:15:49.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.531+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/11989569-703c-4397-b0f1-7ddb0279a491.4517.7 to cache LRU end 2024-09-14T11:15:49.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8 : miss 2024-09-14T11:15:49.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:15:49.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8 info.flags=0x17 2024-09-14T11:15:49.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8 to cache LRU end 2024-09-14T11:15:49.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.533+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8 2024-09-14T11:15:49.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.534+0000 7f52a7da9800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:15:49.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.535+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:15:49.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.536+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:15:49.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.537+0000 7f52a7da9800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:15:49.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.537+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.538+0000 7f52a7da9800 10 manifest: total_size = 24595 2024-09-14T11:15:49.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.538+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.2778509371862053440 2024-09-14T11:15:49.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.538+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:___ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.538+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7bf04b8 2024-09-14T11:15:49.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.538+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.8.2 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2778509371862053440 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.W_mH-lfu32z51t-eWHkBwm3GbYLGWtT_0 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.541+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.2778509371862053440 2024-09-14T11:15:49.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.542+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.542+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.543+0000 7f52a7da9800 10 manifest: total_size = 38 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.543+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.18170742344009804980 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.543+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.543+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7bf04b8 2024-09-14T11:15:49.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.543+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.8.3 2024-09-14T11:15:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=38 stripe_ofs=38 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18170742344009804980 2024-09-14T11:15:49.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.M9SuERThJ4aGpIyvh4VQW8dlF_6Lien_0 2024-09-14T11:15:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.545+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18170742344009804980 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f51897fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 10 manifest: total_size = 524288 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.10094721052240685149 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:__ state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7bf04b8 2024-09-14T11:15:49.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.547+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.8.6 2024-09-14T11:15:49.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10094721052240685149 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.6QJASlxgwg7mVQDtGvFpm8UkRpmneAR_0 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.549+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.10094721052240685149 2024-09-14T11:15:49.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:15:49.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 10 manifest: total_size = 2078 2024-09-14T11:15:49.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.6046111185939639375 2024-09-14T11:15:49.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 20 get_obj_state: octx=0x7f52a005e650 obj=test-client.0-r-test-small-obj-data.2:obj state=0x5568c7bf04b8 s->prefetch_data=0 2024-09-14T11:15:49.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7bf04b8 2024-09-14T11:15:49.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.551+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.8.8 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6046111185939639375 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.phtYHUKEtK8D9jt2EWVGBtsnXuRnnV5_0 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.554+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6046111185939639375 2024-09-14T11:15:49.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.555+0000 7f51897fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:15:49.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.555+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.555+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.556+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.556+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.556+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.556+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.556+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[11989569-703c-4397-b0f1-7ddb0279a491.4517.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.557+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:15:49.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.557+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.558+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:15:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.558+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:15:49.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.558+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:15:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.559+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:15:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.559+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:15:49.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.559+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562427 cookie 93908518171920 notifier 5943 bl.length()=181 2024-09-14T11:15:49.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.562+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8 from cache 2024-09-14T11:15:49.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.562+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:11989569-703c-4397-b0f1-7ddb0279a491.4517.8, ofs0, ns] 2024-09-14T11:15:49.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.562+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562384 cookie 93908518177296 notifier 5943 bl.length()=238 2024-09-14T11:15:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.565+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/11989569-703c-4397-b0f1-7ddb0279a491.4517.8 : miss 2024-09-14T11:15:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.565+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.566+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.566+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/11989569-703c-4397-b0f1-7ddb0279a491.4517.8 info.flags=0x0 2024-09-14T11:15:49.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.566+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/11989569-703c-4397-b0f1-7ddb0279a491.4517.8 to cache LRU end 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9 : miss 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9 info.flags=0x17 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9 to cache LRU end 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:49.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:15:49.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.568+0000 7f52a7da9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9 2024-09-14T11:15:49.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.569+0000 7f52a7da9800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:15:49.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.570+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:15:49.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.571+0000 7f52a7da9800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:15:49.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.572+0000 7f52a7da9800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:15:49.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.572+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5568c7e2bdf8 s->prefetch_data=0 2024-09-14T11:15:49.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.573+0000 7f52a7da9800 10 manifest: total_size = 49187 2024-09-14T11:15:49.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.573+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.12796860407393335969 2024-09-14T11:15:49.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.573+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:___ state=0x5568c7e2bdf8 s->prefetch_data=0 2024-09-14T11:15:49.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.573+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2bdf8 2024-09-14T11:15:49.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.573+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.9.2 2024-09-14T11:15:49.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12796860407393335969 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.T3FNVeFEfXGTK6-Z4w6I-g0bNUTyWGz_0 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.575+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.12796860407393335969 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.576+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:15:49.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 10 manifest: total_size = 1035 2024-09-14T11:15:49.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.4231189482941097845 2024-09-14T11:15:49.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.577+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.9.3 2024-09-14T11:15:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4231189482941097845 2024-09-14T11:15:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.5LDEHGqBKUMkC20_FlBCwA7tPbDJhbS_0 2024-09-14T11:15:49.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.579+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.4231189482941097845 2024-09-14T11:15:49.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.580+0000 7f51897fa640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 10 manifest: total_size = 49187 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.6516732014677589923 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:__ state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.581+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.9.6 2024-09-14T11:15:49.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6516732014677589923 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.Ay9vytFv-VMKAw8smg33FE-wrTvyOGq_0 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.583+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.6516732014677589923 2024-09-14T11:15:49.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f5188ff9640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:15:49.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 10 manifest: total_size = 1035 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.105814988132408890 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 20 get_obj_state: octx=0x7f5298058f10 obj=test-client.0-r-test-small-obj-data.3:obj state=0x5568c7e2cc28 s->prefetch_data=0 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 20 prepare_atomic_modification: state is not atomic. state=0x5568c7e2cc28 2024-09-14T11:15:49.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.585+0000 7f52a7da9800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.9.8 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 RGWObjManifest::operator++(): result: ofs=1035 stripe_ofs=1035 part_ofs=0 rule->part_size=0 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.105814988132408890 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.NKA1BnfKa9CzB7NnvBJQFOR4_9JXb2X_0 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:15:49.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.588+0000 7f52a7da9800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 11989569-703c-4397-b0f1-7ddb0279a491.4517.105814988132408890 2024-09-14T11:15:49.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.589+0000 7f51897fa640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:15:49.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.589+0000 7f52a7da9800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:15:49.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.589+0000 7f52a7da9800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:15:49.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.590+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:15:49.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.590+0000 7f52a7da9800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:15:49.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.590+0000 7f52a7da9800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:15:49.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.590+0000 7f52a7da9800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:15:49.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.590+0000 7f52a7da9800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[11989569-703c-4397-b0f1-7ddb0279a491.4517.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:15:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.592+0000 7f52a7da9800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:15:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.592+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.592+0000 7f52a7da9800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:15:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.592+0000 7f52a7da9800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:15:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.592+0000 7f52a7da9800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:15:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.593+0000 7f52a7da9800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:15:49.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.593+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:15:49.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.594+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562428 cookie 93908518171920 notifier 5943 bl.length()=181 2024-09-14T11:15:49.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.596+0000 7f52a7da9800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9 from cache 2024-09-14T11:15:49.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.596+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:11989569-703c-4397-b0f1-7ddb0279a491.4517.9, ofs0, ns] 2024-09-14T11:15:49.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.597+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562385 cookie 93908518177296 notifier 5943 bl.length()=238 2024-09-14T11:15:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.600+0000 7f52a7da9800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/11989569-703c-4397-b0f1-7ddb0279a491.4517.9 : miss 2024-09-14T11:15:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.600+0000 7f52a7da9800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.600+0000 7f52a7da9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.600+0000 7f52a7da9800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/11989569-703c-4397-b0f1-7ddb0279a491.4517.9 info.flags=0x0 2024-09-14T11:15:49.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.600+0000 7f52a7da9800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/11989569-703c-4397-b0f1-7ddb0279a491.4517.9 to cache LRU end 2024-09-14T11:15:49.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.602+0000 7f52a7da9800 10 removing key index: JQOXXIJICKAMALTAZGZV 2024-09-14T11:15:49.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.603+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:JQOXXIJICKAMALTAZGZV, ofs0, ns] 2024-09-14T11:15:49.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.604+0000 7f51897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562390 cookie 93908518180896 notifier 5943 bl.length()=170 2024-09-14T11:15:49.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.605+0000 7f52a7da9800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:15:49.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.606+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:15:49.605 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.606+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562391 cookie 93908518180896 notifier 5943 bl.length()=182 2024-09-14T11:15:49.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.607+0000 7f52a7da9800 10 removing user buckets index 2024-09-14T11:15:49.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.608+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:15:49.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.608+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562438 cookie 93908518188944 notifier 5943 bl.length()=173 2024-09-14T11:15:49.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.610+0000 7f52a7da9800 10 removing user index: ragweed.client.0 2024-09-14T11:15:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.611+0000 7f52a7da9800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:15:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.611+0000 7f52a7da9800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:15:49.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.611+0000 7f5188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562406 cookie 93908518186240 notifier 5943 bl.length()=165 2024-09-14T11:15:49.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.615+0000 7f51577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.618+0000 7f52a7da9800 20 remove_watcher() i=0 2024-09-14T11:15:49.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.618+0000 7f52a7da9800 2 removed watcher, disabling cache 2024-09-14T11:15:49.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.619+0000 7f52a7da9800 20 remove_watcher() i=1 2024-09-14T11:15:49.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.620+0000 7f52a7da9800 20 remove_watcher() i=2 2024-09-14T11:15:49.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.621+0000 7f52a7da9800 20 remove_watcher() i=3 2024-09-14T11:15:49.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.622+0000 7f52a7da9800 20 remove_watcher() i=4 2024-09-14T11:15:49.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.623+0000 7f52a7da9800 20 remove_watcher() i=5 2024-09-14T11:15:49.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.624+0000 7f52a7da9800 20 remove_watcher() i=6 2024-09-14T11:15:49.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.625+0000 7f52a7da9800 20 remove_watcher() i=7 2024-09-14T11:15:49.636 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:15:49.734 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:49.734 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:49.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.771+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 realm 2024-09-14T11:15:49.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.773+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.774+0000 7f145dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:49.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.774+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.774+0000 7f145dd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:49.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.774+0000 7f145dd2e800 20 searching for the correct realm 2024-09-14T11:15:49.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.776+0000 7f145a16c640 0 -- 172.21.15.29:0/3053635580 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1454010b50 msgr2=0x7f145402c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:49.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:49.983+0000 7f145916a640 0 -- 172.21.15.29:0/3053635580 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f145404f440 msgr2=0x7f145404f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:15:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:50.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.188+0000 7f145dd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.189+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.189+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.189+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.189+0000 7f145dd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:50.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.189+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 zone default found 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 4 Realm: () 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 zonegroup default 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 started sync module instance, tier type = 2024-09-14T11:15:50.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.190+0000 7f145dd2e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=0 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=1 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=2 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=3 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=4 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=5 2024-09-14T11:15:50.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.200+0000 7f145dd2e800 20 add_watcher() i=6 2024-09-14T11:15:50.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.201+0000 7f145dd2e800 20 add_watcher() i=7 2024-09-14T11:15:50.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.201+0000 7f145dd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:50.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.202+0000 7f130bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.203+0000 7f145dd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:50.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.203+0000 7f145dd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:50.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f130affd640 20 reqs_thread_entry: start 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f145dd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f145dd2e800 20 Filter name: none 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f1308ff9640 20 reqs_thread_entry: start 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f145dd2e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.240+0000 7f145dd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:50.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.241+0000 7f145dd2e800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:15:50.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.241+0000 7f145dd2e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:15:50.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.241+0000 7f145dd2e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:15:50.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.241+0000 7f145dd2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:50.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.241+0000 7f145dd2e800 10 removing key index: YCDLLWNYYDUVGLFGYKFK 2024-09-14T11:15:50.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.242+0000 7f145dd2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:YCDLLWNYYDUVGLFGYKFK, ofs0, ns] 2024-09-14T11:15:50.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.243+0000 7f133d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562392 cookie 93978548653936 notifier 5690 bl.length()=170 2024-09-14T11:15:50.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.244+0000 7f145dd2e800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:15:50.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.245+0000 7f145dd2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:15:50.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.245+0000 7f133d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562407 cookie 93978548661184 notifier 5690 bl.length()=182 2024-09-14T11:15:50.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.247+0000 7f145dd2e800 10 removing user buckets index 2024-09-14T11:15:50.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.248+0000 7f145dd2e800 10 removing user index: sysuser.client.0 2024-09-14T11:15:50.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.249+0000 7f145dd2e800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:15:50.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.249+0000 7f145dd2e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:15:50.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.249+0000 7f133d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1108101562393 cookie 93978548653936 notifier 5690 bl.length()=165 2024-09-14T11:15:50.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.251+0000 7f130bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:50.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.253+0000 7f145dd2e800 20 remove_watcher() i=0 2024-09-14T11:15:50.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.253+0000 7f145dd2e800 2 removed watcher, disabling cache 2024-09-14T11:15:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.254+0000 7f145dd2e800 20 remove_watcher() i=1 2024-09-14T11:15:50.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.256+0000 7f145dd2e800 20 remove_watcher() i=2 2024-09-14T11:15:50.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.257+0000 7f145dd2e800 20 remove_watcher() i=3 2024-09-14T11:15:50.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.257+0000 7f145dd2e800 20 remove_watcher() i=4 2024-09-14T11:15:50.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.258+0000 7f145dd2e800 20 remove_watcher() i=5 2024-09-14T11:15:50.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.259+0000 7f145dd2e800 20 remove_watcher() i=6 2024-09-14T11:15:50.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:15:50.260+0000 7f145dd2e800 20 remove_watcher() i=7 2024-09-14T11:15:50.271 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:15:50.271 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:15:50.360 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:15:50.371 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:50.371 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:15:50.371 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:50.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:15:50.401 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:15:50.401 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:50.471 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:15:50.471 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:15:50.541 INFO:tasks.workunit:timeout=3h 2024-09-14T11:15:50.541 INFO:tasks.workunit:cleanup=True 2024-09-14T11:15:50.542 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:15:50.612 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:16:50.869 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 94% (12132/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:16:51.500 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:16:51.501 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:16:51.502 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:16:51.572 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:16:51.574 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:51.575 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:16:51.625 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:16:51.675 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:16:51.715 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:16:51.717 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:51.717 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:16:51.757 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:16:51.761 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:16:51.761 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:16:51.831 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:16:51.832 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:16:51.833 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:16:51.906 INFO:tasks.workunit.client.0.smithi029.stderr:+ ulimit -c 0 2024-09-14T11:16:51.906 INFO:tasks.workunit.client.0.smithi029.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:16:51.906 INFO:tasks.workunit.client.0.smithi029.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:51.906 INFO:tasks.workunit.client.0.smithi029.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ deactivate nondestructive 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:16:54.358 INFO:tasks.workunit.client.0.smithi029.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ export VIRTUAL_ENV 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PATH 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ PS1='(rgw) ' 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PS1 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T11:16:54.359 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install pip --upgrade 2024-09-14T11:16:54.595 INFO:tasks.workunit.client.0.smithi029.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:16:54.789 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting pip 2024-09-14T11:16:54.795 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:16:54.841 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: pip 2024-09-14T11:16:54.841 INFO:tasks.workunit.client.0.smithi029.stdout: Attempting uninstall: pip 2024-09-14T11:16:54.841 INFO:tasks.workunit.client.0.smithi029.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:16:55.006 INFO:tasks.workunit.client.0.smithi029.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:16:55.011 INFO:tasks.workunit.client.0.smithi029.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:16:55.799 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed pip-24.2 2024-09-14T11:16:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install boto3 2024-09-14T11:16:56.664 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting boto3 2024-09-14T11:16:56.665 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:16:57.289 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:16:57.291 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:16:57.347 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:16:57.348 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:16:57.402 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:16:57.403 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:16:57.454 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:57.455 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:16:57.533 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:57.534 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:16:57.793 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:16:57.795 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:16:57.799 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:16:57.800 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:16:57.810 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:16:57.811 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:16:57.812 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:16:57.814 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:16:57.815 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:16:57.891 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:16:59.056 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:16:59.174 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:16:59.303 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:16:59.339 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:59.339 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:59.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.380+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 20 realm 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.382+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.383+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.383+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.383+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:59.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.383+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.384+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:59.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.384+0000 7fd38b20f800 20 searching for the correct realm 2024-09-14T11:16:59.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.385+0000 7fd3884f8640 0 -- 172.21.15.29:0/2030742069 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fd37801d040 msgr2=0x7fd37801c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:59.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.592+0000 7fd3894fa640 0 -- 172.21.15.29:0/2030742069 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56429cb97890 msgr2=0x56429cb99c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:59.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:16:59.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.598+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 zone default found 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 4 Realm: () 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 zonegroup default 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.599+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.600+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.600+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.600+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.600+0000 7fd38b20f800 20 started sync module instance, tier type = 2024-09-14T11:16:59.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.600+0000 7fd38b20f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=0 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=1 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=2 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=3 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=4 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=5 2024-09-14T11:16:59.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.610+0000 7fd38b20f800 20 add_watcher() i=6 2024-09-14T11:16:59.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.611+0000 7fd38b20f800 20 add_watcher() i=7 2024-09-14T11:16:59.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.611+0000 7fd38b20f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:59.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.612+0000 7fd23efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:59.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:59.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:59.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 5 note: GC not initialized 2024-09-14T11:16:59.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd23dfe3640 20 reqs_thread_entry: start 2024-09-14T11:16:59.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 20 init_complete bucket index max shards: 11 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 20 Filter name: none 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd1af7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.613+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=22 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:16:59.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-09-14T11:16:59.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.614+0000 7fd38b20f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:59.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 20 rados_obj.operate() r=0 bl.length=420 2024-09-14T11:16:59.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.615+0000 7fd38b20f800 20 get_user_info_from_index found 0 xattrs 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-09-14T11:16:59.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.616+0000 7fd23efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:59.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.618+0000 7fd38b20f800 20 remove_watcher() i=0 2024-09-14T11:16:59.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.618+0000 7fd38b20f800 2 removed watcher, disabling cache 2024-09-14T11:16:59.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.619+0000 7fd38b20f800 20 remove_watcher() i=1 2024-09-14T11:16:59.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.621+0000 7fd38b20f800 20 remove_watcher() i=2 2024-09-14T11:16:59.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.622+0000 7fd38b20f800 20 remove_watcher() i=3 2024-09-14T11:16:59.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.623+0000 7fd38b20f800 20 remove_watcher() i=4 2024-09-14T11:16:59.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.624+0000 7fd38b20f800 20 remove_watcher() i=5 2024-09-14T11:16:59.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.625+0000 7fd38b20f800 20 remove_watcher() i=6 2024-09-14T11:16:59.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:16:59.626+0000 7fd38b20f800 20 remove_watcher() i=7 2024-09-14T11:17:00.023 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard add 2024-09-14T11:17:00.023 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:00.025 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:17:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.095+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 realm 2024-09-14T11:17:00.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.097+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.098+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:00.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.098+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.099+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:00.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.099+0000 7f1e4aba7800 20 searching for the correct realm 2024-09-14T11:17:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.101+0000 7f1e48e92640 0 -- 172.21.15.29:0/3434935321 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1e4003cb00 msgr2=0x7f1e40060320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:00.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.106+0000 7f1e47e90640 0 -- 172.21.15.29:0/3434935321 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1e4006a470 msgr2=0x7f1e40043040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.313+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 zone default found 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 4 Realm: () 2024-09-14T11:17:00.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 zonegroup default 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.314+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 started sync module instance, tier type = 2024-09-14T11:17:00.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.315+0000 7f1e4aba7800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:00.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=0 2024-09-14T11:17:00.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=1 2024-09-14T11:17:00.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=2 2024-09-14T11:17:00.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=3 2024-09-14T11:17:00.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=4 2024-09-14T11:17:00.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=5 2024-09-14T11:17:00.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.325+0000 7f1e4aba7800 20 add_watcher() i=6 2024-09-14T11:17:00.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.326+0000 7f1e4aba7800 20 add_watcher() i=7 2024-09-14T11:17:00.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.326+0000 7f1e4aba7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1cfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1e4aba7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1e4aba7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1e4aba7800 5 note: GC not initialized 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1cfd7e2640 20 reqs_thread_entry: start 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1e4aba7800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.328+0000 7f1e4aba7800 20 Filter name: none 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.329+0000 7f1c6effd640 20 reqs_thread_entry: start 2024-09-14T11:17:00.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.329+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.329+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:00.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.329+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.330+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.330+0000 7f1e4aba7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.330+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.331+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.331+0000 7f1e4aba7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.331+0000 7f1e4aba7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:00.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.331+0000 7f1e4aba7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:00.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.333+0000 7f1cfe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:00.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.336+0000 7f1e4aba7800 20 remove_watcher() i=0 2024-09-14T11:17:00.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.336+0000 7f1e4aba7800 2 removed watcher, disabling cache 2024-09-14T11:17:00.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.338+0000 7f1e4aba7800 20 remove_watcher() i=1 2024-09-14T11:17:00.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.339+0000 7f1e4aba7800 20 remove_watcher() i=2 2024-09-14T11:17:00.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.340+0000 7f1e4aba7800 20 remove_watcher() i=3 2024-09-14T11:17:00.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.341+0000 7f1e4aba7800 20 remove_watcher() i=4 2024-09-14T11:17:00.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.342+0000 7f1e4aba7800 20 remove_watcher() i=5 2024-09-14T11:17:00.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.342+0000 7f1e4aba7800 20 remove_watcher() i=6 2024-09-14T11:17:00.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.343+0000 7f1e4aba7800 20 remove_watcher() i=7 2024-09-14T11:17:00.353 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:00.353 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:00.353 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:17:00.353 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:00.354 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:17:00.385 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:00.386 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:00.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.428+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 20 realm 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.429+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.430+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.430+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.430+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:00.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.430+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.431+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:00.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.431+0000 7f0b9b420800 20 searching for the correct realm 2024-09-14T11:17:00.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.433+0000 7f0b9970b640 0 -- 172.21.15.29:0/1961868634 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0b90069070 msgr2=0x7f0b900a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:00.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.639+0000 7f0b98709640 0 -- 172.21.15.29:0/1961868634 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0b90060830 msgr2=0x7f0b900a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.847+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:00.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 zone default found 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 4 Realm: () 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 zonegroup default 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.848+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 started sync module instance, tier type = 2024-09-14T11:17:00.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.849+0000 7f0b9b420800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=0 2024-09-14T11:17:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=1 2024-09-14T11:17:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=2 2024-09-14T11:17:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=3 2024-09-14T11:17:00.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=4 2024-09-14T11:17:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=5 2024-09-14T11:17:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.860+0000 7f0b9b420800 20 add_watcher() i=6 2024-09-14T11:17:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.861+0000 7f0b9b420800 20 add_watcher() i=7 2024-09-14T11:17:00.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.861+0000 7f0b9b420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:00.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.863+0000 7f0a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:00.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.863+0000 7f0b9b420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:00.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.863+0000 7f0b9b420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:00.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.863+0000 7f0b9b420800 5 note: GC not initialized 2024-09-14T11:17:00.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0a4e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:00.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0b9b420800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0b9b420800 20 Filter name: none 2024-09-14T11:17:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0a47fff640 20 reqs_thread_entry: start 2024-09-14T11:17:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0b9b420800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:17:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.864+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:00.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.865+0000 7f0b9b420800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:00.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.868+0000 7f0a4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:00.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.870+0000 7f0b9b420800 20 remove_watcher() i=0 2024-09-14T11:17:00.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.870+0000 7f0b9b420800 2 removed watcher, disabling cache 2024-09-14T11:17:00.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.871+0000 7f0b9b420800 20 remove_watcher() i=1 2024-09-14T11:17:00.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.872+0000 7f0b9b420800 20 remove_watcher() i=2 2024-09-14T11:17:00.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.873+0000 7f0b9b420800 20 remove_watcher() i=3 2024-09-14T11:17:00.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.875+0000 7f0b9b420800 20 remove_watcher() i=4 2024-09-14T11:17:00.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.876+0000 7f0b9b420800 20 remove_watcher() i=5 2024-09-14T11:17:00.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.877+0000 7f0b9b420800 20 remove_watcher() i=6 2024-09-14T11:17:00.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.878+0000 7f0b9b420800 20 remove_watcher() i=7 2024-09-14T11:17:00.890 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard list 2024-09-14T11:17:00.919 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:00.919 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:00.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.964+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 realm 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:00.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.966+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.967+0000 7f5034f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:00.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.967+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:00.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.968+0000 7f5034f0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:00.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.968+0000 7f5034f0c800 20 searching for the correct realm 2024-09-14T11:17:00.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:00.970+0000 7f50331fe640 0 -- 172.21.15.29:0/2124133347 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f502c018b40 msgr2=0x7f502c061e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:01.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.176+0000 7f50321fc640 0 -- 172.21.15.29:0/2124133347 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f502c071230 msgr2=0x7f502c06bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:01.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:01.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.383+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:01.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 zone default found 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 4 Realm: () 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 zonegroup default 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.384+0000 7f5034f0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.385+0000 7f5034f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.385+0000 7f5034f0c800 20 started sync module instance, tier type = 2024-09-14T11:17:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.385+0000 7f5034f0c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:01.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=0 2024-09-14T11:17:01.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=1 2024-09-14T11:17:01.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=2 2024-09-14T11:17:01.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=3 2024-09-14T11:17:01.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=4 2024-09-14T11:17:01.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=5 2024-09-14T11:17:01.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.396+0000 7f5034f0c800 20 add_watcher() i=6 2024-09-14T11:17:01.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.397+0000 7f5034f0c800 20 add_watcher() i=7 2024-09-14T11:17:01.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.397+0000 7f5034f0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.399+0000 7f4ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.399+0000 7f5034f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.399+0000 7f5034f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.399+0000 7f5034f0c800 5 note: GC not initialized 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.399+0000 7f4e63fff640 20 reqs_thread_entry: start 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.400+0000 7f5034f0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.400+0000 7f5034f0c800 20 Filter name: none 2024-09-14T11:17:01.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.400+0000 7f4e61ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:01.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.407+0000 7f4ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:01.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.410+0000 7f5034f0c800 20 remove_watcher() i=0 2024-09-14T11:17:01.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.410+0000 7f5034f0c800 2 removed watcher, disabling cache 2024-09-14T11:17:01.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.411+0000 7f5034f0c800 20 remove_watcher() i=1 2024-09-14T11:17:01.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.412+0000 7f5034f0c800 20 remove_watcher() i=2 2024-09-14T11:17:01.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.414+0000 7f5034f0c800 20 remove_watcher() i=3 2024-09-14T11:17:01.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.415+0000 7f5034f0c800 20 remove_watcher() i=4 2024-09-14T11:17:01.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.416+0000 7f5034f0c800 20 remove_watcher() i=5 2024-09-14T11:17:01.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.417+0000 7f5034f0c800 20 remove_watcher() i=6 2024-09-14T11:17:01.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.418+0000 7f5034f0c800 20 remove_watcher() i=7 2024-09-14T11:17:01.428 INFO:tasks.workunit.client.0.smithi029.stderr:bucket name a-bucket 2024-09-14T11:17:01.428 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard process 2024-09-14T11:17:01.428 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:01.429 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard process 2024-09-14T11:17:01.457 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:01.457 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:01.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.500+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.501+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.501+0000 7f10c5814800 20 realm 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.501+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.502+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.502+0000 7f10c5814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.502+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.502+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.502+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.503+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:01.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.503+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.503+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:01.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.503+0000 7f10c5814800 20 searching for the correct realm 2024-09-14T11:17:01.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.506+0000 7f10c17e1640 0 -- 172.21.15.29:0/2180346147 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f10b803d060 msgr2=0x7f10b80a5ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:01.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.510+0000 7f10c07df640 0 -- 172.21.15.29:0/2180346147 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f10b8015070 msgr2=0x7f10b8067960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:01.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:01.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:01.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:01.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.718+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:01.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 zone default found 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 4 Realm: () 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:01.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 zonegroup default 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.719+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.720+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.720+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.720+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.720+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.720+0000 7f10c5814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.721+0000 7f10c5814800 20 started sync module instance, tier type = 2024-09-14T11:17:01.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.721+0000 7f10c5814800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:01.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=0 2024-09-14T11:17:01.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=1 2024-09-14T11:17:01.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=2 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=3 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=4 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=5 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.731+0000 7f10c5814800 20 add_watcher() i=6 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.732+0000 7f10c5814800 20 add_watcher() i=7 2024-09-14T11:17:01.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.732+0000 7f10c5814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:01.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.734+0000 7f0f777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.734+0000 7f10c5814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.734+0000 7f10c5814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.734+0000 7f10c5814800 5 note: GC not initialized 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.734+0000 7f0f767e4640 20 reqs_thread_entry: start 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.735+0000 7f10c5814800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.735+0000 7f10c5814800 20 Filter name: none 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.735+0000 7f0f6ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:01.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.735+0000 7f10c5814800 20 processing logshard = reshard.0000000000 2024-09-14T11:17:01.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.738+0000 7f10c5814800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:17:01.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.738+0000 7f10c5814800 20 processing logshard = reshard.0000000001 2024-09-14T11:17:01.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.741+0000 7f10c5814800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:17:01.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.741+0000 7f10c5814800 20 processing logshard = reshard.0000000002 2024-09-14T11:17:01.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.743+0000 7f10c5814800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:17:01.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.743+0000 7f10c5814800 20 processing logshard = reshard.0000000003 2024-09-14T11:17:01.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.746+0000 7f10c5814800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:17:01.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.746+0000 7f10c5814800 20 processing logshard = reshard.0000000004 2024-09-14T11:17:01.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.749+0000 7f10c5814800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:17:01.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.749+0000 7f10c5814800 20 processing logshard = reshard.0000000005 2024-09-14T11:17:01.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.752+0000 7f10c5814800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:17:01.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.752+0000 7f10c5814800 20 processing logshard = reshard.0000000006 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 20 process_entry resharding a-bucket 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:17:01.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.753+0000 7f10c5814800 20 rados->read ofs=0 len=0 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:01.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.754+0000 7f10c5814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.760+0000 7f10c5814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.760+0000 7f10c5814800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.760+0000 7f10c5814800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.760+0000 7f10c5814800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.761+0000 7f0f97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94780039187168 notifier 6054 bl.length()=911 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.761+0000 7f0f97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.761+0000 7f0f97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.761+0000 7f0f97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.762+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:01.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.762+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:01.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.762+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:01.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.762+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:01.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:01.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:01.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:01.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:01.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:01.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:01.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.767+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.0 2024-09-14T11:17:01.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.768+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.768+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.768+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.769+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.4 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.769+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.5 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.770+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.6 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.770+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.7 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.771+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.8 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.771+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.9 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.772+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.10 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.772+0000 7f10c5814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:01.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.772+0000 7f10c5814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.773+0000 7f10c5814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.773+0000 7f10c5814800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.773+0000 7f10c5814800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.773+0000 7f10c5814800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.774+0000 7f0f977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94780039187168 notifier 6054 bl.length()=911 2024-09-14T11:17:01.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.774+0000 7f0f977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.774+0000 7f0f977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.774+0000 7f0f977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.775+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:01.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.775+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:01.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.775+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:01.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.775+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:01.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.778+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.0 2024-09-14T11:17:01.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.778+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1 2024-09-14T11:17:01.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.778+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2 2024-09-14T11:17:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.779+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3 2024-09-14T11:17:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.779+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.4 2024-09-14T11:17:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.779+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.5 2024-09-14T11:17:01.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.780+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.6 2024-09-14T11:17:01.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.780+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.7 2024-09-14T11:17:01.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.780+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.8 2024-09-14T11:17:01.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.780+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.9 2024-09-14T11:17:01.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.781+0000 7f10c5814800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.10 2024-09-14T11:17:01.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.781+0000 7f10c5814800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:01.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.781+0000 7f10c5814800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f10c5814800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f10c5814800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f10c5814800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f10c5814800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f0f97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497034 cookie 94780039187168 notifier 6054 bl.length()=879 2024-09-14T11:17:01.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f0f97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f0f97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.783+0000 7f0f97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.784+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.784+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.784+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:01.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.784+0000 7f10c5814800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:01.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.786+0000 7f10c5814800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:01.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.787+0000 7f10c5814800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:17:01.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.789+0000 7f10c5814800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:17:01.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.789+0000 7f10c5814800 20 processing logshard = reshard.0000000007 2024-09-14T11:17:01.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.792+0000 7f10c5814800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:17:01.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.792+0000 7f10c5814800 20 processing logshard = reshard.0000000008 2024-09-14T11:17:01.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.794+0000 7f10c5814800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:17:01.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.794+0000 7f10c5814800 20 processing logshard = reshard.0000000009 2024-09-14T11:17:01.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.797+0000 7f10c5814800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:17:01.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.797+0000 7f10c5814800 20 processing logshard = reshard.0000000010 2024-09-14T11:17:01.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.799+0000 7f10c5814800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:17:01.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.799+0000 7f10c5814800 20 processing logshard = reshard.0000000011 2024-09-14T11:17:01.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.801+0000 7f10c5814800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:17:01.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.801+0000 7f10c5814800 20 processing logshard = reshard.0000000012 2024-09-14T11:17:01.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.804+0000 7f10c5814800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:17:01.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.804+0000 7f10c5814800 20 processing logshard = reshard.0000000013 2024-09-14T11:17:01.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.807+0000 7f10c5814800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:17:01.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.807+0000 7f10c5814800 20 processing logshard = reshard.0000000014 2024-09-14T11:17:01.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.809+0000 7f10c5814800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:17:01.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.809+0000 7f10c5814800 20 processing logshard = reshard.0000000015 2024-09-14T11:17:01.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.812+0000 7f10c5814800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:17:01.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.812+0000 7f0f777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:01.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.815+0000 7f10c5814800 20 remove_watcher() i=0 2024-09-14T11:17:01.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.815+0000 7f10c5814800 2 removed watcher, disabling cache 2024-09-14T11:17:01.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.816+0000 7f10c5814800 20 remove_watcher() i=1 2024-09-14T11:17:01.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.818+0000 7f10c5814800 20 remove_watcher() i=2 2024-09-14T11:17:01.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.819+0000 7f10c5814800 20 remove_watcher() i=3 2024-09-14T11:17:01.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.820+0000 7f10c5814800 20 remove_watcher() i=4 2024-09-14T11:17:01.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.821+0000 7f10c5814800 20 remove_watcher() i=5 2024-09-14T11:17:01.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.822+0000 7f10c5814800 20 remove_watcher() i=6 2024-09-14T11:17:01.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:01.823+0000 7f10c5814800 20 remove_watcher() i=7 2024-09-14T11:17:06.838 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:17:06.874 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:06.874 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:06.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.921+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 realm 2024-09-14T11:17:06.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.923+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.924+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.924+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.925+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:06.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.925+0000 7f27e1216800 20 searching for the correct realm 2024-09-14T11:17:06.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:06.927+0000 7f27dd1e8640 0 -- 172.21.15.29:0/923996263 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f27d4065040 msgr2=0x7f27d4067440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.134+0000 7f27dc1e6640 0 -- 172.21.15.29:0/923996263 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f27d40b0980 msgr2=0x7f27d4082400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:07.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:07.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:07.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.342+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.343+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.343+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.343+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.343+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 zone default found 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 4 Realm: () 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 zonegroup default 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.344+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.345+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.345+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.345+0000 7f27e1216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.345+0000 7f27e1216800 20 started sync module instance, tier type = 2024-09-14T11:17:07.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.345+0000 7f27e1216800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=0 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=1 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=2 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=3 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=4 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=5 2024-09-14T11:17:07.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.357+0000 7f27e1216800 20 add_watcher() i=6 2024-09-14T11:17:07.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.358+0000 7f27e1216800 20 add_watcher() i=7 2024-09-14T11:17:07.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.358+0000 7f27e1216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:07.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.360+0000 7f2692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.360+0000 7f27e1216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:07.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.360+0000 7f27e1216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:07.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.360+0000 7f27e1216800 5 note: GC not initialized 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.361+0000 7f2691fe3640 20 reqs_thread_entry: start 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.361+0000 7f27e1216800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.361+0000 7f27e1216800 20 Filter name: none 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.361+0000 7f26037fe640 20 reqs_thread_entry: start 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.361+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.362+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:07.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.362+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.362+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.363+0000 7f27e1216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.363+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.363+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:07.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.363+0000 7f27e1216800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.364+0000 7f27e1216800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:07.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.364+0000 7f27e1216800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.366+0000 7f2692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.369+0000 7f27e1216800 20 remove_watcher() i=0 2024-09-14T11:17:07.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.369+0000 7f27e1216800 2 removed watcher, disabling cache 2024-09-14T11:17:07.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.370+0000 7f27e1216800 20 remove_watcher() i=1 2024-09-14T11:17:07.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.371+0000 7f27e1216800 20 remove_watcher() i=2 2024-09-14T11:17:07.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.372+0000 7f27e1216800 20 remove_watcher() i=3 2024-09-14T11:17:07.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.374+0000 7f27e1216800 20 remove_watcher() i=4 2024-09-14T11:17:07.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.375+0000 7f27e1216800 20 remove_watcher() i=5 2024-09-14T11:17:07.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.376+0000 7f27e1216800 20 remove_watcher() i=6 2024-09-14T11:17:07.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.377+0000 7f27e1216800 20 remove_watcher() i=7 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:07.388 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard add non empty bucket 2024-09-14T11:17:07.389 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:07.719 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:17:07.748 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.748 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.790+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 realm 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.792+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.793+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.793+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.794+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.794+0000 7f4f2a00d800 20 searching for the correct realm 2024-09-14T11:17:07.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:07.796+0000 7f4f282f8640 0 -- 172.21.15.29:0/3483426130 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f4f2004c070 msgr2=0x7f4f2006eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.003+0000 7f4f272f6640 0 -- 172.21.15.29:0/3483426130 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f4f20038030 msgr2=0x7f4f2006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.210+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 zone default found 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 4 Realm: () 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 zonegroup default 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.211+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 started sync module instance, tier type = 2024-09-14T11:17:08.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.212+0000 7f4f2a00d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=0 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=1 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=2 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=3 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=4 2024-09-14T11:17:08.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=5 2024-09-14T11:17:08.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.223+0000 7f4f2a00d800 20 add_watcher() i=6 2024-09-14T11:17:08.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.224+0000 7f4f2a00d800 20 add_watcher() i=7 2024-09-14T11:17:08.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.224+0000 7f4f2a00d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.226+0000 7f4dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.226+0000 7f4f2a00d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.226+0000 7f4f2a00d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.226+0000 7f4f2a00d800 5 note: GC not initialized 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.226+0000 7f4ddcfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.227+0000 7f4f2a00d800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.227+0000 7f4f2a00d800 20 Filter name: none 2024-09-14T11:17:08.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.227+0000 7f4d567fc640 20 reqs_thread_entry: start 2024-09-14T11:17:08.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.227+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.228+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.228+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.228+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.228+0000 7f4f2a00d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.228+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.229+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:08.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.229+0000 7f4f2a00d800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.229+0000 7f4f2a00d800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:08.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.229+0000 7f4f2a00d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:08.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.231+0000 7f4dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.234+0000 7f4f2a00d800 20 remove_watcher() i=0 2024-09-14T11:17:08.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.234+0000 7f4f2a00d800 2 removed watcher, disabling cache 2024-09-14T11:17:08.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.235+0000 7f4f2a00d800 20 remove_watcher() i=1 2024-09-14T11:17:08.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.236+0000 7f4f2a00d800 20 remove_watcher() i=2 2024-09-14T11:17:08.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.237+0000 7f4f2a00d800 20 remove_watcher() i=3 2024-09-14T11:17:08.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.238+0000 7f4f2a00d800 20 remove_watcher() i=4 2024-09-14T11:17:08.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.239+0000 7f4f2a00d800 20 remove_watcher() i=5 2024-09-14T11:17:08.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.240+0000 7f4f2a00d800 20 remove_watcher() i=6 2024-09-14T11:17:08.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.242+0000 7f4f2a00d800 20 remove_watcher() i=7 2024-09-14T11:17:08.251 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:08.251 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:08.251 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:17:08.251 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:08.253 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.327+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 realm 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.329+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.330+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.330+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.331+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:08.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.331+0000 7f79eb73e800 20 searching for the correct realm 2024-09-14T11:17:08.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.333+0000 7f79e7cc1640 0 -- 172.21.15.29:0/95606058 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55ba77d6e400 msgr2=0x55ba77d70810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.337+0000 7f79e7cc1640 0 -- 172.21.15.29:0/95606058 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f78b00877e0 msgr2=0x7f78b0089c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.342+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 zone default found 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 4 Realm: () 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 zonegroup default 2024-09-14T11:17:08.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.343+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.344+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.344+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.344+0000 7f79eb73e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.344+0000 7f79eb73e800 20 started sync module instance, tier type = 2024-09-14T11:17:08.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.344+0000 7f79eb73e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:08.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=0 2024-09-14T11:17:08.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=1 2024-09-14T11:17:08.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=2 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=3 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=4 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=5 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.353+0000 7f79eb73e800 20 add_watcher() i=6 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.354+0000 7f79eb73e800 20 add_watcher() i=7 2024-09-14T11:17:08.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.354+0000 7f79eb73e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f789dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f79eb73e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f79eb73e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f79eb73e800 5 note: GC not initialized 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f789cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.356+0000 7f79eb73e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 20 Filter name: none 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f78167fc640 20 reqs_thread_entry: start 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:17:08.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:08.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:17:08.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.357+0000 7f79eb73e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:08.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.358+0000 7f79eb73e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:08.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.360+0000 7f789dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.362+0000 7f79eb73e800 20 remove_watcher() i=0 2024-09-14T11:17:08.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.362+0000 7f79eb73e800 2 removed watcher, disabling cache 2024-09-14T11:17:08.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.363+0000 7f79eb73e800 20 remove_watcher() i=1 2024-09-14T11:17:08.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.364+0000 7f79eb73e800 20 remove_watcher() i=2 2024-09-14T11:17:08.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.365+0000 7f79eb73e800 20 remove_watcher() i=3 2024-09-14T11:17:08.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.366+0000 7f79eb73e800 20 remove_watcher() i=4 2024-09-14T11:17:08.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.367+0000 7f79eb73e800 20 remove_watcher() i=5 2024-09-14T11:17:08.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.368+0000 7f79eb73e800 20 remove_watcher() i=6 2024-09-14T11:17:08.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.369+0000 7f79eb73e800 20 remove_watcher() i=7 2024-09-14T11:17:08.380 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard list 2024-09-14T11:17:08.407 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:08.407 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:08.447 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.449+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 20 realm 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.450+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.451+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.451+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.451+0000 7fd571b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.451+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.452+0000 7fd571b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:08.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.452+0000 7fd571b25800 20 searching for the correct realm 2024-09-14T11:17:08.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.454+0000 7fd56dfb6640 0 -- 172.21.15.29:0/2950759790 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd568061070 msgr2=0x7fd5680a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:08.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.661+0000 7fd56cfb4640 0 -- 172.21.15.29:0/2950759790 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd5680d25b0 msgr2=0x7fd5680bfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.868+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 zone default found 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 4 Realm: () 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 zonegroup default 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.869+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.870+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.870+0000 7fd571b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.870+0000 7fd571b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.870+0000 7fd571b25800 20 started sync module instance, tier type = 2024-09-14T11:17:08.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.870+0000 7fd571b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=0 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=1 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=2 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=3 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=4 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=5 2024-09-14T11:17:08.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.880+0000 7fd571b25800 20 add_watcher() i=6 2024-09-14T11:17:08.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.881+0000 7fd571b25800 20 add_watcher() i=7 2024-09-14T11:17:08.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.881+0000 7fd571b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd4237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd571b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd571b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd571b25800 5 note: GC not initialized 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd4227e4640 20 reqs_thread_entry: start 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd571b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.883+0000 7fd571b25800 20 Filter name: none 2024-09-14T11:17:08.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.884+0000 7fd393fff640 20 reqs_thread_entry: start 2024-09-14T11:17:08.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.891+0000 7fd4237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.893+0000 7fd571b25800 20 remove_watcher() i=0 2024-09-14T11:17:08.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.893+0000 7fd571b25800 2 removed watcher, disabling cache 2024-09-14T11:17:08.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.894+0000 7fd571b25800 20 remove_watcher() i=1 2024-09-14T11:17:08.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.896+0000 7fd571b25800 20 remove_watcher() i=2 2024-09-14T11:17:08.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.897+0000 7fd571b25800 20 remove_watcher() i=3 2024-09-14T11:17:08.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.898+0000 7fd571b25800 20 remove_watcher() i=4 2024-09-14T11:17:08.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.899+0000 7fd571b25800 20 remove_watcher() i=5 2024-09-14T11:17:08.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.900+0000 7fd571b25800 20 remove_watcher() i=6 2024-09-14T11:17:08.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.901+0000 7fd571b25800 20 remove_watcher() i=7 2024-09-14T11:17:08.910 INFO:tasks.workunit.client.0.smithi029.stderr:bucket name a-bucket 2024-09-14T11:17:08.911 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard process non empty bucket 2024-09-14T11:17:08.911 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:08.912 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshard process 2024-09-14T11:17:08.939 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:08.939 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:08.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.981+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 realm 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:08.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.983+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.984+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.984+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.985+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:08.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.985+0000 7fb6bcb23800 20 searching for the correct realm 2024-09-14T11:17:08.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:08.987+0000 7fb6b900d640 0 -- 172.21.15.29:0/1984887170 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fb6b008b040 msgr2=0x7fb6b0070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.193+0000 7fb6b800b640 0 -- 172.21.15.29:0/1984887170 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fb6b0064410 msgr2=0x7fb6b0064890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:09.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:09.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.400+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 zone default found 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 4 Realm: () 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 zonegroup default 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.401+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.402+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.402+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.402+0000 7fb6bcb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.402+0000 7fb6bcb23800 20 started sync module instance, tier type = 2024-09-14T11:17:09.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.402+0000 7fb6bcb23800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:09.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=0 2024-09-14T11:17:09.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=1 2024-09-14T11:17:09.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=2 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=3 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=4 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=5 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.412+0000 7fb6bcb23800 20 add_watcher() i=6 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.413+0000 7fb6bcb23800 20 add_watcher() i=7 2024-09-14T11:17:09.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.413+0000 7fb6bcb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:09.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.415+0000 7fb56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.415+0000 7fb6bcb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.415+0000 7fb6bcb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.415+0000 7fb6bcb23800 5 note: GC not initialized 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.416+0000 7fb56e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.416+0000 7fb6bcb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.416+0000 7fb6bcb23800 20 Filter name: none 2024-09-14T11:17:09.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.416+0000 7fb5677fe640 20 reqs_thread_entry: start 2024-09-14T11:17:09.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.416+0000 7fb6bcb23800 20 processing logshard = reshard.0000000000 2024-09-14T11:17:09.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.418+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:17:09.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.418+0000 7fb6bcb23800 20 processing logshard = reshard.0000000001 2024-09-14T11:17:09.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.421+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:17:09.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.421+0000 7fb6bcb23800 20 processing logshard = reshard.0000000002 2024-09-14T11:17:09.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.424+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:17:09.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.424+0000 7fb6bcb23800 20 processing logshard = reshard.0000000003 2024-09-14T11:17:09.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.426+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:17:09.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.426+0000 7fb6bcb23800 20 processing logshard = reshard.0000000004 2024-09-14T11:17:09.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.429+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:17:09.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.429+0000 7fb6bcb23800 20 processing logshard = reshard.0000000005 2024-09-14T11:17:09.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.432+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:17:09.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.432+0000 7fb6bcb23800 20 processing logshard = reshard.0000000006 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.433+0000 7fb6bcb23800 20 process_entry resharding a-bucket 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.433+0000 7fb6bcb23800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.433+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:17:09.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.434+0000 7fb6bcb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb6bcb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb6bcb23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb6bcb23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb6bcb23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb58f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497035 cookie 94616607508096 notifier 5855 bl.length()=911 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb58f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb58f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.442+0000 7fb58f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.444+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:09.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.444+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:09.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.444+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:09.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.444+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:17:09.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.449+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:17:09.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.450+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:09.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.451+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.451+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.451+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.451+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.452+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.452+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.452+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.452+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.453+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:09.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.453+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.453+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.453+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.454+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.454+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.454+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:09.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.454+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:09.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.455+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:09.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.455+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:09.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.455+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:09.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.455+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:09.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.458+0000 7fb6bcb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:09.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.458+0000 7fb6bcb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:09.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.459+0000 7fb6bcb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.459+0000 7fb6bcb23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.459+0000 7fb6bcb23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.459+0000 7fb6bcb23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:09.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.460+0000 7fb58ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497036 cookie 94616607508096 notifier 5855 bl.length()=911 2024-09-14T11:17:09.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.460+0000 7fb58ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.460+0000 7fb58ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.460+0000 7fb58ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.461+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.461+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.461+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:09.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.461+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:09.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.464+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:09.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.464+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.0 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.1 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.2 2024-09-14T11:17:09.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:09.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.465+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.3 2024-09-14T11:17:09.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:09.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.4 2024-09-14T11:17:09.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:09.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.5 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.466+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.6 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.7 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.8 2024-09-14T11:17:09.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.467+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.9 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.10 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:09.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.1.11 2024-09-14T11:17:09.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:09.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.468+0000 7fb6bcb23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb6bcb23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb6bcb23800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb6bcb23800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb6bcb23800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb58ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497037 cookie 94616607508096 notifier 5855 bl.length()=879 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb58ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb58ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:17:09.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.470+0000 7fb58ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:17:09.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.471+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:17:09.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.471+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:17:09.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.471+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:17:09.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.471+0000 7fb6bcb23800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:17:09.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.474+0000 7fb6bcb23800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:17:09.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.475+0000 7fb6bcb23800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:17:09.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.477+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:17:09.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.477+0000 7fb6bcb23800 20 processing logshard = reshard.0000000007 2024-09-14T11:17:09.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.479+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:17:09.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.479+0000 7fb6bcb23800 20 processing logshard = reshard.0000000008 2024-09-14T11:17:09.479 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.481+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:17:09.480 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.481+0000 7fb6bcb23800 20 processing logshard = reshard.0000000009 2024-09-14T11:17:09.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.484+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:17:09.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.484+0000 7fb6bcb23800 20 processing logshard = reshard.0000000010 2024-09-14T11:17:09.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.486+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:17:09.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.486+0000 7fb6bcb23800 20 processing logshard = reshard.0000000011 2024-09-14T11:17:09.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.488+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:17:09.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.488+0000 7fb6bcb23800 20 processing logshard = reshard.0000000012 2024-09-14T11:17:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.491+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:17:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.491+0000 7fb6bcb23800 20 processing logshard = reshard.0000000013 2024-09-14T11:17:09.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.493+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:17:09.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.493+0000 7fb6bcb23800 20 processing logshard = reshard.0000000014 2024-09-14T11:17:09.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.495+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:17:09.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.495+0000 7fb6bcb23800 20 processing logshard = reshard.0000000015 2024-09-14T11:17:09.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.498+0000 7fb6bcb23800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:17:09.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.499+0000 7fb56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.501+0000 7fb6bcb23800 20 remove_watcher() i=0 2024-09-14T11:17:09.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.501+0000 7fb6bcb23800 2 removed watcher, disabling cache 2024-09-14T11:17:09.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.502+0000 7fb6bcb23800 20 remove_watcher() i=1 2024-09-14T11:17:09.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.503+0000 7fb6bcb23800 20 remove_watcher() i=2 2024-09-14T11:17:09.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.504+0000 7fb6bcb23800 20 remove_watcher() i=3 2024-09-14T11:17:09.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.505+0000 7fb6bcb23800 20 remove_watcher() i=4 2024-09-14T11:17:09.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.506+0000 7fb6bcb23800 20 remove_watcher() i=5 2024-09-14T11:17:09.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.507+0000 7fb6bcb23800 20 remove_watcher() i=6 2024-09-14T11:17:09.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.508+0000 7fb6bcb23800 20 remove_watcher() i=7 2024-09-14T11:17:09.518 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:17:09.548 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:09.548 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:09.587 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.589+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 realm 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.591+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.592+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.592+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.593+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:09.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.593+0000 7f4681b25800 20 searching for the correct realm 2024-09-14T11:17:09.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.595+0000 7f467df34640 0 -- 172.21.15.29:0/1102488219 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f4678033040 msgr2=0x7f467803f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:09.801+0000 7f4674f32640 0 -- 172.21.15.29:0/1102488219 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f46780323b0 msgr2=0x7f4678032830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.008+0000 7f4681b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.009+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.009+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.009+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.009+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.009+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 zone default found 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 4 Realm: () 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 zonegroup default 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.010+0000 7f4681b25800 20 started sync module instance, tier type = 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.011+0000 7f4681b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=0 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=1 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=2 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=3 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=4 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=5 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.021+0000 7f4681b25800 20 add_watcher() i=6 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.022+0000 7f4681b25800 20 add_watcher() i=7 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.022+0000 7f4681b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.024+0000 7f4533fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 5 note: GC not initialized 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4532fe5640 20 reqs_thread_entry: start 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 20 Filter name: none 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4530fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.025+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.026+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.026+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.026+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.026+0000 7f4681b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.026+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.027+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.027+0000 7f4681b25800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.027+0000 7f4681b25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.027+0000 7f4681b25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.029+0000 7f4533fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.031+0000 7f4681b25800 20 remove_watcher() i=0 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.031+0000 7f4681b25800 2 removed watcher, disabling cache 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.032+0000 7f4681b25800 20 remove_watcher() i=1 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.033+0000 7f4681b25800 20 remove_watcher() i=2 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.035+0000 7f4681b25800 20 remove_watcher() i=3 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.036+0000 7f4681b25800 20 remove_watcher() i=4 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.037+0000 7f4681b25800 20 remove_watcher() i=5 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.038+0000 7f4681b25800 20 remove_watcher() i=6 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:10.039+0000 7f4681b25800 20 remove_watcher() i=7 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:10.930 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:17:10.960 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:10.960 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:11.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.204+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.206+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.206+0000 7f01cd137800 20 realm 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.206+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.207+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.207+0000 7f01cd137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.207+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.207+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.207+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.208+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:11.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.208+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.208+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:11.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.208+0000 7f01cd137800 20 searching for the correct realm 2024-09-14T11:17:11.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.210+0000 7f01c3fff640 0 -- 172.21.15.29:0/2913442954 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f01bc06d070 msgr2=0x7f01bc0b4ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:11.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.214+0000 7f01c967e640 0 -- 172.21.15.29:0/2913442954 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55c9e0647850 msgr2=0x55c9e0649c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:11.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.219+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:11.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:11.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 zone default found 2024-09-14T11:17:11.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 4 Realm: () 2024-09-14T11:17:11.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:11.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 zonegroup default 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.220+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.221+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.221+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.221+0000 7f01cd137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.221+0000 7f01cd137800 20 started sync module instance, tier type = 2024-09-14T11:17:11.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.221+0000 7f01cd137800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=0 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=1 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=2 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=3 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=4 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=5 2024-09-14T11:17:11.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=6 2024-09-14T11:17:11.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 20 add_watcher() i=7 2024-09-14T11:17:11.229 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.230+0000 7f01cd137800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:11.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.232+0000 7f007f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.232+0000 7f01cd137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.232+0000 7f01cd137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.232+0000 7f01cd137800 5 note: GC not initialized 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.233+0000 7f007e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.233+0000 7f01cd137800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.233+0000 7f01cd137800 20 Filter name: none 2024-09-14T11:17:11.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.233+0000 7f0077fff640 20 reqs_thread_entry: start 2024-09-14T11:17:11.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.233+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.234+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:11.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.234+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.234+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.234+0000 7f01cd137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.234+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.235+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.235+0000 7f01cd137800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.235+0000 7f01cd137800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:11.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.235+0000 7f01cd137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:11.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.237+0000 7f007f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:11.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.239+0000 7f01cd137800 20 remove_watcher() i=0 2024-09-14T11:17:11.237 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.239+0000 7f01cd137800 2 removed watcher, disabling cache 2024-09-14T11:17:11.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.240+0000 7f01cd137800 20 remove_watcher() i=1 2024-09-14T11:17:11.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.241+0000 7f01cd137800 20 remove_watcher() i=2 2024-09-14T11:17:11.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.242+0000 7f01cd137800 20 remove_watcher() i=3 2024-09-14T11:17:11.241 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.243+0000 7f01cd137800 20 remove_watcher() i=4 2024-09-14T11:17:11.242 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.244+0000 7f01cd137800 20 remove_watcher() i=5 2024-09-14T11:17:11.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.245+0000 7f01cd137800 20 remove_watcher() i=6 2024-09-14T11:17:11.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.246+0000 7f01cd137800 20 remove_watcher() i=7 2024-09-14T11:17:11.255 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:11.256 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:11.256 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-init-index id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:11.256 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:11.257 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:17:11.292 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:11.292 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:11.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.334+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 realm 2024-09-14T11:17:11.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.335+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.336+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:11.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.336+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.337+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:11.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.337+0000 7f486792f800 20 searching for the correct realm 2024-09-14T11:17:11.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.339+0000 7f4863e77640 0 -- 172.21.15.29:0/2546971843 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f485c034040 msgr2=0x7f485c03f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:11.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.545+0000 7f4862e75640 0 -- 172.21.15.29:0/2546971843 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f485c034420 msgr2=0x7f485c034880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:11.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:11.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.752+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:11.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:11.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 zone default found 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 4 Realm: () 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 zonegroup default 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.753+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.754+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.754+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.754+0000 7f486792f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.754+0000 7f486792f800 20 started sync module instance, tier type = 2024-09-14T11:17:11.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.754+0000 7f486792f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=0 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=1 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=2 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=3 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=4 2024-09-14T11:17:11.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=5 2024-09-14T11:17:11.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.764+0000 7f486792f800 20 add_watcher() i=6 2024-09-14T11:17:11.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.765+0000 7f486792f800 20 add_watcher() i=7 2024-09-14T11:17:11.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.765+0000 7f486792f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:11.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f4719fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f486792f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f486792f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f486792f800 5 note: GC not initialized 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f4718fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f486792f800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.767+0000 7f486792f800 20 Filter name: none 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f46927fc640 20 reqs_thread_entry: start 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:17:11.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 : miss 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.768+0000 7f486792f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.769+0000 7f486792f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.770+0000 7f486792f800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:17:11.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.770+0000 7f486792f800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:17:11.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.772+0000 7f4719fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:11.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.774+0000 7f486792f800 20 remove_watcher() i=0 2024-09-14T11:17:11.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.774+0000 7f486792f800 2 removed watcher, disabling cache 2024-09-14T11:17:11.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.775+0000 7f486792f800 20 remove_watcher() i=1 2024-09-14T11:17:11.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.776+0000 7f486792f800 20 remove_watcher() i=2 2024-09-14T11:17:11.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.777+0000 7f486792f800 20 remove_watcher() i=3 2024-09-14T11:17:11.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.778+0000 7f486792f800 20 remove_watcher() i=4 2024-09-14T11:17:11.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.779+0000 7f486792f800 20 remove_watcher() i=5 2024-09-14T11:17:11.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.781+0000 7f486792f800 20 remove_watcher() i=6 2024-09-14T11:17:11.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.782+0000 7f486792f800 20 remove_watcher() i=7 2024-09-14T11:17:11.794 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:17:11.823 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:11.823 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:11.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.864+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 realm 2024-09-14T11:17:11.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.866+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.867+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:11.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.867+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:11.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.868+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:11.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.868+0000 7f22dc328800 20 searching for the correct realm 2024-09-14T11:17:11.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:11.870+0000 7f22d8870640 0 -- 172.21.15.29:0/1717747171 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f22d0047020 msgr2=0x7f22d00741e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:12.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.076+0000 7f22d786e640 0 -- 172.21.15.29:0/1717747171 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f22d0017020 msgr2=0x7f22d008d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:12.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:12.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.282+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:12.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 zone default found 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 4 Realm: () 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 zonegroup default 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.283+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 started sync module instance, tier type = 2024-09-14T11:17:12.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.284+0000 7f22dc328800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=0 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=1 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=2 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=3 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=4 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=5 2024-09-14T11:17:12.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.294+0000 7f22dc328800 20 add_watcher() i=6 2024-09-14T11:17:12.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.295+0000 7f22dc328800 20 add_watcher() i=7 2024-09-14T11:17:12.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.295+0000 7f22dc328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:12.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.296+0000 7f218efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f22dc328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f22dc328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f22dc328800 5 note: GC not initialized 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f218dfdb640 20 reqs_thread_entry: start 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f22dc328800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.297+0000 7f22dc328800 20 Filter name: none 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.298+0000 7f20ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:12.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.298+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.298+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.298+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:12.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.299+0000 7f22dc328800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:12.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.300+0000 7f22dc328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:12.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.301+0000 7f218efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:12.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.303+0000 7f22dc328800 20 remove_watcher() i=0 2024-09-14T11:17:12.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.303+0000 7f22dc328800 2 removed watcher, disabling cache 2024-09-14T11:17:12.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.305+0000 7f22dc328800 20 remove_watcher() i=1 2024-09-14T11:17:12.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.306+0000 7f22dc328800 20 remove_watcher() i=2 2024-09-14T11:17:12.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.307+0000 7f22dc328800 20 remove_watcher() i=3 2024-09-14T11:17:12.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.308+0000 7f22dc328800 20 remove_watcher() i=4 2024-09-14T11:17:12.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.309+0000 7f22dc328800 20 remove_watcher() i=5 2024-09-14T11:17:12.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.310+0000 7f22dc328800 20 remove_watcher() i=6 2024-09-14T11:17:12.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.311+0000 7f22dc328800 20 remove_watcher() i=7 2024-09-14T11:17:12.321 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:12.321 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:12.321 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-init-index id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:12.321 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:12.414 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:12.448 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:12.448 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:12.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.489+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 realm 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.491+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.492+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:12.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.492+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.493+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:12.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.493+0000 7fed7fc2f800 20 searching for the correct realm 2024-09-14T11:17:12.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.495+0000 7fed7df21640 0 -- 172.21.15.29:0/1607943872 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fed7806ac20 msgr2=0x7fed78075c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:12.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.701+0000 7fed7cf1f640 0 -- 172.21.15.29:0/1607943872 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fed78076230 msgr2=0x7fed78082370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:12.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.908+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 zone default found 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 4 Realm: () 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:12.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 zonegroup default 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.909+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 started sync module instance, tier type = 2024-09-14T11:17:12.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.910+0000 7fed7fc2f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=0 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=1 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=2 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=3 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=4 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=5 2024-09-14T11:17:12.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.920+0000 7fed7fc2f800 20 add_watcher() i=6 2024-09-14T11:17:12.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.921+0000 7fed7fc2f800 20 add_watcher() i=7 2024-09-14T11:17:12.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.921+0000 7fed7fc2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:12.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.922+0000 7fec337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:12.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 5 note: GC not initialized 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fec327e4640 20 reqs_thread_entry: start 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 20 Filter name: none 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7feba3fff640 20 reqs_thread_entry: start 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:17:12.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.923+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.924+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.924+0000 7fed7fc2f800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.924+0000 7fed7fc2f800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.924+0000 7fed7fc2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 : miss 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.924+0000 7fed7fc2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:12.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.925+0000 7fed7fc2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 2024-09-14T11:17:12.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.933+0000 7fed7fc2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.933+0000 7fed7fc2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.933+0000 7fed7fc2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.933+0000 7fed7fc2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20, ofs0, ns] 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.934+0000 7fec60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 93900878878208 notifier 6252 bl.length()=995 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.934+0000 7fec60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.934+0000 7fec60ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.934+0000 7fec60ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.936+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_sources= new_sources= 2024-09-14T11:17:12.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.936+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential sources added=[] removed=[] 2024-09-14T11:17:12.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.936+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_dests= new_dests= 2024-09-14T11:17:12.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.936+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential dests added=[] removed=[] 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.0 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.0 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.1 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.1 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.2 2024-09-14T11:17:12.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.2 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.3 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.3 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.4 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.4 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.5 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.5 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.6 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.6 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.7 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.7 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.8 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.8 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.9 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.9 2024-09-14T11:17:12.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.10 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.10 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.11 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1.11 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.0 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.941+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1 2024-09-14T11:17:12.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.942+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.2 2024-09-14T11:17:12.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.942+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.3 2024-09-14T11:17:12.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.943+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.4 2024-09-14T11:17:12.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.944+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.5 2024-09-14T11:17:12.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.944+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.6 2024-09-14T11:17:12.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.945+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.7 2024-09-14T11:17:12.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.946+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.8 2024-09-14T11:17:12.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.946+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.9 2024-09-14T11:17:12.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.947+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.10 2024-09-14T11:17:12.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.950+0000 7fed7fc2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:12.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.950+0000 7fed7fc2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fed7fc2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fed7fc2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fed7fc2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fed7fc2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20, ofs0, ns] 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fec4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 93900878878208 notifier 6252 bl.length()=995 2024-09-14T11:17:12.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fec4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fec4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.953+0000 7fec4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.955+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_sources= new_sources= 2024-09-14T11:17:12.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.955+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential sources added=[] removed=[] 2024-09-14T11:17:12.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.955+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_dests= new_dests= 2024-09-14T11:17:12.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.955+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential dests added=[] removed=[] 2024-09-14T11:17:12.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.959+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.0 2024-09-14T11:17:12.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.959+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.1 2024-09-14T11:17:12.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.959+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.2 2024-09-14T11:17:12.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.960+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.3 2024-09-14T11:17:12.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.960+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.4 2024-09-14T11:17:12.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.960+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.5 2024-09-14T11:17:12.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.961+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.6 2024-09-14T11:17:12.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.961+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.7 2024-09-14T11:17:12.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.961+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.8 2024-09-14T11:17:12.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.962+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.9 2024-09-14T11:17:12.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.962+0000 7fed7fc2f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.20.10 2024-09-14T11:17:12.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.963+0000 7fed7fc2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:12.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.963+0000 7fed7fc2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 2024-09-14T11:17:12.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fed7fc2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fed7fc2f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fed7fc2f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fed7fc2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20, ofs0, ns] 2024-09-14T11:17:12.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fec4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93900878878208 notifier 6252 bl.length()=963 2024-09-14T11:17:12.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fec4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 info.flags=0x17 2024-09-14T11:17:12.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fec4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.20 to cache LRU end 2024-09-14T11:17:12.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.964+0000 7fec4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:12.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.966+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_sources= new_sources= 2024-09-14T11:17:12.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.966+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential sources added=[] removed=[] 2024-09-14T11:17:12.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.966+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): orig_dests= new_dests= 2024-09-14T11:17:12.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.966+0000 7fed7fc2f800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.20]): potential dests added=[] removed=[] 2024-09-14T11:17:12.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.968+0000 7fed7fc2f800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:12.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.970+0000 7fec337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:12.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.972+0000 7fed7fc2f800 20 remove_watcher() i=0 2024-09-14T11:17:12.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.972+0000 7fed7fc2f800 2 removed watcher, disabling cache 2024-09-14T11:17:12.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.973+0000 7fed7fc2f800 20 remove_watcher() i=1 2024-09-14T11:17:12.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.975+0000 7fed7fc2f800 20 remove_watcher() i=2 2024-09-14T11:17:12.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.977+0000 7fed7fc2f800 20 remove_watcher() i=3 2024-09-14T11:17:12.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.978+0000 7fed7fc2f800 20 remove_watcher() i=4 2024-09-14T11:17:12.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.979+0000 7fed7fc2f800 20 remove_watcher() i=5 2024-09-14T11:17:12.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.980+0000 7fed7fc2f800 20 remove_watcher() i=6 2024-09-14T11:17:12.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:12.981+0000 7fed7fc2f800 20 remove_watcher() i=7 2024-09-14T11:17:12.992 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:17:13.023 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:13.023 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:13.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.064+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 realm 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.066+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.067+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:13.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.067+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.068+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:13.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.068+0000 7f6ad7123800 20 searching for the correct realm 2024-09-14T11:17:13.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.070+0000 7f6ad360d640 0 -- 172.21.15.29:0/2398938964 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6acc02b070 msgr2=0x7f6acc049040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:13.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.276+0000 7f6ad260b640 0 -- 172.21.15.29:0/2398938964 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6acc0a53d0 msgr2=0x7f6acc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:13.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:13.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.483+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 zone default found 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 4 Realm: () 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 zonegroup default 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.484+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.485+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.485+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.485+0000 7f6ad7123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:13.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.485+0000 7f6ad7123800 20 started sync module instance, tier type = 2024-09-14T11:17:13.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.485+0000 7f6ad7123800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=0 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=1 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=2 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=3 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=4 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=5 2024-09-14T11:17:13.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=6 2024-09-14T11:17:13.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 20 add_watcher() i=7 2024-09-14T11:17:13.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.497+0000 7f6ad7123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:13.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.499+0000 7f69897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.499+0000 7f6ad7123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.499+0000 7f6ad7123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.499+0000 7f6ad7123800 5 note: GC not initialized 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6903fff640 20 reqs_thread_entry: start 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6ad7123800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6ad7123800 20 Filter name: none 2024-09-14T11:17:13.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6901ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.500+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.501+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.501+0000 7f6ad7123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:13.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.501+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.501+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:13.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.501+0000 7f6ad7123800 20 rados->read ofs=0 len=0 2024-09-14T11:17:13.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.502+0000 7f6ad7123800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:13.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.502+0000 7f6ad7123800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:13.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.504+0000 7f69897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:13.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.506+0000 7f6ad7123800 20 remove_watcher() i=0 2024-09-14T11:17:13.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.506+0000 7f6ad7123800 2 removed watcher, disabling cache 2024-09-14T11:17:13.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.507+0000 7f6ad7123800 20 remove_watcher() i=1 2024-09-14T11:17:13.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.508+0000 7f6ad7123800 20 remove_watcher() i=2 2024-09-14T11:17:13.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.509+0000 7f6ad7123800 20 remove_watcher() i=3 2024-09-14T11:17:13.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.510+0000 7f6ad7123800 20 remove_watcher() i=4 2024-09-14T11:17:13.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.511+0000 7f6ad7123800 20 remove_watcher() i=5 2024-09-14T11:17:13.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.512+0000 7f6ad7123800 20 remove_watcher() i=6 2024-09-14T11:17:13.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:13.513+0000 7f6ad7123800 20 remove_watcher() i=7 2024-09-14T11:17:13.522 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:13.523 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:13.523 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-init-index id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:13.523 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:13.917 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:17:13.918 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:14.773 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:17:14.803 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:14.803 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:14.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.843+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.845+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.845+0000 7fe47fc11800 20 realm 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.845+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.845+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.845+0000 7fe47fc11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.846+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.846+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:14.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.846+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.847+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:14.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.847+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:14.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.847+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:14.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.847+0000 7fe47fc11800 20 searching for the correct realm 2024-09-14T11:17:14.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:14.849+0000 7fe47bb49640 0 -- 172.21.15.29:0/3020225350 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe474085b60 msgr2=0x7fe47407e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:15.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.054+0000 7fe47ab47640 0 -- 172.21.15.29:0/3020225350 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe47407d440 msgr2=0x7fe47407d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:15.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:15.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:15.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:15.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.262+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 zone default found 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 4 Realm: () 2024-09-14T11:17:15.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 zonegroup default 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.263+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.264+0000 7fe47fc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.264+0000 7fe47fc11800 20 started sync module instance, tier type = 2024-09-14T11:17:15.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.264+0000 7fe47fc11800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:15.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=0 2024-09-14T11:17:15.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=1 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=2 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=3 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=4 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=5 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.273+0000 7fe47fc11800 20 add_watcher() i=6 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.274+0000 7fe47fc11800 20 add_watcher() i=7 2024-09-14T11:17:15.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.274+0000 7fe47fc11800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:15.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.276+0000 7fe331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.276+0000 7fe47fc11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.276+0000 7fe47fc11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.276+0000 7fe47fc11800 5 note: GC not initialized 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.276+0000 7fe330fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.277+0000 7fe47fc11800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.277+0000 7fe47fc11800 20 Filter name: none 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.277+0000 7fe2aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:15.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.277+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:15.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:15.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.278+0000 7fe47fc11800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.279+0000 7fe47fc11800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:15.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.279+0000 7fe47fc11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:15.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.280+0000 7fe331fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:15.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.282+0000 7fe47fc11800 20 remove_watcher() i=0 2024-09-14T11:17:15.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.282+0000 7fe47fc11800 2 removed watcher, disabling cache 2024-09-14T11:17:15.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.283+0000 7fe47fc11800 20 remove_watcher() i=1 2024-09-14T11:17:15.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.284+0000 7fe47fc11800 20 remove_watcher() i=2 2024-09-14T11:17:15.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.285+0000 7fe47fc11800 20 remove_watcher() i=3 2024-09-14T11:17:15.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.286+0000 7fe47fc11800 20 remove_watcher() i=4 2024-09-14T11:17:15.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.287+0000 7fe47fc11800 20 remove_watcher() i=5 2024-09-14T11:17:15.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.288+0000 7fe47fc11800 20 remove_watcher() i=6 2024-09-14T11:17:15.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.289+0000 7fe47fc11800 20 remove_watcher() i=7 2024-09-14T11:17:15.298 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:15.298 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:15.299 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-init-index id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:15.299 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:15.300 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:17:15.337 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:15.337 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:15.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.379+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 20 realm 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.381+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.382+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.382+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.382+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:15.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.382+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.383+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:15.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.383+0000 7f36bff2a800 20 searching for the correct realm 2024-09-14T11:17:15.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.385+0000 7f36bc362640 0 -- 172.21.15.29:0/3808819532 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f36b4044560 msgr2=0x7f36b4043fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:15.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.590+0000 7f36bb360640 0 -- 172.21.15.29:0/3808819532 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f36b406e9d0 msgr2=0x7f36b40789c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:15.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:15.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:15.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:15.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:15.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.798+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 zone default found 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 4 Realm: () 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:15.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 zonegroup default 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 started sync module instance, tier type = 2024-09-14T11:17:15.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.799+0000 7f36bff2a800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=0 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=1 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=2 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=3 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=4 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=5 2024-09-14T11:17:15.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.809+0000 7f36bff2a800 20 add_watcher() i=6 2024-09-14T11:17:15.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.810+0000 7f36bff2a800 20 add_watcher() i=7 2024-09-14T11:17:15.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.810+0000 7f36bff2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:15.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f3571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f36bff2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f36bff2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f36bff2a800 5 note: GC not initialized 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f3570fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.812+0000 7f36bff2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 20 Filter name: none 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f34ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:17:15.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:15.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:17:15.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 : miss 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.813+0000 7f36bff2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 info.flags=0x17 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 to cache LRU end 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.814+0000 7f36bff2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 2024-09-14T11:17:15.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.815+0000 7f36bff2a800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:17:15.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.815+0000 7f36bff2a800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:17:15.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.819+0000 7f36bff2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 info.flags=0x17 2024-09-14T11:17:15.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.819+0000 7f36bff2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 to cache LRU end 2024-09-14T11:17:15.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.819+0000 7f36bff2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:15.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.819+0000 7f36bff2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21, ofs0, ns] 2024-09-14T11:17:15.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.820+0000 7f359affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94062048447792 notifier 5993 bl.length()=995 2024-09-14T11:17:15.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.820+0000 7f359affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 info.flags=0x17 2024-09-14T11:17:15.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.820+0000 7f359affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 to cache LRU end 2024-09-14T11:17:15.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.820+0000 7f359affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:15.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.822+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): orig_sources= new_sources= 2024-09-14T11:17:15.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.822+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): potential sources added=[] removed=[] 2024-09-14T11:17:15.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.822+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): orig_dests= new_dests= 2024-09-14T11:17:15.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.822+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): potential dests added=[] removed=[] 2024-09-14T11:17:15.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.0 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.0 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.1 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.1 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.2 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.2 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.3 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.3 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.4 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.4 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.5 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.5 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.6 2024-09-14T11:17:15.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.6 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.7 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.7 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.8 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.8 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.9 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.9 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.10 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.10 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.11 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1.11 2024-09-14T11:17:15.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.824+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.0 2024-09-14T11:17:15.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.825+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.1 2024-09-14T11:17:15.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.825+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.2 2024-09-14T11:17:15.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.826+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.3 2024-09-14T11:17:15.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.827+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.4 2024-09-14T11:17:15.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.827+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.5 2024-09-14T11:17:15.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.828+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.6 2024-09-14T11:17:15.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.828+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.7 2024-09-14T11:17:15.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.828+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.8 2024-09-14T11:17:15.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.829+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.9 2024-09-14T11:17:15.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.830+0000 7f36bff2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.21.10 2024-09-14T11:17:15.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.833+0000 7f36bff2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:15.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.833+0000 7f36bff2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 2024-09-14T11:17:15.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f36bff2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 info.flags=0x17 2024-09-14T11:17:15.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f36bff2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 to cache LRU end 2024-09-14T11:17:15.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f36bff2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:15.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f36bff2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21, ofs0, ns] 2024-09-14T11:17:15.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f359a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497008 cookie 94062048447792 notifier 5993 bl.length()=963 2024-09-14T11:17:15.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f359a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 info.flags=0x17 2024-09-14T11:17:15.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f359a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:11989569-703c-4397-b0f1-7ddb0279a491.4517.21 to cache LRU end 2024-09-14T11:17:15.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.834+0000 7f359a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:15.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.836+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): orig_sources= new_sources= 2024-09-14T11:17:15.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.836+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): potential sources added=[] removed=[] 2024-09-14T11:17:15.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.836+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): orig_dests= new_dests= 2024-09-14T11:17:15.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.836+0000 7f36bff2a800 20 handle_bi_update(): bucket=:error-at-init-index[11989569-703c-4397-b0f1-7ddb0279a491.4517.21]): potential dests added=[] removed=[] 2024-09-14T11:17:15.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.838+0000 7f36bff2a800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:15.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.840+0000 7f3571fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:15.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.842+0000 7f36bff2a800 20 remove_watcher() i=0 2024-09-14T11:17:15.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.842+0000 7f36bff2a800 2 removed watcher, disabling cache 2024-09-14T11:17:15.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.844+0000 7f36bff2a800 20 remove_watcher() i=1 2024-09-14T11:17:15.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.845+0000 7f36bff2a800 20 remove_watcher() i=2 2024-09-14T11:17:15.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.846+0000 7f36bff2a800 20 remove_watcher() i=3 2024-09-14T11:17:15.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.847+0000 7f36bff2a800 20 remove_watcher() i=4 2024-09-14T11:17:15.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.848+0000 7f36bff2a800 20 remove_watcher() i=5 2024-09-14T11:17:15.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.849+0000 7f36bff2a800 20 remove_watcher() i=6 2024-09-14T11:17:15.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.850+0000 7f36bff2a800 20 remove_watcher() i=7 2024-09-14T11:17:15.861 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:17:15.891 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:15.891 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:15.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.933+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.934+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.934+0000 7f4eca52e800 20 realm 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.934+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.934+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.934+0000 7f4eca52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.935+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.935+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:15.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.935+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.935+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:15.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.935+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:15.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.936+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:15.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.936+0000 7f4eca52e800 20 searching for the correct realm 2024-09-14T11:17:15.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.937+0000 7f4ec62dd640 0 -- 172.21.15.29:0/206945 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55e63a6dee40 msgr2=0x55e63a6e1300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:15.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:15.940+0000 7f4ec62dd640 0 -- 172.21.15.29:0/206945 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f4eb0003c80 msgr2=0x7f4ec0041910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:16.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:16.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:16.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:16.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:16.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.149+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 zone default found 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 4 Realm: () 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:16.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 zonegroup default 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.150+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.151+0000 7f4eca52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.151+0000 7f4eca52e800 20 started sync module instance, tier type = 2024-09-14T11:17:16.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.151+0000 7f4eca52e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:16.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=0 2024-09-14T11:17:16.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=1 2024-09-14T11:17:16.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=2 2024-09-14T11:17:16.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=3 2024-09-14T11:17:16.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=4 2024-09-14T11:17:16.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=5 2024-09-14T11:17:16.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.159+0000 7f4eca52e800 20 add_watcher() i=6 2024-09-14T11:17:16.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.160+0000 7f4eca52e800 20 add_watcher() i=7 2024-09-14T11:17:16.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.160+0000 7f4eca52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:16.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.162+0000 7f4d7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.162+0000 7f4eca52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.162+0000 7f4eca52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.162+0000 7f4eca52e800 5 note: GC not initialized 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.162+0000 7f4cf77fe640 20 reqs_thread_entry: start 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.163+0000 7f4eca52e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.163+0000 7f4eca52e800 20 Filter name: none 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.163+0000 7f4cf57fa640 20 reqs_thread_entry: start 2024-09-14T11:17:16.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.163+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.164+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:16.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.164+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.164+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.164+0000 7f4eca52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.164+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.165+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.165+0000 7f4eca52e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.165+0000 7f4eca52e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:17:16.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.165+0000 7f4eca52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:16.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.167+0000 7f4d7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:16.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.169+0000 7f4eca52e800 20 remove_watcher() i=0 2024-09-14T11:17:16.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.169+0000 7f4eca52e800 2 removed watcher, disabling cache 2024-09-14T11:17:16.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.170+0000 7f4eca52e800 20 remove_watcher() i=1 2024-09-14T11:17:16.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.171+0000 7f4eca52e800 20 remove_watcher() i=2 2024-09-14T11:17:16.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.172+0000 7f4eca52e800 20 remove_watcher() i=3 2024-09-14T11:17:16.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.173+0000 7f4eca52e800 20 remove_watcher() i=4 2024-09-14T11:17:16.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.174+0000 7f4eca52e800 20 remove_watcher() i=5 2024-09-14T11:17:16.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.175+0000 7f4eca52e800 20 remove_watcher() i=6 2024-09-14T11:17:16.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:16.176+0000 7f4eca52e800 20 remove_watcher() i=7 2024-09-14T11:17:16.184 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:16.184 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:16.185 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-init-index id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:17:16.185 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:16.632 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:17:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:17.572 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:17:17.604 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:17.604 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:17.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.651+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.652+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.652+0000 7f0333a0e800 20 realm 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.652+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.653+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.653+0000 7f0333a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.653+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.653+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:17.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.653+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.654+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:17.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.654+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.654+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:17.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.655+0000 7f0333a0e800 20 searching for the correct realm 2024-09-14T11:17:17.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.656+0000 7f032f8cc640 0 -- 172.21.15.29:0/2828970688 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f03280783e0 msgr2=0x7f0328078800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:17.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:17.861+0000 7f032e8ca640 0 -- 172.21.15.29:0/2828970688 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0328056420 msgr2=0x7f03280568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:18.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.068+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 zone default found 2024-09-14T11:17:18.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 4 Realm: () 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 zonegroup default 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.069+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.070+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.070+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.070+0000 7f0333a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.070+0000 7f0333a0e800 20 started sync module instance, tier type = 2024-09-14T11:17:18.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.070+0000 7f0333a0e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=0 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=1 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=2 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=3 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=4 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=5 2024-09-14T11:17:18.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.078+0000 7f0333a0e800 20 add_watcher() i=6 2024-09-14T11:17:18.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.079+0000 7f0333a0e800 20 add_watcher() i=7 2024-09-14T11:17:18.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.079+0000 7f0333a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.081+0000 7f01e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.081+0000 7f0333a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.081+0000 7f0333a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.081+0000 7f0333a0e800 5 note: GC not initialized 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.081+0000 7f01e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f0333a0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f0333a0e800 20 Filter name: none 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f015e7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:18.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.082+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.083+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.083+0000 7f0333a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.083+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.083+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:18.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.083+0000 7f0333a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.084+0000 7f0333a0e800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:18.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.084+0000 7f0333a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:18.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.085+0000 7f01e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.087+0000 7f0333a0e800 20 remove_watcher() i=0 2024-09-14T11:17:18.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.087+0000 7f0333a0e800 2 removed watcher, disabling cache 2024-09-14T11:17:18.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.088+0000 7f0333a0e800 20 remove_watcher() i=1 2024-09-14T11:17:18.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.089+0000 7f0333a0e800 20 remove_watcher() i=2 2024-09-14T11:17:18.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.090+0000 7f0333a0e800 20 remove_watcher() i=3 2024-09-14T11:17:18.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.091+0000 7f0333a0e800 20 remove_watcher() i=4 2024-09-14T11:17:18.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.092+0000 7f0333a0e800 20 remove_watcher() i=5 2024-09-14T11:17:18.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.093+0000 7f0333a0e800 20 remove_watcher() i=6 2024-09-14T11:17:18.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.094+0000 7f0333a0e800 20 remove_watcher() i=7 2024-09-14T11:17:18.103 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.103 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:18.103 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-init-indext id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:18.103 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.105 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:17:18.139 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:18.139 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:18.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.182+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 realm 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.186+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.186+0000 7f7dbe887800 20 searching for the correct realm 2024-09-14T11:17:18.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.186+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x557ba03973e0 msgr2=0x557ba03998a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.390+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f7db4043040 msgr2=0x7f7db4045950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:18.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.598 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zone default found 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Realm: () 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:18.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zonegroup default 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started sync module instance, tier type = 2024-09-14T11:17:18.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:18.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=0 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=1 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=2 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=3 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=4 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=5 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=6 2024-09-14T11:17:18.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.611+0000 7f7dbe887800 20 add_watcher() i=7 2024-09-14T11:17:18.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.611+0000 7f7dbe887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.613+0000 7f7c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 5 note: GC not initialized 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 20 Filter name: none 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7be37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:17:18.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.615+0000 7f7dbe887800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : miss 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.616+0000 7f7dbe887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:18.615 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7dbe887800 time 2024-09-14T11:17:18.618147+0000 2024-09-14T11:17:18.615 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:18.616 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.616 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7dc1d8c76a] 2024-09-14T11:17:18.616 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.616 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.616 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f7dbe887800 thread_name:radosgw-admin 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.618+0000 7f7dbe887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7dbe887800 time 2024-09-14T11:17:18.618147+0000 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7dc1d8c76a] 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.617 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:18.618 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dc0a3e6f0] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dc0a8b99c] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7dc1d8c7c4] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:18.638 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.619+0000 7f7dbe887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f7dbe887800 thread_name:radosgw-admin 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dc0a3e6f0] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dc0a8b99c] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7dc1d8c7c4] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.639 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:17:18.164+0000 7f7dbcb79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:17:18.164+0000 7f7caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: dump: 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.640 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6026 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:18.641 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:17:18.165+0000 7f7dbe887800 4 set_mon_vals no callback set 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: dump: 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: shutdown 2024-09-14T11:17:18.642 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 asok(0x557ba007c270) unregister_commands rotate-key 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:17:18.165+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.643 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.644 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: starting msgr at 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: starting objecter 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests hook 0x557ba02c5fb0 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: setting wanted keys 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: calling monclient init 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.645 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key hook 0x557ba029c6f8 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:18.646 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba02c6800 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba02c7180 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x7f7da8002340 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.801806s 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba02c7180 auth_method 0 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x7f7da8002340 auth_method 0 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.647 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:17:18.167+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba02c6800 auth_method 0 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:17:18.167+0000 7f7db3fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:18.648 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: dump: 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.649 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:17:18.167+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: dump: 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.650 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:17:18.167+0000 7f7caa60c640 4 set_mon_vals no callback set 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:17:18.167+0000 7f7dbe887800 1 librados: init done 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:17:18.170+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7ca4077230 auth_method 0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:17:18.170+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba02c52d0 auth_method 0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:17:18.171+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba02e84b0 auth_method 0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:17:18.171+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba02ecb80 auth_method 0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:17:18.172+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba02f0980 auth_method 0 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.651 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:17:18.173+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.652 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:17:18.173+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests cmddesc objecter_requests hook 0x557ba02f7f90 EEXIST 2024-09-14T11:17:18.653 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.654 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:17:18.174+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:17:18.174+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:17:18.174+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x557ba02f3b20 EEXIST 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba031c2b0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba031c690 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba031afc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.809448s 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba031c2b0 auth_method 0 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.655 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba031afc0 auth_method 0 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba031c690 auth_method 0 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.656 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 6360 payload 824 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:17:18.174+0000 7f7db3fff640 1 monclient: found mon.noname-a 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: dump: 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.657 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: dump: 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.658 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:17:18.175+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6360 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:17:18.175+0000 7f7dbd37a640 4 set_mon_vals no callback set 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.659 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:17:18.177+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x7f7c94077140 auth_method 0 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: get_monmap_and_config 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:17:18.177+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.660 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.661 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:17:18.177+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.662 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:17:18.177+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:17:18.178+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:17:18.178+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x7ffc97d147a8 EEXIST 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba0340380 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba036adf0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba036c1a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.663 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.813184s 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba036adf0 auth_method 0 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba0340380 auth_method 0 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba036c1a0 auth_method 0 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.664 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 5974 payload 274 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:17:18.178+0000 7f7db3fff640 1 monclient: found mon.noname-b 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.73:3300/0 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: dump: 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.665 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: dump: 2024-09-14T11:17:18.666 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:17:18.178+0000 7f7dbe887800 5 monclient: authenticate success, global_id 5974 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:17:18.178+0000 7f7dbe887800 4 set_mon_vals no callback set 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: shutdown 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.667 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.668 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:17:18.179+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: starting msgr at 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: starting objecter 2024-09-14T11:17:18.669 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests cmddesc objecter_requests hook 0x557ba0366e40 EEXIST 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: setting wanted keys 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: calling monclient init 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.670 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:17:18.180+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:17:18.180+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x557ba0330cb8 EEXIST 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba0340380 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba036c1a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba0373dc0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.671 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.815511s 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba0340380 auth_method 0 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba0373dc0 auth_method 0 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba036c1a0 auth_method 0 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.672 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_done global_id 6366 payload 824 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:17:18.180+0000 7f7dbc378640 1 monclient: found mon.noname-a 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: dump: 2024-09-14T11:17:18.673 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: dump: 2024-09-14T11:17:18.674 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:17:18.181+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6366 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:17:18.181+0000 7f7c937fe640 4 set_mon_vals no callback set 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.675 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:17:18.181+0000 7f7dbe887800 1 librados: init done 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:17:18.181+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cr dump hook 0x557ba0369078 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:17:18.182+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:17:18.183+0000 7f7db3fff640 10 monclient: get_auth_request con 0x7f7c84077230 auth_method 0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:17:18.183+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba038abb0 auth_method 0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 realm 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:17:18.184+0000 7f7dbe887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.676 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:17:18.185+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba038ee70 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:17:18.185+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba03926d0 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:17:18.186+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:17:18.186+0000 7f7dbe887800 20 searching for the correct realm 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:17:18.186+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba03973e0 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:17:18.186+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x557ba03973e0 msgr2=0x557ba03998a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:17:18.387+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba03973e0 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:17:18.387+0000 7f7db3fff640 10 monclient: get_auth_request con 0x7f7dac083070 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:17:18.389+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x7f7da8003ab0 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:17:18.390+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7db4043040 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:17:18.390+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f7db4043040 msgr2=0x7f7db4045950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:17:18.591+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7db4043040 auth_method 0 2024-09-14T11:17:18.677 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:17:18.594+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba0112d00 auth_method 0 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zone default found 2024-09-14T11:17:18.678 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Realm: () 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:17:18.600+0000 7f7dbe887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zonegroup default 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started sync module instance, tier type = 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=0 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=1 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=2 2024-09-14T11:17:18.679 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=3 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=4 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=5 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=6 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:17:18.611+0000 7f7dbe887800 20 add_watcher() i=7 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:17:18.611+0000 7f7dbe887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.680 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:17:18.613+0000 7f7c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:17:18.614+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache list hook 0x557ba0361f00 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache inspect hook 0x557ba0361f00 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache erase hook 0x557ba0361f00 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache zap hook 0x557ba0361f00 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 note: GC not initialized 2024-09-14T11:17:18.681 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:17:18.614+0000 7f7c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace show hook 0x7f7da4077f20 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace history hook 0x7f7da4077f20 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace active hook 0x7f7da4077f20 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace active_short hook 0x7f7da4077f20 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 Filter name: none 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:17:18.614+0000 7f7be37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:17:18.614+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : miss 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:17:18.616+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:18.682 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:17:18.618+0000 7f7dbe887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7dbe887800 time 2024-09-14T11:17:18.618147+0000 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7dc1d8c76a] 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:18.683 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:17:18.619+0000 7f7dbe887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f7dbe887800 thread_name:radosgw-admin 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dc0a3e6f0] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dc0a8b99c] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7dc1d8c7c4] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.684 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:17:18.685 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:18.686 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:17:18.687 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:17:18.688 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:17:18.689 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:17:18.690 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7be37fe640 / http_manager 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c71fdb640 / http_manager 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c72fdd640 / rgw_dt_lg_renew 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c91ffb640 / ms_dispatch 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c937fe640 / io_context_pool 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7ca1ffb640 / ms_dispatch 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7ca8e09640 / ms_dispatch 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7caa60c640 / io_context_pool 2024-09-14T11:17:18.691 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7db3fff640 / msgr-worker-2 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbc378640 / msgr-worker-1 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbcb79640 / msgr-worker-0 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbd37a640 / io_context_pool 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbe887800 / radosgw-admin 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.90975.log 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:17:18.164+0000 7f7dbcb79640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:17:18.164+0000 7f7caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: dump: 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.692 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6026 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:17:18.165+0000 7f7dbe887800 4 set_mon_vals no callback set 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.693 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:17:18.165+0000 7f7caa60c640 10 monclient: dump: 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: shutdown 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 asok(0x557ba007c270) unregister_commands rotate-key 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.694 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:17:18.165+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:17:18.165+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding auth protocol: cephx 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.695 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: crc 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:17:18.165+0000 7f7dbe887800 5 AuthRegistry(0x557ba02a21a0) adding con mode: secure 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: starting msgr at 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: starting objecter 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests hook 0x557ba02c5fb0 2024-09-14T11:17:18.696 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: setting wanted keys 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:17:18.166+0000 7f7dbe887800 1 librados: calling monclient init 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding auth protocol: cephx 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.697 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: crc 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 AuthRegistry(0x557ba029c5b0) adding con mode: secure 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:17:18.166+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:17:18.166+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key hook 0x557ba029c6f8 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba02c6800 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba02c7180 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x7f7da8002340 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:17:18.166+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.801806s 2024-09-14T11:17:18.698 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba02c7180 auth_method 0 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x7f7da8002340 auth_method 0 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:17:18.166+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:17:18.166+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:17:18.167+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba02c6800 auth_method 0 2024-09-14T11:17:18.699 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:17:18.167+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:17:18.167+0000 7f7db3fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:17:18.167+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: dump: 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.700 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:17:18.167+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6029 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:17:18.167+0000 7f7ca8e09640 10 monclient: dump: 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.701 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:17:18.167+0000 7f7caa60c640 4 set_mon_vals no callback set 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:17:18.167+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:17:18.167+0000 7f7dbe887800 1 librados: init done 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:17:18.169+0000 7f7ca8e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:17:18.170+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7ca4077230 auth_method 0 2024-09-14T11:17:18.702 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:17:18.170+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba02c52d0 auth_method 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:17:18.171+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba02e84b0 auth_method 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:17:18.171+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba02ecb80 auth_method 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:17:18.172+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba02f0980 auth_method 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:17:18.173+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.703 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding auth protocol: cephx 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: crc 2024-09-14T11:17:18.704 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f4ae0) adding con mode: secure 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:17:18.173+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests cmddesc objecter_requests hook 0x557ba02f7f90 EEXIST 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:17:18.173+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding auth protocol: cephx 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.705 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: crc 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:17:18.173+0000 7f7dbe887800 5 AuthRegistry(0x557ba02f39d8) adding con mode: secure 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:17:18.174+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:17:18.174+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:17:18.174+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x557ba02f3b20 EEXIST 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba031c2b0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba031c690 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba031afc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.706 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:17:18.174+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.809448s 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba031c2b0 auth_method 0 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba031afc0 auth_method 0 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba031c690 auth_method 0 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.707 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:17:18.174+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:17:18.174+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 6360 payload 824 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:17:18.174+0000 7f7db3fff640 1 monclient: found mon.noname-a 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:17:18.174+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: dump: 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.708 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:17:18.175+0000 7f7ca1ffb640 10 monclient: dump: 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.709 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:17:18.175+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6360 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:17:18.175+0000 7f7dbd37a640 4 set_mon_vals no callback set 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:17:18.175+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.710 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:17:18.176+0000 7f7ca1ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:17:18.177+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x7f7c94077140 auth_method 0 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: get_monmap_and_config 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:17:18.177+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.711 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding auth protocol: cephx 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.712 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: crc 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x557ba033c230) adding con mode: secure 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:17:18.177+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:17:18.177+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding auth protocol: cephx 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.713 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: crc 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:17:18.177+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14660) adding con mode: secure 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:17:18.177+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:17:18.178+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:17:18.178+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x7ffc97d147a8 EEXIST 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba0340380 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba036adf0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba036c1a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.714 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.813184s 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba036adf0 auth_method 0 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba0340380 auth_method 0 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba036c1a0 auth_method 0 2024-09-14T11:17:18.715 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:17:18.178+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:17:18.178+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient(hunting): handle_auth_done global_id 5974 payload 274 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.716 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:17:18.178+0000 7f7db3fff640 1 monclient: found mon.noname-b 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:17:18.178+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:172.21.15.73:3300/0 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: dump: 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.717 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:17:18.178+0000 7f7c937fe640 10 monclient: dump: 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.718 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:17:18.178+0000 7f7dbe887800 5 monclient: authenticate success, global_id 5974 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:17:18.178+0000 7f7dbe887800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:17:18.178+0000 7f7dbe887800 4 set_mon_vals no callback set 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: shutdown 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: build_initial_monmap 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 build_initial for_mkfs: 0 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: monmap: 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:18.719 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding auth protocol: cephx 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.720 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: crc 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0340f60) adding con mode: secure 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:17:18.179+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: starting msgr at 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: starting objecter 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command objecter_requests cmddesc objecter_requests hook 0x557ba0366e40 EEXIST 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: setting wanted keys 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:17:18.179+0000 7f7dbe887800 1 librados: calling monclient init 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:17:18.179+0000 7f7dbe887800 10 monclient: init 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding auth protocol: cephx 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.721 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:17:18.179+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: crc 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 AuthRegistry(0x557ba0330b70) adding con mode: secure 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:17:18.180+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:17:18.180+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:17:18.180+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command rotate-key cmddesc rotate-key hook 0x557ba0330cb8 EEXIST 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-c con 0x557ba0340380 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-b con 0x557ba036c1a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:18.722 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): picked mon.noname-a con 0x557ba0373dc0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:17:18.180+0000 7f7dbe887800 10 monclient(hunting): authenticate will time out at 2041.815511s 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): get_auth_request con 0x557ba0340380 auth_method 0 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): get_auth_request con 0x557ba0373dc0 auth_method 0 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request con 0x557ba036c1a0 auth_method 0 2024-09-14T11:17:18.723 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:17:18.180+0000 7f7db3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:17:18.180+0000 7f7dbcb79640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient(hunting): handle_auth_done global_id 6366 payload 824 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient: _finish_hunting 0 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:17:18.180+0000 7f7dbc378640 1 monclient: found mon.noname-a 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:17:18.180+0000 7f7dbc378640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.724 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: dump: 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:18.725 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:17:18.181+0000 7f7c91ffb640 10 monclient: dump: 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.726 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:17:18.181+0000 7f7dbe887800 5 monclient: authenticate success, global_id 6366 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:17:18.181+0000 7f7c937fe640 4 set_mon_vals no callback set 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _renew_subs 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:17:18.181+0000 7f7dbe887800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:17:18.181+0000 7f7dbe887800 1 librados: init done 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:17:18.181+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cr dump hook 0x557ba0369078 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:17:18.182+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:17:18.183+0000 7f7c91ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:17:18.183+0000 7f7db3fff640 10 monclient: get_auth_request con 0x7f7c84077230 auth_method 0 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:17:18.183+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba038abb0 auth_method 0 2024-09-14T11:17:18.727 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 realm 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:17:18.184+0000 7f7dbe887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:17:18.184+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:17:18.185+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba038ee70 auth_method 0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:17:18.185+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:17:18.185+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x557ba03926d0 auth_method 0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:17:18.186+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:17:18.186+0000 7f7dbe887800 20 searching for the correct realm 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:17:18.186+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba03973e0 auth_method 0 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:17:18.186+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x557ba03973e0 msgr2=0x557ba03998a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.728 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:17:18.387+0000 7f7dbc378640 10 monclient: get_auth_request con 0x557ba03973e0 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:17:18.387+0000 7f7db3fff640 10 monclient: get_auth_request con 0x7f7dac083070 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:17:18.389+0000 7f7dbcb79640 10 monclient: get_auth_request con 0x7f7da8003ab0 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:17:18.390+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7db4043040 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:17:18.390+0000 7f7dbc378640 0 -- 172.21.15.29:0/1373358725 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f7db4043040 msgr2=0x7f7db4045950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:17:18.591+0000 7f7dbc378640 10 monclient: get_auth_request con 0x7f7db4043040 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:17:18.594+0000 7f7db3fff640 10 monclient: get_auth_request con 0x557ba0112d00 auth_method 0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.729 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:17:18.599+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zone default found 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Realm: () 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:17:18.600+0000 7f7dbe887800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:17:18.600+0000 7f7dbe887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 zonegroup default 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:17:18.600+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.730 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started sync module instance, tier type = 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:17:18.601+0000 7f7dbe887800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=0 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=1 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=2 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=3 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=4 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=5 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:17:18.610+0000 7f7dbe887800 20 add_watcher() i=6 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:17:18.611+0000 7f7dbe887800 20 add_watcher() i=7 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:17:18.611+0000 7f7dbe887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding auth protocol: cephx 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.731 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: crc 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:17:18.613+0000 7f7dbe887800 5 AuthRegistry(0x7ffc97d14b40) adding con mode: secure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:17:18.613+0000 7f7c72fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:17:18.614+0000 7f7dbe887800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache list hook 0x557ba0361f00 2024-09-14T11:17:18.732 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache inspect hook 0x557ba0361f00 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache erase hook 0x557ba0361f00 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command cache zap hook 0x557ba0361f00 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 note: GC not initialized 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:17:18.614+0000 7f7c71fdb640 20 reqs_thread_entry: start 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace show hook 0x7f7da4077f20 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace history hook 0x7f7da4077f20 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace active hook 0x7f7da4077f20 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:17:18.614+0000 7f7dbe887800 5 asok(0x557ba007c270) register_command sync trace active_short hook 0x7f7da4077f20 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 Filter name: none 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:17:18.614+0000 7f7be37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:17:18.614+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:17:18.614+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:17:18.733 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:17:18.615+0000 7f7dbe887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : miss 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:17:18.615+0000 7f7dbe887800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:17:18.616+0000 7f7dbe887800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:17:18.616+0000 7f7dbe887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:17:18.618+0000 7f7dbe887800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7dbe887800 time 2024-09-14T11:17:18.618147+0000 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.734 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7dc1d8c76a] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:17:18.619+0000 7f7dbe887800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f7dbe887800 thread_name:radosgw-admin 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7dc0a3e6f0] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7dc0a8b99c] 2024-09-14T11:17:18.735 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7dc1d8c7c4] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f7dc1d8c928] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557b9e43e0b1] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd882d4) [0x557b9e9512d4] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557b9e44defd] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7dc0a29590] 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:17:18.736 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:17:18.737 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:17:18.738 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:18.739 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:17:18.740 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:18.741 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:18.742 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7be37fe640 / http_manager 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c71fdb640 / http_manager 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c72fdd640 / rgw_dt_lg_renew 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c91ffb640 / ms_dispatch 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7c937fe640 / io_context_pool 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7ca1ffb640 / ms_dispatch 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7ca8e09640 / ms_dispatch 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7caa60c640 / io_context_pool 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7db3fff640 / msgr-worker-2 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbc378640 / msgr-worker-1 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbcb79640 / msgr-worker-0 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbd37a640 / io_context_pool 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: 7f7dbe887800 / radosgw-admin 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:17:18.620003Z_69ebf48a-35a7-4956-b3db-c9f1d0163c98/log 2024-09-14T11:17:18.743 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:17:18.744 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:17:18.745 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:18.745 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:18.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.701+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 realm 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.703+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.705+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.705+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.705+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.705+0000 7fa046931800 20 searching for the correct realm 2024-09-14T11:17:18.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.707+0000 7fa042d9a640 0 -- 172.21.15.29:0/804884004 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa03c010640 msgr2=0x7fa03c010aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:18.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:18.912+0000 7fa041d98640 0 -- 172.21.15.29:0/804884004 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa03c021950 msgr2=0x7fa03c031420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.120+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.119 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 zone default found 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 4 Realm: () 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 zonegroup default 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.121+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.122+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.122+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.122+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.122+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.123+0000 7fa046931800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.123+0000 7fa046931800 20 started sync module instance, tier type = 2024-09-14T11:17:19.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.123+0000 7fa046931800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:19.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=0 2024-09-14T11:17:19.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=1 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=2 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=3 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=4 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=5 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.132+0000 7fa046931800 20 add_watcher() i=6 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.133+0000 7fa046931800 20 add_watcher() i=7 2024-09-14T11:17:19.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.133+0000 7fa046931800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:19.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7f9ef8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7fa046931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7fa046931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7fa046931800 5 note: GC not initialized 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7f9e737fe640 20 reqs_thread_entry: start 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.135+0000 7fa046931800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.136+0000 7fa046931800 20 Filter name: none 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.136+0000 7f9e717fa640 20 reqs_thread_entry: start 2024-09-14T11:17:19.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.136+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.136+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:19.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.136+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.137+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:19.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.137+0000 7fa046931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.137+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.137+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.137+0000 7fa046931800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.138+0000 7fa046931800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:19.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.138+0000 7fa046931800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:19.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.140+0000 7f9ef8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.142+0000 7fa046931800 20 remove_watcher() i=0 2024-09-14T11:17:19.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.142+0000 7fa046931800 2 removed watcher, disabling cache 2024-09-14T11:17:19.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.143+0000 7fa046931800 20 remove_watcher() i=1 2024-09-14T11:17:19.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.144+0000 7fa046931800 20 remove_watcher() i=2 2024-09-14T11:17:19.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.145+0000 7fa046931800 20 remove_watcher() i=3 2024-09-14T11:17:19.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.146+0000 7fa046931800 20 remove_watcher() i=4 2024-09-14T11:17:19.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.148+0000 7fa046931800 20 remove_watcher() i=5 2024-09-14T11:17:19.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.149+0000 7fa046931800 20 remove_watcher() i=6 2024-09-14T11:17:19.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.150+0000 7fa046931800 20 remove_watcher() i=7 2024-09-14T11:17:19.160 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:19.161 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:19.161 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-init-indext id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:19.161 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:19.256 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:19.289 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:19.289 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:19.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.330+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 realm 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.332+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.333+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:19.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.333+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.334+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:19.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.334+0000 7f870a932800 20 searching for the correct realm 2024-09-14T11:17:19.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.336+0000 7f8706dbd640 0 -- 172.21.15.29:0/1405795975 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f8700080020 msgr2=0x7f87000b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:19.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.541+0000 7f8705dbb640 0 -- 172.21.15.29:0/1405795975 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f87000ac6e0 msgr2=0x7f87000aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:19.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.748+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 zone default found 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 4 Realm: () 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 zonegroup default 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.749+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 started sync module instance, tier type = 2024-09-14T11:17:19.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.750+0000 7f870a932800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=0 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=1 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=2 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=3 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=4 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=5 2024-09-14T11:17:19.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.760+0000 7f870a932800 20 add_watcher() i=6 2024-09-14T11:17:19.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.761+0000 7f870a932800 20 add_watcher() i=7 2024-09-14T11:17:19.759 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.761+0000 7f870a932800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:19.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.763+0000 7f85bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:19.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:19.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 5 note: GC not initialized 2024-09-14T11:17:19.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f85377fe640 20 reqs_thread_entry: start 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 20 Filter name: none 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f85357fa640 20 reqs_thread_entry: start 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.764+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.765+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.765+0000 7f870a932800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.765+0000 7f870a932800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.765+0000 7f870a932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : miss 2024-09-14T11:17:19.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.765+0000 7f870a932800 20 rados->read ofs=0 len=0 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:19.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.766+0000 7f870a932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:19.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.767+0000 7f870a932800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to be held by another RGW process; skipping for now 2024-09-14T11:17:19.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.768+0000 7f85bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:19.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.770+0000 7f870a932800 20 remove_watcher() i=0 2024-09-14T11:17:19.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.770+0000 7f870a932800 2 removed watcher, disabling cache 2024-09-14T11:17:19.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.771+0000 7f870a932800 20 remove_watcher() i=1 2024-09-14T11:17:19.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.772+0000 7f870a932800 20 remove_watcher() i=2 2024-09-14T11:17:19.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.773+0000 7f870a932800 20 remove_watcher() i=3 2024-09-14T11:17:19.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.774+0000 7f870a932800 20 remove_watcher() i=4 2024-09-14T11:17:19.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.775+0000 7f870a932800 20 remove_watcher() i=5 2024-09-14T11:17:19.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.776+0000 7f870a932800 20 remove_watcher() i=6 2024-09-14T11:17:19.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:19.777+0000 7f870a932800 20 remove_watcher() i=7 2024-09-14T11:17:19.788 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:17:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:49.831 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:49.831 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:49.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.877+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.879+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.879+0000 7f62c972c800 20 realm 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.879+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.880+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.880+0000 7f62c972c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.880+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.880+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:49.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.880+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:49.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.881+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:49.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.881+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:49.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.882+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:49.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.882+0000 7f62c972c800 20 searching for the correct realm 2024-09-14T11:17:49.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:49.884+0000 7f62c5b3f640 0 -- 172.21.15.29:0/471336792 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f62c0069040 msgr2=0x7f62c00733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:50.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.090+0000 7f62c5b3f640 0 -- 172.21.15.29:0/471336792 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5608295e17b0 msgr2=0x5608295e3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.097+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.098+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.098+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.098+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:50.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.098+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:50.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 zone default found 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 4 Realm: () 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 zonegroup default 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.099+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.100+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.100+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.100+0000 7f62c972c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.100+0000 7f62c972c800 20 started sync module instance, tier type = 2024-09-14T11:17:50.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.100+0000 7f62c972c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=0 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=1 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=2 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=3 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=4 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=5 2024-09-14T11:17:50.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.111+0000 7f62c972c800 20 add_watcher() i=6 2024-09-14T11:17:50.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.112+0000 7f62c972c800 20 add_watcher() i=7 2024-09-14T11:17:50.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.112+0000 7f62c972c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:50.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.114+0000 7f617b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.114+0000 7f62c972c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.114+0000 7f62c972c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.114+0000 7f62c972c800 5 note: GC not initialized 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.114+0000 7f617a7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 20 Filter name: none 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f60ebfff640 20 reqs_thread_entry: start 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:17:50.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : miss 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.115+0000 7f62c972c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:50.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:50.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.116+0000 7f62c972c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:50.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.123+0000 7f62c972c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.123+0000 7f62c972c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.123+0000 7f62c972c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.122 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.123+0000 7f62c972c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22, ofs0, ns] 2024-09-14T11:17:50.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.123+0000 7f61a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497011 cookie 94593053765312 notifier 6426 bl.length()=997 2024-09-14T11:17:50.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.124+0000 7f61a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.124+0000 7f61a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.123 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.124+0000 7f61a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.126+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_sources= new_sources= 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.126+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential sources added=[] removed=[] 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.126+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_dests= new_dests= 2024-09-14T11:17:50.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.126+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential dests added=[] removed=[] 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.0 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.0 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.1 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.1 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.2 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.2 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.3 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.3 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.4 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.4 2024-09-14T11:17:50.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.5 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.5 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.6 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.6 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.7 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.7 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.8 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.8 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.9 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.9 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.10 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.10 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.11 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1.11 2024-09-14T11:17:50.132 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.131+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.0 2024-09-14T11:17:50.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.132+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1 2024-09-14T11:17:50.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.132+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.2 2024-09-14T11:17:50.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.133+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.3 2024-09-14T11:17:50.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.134+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.4 2024-09-14T11:17:50.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.134+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.5 2024-09-14T11:17:50.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.135+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.6 2024-09-14T11:17:50.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.136+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.7 2024-09-14T11:17:50.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.136+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.8 2024-09-14T11:17:50.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.137+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.9 2024-09-14T11:17:50.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.137+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.10 2024-09-14T11:17:50.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.141+0000 7f62c972c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:50.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.141+0000 7f62c972c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.142+0000 7f62c972c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.142+0000 7f62c972c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.142+0000 7f62c972c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.142+0000 7f62c972c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22, ofs0, ns] 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.143+0000 7f6197fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497012 cookie 94593053765312 notifier 6426 bl.length()=997 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.143+0000 7f6197fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.143+0000 7f6197fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.143+0000 7f6197fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.145+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_sources= new_sources= 2024-09-14T11:17:50.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.145+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential sources added=[] removed=[] 2024-09-14T11:17:50.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.145+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_dests= new_dests= 2024-09-14T11:17:50.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.145+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential dests added=[] removed=[] 2024-09-14T11:17:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.148+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.0 2024-09-14T11:17:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.148+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.1 2024-09-14T11:17:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.148+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.2 2024-09-14T11:17:50.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.149+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.3 2024-09-14T11:17:50.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.149+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.4 2024-09-14T11:17:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.150+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.5 2024-09-14T11:17:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.150+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.6 2024-09-14T11:17:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.150+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.7 2024-09-14T11:17:50.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.151+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.8 2024-09-14T11:17:50.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.151+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.9 2024-09-14T11:17:50.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.151+0000 7f62c972c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.22.10 2024-09-14T11:17:50.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.152+0000 7f62c972c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:50.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.152+0000 7f62c972c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f62c972c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f62c972c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f62c972c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f62c972c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22, ofs0, ns] 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f6197fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497013 cookie 94593053765312 notifier 6426 bl.length()=965 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.153+0000 7f6197fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 info.flags=0x17 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.154+0000 7f6197fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:11989569-703c-4397-b0f1-7ddb0279a491.4517.22 to cache LRU end 2024-09-14T11:17:50.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.154+0000 7f6197fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.155+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_sources= new_sources= 2024-09-14T11:17:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.155+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential sources added=[] removed=[] 2024-09-14T11:17:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.155+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): orig_dests= new_dests= 2024-09-14T11:17:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.155+0000 7f62c972c800 20 handle_bi_update(): bucket=:abort-at-init-indext[11989569-703c-4397-b0f1-7ddb0279a491.4517.22]): potential dests added=[] removed=[] 2024-09-14T11:17:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.158+0000 7f62c972c800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:50.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.160+0000 7f617b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:50.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.162+0000 7f62c972c800 20 remove_watcher() i=0 2024-09-14T11:17:50.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.162+0000 7f62c972c800 2 removed watcher, disabling cache 2024-09-14T11:17:50.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.164+0000 7f62c972c800 20 remove_watcher() i=1 2024-09-14T11:17:50.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.165+0000 7f62c972c800 20 remove_watcher() i=2 2024-09-14T11:17:50.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.166+0000 7f62c972c800 20 remove_watcher() i=3 2024-09-14T11:17:50.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.167+0000 7f62c972c800 20 remove_watcher() i=4 2024-09-14T11:17:50.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.168+0000 7f62c972c800 20 remove_watcher() i=5 2024-09-14T11:17:50.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.169+0000 7f62c972c800 20 remove_watcher() i=6 2024-09-14T11:17:50.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.170+0000 7f62c972c800 20 remove_watcher() i=7 2024-09-14T11:17:50.183 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:17:50.214 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:50.215 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:50.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.256+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.258+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.258+0000 7f66f9d42800 20 realm 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.258+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.259+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.259+0000 7f66f9d42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.259+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.259+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.259+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.260+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:50.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.260+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.260+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:50.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.260+0000 7f66f9d42800 20 searching for the correct realm 2024-09-14T11:17:50.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.263+0000 7f66f6287640 0 -- 172.21.15.29:0/394289493 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f66f006c190 msgr2=0x7f66f0066930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:50.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.468+0000 7f66f5285640 0 -- 172.21.15.29:0/394289493 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f66f001a7d0 msgr2=0x7f66f0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.675+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 zone default found 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 4 Realm: () 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 zonegroup default 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.676+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:50.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 started sync module instance, tier type = 2024-09-14T11:17:50.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.677+0000 7f66f9d42800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=0 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=1 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=2 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=3 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=4 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=5 2024-09-14T11:17:50.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.687+0000 7f66f9d42800 20 add_watcher() i=6 2024-09-14T11:17:50.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.688+0000 7f66f9d42800 20 add_watcher() i=7 2024-09-14T11:17:50.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.688+0000 7f66f9d42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:50.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.690+0000 7f65a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.690+0000 7f66f9d42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.690+0000 7f66f9d42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.690+0000 7f66f9d42800 5 note: GC not initialized 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f65a67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f66f9d42800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f66f9d42800 20 Filter name: none 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f6517fff640 20 reqs_thread_entry: start 2024-09-14T11:17:50.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:50.691 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.691+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.692+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.692+0000 7f66f9d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.692+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.693+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=212 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.693+0000 7f66f9d42800 20 rados->read ofs=0 len=0 2024-09-14T11:17:50.692 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.693+0000 7f66f9d42800 20 rados_obj.operate() r=0 bl.length=434 2024-09-14T11:17:50.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.693+0000 7f66f9d42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:50.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.695+0000 7f65a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:50.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.697+0000 7f66f9d42800 20 remove_watcher() i=0 2024-09-14T11:17:50.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.697+0000 7f66f9d42800 2 removed watcher, disabling cache 2024-09-14T11:17:50.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.698+0000 7f66f9d42800 20 remove_watcher() i=1 2024-09-14T11:17:50.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.699+0000 7f66f9d42800 20 remove_watcher() i=2 2024-09-14T11:17:50.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.700+0000 7f66f9d42800 20 remove_watcher() i=3 2024-09-14T11:17:50.701 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.702+0000 7f66f9d42800 20 remove_watcher() i=4 2024-09-14T11:17:50.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.702+0000 7f66f9d42800 20 remove_watcher() i=5 2024-09-14T11:17:50.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.703+0000 7f66f9d42800 20 remove_watcher() i=6 2024-09-14T11:17:50.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:50.705+0000 7f66f9d42800 20 remove_watcher() i=7 2024-09-14T11:17:50.716 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:50.716 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:50.716 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-init-indext id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:50.716 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:51.114 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:17:51.114 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:51.989 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:17:52.017 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:52.018 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:52.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.057+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.059+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.059+0000 7fb73d726800 20 realm 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.059+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.060+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.061+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:52.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.061+0000 7fb73d726800 20 searching for the correct realm 2024-09-14T11:17:52.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.063+0000 7fb739cd7640 0 -- 172.21.15.29:0/1869337996 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fb734051b60 msgr2=0x7fb73403c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:52.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.269+0000 7fb738cd5640 0 -- 172.21.15.29:0/1869337996 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fb734017910 msgr2=0x7fb7340603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.475+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 zone default found 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 4 Realm: () 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 zonegroup default 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.476+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 started sync module instance, tier type = 2024-09-14T11:17:52.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.477+0000 7fb73d726800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=0 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=1 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=2 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=3 2024-09-14T11:17:52.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=4 2024-09-14T11:17:52.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=5 2024-09-14T11:17:52.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.487+0000 7fb73d726800 20 add_watcher() i=6 2024-09-14T11:17:52.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.488+0000 7fb73d726800 20 add_watcher() i=7 2024-09-14T11:17:52.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.488+0000 7fb73d726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:52.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb5ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb73d726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb73d726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb73d726800 5 note: GC not initialized 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb5ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.490+0000 7fb73d726800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.491+0000 7fb73d726800 20 Filter name: none 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.491+0000 7fb55ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:52.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.491+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.491+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.491+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:52.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:52.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:52.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.492+0000 7fb73d726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:52.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.495+0000 7fb5ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:52.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.497+0000 7fb73d726800 20 remove_watcher() i=0 2024-09-14T11:17:52.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.497+0000 7fb73d726800 2 removed watcher, disabling cache 2024-09-14T11:17:52.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.498+0000 7fb73d726800 20 remove_watcher() i=1 2024-09-14T11:17:52.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.500+0000 7fb73d726800 20 remove_watcher() i=2 2024-09-14T11:17:52.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.501+0000 7fb73d726800 20 remove_watcher() i=3 2024-09-14T11:17:52.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.502+0000 7fb73d726800 20 remove_watcher() i=4 2024-09-14T11:17:52.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.503+0000 7fb73d726800 20 remove_watcher() i=5 2024-09-14T11:17:52.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.504+0000 7fb73d726800 20 remove_watcher() i=6 2024-09-14T11:17:52.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.505+0000 7fb73d726800 20 remove_watcher() i=7 2024-09-14T11:17:52.516 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:52.516 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:52.516 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:52.516 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:52.517 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:17:52.553 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:52.553 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:52.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.595+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.596+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.596+0000 7fb5ca40e800 20 realm 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.596+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.597+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.597+0000 7fb5ca40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.597+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.597+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.597+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.598+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.598+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.598+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:52.597 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.598+0000 7fb5ca40e800 20 searching for the correct realm 2024-09-14T11:17:52.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.600+0000 7fb5c641b640 0 -- 172.21.15.29:0/1620028411 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55df6eecd1b0 msgr2=0x55df6eecf5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:52.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.603+0000 7fb5c641b640 0 -- 172.21.15.29:0/1620028411 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7fb490087860 msgr2=0x7fb490089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.608+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:52.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 zone default found 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 4 Realm: () 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 zonegroup default 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.609+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.610+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.610+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.610+0000 7fb5ca40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.610+0000 7fb5ca40e800 20 started sync module instance, tier type = 2024-09-14T11:17:52.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.610+0000 7fb5ca40e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=0 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=1 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=2 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=3 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=4 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=5 2024-09-14T11:17:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.619+0000 7fb5ca40e800 20 add_watcher() i=6 2024-09-14T11:17:52.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.620+0000 7fb5ca40e800 20 add_watcher() i=7 2024-09-14T11:17:52.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.620+0000 7fb5ca40e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:52.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.621+0000 7fb4777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:52.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.621+0000 7fb5ca40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:52.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.621+0000 7fb5ca40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.621+0000 7fb5ca40e800 5 note: GC not initialized 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb4767fc640 20 reqs_thread_entry: start 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 20 Filter name: none 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb3e7fff640 20 reqs_thread_entry: start 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:17:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 : miss 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.622+0000 7fb5ca40e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.623+0000 7fb5ca40e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 2024-09-14T11:17:52.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.627+0000 7fb5ca40e800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:17:52.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.627+0000 7fb5ca40e800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:17:52.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.633+0000 7fb4777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:52.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.635+0000 7fb5ca40e800 20 remove_watcher() i=0 2024-09-14T11:17:52.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.635+0000 7fb5ca40e800 2 removed watcher, disabling cache 2024-09-14T11:17:52.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.636+0000 7fb5ca40e800 20 remove_watcher() i=1 2024-09-14T11:17:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.637+0000 7fb5ca40e800 20 remove_watcher() i=2 2024-09-14T11:17:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.638+0000 7fb5ca40e800 20 remove_watcher() i=3 2024-09-14T11:17:52.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.639+0000 7fb5ca40e800 20 remove_watcher() i=4 2024-09-14T11:17:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.640+0000 7fb5ca40e800 20 remove_watcher() i=5 2024-09-14T11:17:52.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.641+0000 7fb5ca40e800 20 remove_watcher() i=6 2024-09-14T11:17:52.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.642+0000 7fb5ca40e800 20 remove_watcher() i=7 2024-09-14T11:17:52.654 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:17:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:52.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.724+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 realm 2024-09-14T11:17:52.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.726+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.727+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.727+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.727+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.727+0000 7f22caf2c800 20 searching for the correct realm 2024-09-14T11:17:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.729+0000 7f22c733f640 0 -- 172.21.15.29:0/3250456759 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f22c004cc20 msgr2=0x7f22c0083900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:52.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:52.934+0000 7f22c633d640 0 -- 172.21.15.29:0/3250456759 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f22c0070330 msgr2=0x7f22c00971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:53.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:53.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:53.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.141+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 zone default found 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 4 Realm: () 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:53.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 zonegroup default 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.142+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.143+0000 7f22caf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.143+0000 7f22caf2c800 20 started sync module instance, tier type = 2024-09-14T11:17:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.143+0000 7f22caf2c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=0 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=1 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=2 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=3 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=4 2024-09-14T11:17:53.151 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=5 2024-09-14T11:17:53.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.152+0000 7f22caf2c800 20 add_watcher() i=6 2024-09-14T11:17:53.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.153+0000 7f22caf2c800 20 add_watcher() i=7 2024-09-14T11:17:53.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.153+0000 7f22caf2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:53.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f217d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f22caf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f22caf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f22caf2c800 5 note: GC not initialized 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f20f7fff640 20 reqs_thread_entry: start 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f22caf2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.155+0000 7f22caf2c800 20 Filter name: none 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f20f5ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:53.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.156+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.157+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.157+0000 7f22caf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.157+0000 7f22caf2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.157+0000 7f22caf2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.159+0000 7f217d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.161+0000 7f22caf2c800 20 remove_watcher() i=0 2024-09-14T11:17:53.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.161+0000 7f22caf2c800 2 removed watcher, disabling cache 2024-09-14T11:17:53.161 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.162+0000 7f22caf2c800 20 remove_watcher() i=1 2024-09-14T11:17:53.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.163+0000 7f22caf2c800 20 remove_watcher() i=2 2024-09-14T11:17:53.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.164+0000 7f22caf2c800 20 remove_watcher() i=3 2024-09-14T11:17:53.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.165+0000 7f22caf2c800 20 remove_watcher() i=4 2024-09-14T11:17:53.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.166+0000 7f22caf2c800 20 remove_watcher() i=5 2024-09-14T11:17:53.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.167+0000 7f22caf2c800 20 remove_watcher() i=6 2024-09-14T11:17:53.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.168+0000 7f22caf2c800 20 remove_watcher() i=7 2024-09-14T11:17:53.179 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:53.180 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:53.180 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:53.180 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:53.274 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:53.306 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:53.306 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:53.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.548+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 realm 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.550+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.551+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:53.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.551+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.552+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:53.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.552+0000 7fb5aa2b7800 20 searching for the correct realm 2024-09-14T11:17:53.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.554+0000 7fb5a85a2640 0 -- 172.21.15.29:0/2297673109 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55845b6f5c40 msgr2=0x55845b6f8050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:53.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.558+0000 7fb5a85a2640 0 -- 172.21.15.29:0/2297673109 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7fb470087890 msgr2=0x7fb470089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:53.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:53.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:53.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:53.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:53.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:53.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 zone default found 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 4 Realm: () 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 zonegroup default 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.564+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 started sync module instance, tier type = 2024-09-14T11:17:53.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.565+0000 7fb5aa2b7800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=0 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=1 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=2 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=3 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=4 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=5 2024-09-14T11:17:53.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.575+0000 7fb5aa2b7800 20 add_watcher() i=6 2024-09-14T11:17:53.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.576+0000 7fb5aa2b7800 20 add_watcher() i=7 2024-09-14T11:17:53.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.576+0000 7fb5aa2b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:53.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.577+0000 7fb45dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 5 note: GC not initialized 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb45cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 20 Filter name: none 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb3d67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.578+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:53.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 : miss 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:53.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.579+0000 7fb5aa2b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.584+0000 7fb5aa2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.584+0000 7fb5aa2b7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.584+0000 7fb5aa2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.584+0000 7fb5aa2b7800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23, ofs0, ns] 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.585+0000 7fb486ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497039 cookie 94026958116112 notifier 6179 bl.length()=1009 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.585+0000 7fb486ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.585+0000 7fb486ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.585+0000 7fb486ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.586+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_sources= new_sources= 2024-09-14T11:17:53.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.586+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential sources added=[] removed=[] 2024-09-14T11:17:53.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.586+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_dests= new_dests= 2024-09-14T11:17:53.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.586+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential dests added=[] removed=[] 2024-09-14T11:17:53.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.0 2024-09-14T11:17:53.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.0 2024-09-14T11:17:53.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.1 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.1 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.2 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.2 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.3 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.3 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.4 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.4 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.5 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.5 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.6 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.6 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.7 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.7 2024-09-14T11:17:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.8 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.8 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.9 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.9 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.10 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.10 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.11 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1.11 2024-09-14T11:17:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.591+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.0 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.592+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.592+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.2 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.592+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.3 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.593+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.4 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.594+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.5 2024-09-14T11:17:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.594+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.6 2024-09-14T11:17:53.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.595+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.7 2024-09-14T11:17:53.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.595+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.8 2024-09-14T11:17:53.595 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.596+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.9 2024-09-14T11:17:53.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.596+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.10 2024-09-14T11:17:53.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.600+0000 7fb5aa2b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:53.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.600+0000 7fb5aa2b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 2024-09-14T11:17:53.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb5aa2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb5aa2b7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb5aa2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb5aa2b7800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23, ofs0, ns] 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb4867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497040 cookie 94026958116112 notifier 6179 bl.length()=1009 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb4867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb4867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.601+0000 7fb4867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.603+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_sources= new_sources= 2024-09-14T11:17:53.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.603+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential sources added=[] removed=[] 2024-09-14T11:17:53.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.603+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_dests= new_dests= 2024-09-14T11:17:53.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.603+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential dests added=[] removed=[] 2024-09-14T11:17:53.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.605+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.0 2024-09-14T11:17:53.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.606+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.1 2024-09-14T11:17:53.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.606+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.2 2024-09-14T11:17:53.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.606+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.3 2024-09-14T11:17:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.606+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.4 2024-09-14T11:17:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.607+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.5 2024-09-14T11:17:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.607+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.6 2024-09-14T11:17:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.608+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.7 2024-09-14T11:17:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.608+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.8 2024-09-14T11:17:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.608+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.9 2024-09-14T11:17:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.608+0000 7fb5aa2b7800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.23.10 2024-09-14T11:17:53.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.609+0000 7fb5aa2b7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:53.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.609+0000 7fb5aa2b7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 2024-09-14T11:17:53.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb5aa2b7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb5aa2b7800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb5aa2b7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb5aa2b7800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23, ofs0, ns] 2024-09-14T11:17:53.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb4867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497041 cookie 94026958116112 notifier 6179 bl.length()=977 2024-09-14T11:17:53.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb4867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 info.flags=0x17 2024-09-14T11:17:53.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb4867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.23 to cache LRU end 2024-09-14T11:17:53.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.610+0000 7fb4867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:53.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.612+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_sources= new_sources= 2024-09-14T11:17:53.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.612+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential sources added=[] removed=[] 2024-09-14T11:17:53.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.612+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): orig_dests= new_dests= 2024-09-14T11:17:53.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.612+0000 7fb5aa2b7800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.23]): potential dests added=[] removed=[] 2024-09-14T11:17:53.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.615+0000 7fb5aa2b7800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.616+0000 7fb45dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.618+0000 7fb5aa2b7800 20 remove_watcher() i=0 2024-09-14T11:17:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.618+0000 7fb5aa2b7800 2 removed watcher, disabling cache 2024-09-14T11:17:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.619+0000 7fb5aa2b7800 20 remove_watcher() i=1 2024-09-14T11:17:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.620+0000 7fb5aa2b7800 20 remove_watcher() i=2 2024-09-14T11:17:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.621+0000 7fb5aa2b7800 20 remove_watcher() i=3 2024-09-14T11:17:53.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.622+0000 7fb5aa2b7800 20 remove_watcher() i=4 2024-09-14T11:17:53.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.623+0000 7fb5aa2b7800 20 remove_watcher() i=5 2024-09-14T11:17:53.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.624+0000 7fb5aa2b7800 20 remove_watcher() i=6 2024-09-14T11:17:53.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.625+0000 7fb5aa2b7800 20 remove_watcher() i=7 2024-09-14T11:17:53.637 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:17:53.666 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:53.666 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:53.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.707+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 realm 2024-09-14T11:17:53.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:53.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.709+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.710+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:53.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.710+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.710+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:53.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.710+0000 7fcccc20e800 20 searching for the correct realm 2024-09-14T11:17:53.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.713+0000 7fccc816c640 0 -- 172.21.15.29:0/91234233 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fccc003c410 msgr2=0x7fccc003c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:53.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.918+0000 7fccc816c640 0 -- 172.21.15.29:0/91234233 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55e5136687c0 msgr2=0x55e51366abb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:53.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:53.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.923+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:53.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 zone default found 2024-09-14T11:17:53.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 4 Realm: () 2024-09-14T11:17:53.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:53.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 zonegroup default 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.924+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.925+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.925+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.925+0000 7fcccc20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.925+0000 7fcccc20e800 20 started sync module instance, tier type = 2024-09-14T11:17:53.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.925+0000 7fcccc20e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:53.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=0 2024-09-14T11:17:53.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=1 2024-09-14T11:17:53.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=2 2024-09-14T11:17:53.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=3 2024-09-14T11:17:53.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=4 2024-09-14T11:17:53.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=5 2024-09-14T11:17:53.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.934+0000 7fcccc20e800 20 add_watcher() i=6 2024-09-14T11:17:53.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.935+0000 7fcccc20e800 20 add_watcher() i=7 2024-09-14T11:17:53.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.935+0000 7fcccc20e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:53.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcb7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcccc20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcccc20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcccc20e800 5 note: GC not initialized 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcb7cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcccc20e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.937+0000 7fcccc20e800 20 Filter name: none 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcaf67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:53.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:53.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:53.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:53.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.938+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.939+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:53.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.939+0000 7fcccc20e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:53.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.939+0000 7fcccc20e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:53.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.939+0000 7fcccc20e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:53.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.941+0000 7fcb7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:53.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.943+0000 7fcccc20e800 20 remove_watcher() i=0 2024-09-14T11:17:53.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.943+0000 7fcccc20e800 2 removed watcher, disabling cache 2024-09-14T11:17:53.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.944+0000 7fcccc20e800 20 remove_watcher() i=1 2024-09-14T11:17:53.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.945+0000 7fcccc20e800 20 remove_watcher() i=2 2024-09-14T11:17:53.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.946+0000 7fcccc20e800 20 remove_watcher() i=3 2024-09-14T11:17:53.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.947+0000 7fcccc20e800 20 remove_watcher() i=4 2024-09-14T11:17:53.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.948+0000 7fcccc20e800 20 remove_watcher() i=5 2024-09-14T11:17:53.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.949+0000 7fcccc20e800 20 remove_watcher() i=6 2024-09-14T11:17:53.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:53.950+0000 7fcccc20e800 20 remove_watcher() i=7 2024-09-14T11:17:53.960 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:53.960 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:53.960 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:17:53.960 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:54.348 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:17:54.348 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:55.199 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:17:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:55.228 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:55.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.268+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.270+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.270+0000 7f6f5211f800 20 realm 2024-09-14T11:17:55.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.270+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.271+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.271+0000 7f6f5211f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.271+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.271+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.271+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.272+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:55.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.272+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.273+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:55.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.273+0000 7f6f5211f800 20 searching for the correct realm 2024-09-14T11:17:55.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.274+0000 7f6f4d6a1640 0 -- 172.21.15.29:0/3906810679 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f6f400b54b0 msgr2=0x7f6f400a53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:55.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.479+0000 7f6f4e6a3640 0 -- 172.21.15.29:0/3906810679 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x559dee44c610 msgr2=0x559dee44ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.485+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:55.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 zone default found 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 4 Realm: () 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 zonegroup default 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.486+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.487+0000 7f6f5211f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.487+0000 7f6f5211f800 20 started sync module instance, tier type = 2024-09-14T11:17:55.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.487+0000 7f6f5211f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=0 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=1 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=2 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=3 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=4 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=5 2024-09-14T11:17:55.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=6 2024-09-14T11:17:55.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 20 add_watcher() i=7 2024-09-14T11:17:55.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.496+0000 7f6f5211f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:55.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.498+0000 7f6dff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.498+0000 7f6f5211f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.498+0000 7f6f5211f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.498+0000 7f6f5211f800 5 note: GC not initialized 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6dfe7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6f5211f800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:55.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6f5211f800 20 Filter name: none 2024-09-14T11:17:55.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6d6ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:55.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:55.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.499+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.500+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.500+0000 7f6f5211f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.500+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.501+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.501+0000 7f6f5211f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.501+0000 7f6f5211f800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:55.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.501+0000 7f6f5211f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:55.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.503+0000 7f6dff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:55.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.505+0000 7f6f5211f800 20 remove_watcher() i=0 2024-09-14T11:17:55.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.505+0000 7f6f5211f800 2 removed watcher, disabling cache 2024-09-14T11:17:55.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.506+0000 7f6f5211f800 20 remove_watcher() i=1 2024-09-14T11:17:55.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.507+0000 7f6f5211f800 20 remove_watcher() i=2 2024-09-14T11:17:55.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.508+0000 7f6f5211f800 20 remove_watcher() i=3 2024-09-14T11:17:55.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.509+0000 7f6f5211f800 20 remove_watcher() i=4 2024-09-14T11:17:55.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.510+0000 7f6f5211f800 20 remove_watcher() i=5 2024-09-14T11:17:55.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.511+0000 7f6f5211f800 20 remove_watcher() i=6 2024-09-14T11:17:55.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.512+0000 7f6f5211f800 20 remove_watcher() i=7 2024-09-14T11:17:55.523 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:55.523 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:55.523 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:55.523 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:55.524 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:55.561 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:55.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.601+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 realm 2024-09-14T11:17:55.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:55.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.603+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.604+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:55.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.604+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.605+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:55.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.605+0000 7f69e5132800 20 searching for the correct realm 2024-09-14T11:17:55.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.606+0000 7f69dbfff640 0 -- 172.21.15.29:0/2868318311 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f69d4018070 msgr2=0x7f69d405ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:55.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.610+0000 7f69dbfff640 0 -- 172.21.15.29:0/2868318311 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f68ac087810 msgr2=0x7f68ac089c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.815+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:55.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 zone default found 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 4 Realm: () 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 zonegroup default 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.816+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.817+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.817+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.817+0000 7f69e5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.817+0000 7f69e5132800 20 started sync module instance, tier type = 2024-09-14T11:17:55.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.817+0000 7f69e5132800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:55.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=0 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=1 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=2 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=3 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=4 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=5 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.826+0000 7f69e5132800 20 add_watcher() i=6 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.827+0000 7f69e5132800 20 add_watcher() i=7 2024-09-14T11:17:55.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.827+0000 7f69e5132800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:55.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.829+0000 7f68977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.829+0000 7f69e5132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.829+0000 7f69e5132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.829+0000 7f69e5132800 5 note: GC not initialized 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f68967e4640 20 reqs_thread_entry: start 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 20 Filter name: none 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f688f7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:55.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 : miss 2024-09-14T11:17:55.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.830+0000 7f69e5132800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.831+0000 7f69e5132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 2024-09-14T11:17:55.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.837+0000 7f69e5132800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:17:55.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f69e5132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f69e5132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f69e5132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f69e5132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24, ofs0, ns] 2024-09-14T11:17:55.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f68b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497044 cookie 94655742373824 notifier 6230 bl.length()=1009 2024-09-14T11:17:55.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f68b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f68b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.838+0000 7f68b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.840+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_sources= new_sources= 2024-09-14T11:17:55.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.840+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential sources added=[] removed=[] 2024-09-14T11:17:55.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.840+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_dests= new_dests= 2024-09-14T11:17:55.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.840+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential dests added=[] removed=[] 2024-09-14T11:17:55.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.0 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.0 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.1 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.1 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.2 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.2 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.3 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.3 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.4 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.4 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.5 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.5 2024-09-14T11:17:55.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.6 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.6 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.7 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.7 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.8 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.8 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.9 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.9 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.10 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.10 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.11 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1.11 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.0 2024-09-14T11:17:55.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.845+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1 2024-09-14T11:17:55.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.846+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.2 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.846+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.3 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.847+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.4 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.847+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.5 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.848+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.6 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.848+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.7 2024-09-14T11:17:55.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.849+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.8 2024-09-14T11:17:55.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.850+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.9 2024-09-14T11:17:55.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.850+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.10 2024-09-14T11:17:55.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.853+0000 7f69e5132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:55.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.853+0000 7f69e5132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f69e5132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f69e5132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f69e5132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f69e5132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24, ofs0, ns] 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f68b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497045 cookie 94655742373824 notifier 6230 bl.length()=1009 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f68b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f68b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.855+0000 7f68b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.857+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_sources= new_sources= 2024-09-14T11:17:55.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.857+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential sources added=[] removed=[] 2024-09-14T11:17:55.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.857+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_dests= new_dests= 2024-09-14T11:17:55.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.857+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential dests added=[] removed=[] 2024-09-14T11:17:55.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.859+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.0 2024-09-14T11:17:55.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.859+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.1 2024-09-14T11:17:55.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.860+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.2 2024-09-14T11:17:55.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.860+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.3 2024-09-14T11:17:55.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.860+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.4 2024-09-14T11:17:55.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.860+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.5 2024-09-14T11:17:55.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.861+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.6 2024-09-14T11:17:55.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.861+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.7 2024-09-14T11:17:55.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.861+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.8 2024-09-14T11:17:55.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.862+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.9 2024-09-14T11:17:55.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.862+0000 7f69e5132800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.24.10 2024-09-14T11:17:55.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.862+0000 7f69e5132800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:55.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.862+0000 7f69e5132800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f69e5132800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f69e5132800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f69e5132800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f69e5132800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24, ofs0, ns] 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f68b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497046 cookie 94655742373824 notifier 6230 bl.length()=977 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f68b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 info.flags=0x17 2024-09-14T11:17:55.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f68b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.24 to cache LRU end 2024-09-14T11:17:55.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.865+0000 7f68b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:55.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.866+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_sources= new_sources= 2024-09-14T11:17:55.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.866+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential sources added=[] removed=[] 2024-09-14T11:17:55.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.866+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): orig_dests= new_dests= 2024-09-14T11:17:55.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.866+0000 7f69e5132800 20 handle_bi_update(): bucket=:error-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.24]): potential dests added=[] removed=[] 2024-09-14T11:17:55.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.868+0000 7f69e5132800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:17:55.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.870+0000 7f68977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:55.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.872+0000 7f69e5132800 20 remove_watcher() i=0 2024-09-14T11:17:55.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.872+0000 7f69e5132800 2 removed watcher, disabling cache 2024-09-14T11:17:55.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.873+0000 7f69e5132800 20 remove_watcher() i=1 2024-09-14T11:17:55.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.874+0000 7f69e5132800 20 remove_watcher() i=2 2024-09-14T11:17:55.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.875+0000 7f69e5132800 20 remove_watcher() i=3 2024-09-14T11:17:55.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.876+0000 7f69e5132800 20 remove_watcher() i=4 2024-09-14T11:17:55.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.877+0000 7f69e5132800 20 remove_watcher() i=5 2024-09-14T11:17:55.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.878+0000 7f69e5132800 20 remove_watcher() i=6 2024-09-14T11:17:55.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.879+0000 7f69e5132800 20 remove_watcher() i=7 2024-09-14T11:17:55.891 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:17:55.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:55.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:55.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.961+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 realm 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.963+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.964+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.964+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:55.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.964+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:55.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.964+0000 7fa3d6a14800 20 searching for the correct realm 2024-09-14T11:17:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:55.966+0000 7fa3d28cc640 0 -- 172.21.15.29:0/52592726 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa3cc0c4070 msgr2=0x7fa3cc0a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:56.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.171+0000 7fa3d18ca640 0 -- 172.21.15.29:0/52592726 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa3cc06a800 msgr2=0x7fa3cc0a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:56.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:56.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:56.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:56.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:56.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.377+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:56.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 zone default found 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 4 Realm: () 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:56.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 zonegroup default 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.378+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 started sync module instance, tier type = 2024-09-14T11:17:56.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.379+0000 7fa3d6a14800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:56.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=0 2024-09-14T11:17:56.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=1 2024-09-14T11:17:56.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=2 2024-09-14T11:17:56.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=3 2024-09-14T11:17:56.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=4 2024-09-14T11:17:56.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=5 2024-09-14T11:17:56.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.389+0000 7fa3d6a14800 20 add_watcher() i=6 2024-09-14T11:17:56.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.390+0000 7fa3d6a14800 20 add_watcher() i=7 2024-09-14T11:17:56.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.390+0000 7fa3d6a14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:56.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa3d6a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa3d6a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa3d6a14800 5 note: GC not initialized 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa2037fe640 20 reqs_thread_entry: start 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa3d6a14800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.392+0000 7fa3d6a14800 20 Filter name: none 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.393+0000 7fa2017fa640 20 reqs_thread_entry: start 2024-09-14T11:17:56.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.393+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.393+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:56.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.393+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.394+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:56.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.394+0000 7fa3d6a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:56.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.394+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.394+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:56.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.394+0000 7fa3d6a14800 20 rados->read ofs=0 len=0 2024-09-14T11:17:56.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.395+0000 7fa3d6a14800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:56.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.395+0000 7fa3d6a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:56.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.396+0000 7fa288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:56.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.398+0000 7fa3d6a14800 20 remove_watcher() i=0 2024-09-14T11:17:56.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.398+0000 7fa3d6a14800 2 removed watcher, disabling cache 2024-09-14T11:17:56.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.399+0000 7fa3d6a14800 20 remove_watcher() i=1 2024-09-14T11:17:56.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.401+0000 7fa3d6a14800 20 remove_watcher() i=2 2024-09-14T11:17:56.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.402+0000 7fa3d6a14800 20 remove_watcher() i=3 2024-09-14T11:17:56.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.403+0000 7fa3d6a14800 20 remove_watcher() i=4 2024-09-14T11:17:56.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.404+0000 7fa3d6a14800 20 remove_watcher() i=5 2024-09-14T11:17:56.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.405+0000 7fa3d6a14800 20 remove_watcher() i=6 2024-09-14T11:17:56.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:56.406+0000 7fa3d6a14800 20 remove_watcher() i=7 2024-09-14T11:17:56.417 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:56.417 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:56.417 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.24 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:17:56.417 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:56.823 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:17:56.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:57.682 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:17:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:57.711 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:57.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.753+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 realm 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:57.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.755+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.756+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:57.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.756+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:57.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.756+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:57.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.756+0000 7fc98d975800 20 searching for the correct realm 2024-09-14T11:17:57.757 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.759+0000 7fc98bc60640 0 -- 172.21.15.29:0/578145782 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc984069da0 msgr2=0x7fc984070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:57.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:57.964+0000 7fc98ac5e640 0 -- 172.21.15.29:0/578145782 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc98406e0b0 msgr2=0x7fc9840a20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.170+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 zone default found 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 4 Realm: () 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 zonegroup default 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.171+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 started sync module instance, tier type = 2024-09-14T11:17:58.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.172+0000 7fc98d975800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=0 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=1 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=2 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=3 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=4 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=5 2024-09-14T11:17:58.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.182+0000 7fc98d975800 20 add_watcher() i=6 2024-09-14T11:17:58.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.183+0000 7fc98d975800 20 add_watcher() i=7 2024-09-14T11:17:58.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.183+0000 7fc98d975800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:58.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.185+0000 7fc841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.185+0000 7fc98d975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.185+0000 7fc98d975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.185+0000 7fc98d975800 5 note: GC not initialized 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.185+0000 7fc840fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc98d975800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc98d975800 20 Filter name: none 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc7ba7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:58.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.186+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.187+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:58.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.187+0000 7fc98d975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.187+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.187+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.187+0000 7fc98d975800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.188+0000 7fc98d975800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:58.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.188+0000 7fc98d975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:58.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.190+0000 7fc841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:58.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.192+0000 7fc98d975800 20 remove_watcher() i=0 2024-09-14T11:17:58.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.192+0000 7fc98d975800 2 removed watcher, disabling cache 2024-09-14T11:17:58.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.193+0000 7fc98d975800 20 remove_watcher() i=1 2024-09-14T11:17:58.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.194+0000 7fc98d975800 20 remove_watcher() i=2 2024-09-14T11:17:58.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.195+0000 7fc98d975800 20 remove_watcher() i=3 2024-09-14T11:17:58.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.196+0000 7fc98d975800 20 remove_watcher() i=4 2024-09-14T11:17:58.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.198+0000 7fc98d975800 20 remove_watcher() i=5 2024-09-14T11:17:58.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.199+0000 7fc98d975800 20 remove_watcher() i=6 2024-09-14T11:17:58.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.200+0000 7fc98d975800 20 remove_watcher() i=7 2024-09-14T11:17:58.210 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.210 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:58.210 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:58.210 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:17:58.247 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:58.248 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:58.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.289+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 realm 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.293+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:58.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.293+0000 7f96a6525800 20 searching for the correct realm 2024-09-14T11:17:58.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.295+0000 7f96a29af640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f969c073070 msgr2=0x7f969c0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.501+0000 7f96a19ad640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f969c0a20f0 msgr2=0x7f969c0de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:58.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:58.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:58.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:58.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:58.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:58.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 zone default found 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 4 Realm: () 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 zonegroup default 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.710+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.710+0000 7f96a6525800 20 started sync module instance, tier type = 2024-09-14T11:17:58.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.710+0000 7f96a6525800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=0 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=1 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=2 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=3 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=4 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=5 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=6 2024-09-14T11:17:58.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.720+0000 7f96a6525800 20 add_watcher() i=7 2024-09-14T11:17:58.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.720+0000 7f96a6525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:58.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.722+0000 7f9558fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 5 note: GC not initialized 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f94d37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 20 Filter name: none 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f94d17fa640 20 reqs_thread_entry: start 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:17:58.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.723+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:58.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:17:58.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.724+0000 7f96a6525800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:17:58.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : miss 2024-09-14T11:17:58.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:58.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.725+0000 7f96a6525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:17:58.726 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f96a6525800 time 2024-09-14T11:17:58.729541+0000 2024-09-14T11:17:58.726 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f96a7b8c76a] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.729+0000 7f96a6525800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f96a6525800 time 2024-09-14T11:17:58.729541+0000 2024-09-14T11:17:58.728 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f96a7b8c76a] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:17:58.729 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f96a6525800 thread_name:radosgw-admin 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f96a683e6f0] 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f96a688b99c] 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f96a7b8c7c4] 2024-09-14T11:17:58.746 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.730+0000 7f96a6525800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f96a6525800 thread_name:radosgw-admin 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f96a683e6f0] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f96a688b99c] 2024-09-14T11:17:58.747 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f96a7b8c7c4] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.748 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:17:58.271+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6269 payload 274 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:17:58.271+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: dump: 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: dump: 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.750 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:17:58.271+0000 7f96a6525800 5 monclient: authenticate success, global_id 6269 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:17:58.271+0000 7f96a6525800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:17:58.271+0000 7f96a6525800 4 set_mon_vals no callback set 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: shutdown 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 asok(0x55cfec3c4270) unregister_commands rotate-key 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.752 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:17:58.272+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 librados: starting msgr at 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 librados: starting objecter 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests hook 0x55cfec5e7220 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:17:58.273+0000 7f96a6525800 1 librados: setting wanted keys 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:17:58.273+0000 7f96a6525800 1 librados: calling monclient init 2024-09-14T11:17:58.753 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.754 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:17:58.273+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:17:58.273+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key hook 0x55cfec5e4b28 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec4920e0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec5279c0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec52d940 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.908660s 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec4920e0 auth_method 0 2024-09-14T11:17:58.755 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec52d940 auth_method 0 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:17:58.274+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.756 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:17:58.274+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: dump: 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.757 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: dump: 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:17:58.274+0000 7f96a6525800 5 monclient: authenticate success, global_id 6272 2024-09-14T11:17:58.758 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:17:58.274+0000 7f9590608640 4 set_mon_vals no callback set 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:17:58.274+0000 7f96a6525800 1 librados: init done 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:17:58.276+0000 7f96a21ae640 10 monclient: get_auth_request con 0x7f9588077230 auth_method 0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:17:58.276+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec622f50 auth_method 0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:17:58.277+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6302d0 auth_method 0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:17:58.278+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec634550 auth_method 0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:17:58.279+0000 7f96a29af640 10 monclient: get_auth_request con 0x55cfec633bb0 auth_method 0 2024-09-14T11:17:58.759 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:17:58.280+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.760 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.761 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.763 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.763 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.763 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:17:58.280+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests cmddesc objecter_requests hook 0x55cfec6400e0 EEXIST 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.764 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:17:58.280+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:17:58.281+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:17:58.281+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x55cfec63b720 EEXIST 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec663dd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec6660a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6625a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.765 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.916264s 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6625a0 auth_method 0 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec6660a0 auth_method 0 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec663dd0 auth_method 0 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.766 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:17:58.281+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.767 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: dump: 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.768 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: dump: 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.769 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:17:58.281+0000 7f96a6525800 5 monclient: authenticate success, global_id 6275 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:17:58.281+0000 7f96a31b0640 4 set_mon_vals no callback set 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:17:58.282+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:17:58.282+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:17:58.284+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f957c077140 auth_method 0 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: get_monmap_and_config 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:17:58.284+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.770 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.771 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.772 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x7ffe91062268 EEXIST 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:58.773 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6b7bc0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec688b10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec6b3460 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.919996s 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec6b7bc0 auth_method 0 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6b3460 auth_method 0 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.774 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec688b10 auth_method 0 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.775 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_done global_id 6624 payload 274 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:17:58.285+0000 7f96a19ad640 1 monclient: found mon.noname-a 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: dump: 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.776 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: dump: 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.777 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:17:58.285+0000 7f96a6525800 5 monclient: authenticate success, global_id 6624 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:17:58.285+0000 7f96a6525800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:17:58.285+0000 7f96a6525800 4 set_mon_vals no callback set 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: shutdown 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.778 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.779 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:17:58.286+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: starting msgr at 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: starting objecter 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests cmddesc objecter_requests hook 0x55cfec664450 EEXIST 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: setting wanted keys 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: calling monclient init 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.780 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:17:58.287+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.781 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:17:58.287+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:17:58.287+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x55cfec67bcc8 EEXIST 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec688b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6b3460 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec6b7bc0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.922369s 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec6b3460 auth_method 0 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.782 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec688b10 auth_method 0 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6b7bc0 auth_method 0 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.783 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:17:58.287+0000 7f96a19ad640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: dump: 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.784 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: dump: 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.785 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:17:58.288+0000 7f96a6525800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:17:58.288+0000 7f9585ffb640 4 set_mon_vals no callback set 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:17:58.288+0000 7f96a6525800 1 librados: init done 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:17:58.288+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cr dump hook 0x55cfec6af9e8 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:17:58.289+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.786 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:17:58.290+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f956c077230 auth_method 0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:17:58.290+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6d1db0 auth_method 0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 realm 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:17:58.291+0000 7f96a6525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:17:58.292+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec6d5ff0 auth_method 0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:17:58.292+0000 7f96a29af640 10 monclient: get_auth_request con 0x55cfec6d9850 auth_method 0 2024-09-14T11:17:58.787 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:17:58.293+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:17:58.293+0000 7f96a6525800 20 searching for the correct realm 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:17:58.293+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6de610 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:17:58.294+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969400d3c0 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:17:58.295+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f969c073070 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:17:58.295+0000 7f96a29af640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f969c073070 msgr2=0x7f969c0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:17:58.497+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f969c073070 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:17:58.499+0000 7f96a21ae640 10 monclient: get_auth_request con 0x7f969c06a070 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:17:58.501+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969c0a20f0 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:17:58.501+0000 7f96a19ad640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f969c0a20f0 msgr2=0x7f969c0de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:17:58.702+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969c0a20f0 auth_method 0 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:58.788 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 zone default found 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 Realm: () 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:17:58.709+0000 7f96a6525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 zonegroup default 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.789 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 started sync module instance, tier type = 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=0 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=1 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=2 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=3 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=4 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=5 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=6 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:17:58.720+0000 7f96a6525800 20 add_watcher() i=7 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:17:58.720+0000 7f96a6525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:58.790 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:17:58.722+0000 7f9558fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.791 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:17:58.723+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache list hook 0x55cfec6ae260 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache inspect hook 0x55cfec6ae260 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache erase hook 0x55cfec6ae260 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache zap hook 0x55cfec6ae260 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 note: GC not initialized 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:17:58.723+0000 7f94d37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace show hook 0x7f9698004540 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace history hook 0x7f9698004540 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace active hook 0x7f9698004540 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace active_short hook 0x7f9698004540 2024-09-14T11:17:58.792 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 Filter name: none 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:17:58.723+0000 7f94d17fa640 20 reqs_thread_entry: start 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:17:58.723+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : miss 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:17:58.725+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:58.793 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:17:58.729+0000 7f96a6525800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f96a6525800 time 2024-09-14T11:17:58.729541+0000 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f96a7b8c76a] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:58.794 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:17:58.730+0000 7f96a6525800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f96a6525800 thread_name:radosgw-admin 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f96a683e6f0] 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f96a688b99c] 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:58.795 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f96a7b8c7c4] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:17:58.796 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:17:58.797 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:17:58.798 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:17:58.799 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:17:58.800 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:58.801 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:58.802 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f94d17fa640 / http_manager 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f94d37fe640 / http_manager 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9558fe1640 / rgw_dt_lg_renew 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9573fff640 / ms_dispatch 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9585ffb640 / io_context_pool 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9587fff640 / ms_dispatch 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f958ee05640 / ms_dispatch 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9590608640 / io_context_pool 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a19ad640 / msgr-worker-2 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a21ae640 / msgr-worker-1 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a29af640 / msgr-worker-0 2024-09-14T11:17:58.803 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a31b0640 / io_context_pool 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a6525800 / radosgw-admin 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.99221.log 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:17:58.271+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6269 payload 274 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:17:58.271+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:17:58.271+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: dump: 2024-09-14T11:17:58.804 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.805 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:17:58.271+0000 7f9590608640 10 monclient: dump: 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:17:58.271+0000 7f96a6525800 5 monclient: authenticate success, global_id 6269 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:17:58.271+0000 7f96a6525800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:58.806 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:17:58.271+0000 7f96a6525800 4 set_mon_vals no callback set 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: shutdown 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 asok(0x55cfec3c4270) unregister_commands rotate-key 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:17:58.272+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.807 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding auth protocol: cephx 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.808 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: crc 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:17:58.272+0000 7f96a6525800 5 AuthRegistry(0x55cfec5ea530) adding con mode: secure 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:17:58.272+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 librados: starting msgr at 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:17:58.272+0000 7f96a6525800 1 librados: starting objecter 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests hook 0x55cfec5e7220 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:17:58.273+0000 7f96a6525800 1 librados: setting wanted keys 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:17:58.273+0000 7f96a6525800 1 librados: calling monclient init 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding auth protocol: cephx 2024-09-14T11:17:58.809 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: crc 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 AuthRegistry(0x55cfec5e49e0) adding con mode: secure 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:17:58.273+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:17:58.273+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.810 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:17:58.273+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key hook 0x55cfec5e4b28 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec4920e0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec5279c0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec52d940 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:17:58.273+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.908660s 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec4920e0 auth_method 0 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.811 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec52d940 auth_method 0 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:17:58.273+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:17:58.273+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:17:58.274+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.812 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:17:58.274+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: dump: 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.813 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:17:58.274+0000 7f958ee05640 10 monclient: dump: 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.814 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:17:58.274+0000 7f96a6525800 5 monclient: authenticate success, global_id 6272 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:17:58.274+0000 7f9590608640 4 set_mon_vals no callback set 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:17:58.274+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:17:58.274+0000 7f96a6525800 1 librados: init done 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:17:58.276+0000 7f958ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:17:58.276+0000 7f96a21ae640 10 monclient: get_auth_request con 0x7f9588077230 auth_method 0 2024-09-14T11:17:58.815 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:17:58.276+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec622f50 auth_method 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:17:58.277+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6302d0 auth_method 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:17:58.278+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec634550 auth_method 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:17:58.279+0000 7f96a29af640 10 monclient: get_auth_request con 0x55cfec633bb0 auth_method 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:17:58.280+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.816 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding auth protocol: cephx 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.817 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: crc 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63c690) adding con mode: secure 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:17:58.280+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests cmddesc objecter_requests hook 0x55cfec6400e0 EEXIST 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:17:58.280+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.818 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding auth protocol: cephx 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: crc 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:17:58.280+0000 7f96a6525800 5 AuthRegistry(0x55cfec63b5d8) adding con mode: secure 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:17:58.280+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.819 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:17:58.281+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:17:58.281+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x55cfec63b720 EEXIST 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec663dd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec6660a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6625a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.916264s 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6625a0 auth_method 0 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.820 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec6660a0 auth_method 0 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec663dd0 auth_method 0 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:17:58.281+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.821 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:17:58.281+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient(hunting): handle_auth_done global_id 6275 payload 824 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:17:58.281+0000 7f96a29af640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:17:58.281+0000 7f96a29af640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: dump: 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.822 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:17:58.281+0000 7f9587fff640 10 monclient: dump: 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.823 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:17:58.281+0000 7f96a6525800 5 monclient: authenticate success, global_id 6275 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:17:58.281+0000 7f96a31b0640 4 set_mon_vals no callback set 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:17:58.281+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.824 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:17:58.282+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:17:58.282+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:17:58.283+0000 7f9587fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:17:58.284+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f957c077140 auth_method 0 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: get_monmap_and_config 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:17:58.284+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.825 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding auth protocol: cephx 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.826 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: crc 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x55cfec6835c0) adding con mode: secure 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding auth protocol: cephx 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.827 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: crc 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062120) adding con mode: secure 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:17:58.284+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:17:58.284+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x7ffe91062268 EEXIST 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6b7bc0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec688b10 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.828 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec6b3460 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:17:58.284+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.919996s 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec6b7bc0 auth_method 0 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6b3460 auth_method 0 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.829 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec688b10 auth_method 0 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:17:58.285+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:17:58.285+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient(hunting): handle_auth_done global_id 6624 payload 274 2024-09-14T11:17:58.830 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:17:58.285+0000 7f96a19ad640 1 monclient: found mon.noname-a 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:17:58.285+0000 7f96a19ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: dump: 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.831 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:17:58.285+0000 7f9585ffb640 10 monclient: dump: 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.832 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:17:58.285+0000 7f96a6525800 5 monclient: authenticate success, global_id 6624 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:17:58.285+0000 7f96a6525800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:17:58.285+0000 7f96a6525800 4 set_mon_vals no callback set 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: shutdown 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: build_initial_monmap 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 build_initial for_mkfs: 0 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: monmap: 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:17:58.833 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding auth protocol: cephx 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.834 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: crc 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec6aa0e0) adding con mode: secure 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:17:58.286+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: starting msgr at 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: starting objecter 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command objecter_requests cmddesc objecter_requests hook 0x55cfec664450 EEXIST 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: setting wanted keys 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:17:58.286+0000 7f96a6525800 1 librados: calling monclient init 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:17:58.286+0000 7f96a6525800 10 monclient: init 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.835 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding auth protocol: cephx 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: crc 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:17:58.286+0000 7f96a6525800 5 AuthRegistry(0x55cfec67bb80) adding con mode: secure 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:17:58.287+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:17:58.287+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.836 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:17:58.287+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command rotate-key cmddesc rotate-key hook 0x55cfec67bcc8 EEXIST 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-c con 0x55cfec688b10 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-a con 0x55cfec6b3460 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): picked mon.noname-b con 0x55cfec6b7bc0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:17:58.287+0000 7f96a6525800 10 monclient(hunting): authenticate will time out at 2081.922369s 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): get_auth_request con 0x55cfec6b3460 auth_method 0 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.837 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): get_auth_request con 0x55cfec688b10 auth_method 0 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): get_auth_request con 0x55cfec6b7bc0 auth_method 0 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:17:58.287+0000 7f96a29af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.838 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:17:58.287+0000 7f96a21ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient: _finish_hunting 0 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:17:58.287+0000 7f96a19ad640 1 monclient: found mon.noname-c 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:17:58.287+0000 7f96a19ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: dump: 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.839 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: _finish_auth 0 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:17:58.288+0000 7f9573fff640 10 monclient: dump: 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:17:58.840 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:17:58.288+0000 7f96a6525800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:17:58.288+0000 7f9585ffb640 4 set_mon_vals no callback set 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _renew_subs 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:17:58.288+0000 7f96a6525800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:17:58.288+0000 7f96a6525800 1 librados: init done 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:17:58.288+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cr dump hook 0x55cfec6af9e8 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:17:58.289+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.841 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:17:58.290+0000 7f9573fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:17:58.290+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f956c077230 auth_method 0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:17:58.290+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6d1db0 auth_method 0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 realm 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:17:58.291+0000 7f96a6525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:17:58.291+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:17:58.292+0000 7f96a19ad640 10 monclient: get_auth_request con 0x55cfec6d5ff0 auth_method 0 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.842 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:17:58.292+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:17:58.292+0000 7f96a29af640 10 monclient: get_auth_request con 0x55cfec6d9850 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:17:58.293+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:17:58.293+0000 7f96a6525800 20 searching for the correct realm 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:17:58.293+0000 7f96a21ae640 10 monclient: get_auth_request con 0x55cfec6de610 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:17:58.294+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969400d3c0 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:17:58.295+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f969c073070 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:17:58.295+0000 7f96a29af640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f969c073070 msgr2=0x7f969c0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:17:58.497+0000 7f96a29af640 10 monclient: get_auth_request con 0x7f969c073070 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:17:58.499+0000 7f96a21ae640 10 monclient: get_auth_request con 0x7f969c06a070 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:17:58.501+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969c0a20f0 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:17:58.501+0000 7f96a19ad640 0 -- 172.21.15.29:0/3023116844 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f969c0a20f0 msgr2=0x7f969c0de960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:17:58.702+0000 7f96a19ad640 10 monclient: get_auth_request con 0x7f969c0a20f0 auth_method 0 2024-09-14T11:17:58.843 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:17:58.708+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 zone default found 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 Realm: () 2024-09-14T11:17:58.844 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:17:58.709+0000 7f96a6525800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:17:58.709+0000 7f96a6525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 zonegroup default 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:17:58.709+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 started sync module instance, tier type = 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:17:58.710+0000 7f96a6525800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=0 2024-09-14T11:17:58.845 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=1 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=2 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=3 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=4 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=5 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:17:58.719+0000 7f96a6525800 20 add_watcher() i=6 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:17:58.720+0000 7f96a6525800 20 add_watcher() i=7 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:17:58.720+0000 7f96a6525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding auth protocol: cephx 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.846 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:17:58.722+0000 7f9558fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: crc 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:17:58.722+0000 7f96a6525800 5 AuthRegistry(0x7ffe91062600) adding con mode: secure 2024-09-14T11:17:58.847 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:17:58.723+0000 7f96a6525800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache list hook 0x55cfec6ae260 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache inspect hook 0x55cfec6ae260 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache erase hook 0x55cfec6ae260 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command cache zap hook 0x55cfec6ae260 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 note: GC not initialized 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:17:58.723+0000 7f94d37fe640 20 reqs_thread_entry: start 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace show hook 0x7f9698004540 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace history hook 0x7f9698004540 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace active hook 0x7f9698004540 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:17:58.723+0000 7f96a6525800 5 asok(0x55cfec3c4270) register_command sync trace active_short hook 0x7f9698004540 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:58.848 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 Filter name: none 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:17:58.723+0000 7f94d17fa640 20 reqs_thread_entry: start 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:17:58.723+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:17:58.723+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:17:58.724+0000 7f96a6525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : miss 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:17:58.724+0000 7f96a6525800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:17:58.725+0000 7f96a6525800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:58.849 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:17:58.725+0000 7f96a6525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:17:58.729+0000 7f96a6525800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f96a6525800 time 2024-09-14T11:17:58.729541+0000 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f96a7b8c76a] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:17:58.850 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:17:58.730+0000 7f96a6525800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f96a6525800 thread_name:radosgw-admin 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f96a683e6f0] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f96a688b99c] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f96a7b8c7c4] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f96a7b8c928] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cfea5e60b1] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd88418) [0x55cfeaaf9418] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cfea5f5efd] 2024-09-14T11:17:58.851 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f96a6829590] 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:17:58.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:58.853 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:17:58.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:17:58.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:17:58.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:58.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 7f94d17fa640 / http_manager 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 7f94d37fe640 / http_manager 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9558fe1640 / rgw_dt_lg_renew 2024-09-14T11:17:58.858 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9573fff640 / ms_dispatch 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9585ffb640 / io_context_pool 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9587fff640 / ms_dispatch 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f958ee05640 / ms_dispatch 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f9590608640 / io_context_pool 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a19ad640 / msgr-worker-2 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a21ae640 / msgr-worker-1 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a29af640 / msgr-worker-0 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a31b0640 / io_context_pool 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: 7f96a6525800 / radosgw-admin 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:17:58.731237Z_229ac69a-f9f7-4131-8008-0d8c0ee415d4/log 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:17:58.859 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.813+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 realm 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.814+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.815+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.815+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.816+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.816+0000 7f2ef9b3e800 20 searching for the correct realm 2024-09-14T11:17:58.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:58.818+0000 7f2ef6087640 0 -- 172.21.15.29:0/594725060 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f2ef0083070 msgr2=0x7f2ef0092440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:59.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.025+0000 7f2ef5085640 0 -- 172.21.15.29:0/594725060 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f2ef0069930 msgr2=0x7f2ef0003410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:59.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:59.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.232+0000 7f2ef9b3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.233+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.233+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.233+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.233+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:59.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.233+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:59.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 zone default found 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 4 Realm: () 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 zonegroup default 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.234+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.235+0000 7f2ef9b3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.235+0000 7f2ef9b3e800 20 started sync module instance, tier type = 2024-09-14T11:17:59.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.235+0000 7f2ef9b3e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=0 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=1 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=2 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=3 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=4 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=5 2024-09-14T11:17:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.245+0000 7f2ef9b3e800 20 add_watcher() i=6 2024-09-14T11:17:59.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.246+0000 7f2ef9b3e800 20 add_watcher() i=7 2024-09-14T11:17:59.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.246+0000 7f2ef9b3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:59.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.247+0000 7f2da77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:59.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:59.246 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 5 note: GC not initialized 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2da67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 20 Filter name: none 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2d17fff640 20 reqs_thread_entry: start 2024-09-14T11:17:59.247 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.248+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.249+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:59.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.249+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:59.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:59.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:59.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.250+0000 7f2ef9b3e800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:59.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.251+0000 7f2ef9b3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:59.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.252+0000 7f2da77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:59.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.255+0000 7f2ef9b3e800 20 remove_watcher() i=0 2024-09-14T11:17:59.253 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.255+0000 7f2ef9b3e800 2 removed watcher, disabling cache 2024-09-14T11:17:59.254 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.256+0000 7f2ef9b3e800 20 remove_watcher() i=1 2024-09-14T11:17:59.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.257+0000 7f2ef9b3e800 20 remove_watcher() i=2 2024-09-14T11:17:59.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.258+0000 7f2ef9b3e800 20 remove_watcher() i=3 2024-09-14T11:17:59.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.260+0000 7f2ef9b3e800 20 remove_watcher() i=4 2024-09-14T11:17:59.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.261+0000 7f2ef9b3e800 20 remove_watcher() i=5 2024-09-14T11:17:59.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.262+0000 7f2ef9b3e800 20 remove_watcher() i=6 2024-09-14T11:17:59.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.263+0000 7f2ef9b3e800 20 remove_watcher() i=7 2024-09-14T11:17:59.272 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:59.272 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:17:59.272 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:17:59.272 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:17:59.365 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:59.397 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:59.397 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:59.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.440+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 realm 2024-09-14T11:17:59.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.442+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.443+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:59.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.443+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.444+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:59.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.444+0000 7fe9f3d2c800 20 searching for the correct realm 2024-09-14T11:17:59.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.445+0000 7fe9ef144640 0 -- 172.21.15.29:0/2013443555 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fe9e0065040 msgr2=0x7fe9e00843b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:59.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.651+0000 7fe9f0146640 0 -- 172.21.15.29:0/2013443555 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x564842cf5ad0 msgr2=0x564842cf7ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.658+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 zone default found 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 4 Realm: () 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 zonegroup default 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.659+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.660+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.660+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.660+0000 7fe9f3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:59.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.660+0000 7fe9f3d2c800 20 started sync module instance, tier type = 2024-09-14T11:17:59.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.660+0000 7fe9f3d2c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=0 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=1 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=2 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=3 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=4 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=5 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.670+0000 7fe9f3d2c800 20 add_watcher() i=6 2024-09-14T11:17:59.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.671+0000 7fe9f3d2c800 20 add_watcher() i=7 2024-09-14T11:17:59.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.671+0000 7fe9f3d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:59.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe8a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:59.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe9f3d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:59.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe9f3d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:59.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe9f3d2c800 5 note: GC not initialized 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe8a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe9f3d2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe9f3d2c800 20 Filter name: none 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.674+0000 7fe81e7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:17:59.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : miss 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:17:59.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:17:59.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:17:59.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:59.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:17:59.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.675+0000 7fe9f3d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:17:59.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.677+0000 7fe9f3d2c800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to be held by another RGW process; skipping for now 2024-09-14T11:17:59.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.678+0000 7fe8a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:59.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.680+0000 7fe9f3d2c800 20 remove_watcher() i=0 2024-09-14T11:17:59.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.680+0000 7fe9f3d2c800 2 removed watcher, disabling cache 2024-09-14T11:17:59.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.682+0000 7fe9f3d2c800 20 remove_watcher() i=1 2024-09-14T11:17:59.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.683+0000 7fe9f3d2c800 20 remove_watcher() i=2 2024-09-14T11:17:59.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.684+0000 7fe9f3d2c800 20 remove_watcher() i=3 2024-09-14T11:17:59.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.685+0000 7fe9f3d2c800 20 remove_watcher() i=4 2024-09-14T11:17:59.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.686+0000 7fe9f3d2c800 20 remove_watcher() i=5 2024-09-14T11:17:59.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.687+0000 7fe9f3d2c800 20 remove_watcher() i=6 2024-09-14T11:17:59.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:17:59.688+0000 7fe9f3d2c800 20 remove_watcher() i=7 2024-09-14T11:17:59.699 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:18:29.728 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:29.765 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:29.765 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:29.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.812+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:29.812 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 realm 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.814+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:29.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.815+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:29.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.815+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:29.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.816+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:29.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.816+0000 7fbe4fb22800 20 searching for the correct realm 2024-09-14T11:18:29.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:29.818+0000 7fbe4c069640 0 -- 172.21.15.29:0/1210822967 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fbe44040070 msgr2=0x7fbe4406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:30.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.025+0000 7fbe4b067640 0 -- 172.21.15.29:0/1210822967 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fbe4406be40 msgr2=0x7fbe440717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.232+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.231 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:30.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 zone default found 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 4 Realm: () 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 zonegroup default 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.233+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.234+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.234+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.234+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.234+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.235+0000 7fbe4fb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.235+0000 7fbe4fb22800 20 started sync module instance, tier type = 2024-09-14T11:18:30.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.235+0000 7fbe4fb22800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:30.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=0 2024-09-14T11:18:30.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=1 2024-09-14T11:18:30.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=2 2024-09-14T11:18:30.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=3 2024-09-14T11:18:30.244 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=4 2024-09-14T11:18:30.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=5 2024-09-14T11:18:30.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.246+0000 7fbe4fb22800 20 add_watcher() i=6 2024-09-14T11:18:30.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.247+0000 7fbe4fb22800 20 add_watcher() i=7 2024-09-14T11:18:30.245 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.247+0000 7fbe4fb22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:30.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.249+0000 7fbd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:30.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:30.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:30.248 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 5 note: GC not initialized 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbd00fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 20 Filter name: none 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbc7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:18:30.249 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.250+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : miss 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.250 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.251+0000 7fbe4fb22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:18:30.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbe4fb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.255 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbe4fb22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbe4fb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbe4fb22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25, ofs0, ns] 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbd2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496979 cookie 94214703543616 notifier 6678 bl.length()=1009 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbd2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbd2affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.257+0000 7fbd2affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.259+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_sources= new_sources= 2024-09-14T11:18:30.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.259+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential sources added=[] removed=[] 2024-09-14T11:18:30.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.259+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_dests= new_dests= 2024-09-14T11:18:30.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.259+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential dests added=[] removed=[] 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.0 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.0 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.1 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.1 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.2 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.2 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.3 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.3 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.4 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.4 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.5 2024-09-14T11:18:30.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.5 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.6 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.6 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.7 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.7 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.8 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.8 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.9 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.9 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.10 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.10 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.11 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1.11 2024-09-14T11:18:30.264 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.264+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.0 2024-09-14T11:18:30.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.265+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1 2024-09-14T11:18:30.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.265+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.2 2024-09-14T11:18:30.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.266+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.3 2024-09-14T11:18:30.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.267+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.4 2024-09-14T11:18:30.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.268+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.5 2024-09-14T11:18:30.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.268+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.6 2024-09-14T11:18:30.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.269+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.7 2024-09-14T11:18:30.267 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.269+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.8 2024-09-14T11:18:30.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.270+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.9 2024-09-14T11:18:30.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.270+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.10 2024-09-14T11:18:30.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.274+0000 7fbe4fb22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:30.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.274+0000 7fbe4fb22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:18:30.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.275+0000 7fbe4fb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.275+0000 7fbe4fb22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.275+0000 7fbe4fb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.275+0000 7fbe4fb22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25, ofs0, ns] 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.276+0000 7fbd2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496980 cookie 94214703543616 notifier 6678 bl.length()=1009 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.276+0000 7fbd2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.276+0000 7fbd2a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.276+0000 7fbd2a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.278+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_sources= new_sources= 2024-09-14T11:18:30.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.278+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential sources added=[] removed=[] 2024-09-14T11:18:30.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.278+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_dests= new_dests= 2024-09-14T11:18:30.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.278+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential dests added=[] removed=[] 2024-09-14T11:18:30.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.280+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.0 2024-09-14T11:18:30.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.282+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.1 2024-09-14T11:18:30.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.282+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.2 2024-09-14T11:18:30.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.282+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.3 2024-09-14T11:18:30.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.283+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.4 2024-09-14T11:18:30.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.283+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.5 2024-09-14T11:18:30.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.283+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.6 2024-09-14T11:18:30.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.284+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.7 2024-09-14T11:18:30.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.284+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.8 2024-09-14T11:18:30.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.285+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.9 2024-09-14T11:18:30.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.285+0000 7fbe4fb22800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.25.10 2024-09-14T11:18:30.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.285+0000 7fbe4fb22800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:30.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.285+0000 7fbe4fb22800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 2024-09-14T11:18:30.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbe4fb22800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbe4fb22800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbe4fb22800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbe4fb22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25, ofs0, ns] 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbd2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496981 cookie 94214703543616 notifier 6678 bl.length()=977 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbd2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 info.flags=0x17 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbd2a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.25 to cache LRU end 2024-09-14T11:18:30.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.287+0000 7fbd2a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:30.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.289+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_sources= new_sources= 2024-09-14T11:18:30.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.289+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential sources added=[] removed=[] 2024-09-14T11:18:30.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.289+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): orig_dests= new_dests= 2024-09-14T11:18:30.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.289+0000 7fbe4fb22800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.25]): potential dests added=[] removed=[] 2024-09-14T11:18:30.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.292+0000 7fbe4fb22800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:30.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.294+0000 7fbd01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:30.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.297+0000 7fbe4fb22800 20 remove_watcher() i=0 2024-09-14T11:18:30.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.297+0000 7fbe4fb22800 2 removed watcher, disabling cache 2024-09-14T11:18:30.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.298+0000 7fbe4fb22800 20 remove_watcher() i=1 2024-09-14T11:18:30.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.299+0000 7fbe4fb22800 20 remove_watcher() i=2 2024-09-14T11:18:30.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.300+0000 7fbe4fb22800 20 remove_watcher() i=3 2024-09-14T11:18:30.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.301+0000 7fbe4fb22800 20 remove_watcher() i=4 2024-09-14T11:18:30.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.302+0000 7fbe4fb22800 20 remove_watcher() i=5 2024-09-14T11:18:30.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.303+0000 7fbe4fb22800 20 remove_watcher() i=6 2024-09-14T11:18:30.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.304+0000 7fbe4fb22800 20 remove_watcher() i=7 2024-09-14T11:18:30.317 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:18:30.348 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:30.348 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:30.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.390+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 20 realm 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.392+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.393+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.393+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.394+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:30.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.394+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.394+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:30.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.394+0000 7fb10b492800 20 searching for the correct realm 2024-09-14T11:18:30.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.396+0000 7fb10977d640 0 -- 172.21.15.29:0/3873126843 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fb10003f060 msgr2=0x7fb100068520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:30.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.602+0000 7fb10877b640 0 -- 172.21.15.29:0/3873126843 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fb100069ab0 msgr2=0x7fb100035800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:30.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:30.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:30.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:30.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:30.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:30.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:30.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.809+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 zone default found 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 4 Realm: () 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:30.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 zonegroup default 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.810+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.811+0000 7fb10b492800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.811+0000 7fb10b492800 20 started sync module instance, tier type = 2024-09-14T11:18:30.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.811+0000 7fb10b492800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=0 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=1 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=2 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=3 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=4 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=5 2024-09-14T11:18:30.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.821+0000 7fb10b492800 20 add_watcher() i=6 2024-09-14T11:18:30.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.822+0000 7fb10b492800 20 add_watcher() i=7 2024-09-14T11:18:30.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.822+0000 7fb10b492800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:30.823 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.825+0000 7fafbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.825+0000 7fb10b492800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.825+0000 7fb10b492800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.825+0000 7fb10b492800 5 note: GC not initialized 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.825+0000 7fafbdfe3640 20 reqs_thread_entry: start 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.826+0000 7fb10b492800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.826+0000 7fb10b492800 20 Filter name: none 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.826+0000 7faf2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:30.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.826+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.826+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:18:30.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=218 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.827+0000 7fb10b492800 20 rados->read ofs=0 len=0 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.828+0000 7fb10b492800 20 rados_obj.operate() r=0 bl.length=440 2024-09-14T11:18:30.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.828+0000 7fb10b492800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:30.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.830+0000 7fafbefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:30.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.832+0000 7fb10b492800 20 remove_watcher() i=0 2024-09-14T11:18:30.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.832+0000 7fb10b492800 2 removed watcher, disabling cache 2024-09-14T11:18:30.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.833+0000 7fb10b492800 20 remove_watcher() i=1 2024-09-14T11:18:30.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.835+0000 7fb10b492800 20 remove_watcher() i=2 2024-09-14T11:18:30.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.836+0000 7fb10b492800 20 remove_watcher() i=3 2024-09-14T11:18:30.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.837+0000 7fb10b492800 20 remove_watcher() i=4 2024-09-14T11:18:30.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.838+0000 7fb10b492800 20 remove_watcher() i=5 2024-09-14T11:18:30.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.839+0000 7fb10b492800 20 remove_watcher() i=6 2024-09-14T11:18:30.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:30.840+0000 7fb10b492800 20 remove_watcher() i=7 2024-09-14T11:18:30.850 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:30.850 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:30.850 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-set-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:18:30.850 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:31.230 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:18:31.230 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:32.099 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:18:32.128 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:32.128 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:32.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.169+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 realm 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.171+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.172+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.172+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.173+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:32.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.173+0000 7f86a4936800 20 searching for the correct realm 2024-09-14T11:18:32.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.175+0000 7f86a0eb8640 0 -- 172.21.15.29:0/2270933607 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55f3ae71f0e0 msgr2=0x55f3ae7214d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:32.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.178+0000 7f86a0eb8640 0 -- 172.21.15.29:0/2270933607 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f8568087920 msgr2=0x7f8568089d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.183+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 zone default found 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 4 Realm: () 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 zonegroup default 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.184+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.185+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.185+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.185+0000 7f86a4936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.185+0000 7f86a4936800 20 started sync module instance, tier type = 2024-09-14T11:18:32.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.185+0000 7f86a4936800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=0 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=1 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=2 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=3 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=4 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=5 2024-09-14T11:18:32.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.194+0000 7f86a4936800 20 add_watcher() i=6 2024-09-14T11:18:32.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.195+0000 7f86a4936800 20 add_watcher() i=7 2024-09-14T11:18:32.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.195+0000 7f86a4936800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:32.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.196+0000 7f85567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:32.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:32.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 5 note: GC not initialized 2024-09-14T11:18:32.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f85557e2640 20 reqs_thread_entry: start 2024-09-14T11:18:32.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:32.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 20 Filter name: none 2024-09-14T11:18:32.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f84c6ffd640 20 reqs_thread_entry: start 2024-09-14T11:18:32.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.197+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.198+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:32.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.198+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.198+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:32.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.198+0000 7f86a4936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:32.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.198+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.199+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:32.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.199+0000 7f86a4936800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.199+0000 7f86a4936800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:32.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.199+0000 7f86a4936800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:32.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.201+0000 7f85567e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.203+0000 7f86a4936800 20 remove_watcher() i=0 2024-09-14T11:18:32.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.203+0000 7f86a4936800 2 removed watcher, disabling cache 2024-09-14T11:18:32.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.204+0000 7f86a4936800 20 remove_watcher() i=1 2024-09-14T11:18:32.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.205+0000 7f86a4936800 20 remove_watcher() i=2 2024-09-14T11:18:32.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.206+0000 7f86a4936800 20 remove_watcher() i=3 2024-09-14T11:18:32.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.207+0000 7f86a4936800 20 remove_watcher() i=4 2024-09-14T11:18:32.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.208+0000 7f86a4936800 20 remove_watcher() i=5 2024-09-14T11:18:32.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.208+0000 7f86a4936800 20 remove_watcher() i=6 2024-09-14T11:18:32.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.209+0000 7f86a4936800 20 remove_watcher() i=7 2024-09-14T11:18:32.219 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:32.219 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:32.219 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:32.219 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:32.220 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:18:32.255 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:32.255 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:32.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.297+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 realm 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.298+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.299+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.299+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.300+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:32.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.300+0000 7f4e4cc87800 20 searching for the correct realm 2024-09-14T11:18:32.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.302+0000 7f4e4af72640 0 -- 172.21.15.29:0/3345535446 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f4e44089020 msgr2=0x7f4e44067b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:32.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.508+0000 7f4e49f70640 0 -- 172.21.15.29:0/3345535446 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f4e44025040 msgr2=0x7f4e44071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:32.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:32.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.714+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 zone default found 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 4 Realm: () 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 zonegroup default 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.715+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.716+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.716+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.716+0000 7f4e4cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.716+0000 7f4e4cc87800 20 started sync module instance, tier type = 2024-09-14T11:18:32.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.716+0000 7f4e4cc87800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=0 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=1 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=2 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=3 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=4 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=5 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.725+0000 7f4e4cc87800 20 add_watcher() i=6 2024-09-14T11:18:32.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.726+0000 7f4e4cc87800 20 add_watcher() i=7 2024-09-14T11:18:32.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.726+0000 7f4e4cc87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:32.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.728+0000 7f4d00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 5 note: GC not initialized 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4c7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 20 Filter name: none 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4c797fa640 20 reqs_thread_entry: start 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:18:32.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.729+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 : miss 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:32.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:32.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:32.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:32.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:32.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.730+0000 7f4e4cc87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.735+0000 7f4e4cc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.735+0000 7f4e4cc87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.735+0000 7f4e4cc87800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.735+0000 7f4e4cc87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26, ofs0, ns] 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.736+0000 7f4d2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497016 cookie 93931664061168 notifier 6386 bl.length()=1023 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.736+0000 7f4d2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.736+0000 7f4d2dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:32.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.736+0000 7f4d2dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_sources= new_sources= 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential sources added=[] removed=[] 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_dests= new_dests= 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential dests added=[] removed=[] 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:18:32.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.738+0000 7f4e4cc87800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:18:32.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.740+0000 7f4d00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.742+0000 7f4e4cc87800 20 remove_watcher() i=0 2024-09-14T11:18:32.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.742+0000 7f4e4cc87800 2 removed watcher, disabling cache 2024-09-14T11:18:32.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.743+0000 7f4e4cc87800 20 remove_watcher() i=1 2024-09-14T11:18:32.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.744+0000 7f4e4cc87800 20 remove_watcher() i=2 2024-09-14T11:18:32.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.745+0000 7f4e4cc87800 20 remove_watcher() i=3 2024-09-14T11:18:32.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.746+0000 7f4e4cc87800 20 remove_watcher() i=4 2024-09-14T11:18:32.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.747+0000 7f4e4cc87800 20 remove_watcher() i=5 2024-09-14T11:18:32.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.748+0000 7f4e4cc87800 20 remove_watcher() i=6 2024-09-14T11:18:32.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.749+0000 7f4e4cc87800 20 remove_watcher() i=7 2024-09-14T11:18:32.761 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:18:32.791 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:32.791 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:32.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.833+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 realm 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.835+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.836+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.836+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.837+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:32.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.837+0000 7fc12ff46800 20 searching for the correct realm 2024-09-14T11:18:32.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.839+0000 7fc127fff640 0 -- 172.21.15.29:0/1341347558 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fc120084040 msgr2=0x7fc120056980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:32.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.842+0000 7fc127fff640 0 -- 172.21.15.29:0/1341347558 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fbff8087860 msgr2=0x7fbff8089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:32.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:32.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:32.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 zone default found 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 4 Realm: () 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 zonegroup default 2024-09-14T11:18:32.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.848+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 started sync module instance, tier type = 2024-09-14T11:18:32.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.849+0000 7fc12ff46800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=0 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=1 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=2 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=3 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=4 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=5 2024-09-14T11:18:32.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.858+0000 7fc12ff46800 20 add_watcher() i=6 2024-09-14T11:18:32.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.859+0000 7fc12ff46800 20 add_watcher() i=7 2024-09-14T11:18:32.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.859+0000 7fc12ff46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:32.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.860+0000 7fbfdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 5 note: GC not initialized 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fbfde7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 20 Filter name: none 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fbf4ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:32.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.861+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.862+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.862+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:32.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 rados->read ofs=0 len=0 2024-09-14T11:18:32.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:32.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.863+0000 7fc12ff46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:32.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.865+0000 7fbfdf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:32.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.867+0000 7fc12ff46800 20 remove_watcher() i=0 2024-09-14T11:18:32.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.867+0000 7fc12ff46800 2 removed watcher, disabling cache 2024-09-14T11:18:32.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.868+0000 7fc12ff46800 20 remove_watcher() i=1 2024-09-14T11:18:32.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.869+0000 7fc12ff46800 20 remove_watcher() i=2 2024-09-14T11:18:32.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.870+0000 7fc12ff46800 20 remove_watcher() i=3 2024-09-14T11:18:32.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.871+0000 7fc12ff46800 20 remove_watcher() i=4 2024-09-14T11:18:32.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.872+0000 7fc12ff46800 20 remove_watcher() i=5 2024-09-14T11:18:32.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.873+0000 7fc12ff46800 20 remove_watcher() i=6 2024-09-14T11:18:32.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:32.874+0000 7fc12ff46800 20 remove_watcher() i=7 2024-09-14T11:18:32.884 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:32.884 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:32.884 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:32.884 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:32.979 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:33.011 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:33.011 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:33.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.053+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 20 realm 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.054+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.055+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.055+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.055+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:33.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.055+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.056+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:33.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.056+0000 7f527c22f800 20 searching for the correct realm 2024-09-14T11:18:33.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.058+0000 7f527a521640 0 -- 172.21.15.29:0/3994316156 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f527402c040 msgr2=0x7f527406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:33.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.264+0000 7f527951f640 0 -- 172.21.15.29:0/3994316156 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f527408fbd0 msgr2=0x7f5274087920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:33.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:33.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:33.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:33.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:33.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.470+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:33.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 zone default found 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 4 Realm: () 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 zonegroup default 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.471+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 started sync module instance, tier type = 2024-09-14T11:18:33.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.472+0000 7f527c22f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=0 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=1 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=2 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=3 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=4 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=5 2024-09-14T11:18:33.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.482+0000 7f527c22f800 20 add_watcher() i=6 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.483+0000 7f527c22f800 20 add_watcher() i=7 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.483+0000 7f527c22f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.485+0000 7f512bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.485+0000 7f527c22f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.485+0000 7f527c22f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.485+0000 7f527c22f800 5 note: GC not initialized 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f512affd640 20 reqs_thread_entry: start 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:33.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 20 Filter name: none 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f5128ff9640 20 reqs_thread_entry: start 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 : miss 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.486+0000 7f527c22f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.487+0000 7f527c22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 2024-09-14T11:18:33.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.488+0000 7f527c22f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.494+0000 7f527c22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.494+0000 7f527c22f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.494+0000 7f527c22f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.494+0000 7f527c22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26, ofs0, ns] 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.495+0000 7f515cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497017 cookie 93977472326336 notifier 6419 bl.length()=1023 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.495+0000 7f515cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.495+0000 7f515cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.495+0000 7f515cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.496+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_sources= new_sources= 2024-09-14T11:18:33.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.496+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential sources added=[] removed=[] 2024-09-14T11:18:33.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.496+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_dests= new_dests= 2024-09-14T11:18:33.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.496+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential dests added=[] removed=[] 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.0 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.0 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.1 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.1 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.2 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.2 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.3 2024-09-14T11:18:33.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.3 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.4 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.4 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.5 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.5 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.6 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.6 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.7 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.7 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.8 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.8 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.9 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.9 2024-09-14T11:18:33.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.10 2024-09-14T11:18:33.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.10 2024-09-14T11:18:33.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.11 2024-09-14T11:18:33.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2.11 2024-09-14T11:18:33.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.501+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.0 2024-09-14T11:18:33.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.502+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.1 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.502+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.503+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.3 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.503+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.4 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.504+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.5 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.505+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.6 2024-09-14T11:18:33.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.505+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.7 2024-09-14T11:18:33.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.506+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.8 2024-09-14T11:18:33.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.506+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.9 2024-09-14T11:18:33.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.507+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.10 2024-09-14T11:18:33.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.509+0000 7f527c22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:33.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.509+0000 7f527c22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 2024-09-14T11:18:33.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f527c22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f527c22f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f527c22f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f527c22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26, ofs0, ns] 2024-09-14T11:18:33.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f515cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497018 cookie 93977472326336 notifier 6419 bl.length()=1023 2024-09-14T11:18:33.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f515cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f515cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.511+0000 7f515cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.513+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_sources= new_sources= 2024-09-14T11:18:33.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.513+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential sources added=[] removed=[] 2024-09-14T11:18:33.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.513+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_dests= new_dests= 2024-09-14T11:18:33.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.513+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential dests added=[] removed=[] 2024-09-14T11:18:33.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.517+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.0 2024-09-14T11:18:33.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.517+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.1 2024-09-14T11:18:33.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.518+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.2 2024-09-14T11:18:33.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.518+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.3 2024-09-14T11:18:33.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.518+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.4 2024-09-14T11:18:33.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.519+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.5 2024-09-14T11:18:33.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.519+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.6 2024-09-14T11:18:33.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.519+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.7 2024-09-14T11:18:33.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.520+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.8 2024-09-14T11:18:33.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.520+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.9 2024-09-14T11:18:33.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.520+0000 7f527c22f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.26.10 2024-09-14T11:18:33.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.520+0000 7f527c22f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:33.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.520+0000 7f527c22f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 2024-09-14T11:18:33.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f527c22f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f527c22f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f527c22f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f527c22f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26, ofs0, ns] 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f515cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497019 cookie 93977472326336 notifier 6419 bl.length()=991 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f515cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 info.flags=0x17 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f515cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.26 to cache LRU end 2024-09-14T11:18:33.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.522+0000 7f515cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:33.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.524+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_sources= new_sources= 2024-09-14T11:18:33.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.524+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential sources added=[] removed=[] 2024-09-14T11:18:33.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.524+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): orig_dests= new_dests= 2024-09-14T11:18:33.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.524+0000 7f527c22f800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.26]): potential dests added=[] removed=[] 2024-09-14T11:18:33.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.529+0000 7f527c22f800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:33.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.530+0000 7f512bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:33.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.532+0000 7f527c22f800 20 remove_watcher() i=0 2024-09-14T11:18:33.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.532+0000 7f527c22f800 2 removed watcher, disabling cache 2024-09-14T11:18:33.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.534+0000 7f527c22f800 20 remove_watcher() i=1 2024-09-14T11:18:33.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.535+0000 7f527c22f800 20 remove_watcher() i=2 2024-09-14T11:18:33.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.536+0000 7f527c22f800 20 remove_watcher() i=3 2024-09-14T11:18:33.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.537+0000 7f527c22f800 20 remove_watcher() i=4 2024-09-14T11:18:33.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.538+0000 7f527c22f800 20 remove_watcher() i=5 2024-09-14T11:18:33.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.539+0000 7f527c22f800 20 remove_watcher() i=6 2024-09-14T11:18:33.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.540+0000 7f527c22f800 20 remove_watcher() i=7 2024-09-14T11:18:33.550 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:18:33.581 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:33.581 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:33.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.622+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.623+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.623+0000 7f5bcc42f800 20 realm 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.623+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.624+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.624+0000 7f5bcc42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.624+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.624+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:33.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.624+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.625+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:33.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.625+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:33.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.625+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:33.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.625+0000 7f5bcc42f800 20 searching for the correct realm 2024-09-14T11:18:33.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.628+0000 7f5bca71a640 0 -- 172.21.15.29:0/3955090156 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f5bc4018040 msgr2=0x7f5bc40343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:33.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:33.833+0000 7f5bc9718640 0 -- 172.21.15.29:0/3955090156 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f5bc4050410 msgr2=0x7f5bc4050890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.040+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 zone default found 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 4 Realm: () 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 zonegroup default 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.041+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.042+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.042+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.042+0000 7f5bcc42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.042+0000 7f5bcc42f800 20 started sync module instance, tier type = 2024-09-14T11:18:34.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.042+0000 7f5bcc42f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=0 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=1 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=2 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=3 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=4 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=5 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.051+0000 7f5bcc42f800 20 add_watcher() i=6 2024-09-14T11:18:34.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.052+0000 7f5bcc42f800 20 add_watcher() i=7 2024-09-14T11:18:34.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.052+0000 7f5bcc42f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:34.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.054+0000 7f5a7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.054+0000 7f5bcc42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.054+0000 7f5bcc42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.054+0000 7f5bcc42f800 5 note: GC not initialized 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5a7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5bcc42f800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5bcc42f800 20 Filter name: none 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f59effff640 20 reqs_thread_entry: start 2024-09-14T11:18:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.055+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.056+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.056+0000 7f5bcc42f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.056+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.056+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.056+0000 7f5bcc42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.057+0000 7f5bcc42f800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.057+0000 7f5bcc42f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:34.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.058+0000 7f5a7b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:34.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.060+0000 7f5bcc42f800 20 remove_watcher() i=0 2024-09-14T11:18:34.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.060+0000 7f5bcc42f800 2 removed watcher, disabling cache 2024-09-14T11:18:34.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.061+0000 7f5bcc42f800 20 remove_watcher() i=1 2024-09-14T11:18:34.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.062+0000 7f5bcc42f800 20 remove_watcher() i=2 2024-09-14T11:18:34.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.063+0000 7f5bcc42f800 20 remove_watcher() i=3 2024-09-14T11:18:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.064+0000 7f5bcc42f800 20 remove_watcher() i=4 2024-09-14T11:18:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.065+0000 7f5bcc42f800 20 remove_watcher() i=5 2024-09-14T11:18:34.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.066+0000 7f5bcc42f800 20 remove_watcher() i=6 2024-09-14T11:18:34.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:34.068+0000 7f5bcc42f800 20 remove_watcher() i=7 2024-09-14T11:18:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:34.077 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:34.077 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.26 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:18:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:34.458 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:18:34.458 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:35.355 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:18:35.385 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:35.385 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:35.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.427+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 20 realm 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.428+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.429+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.429+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.429+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.429+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.430+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:35.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.430+0000 7fcf71b28800 20 searching for the correct realm 2024-09-14T11:18:35.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.433+0000 7fcf6e0d7640 0 -- 172.21.15.29:0/3928887505 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fcf68017410 msgr2=0x7fcf68017890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:35.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.638+0000 7fcf6d0d5640 0 -- 172.21.15.29:0/3928887505 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fcf6804f3f0 msgr2=0x7fcf6804f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:35.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:35.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:35.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.844+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 zone default found 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 4 Realm: () 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:35.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 zonegroup default 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.845+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.846+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.846+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.846+0000 7fcf71b28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.846+0000 7fcf71b28800 20 started sync module instance, tier type = 2024-09-14T11:18:35.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.846+0000 7fcf71b28800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=0 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=1 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=2 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=3 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=4 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=5 2024-09-14T11:18:35.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.855+0000 7fcf71b28800 20 add_watcher() i=6 2024-09-14T11:18:35.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.856+0000 7fcf71b28800 20 add_watcher() i=7 2024-09-14T11:18:35.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.856+0000 7fcf71b28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:35.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fce1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fcf71b28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fcf71b28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fcf71b28800 5 note: GC not initialized 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fce1e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.858+0000 7fcf71b28800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.859+0000 7fcf71b28800 20 Filter name: none 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.859+0000 7fcd8ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:35.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.859+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.859+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:35.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.859+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.860+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:35.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.860+0000 7fcf71b28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:35.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.860+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.860+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:35.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.860+0000 7fcf71b28800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.861+0000 7fcf71b28800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:35.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.861+0000 7fcf71b28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:35.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.863+0000 7fce1f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:35.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.865+0000 7fcf71b28800 20 remove_watcher() i=0 2024-09-14T11:18:35.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.865+0000 7fcf71b28800 2 removed watcher, disabling cache 2024-09-14T11:18:35.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.866+0000 7fcf71b28800 20 remove_watcher() i=1 2024-09-14T11:18:35.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.867+0000 7fcf71b28800 20 remove_watcher() i=2 2024-09-14T11:18:35.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.868+0000 7fcf71b28800 20 remove_watcher() i=3 2024-09-14T11:18:35.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.869+0000 7fcf71b28800 20 remove_watcher() i=4 2024-09-14T11:18:35.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.870+0000 7fcf71b28800 20 remove_watcher() i=5 2024-09-14T11:18:35.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.871+0000 7fcf71b28800 20 remove_watcher() i=6 2024-09-14T11:18:35.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.872+0000 7fcf71b28800 20 remove_watcher() i=7 2024-09-14T11:18:35.881 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:35.882 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:35.882 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:35.882 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:35.883 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:18:35.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:35.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:35.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.962+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 realm 2024-09-14T11:18:35.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.963+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.964+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.964+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:35.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.965+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:35.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.965+0000 7fd31af2a800 20 searching for the correct realm 2024-09-14T11:18:35.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:35.967+0000 7fd317418640 0 -- 172.21.15.29:0/616369038 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd310033060 msgr2=0x7fd310078ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.172+0000 7fd316416640 0 -- 172.21.15.29:0/616369038 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd31009e090 msgr2=0x7fd310079bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.379+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.380+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.380+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.380+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.380+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 zone default found 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 4 Realm: () 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 zonegroup default 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.381+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.382+0000 7fd31af2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.382+0000 7fd31af2a800 20 started sync module instance, tier type = 2024-09-14T11:18:36.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.382+0000 7fd31af2a800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:36.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=0 2024-09-14T11:18:36.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=1 2024-09-14T11:18:36.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=2 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=3 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=4 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=5 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.391+0000 7fd31af2a800 20 add_watcher() i=6 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.392+0000 7fd31af2a800 20 add_watcher() i=7 2024-09-14T11:18:36.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.392+0000 7fd31af2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:36.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd1cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd31af2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:36.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd31af2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:36.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd31af2a800 5 note: GC not initialized 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd147fff640 20 reqs_thread_entry: start 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.394+0000 7fd31af2a800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 20 Filter name: none 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd145ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:36.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 : miss 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.395+0000 7fd31af2a800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 info.flags=0x17 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 to cache LRU end 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.396+0000 7fd31af2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 2024-09-14T11:18:36.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd31af2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 info.flags=0x17 2024-09-14T11:18:36.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd31af2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 to cache LRU end 2024-09-14T11:18:36.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd31af2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd31af2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27, ofs0, ns] 2024-09-14T11:18:36.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd1fa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497022 cookie 94172722491360 notifier 6828 bl.length()=1023 2024-09-14T11:18:36.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd1fa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 info.flags=0x17 2024-09-14T11:18:36.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd1fa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 to cache LRU end 2024-09-14T11:18:36.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.401+0000 7fd1fa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): orig_sources= new_sources= 2024-09-14T11:18:36.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): potential sources added=[] removed=[] 2024-09-14T11:18:36.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): orig_dests= new_dests= 2024-09-14T11:18:36.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): potential dests added=[] removed=[] 2024-09-14T11:18:36.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:18:36.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.403+0000 7fd31af2a800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:18:36.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.0 2024-09-14T11:18:36.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.0 2024-09-14T11:18:36.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.1 2024-09-14T11:18:36.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.1 2024-09-14T11:18:36.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.2 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.2 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.3 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.3 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.4 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.4 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.5 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.5 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.6 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.6 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.405+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.7 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.7 2024-09-14T11:18:36.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.8 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.8 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.9 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.9 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.10 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.10 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.11 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1.11 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.0 2024-09-14T11:18:36.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.406+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.1 2024-09-14T11:18:36.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.407+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.2 2024-09-14T11:18:36.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.407+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.3 2024-09-14T11:18:36.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.408+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.4 2024-09-14T11:18:36.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.408+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.5 2024-09-14T11:18:36.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.409+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.6 2024-09-14T11:18:36.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.410+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.7 2024-09-14T11:18:36.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.410+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.8 2024-09-14T11:18:36.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.411+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.9 2024-09-14T11:18:36.409 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.411+0000 7fd31af2a800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.27.10 2024-09-14T11:18:36.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.414+0000 7fd31af2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:36.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.414+0000 7fd31af2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.415+0000 7fd31af2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 info.flags=0x17 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.415+0000 7fd31af2a800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 to cache LRU end 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.415+0000 7fd31af2a800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.415+0000 7fd31af2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27, ofs0, ns] 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.416+0000 7fd1f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497023 cookie 94172722491360 notifier 6828 bl.length()=991 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.416+0000 7fd1f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 info.flags=0x17 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.416+0000 7fd1f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.27 to cache LRU end 2024-09-14T11:18:36.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.416+0000 7fd1f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:36.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.417+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): orig_sources= new_sources= 2024-09-14T11:18:36.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.417+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): potential sources added=[] removed=[] 2024-09-14T11:18:36.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.417+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): orig_dests= new_dests= 2024-09-14T11:18:36.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.417+0000 7fd31af2a800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.27]): potential dests added=[] removed=[] 2024-09-14T11:18:36.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.420+0000 7fd31af2a800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:18:36.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.422+0000 7fd1cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.424+0000 7fd31af2a800 20 remove_watcher() i=0 2024-09-14T11:18:36.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.424+0000 7fd31af2a800 2 removed watcher, disabling cache 2024-09-14T11:18:36.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.425+0000 7fd31af2a800 20 remove_watcher() i=1 2024-09-14T11:18:36.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.426+0000 7fd31af2a800 20 remove_watcher() i=2 2024-09-14T11:18:36.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.427+0000 7fd31af2a800 20 remove_watcher() i=3 2024-09-14T11:18:36.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.428+0000 7fd31af2a800 20 remove_watcher() i=4 2024-09-14T11:18:36.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.430+0000 7fd31af2a800 20 remove_watcher() i=5 2024-09-14T11:18:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.431+0000 7fd31af2a800 20 remove_watcher() i=6 2024-09-14T11:18:36.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.432+0000 7fd31af2a800 20 remove_watcher() i=7 2024-09-14T11:18:36.443 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:18:36.473 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:36.473 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:36.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.514+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 20 realm 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.516+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.517+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.517+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.517+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.517+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.518+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:36.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.518+0000 7f4dbd60d800 20 searching for the correct realm 2024-09-14T11:18:36.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.520+0000 7f4dbb8f8640 0 -- 172.21.15.29:0/2232659958 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55e4d79a23b0 msgr2=0x55e4d79a47a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.523+0000 7f4dba8f6640 0 -- 172.21.15.29:0/2232659958 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f4dac0870d0 msgr2=0x7f4dac05fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:36.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.528+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:36.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:36.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 zone default found 2024-09-14T11:18:36.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 4 Realm: () 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 zonegroup default 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.529+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.530+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.530+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.530+0000 7f4dbd60d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.530+0000 7f4dbd60d800 20 started sync module instance, tier type = 2024-09-14T11:18:36.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.530+0000 7f4dbd60d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=0 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=1 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=2 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=3 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=4 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=5 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=6 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 20 add_watcher() i=7 2024-09-14T11:18:36.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.540+0000 7f4dbd60d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:36.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.542+0000 7f4c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 5 note: GC not initialized 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4c70fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 20 Filter name: none 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4bea7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.543+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.544+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.544+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.544+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.544+0000 7f4dbd60d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.544+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.545+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.545+0000 7f4dbd60d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.545+0000 7f4dbd60d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.545+0000 7f4dbd60d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.547+0000 7f4c71fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.549+0000 7f4dbd60d800 20 remove_watcher() i=0 2024-09-14T11:18:36.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.549+0000 7f4dbd60d800 2 removed watcher, disabling cache 2024-09-14T11:18:36.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.551+0000 7f4dbd60d800 20 remove_watcher() i=1 2024-09-14T11:18:36.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.552+0000 7f4dbd60d800 20 remove_watcher() i=2 2024-09-14T11:18:36.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.553+0000 7f4dbd60d800 20 remove_watcher() i=3 2024-09-14T11:18:36.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.554+0000 7f4dbd60d800 20 remove_watcher() i=4 2024-09-14T11:18:36.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.555+0000 7f4dbd60d800 20 remove_watcher() i=5 2024-09-14T11:18:36.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.556+0000 7f4dbd60d800 20 remove_watcher() i=6 2024-09-14T11:18:36.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:36.557+0000 7f4dbd60d800 20 remove_watcher() i=7 2024-09-14T11:18:36.566 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:36.567 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:36.567 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.27 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:18:36.567 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:36.962 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:18:36.962 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:37.828 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:18:37.857 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:37.857 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:37.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.897+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:37.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 20 realm 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.899+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.900+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:37.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.900+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:37.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.901+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:37.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.901+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:37.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.901+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:37.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.901+0000 7fc7a04bb800 20 searching for the correct realm 2024-09-14T11:18:37.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:37.904+0000 7fc79e7a6640 0 -- 172.21.15.29:0/2575974531 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc798017020 msgr2=0x7fc798030410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:38.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.109+0000 7fc79d7a4640 0 -- 172.21.15.29:0/2575974531 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc798027410 msgr2=0x7fc798027890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.316+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 zone default found 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 4 Realm: () 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 zonegroup default 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.317+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 started sync module instance, tier type = 2024-09-14T11:18:38.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.318+0000 7fc7a04bb800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=0 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=1 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=2 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=3 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=4 2024-09-14T11:18:38.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=5 2024-09-14T11:18:38.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.328+0000 7fc7a04bb800 20 add_watcher() i=6 2024-09-14T11:18:38.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.329+0000 7fc7a04bb800 20 add_watcher() i=7 2024-09-14T11:18:38.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.329+0000 7fc7a04bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:38.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.331+0000 7fc64f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.331+0000 7fc7a04bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.331+0000 7fc7a04bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.331+0000 7fc7a04bb800 5 note: GC not initialized 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.332+0000 7fc64e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.332+0000 7fc7a04bb800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.332+0000 7fc7a04bb800 20 Filter name: none 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.332+0000 7fc5bffff640 20 reqs_thread_entry: start 2024-09-14T11:18:38.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.332+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.333+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.333+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.333+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:38.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.333+0000 7fc7a04bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:38.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.333+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.334+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.334+0000 7fc7a04bb800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.334+0000 7fc7a04bb800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:38.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.334+0000 7fc7a04bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:38.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.336+0000 7fc64f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.339+0000 7fc7a04bb800 20 remove_watcher() i=0 2024-09-14T11:18:38.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.339+0000 7fc7a04bb800 2 removed watcher, disabling cache 2024-09-14T11:18:38.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.340+0000 7fc7a04bb800 20 remove_watcher() i=1 2024-09-14T11:18:38.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.342+0000 7fc7a04bb800 20 remove_watcher() i=2 2024-09-14T11:18:38.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.343+0000 7fc7a04bb800 20 remove_watcher() i=3 2024-09-14T11:18:38.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.344+0000 7fc7a04bb800 20 remove_watcher() i=4 2024-09-14T11:18:38.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.345+0000 7fc7a04bb800 20 remove_watcher() i=5 2024-09-14T11:18:38.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.346+0000 7fc7a04bb800 20 remove_watcher() i=6 2024-09-14T11:18:38.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.347+0000 7fc7a04bb800 20 remove_watcher() i=7 2024-09-14T11:18:38.357 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.357 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:38.357 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:38.357 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.358 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:18:38.394 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:38.394 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:38.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.436+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 realm 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:38.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.439+0000 7ffaf833d800 20 searching for the correct realm 2024-09-14T11:18:38.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.441+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5573350fcc60 msgr2=0x5573350ff070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:38.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.444+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7ff9bc087890 msgr2=0x7ff9bc089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:38.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:38.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.449 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zone default found 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Realm: () 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:38.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zonegroup default 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started sync module instance, tier type = 2024-09-14T11:18:38.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=0 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=1 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=2 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=3 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=4 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=5 2024-09-14T11:18:38.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=6 2024-09-14T11:18:38.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.463+0000 7ffaf833d800 20 add_watcher() i=7 2024-09-14T11:18:38.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.463+0000 7ffaf833d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:38.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.464+0000 7ff9aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:38.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:38.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 5 note: GC not initialized 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ff9a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 20 Filter name: none 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ff91b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:18:38.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : miss 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.466+0000 7ffaf833d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:18:38.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ffaf833d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ffaf833d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 93953299865120 notifier 6882 bl.length()=1023 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.470 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffaf833d800 time 2024-09-14T11:18:38.474255+0000 2024-09-14T11:18:38.471 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffaf998c76a] 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:18:38.472 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7ffaf833d800 thread_name:radosgw-admin 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.474+0000 7ffaf833d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffaf833d800 time 2024-09-14T11:18:38.474255+0000 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffaf998c76a] 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.473 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.474 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:18:38.474 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.474 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:18:38.474 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:18:38.474 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffaf883e6f0] 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffaf888b99c] 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffaf998c7c4] 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.490 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.475+0000 7ffaf833d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7ffaf833d800 thread_name:radosgw-admin 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffaf883e6f0] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffaf888b99c] 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:18:38.491 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffaf998c7c4] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: shutdown 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 asok(0x557334de4270) unregister_commands rotate-key 2024-09-14T11:18:38.492 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.493 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:18:38.419+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: starting msgr at 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: starting objecter 2024-09-14T11:18:38.494 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests hook 0x557335009740 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: setting wanted keys 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: calling monclient init 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.495 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:18:38.419+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:18:38.420+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:18:38.420+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key hook 0x557335006b68 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x557334e8f5e0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x557334e8f9c0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x557334ebae80 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.496 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.055210s 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x557334e8f5e0 auth_method 0 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x557334ebae80 auth_method 0 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x557334e8f9c0 auth_method 0 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.497 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_done global_id 6873 payload 824 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:18:38.420+0000 7ffaf402a640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: dump: 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.498 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: dump: 2024-09-14T11:18:38.499 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:18:38.421+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6873 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:18:38.421+0000 7ff9e260c640 4 set_mon_vals no callback set 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.500 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:18:38.421+0000 7ffaf833d800 1 librados: init done 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:18:38.423+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ff9dc077260 auth_method 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:18:38.423+0000 7ffaf482b640 10 monclient: get_auth_request con 0x557335039a30 auth_method 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:18:38.424+0000 7ffaf402a640 10 monclient: get_auth_request con 0x5573350524a0 auth_method 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:18:38.425+0000 7ffaf3829640 10 monclient: get_auth_request con 0x557335056800 auth_method 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:18:38.426+0000 7ffaf482b640 10 monclient: get_auth_request con 0x557335055d50 auth_method 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:18:38.426+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:18:38.426+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:18:38.426+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.501 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.502 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests cmddesc objecter_requests hook 0x557335061e90 EEXIST 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.503 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x55733505da00 EEXIST 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.504 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350861b0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x557335086590 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x557335084ec0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.062809s 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350861b0 auth_method 0 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x557335086590 auth_method 0 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.505 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:18:38.428+0000 7ffaf3829640 1 monclient: found mon.noname-c 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:18:38.428+0000 7ffaf402a640 10 monclient: get_auth_request con 0x557335084ec0 auth_method 0 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:38.506 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: dump: 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:38.507 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: dump: 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:18:38.428+0000 7ffaf502c640 4 set_mon_vals no callback set 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:18:38.428+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6521 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.508 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:18:38.430+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ff9cc077140 auth_method 0 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: get_monmap_and_config 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:18:38.430+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.509 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.510 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.511 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x7fff2befd4a8 EEXIST 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x5573350da650 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.512 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x5573350ab660 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350d5b30 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.066786s 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x5573350d5b30 auth_method 0 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350da650 auth_method 0 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.513 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x5573350ab660 auth_method 0 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:18:38.432+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_done global_id 6879 payload 274 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.514 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:18:38.432+0000 7ffaf3829640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: dump: 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.515 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:18:38.432+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6879 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:18:38.432+0000 7ffaf833d800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:18:38.432+0000 7ffaf833d800 4 set_mon_vals no callback set 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: dump: 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.516 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:18:38.432+0000 7ffaf833d800 10 monclient: shutdown 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.517 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.518 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: starting msgr at 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: starting objecter 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests cmddesc objecter_requests hook 0x5573350aa710 EEXIST 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: setting wanted keys 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: calling monclient init 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.519 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x55733509abb8 EEXIST 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.520 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x5573350ab660 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x5573350d5b30 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350da650 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.069080s 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x5573350d5b30 auth_method 0 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x5573350da650 auth_method 0 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.521 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350ab660 auth_method 0 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.522 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:18:38.434+0000 7ffaf482b640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: dump: 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.523 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: dump: 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.524 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:18:38.434+0000 7ff9cb7fe640 4 set_mon_vals no callback set 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6882 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:18:38.434+0000 7ffaf833d800 1 librados: init done 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cr dump hook 0x5573350cad18 2024-09-14T11:18:38.525 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:18:38.436+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:18:38.437+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ff9bc077260 auth_method 0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:18:38.437+0000 7ffaf402a640 10 monclient: get_auth_request con 0x5573350f5230 auth_method 0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 realm 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:18:38.438+0000 7ffaf833d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.526 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:18:38.438+0000 7ffaf3829640 10 monclient: get_auth_request con 0x5573350f9540 auth_method 0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:18:38.439+0000 7ffaf482b640 10 monclient: get_auth_request con 0x5573350fcc60 auth_method 0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 searching for the correct realm 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:18:38.439+0000 7ffaf402a640 10 monclient: get_auth_request con 0x557335101a20 auth_method 0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:18:38.440+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ffae40bfc20 auth_method 0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:18:38.441+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5573350fcc60 msgr2=0x5573350ff070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 1 client.6882.objecter ms_handle_reset 0x5573350fcc60 session 0x5573350f8de0 osd.2 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 10 monclient: _renew_subs 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:18:38.441+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ff9bc087890 auth_method 0 2024-09-14T11:18:38.527 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:18:38.441+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ffaec03f020 auth_method 0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:18:38.443+0000 7ffaf402a640 10 monclient: get_auth_request con 0x7ffaec06c6c0 auth_method 0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:18:38.444+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7ff9bc087890 msgr2=0x7ff9bc089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:18:38.444+0000 7ff9c9ffb640 1 client.6882.objecter ms_handle_reset 0x7ff9bc087890 session 0x5573350f8de0 osd.2 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:18:38.444+0000 7ffaf482b640 10 monclient: get_auth_request con 0x5573350fcc60 auth_method 0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:18:38.445+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ffaec0758b0 auth_method 0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.528 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zone default found 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Realm: () 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:18:38.451+0000 7ffaf833d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zonegroup default 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.529 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started sync module instance, tier type = 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=0 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=1 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=2 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=3 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=4 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=5 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=6 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:18:38.463+0000 7ffaf833d800 20 add_watcher() i=7 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:18:38.463+0000 7ffaf833d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.530 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:18:38.464+0000 7ff9aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.531 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:18:38.465+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache list hook 0x5573350c9ff0 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache inspect hook 0x5573350c9ff0 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache erase hook 0x5573350c9ff0 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache zap hook 0x5573350c9ff0 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 note: GC not initialized 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:18:38.465+0000 7ff9a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace show hook 0x7ffae8071f20 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace history hook 0x7ffae8071f20 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace active hook 0x7ffae8071f20 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace active_short hook 0x7ffae8071f20 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:38.532 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 Filter name: none 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:18:38.465+0000 7ff91b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:18:38.465+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : miss 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.533 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 93953299865120 notifier 6882 bl.length()=1023 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:18:38.534 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:18:38.474+0000 7ffaf833d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffaf833d800 time 2024-09-14T11:18:38.474255+0000 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffaf998c76a] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:18:38.535 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:18:38.475+0000 7ffaf833d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7ffaf833d800 thread_name:radosgw-admin 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffaf883e6f0] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffaf888b99c] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffaf998c7c4] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.536 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:18:38.537 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:38.538 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:18:38.539 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:18:38.540 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:18:38.541 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:38.542 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:38.543 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff91b7fe640 / http_manager 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9a9fdb640 / http_manager 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9aafdd640 / rgw_dt_lg_renew 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9c9ffb640 / ms_dispatch 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9caffd640 / io_context_pool 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9cb7fe640 / io_context_pool 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9d9ffb640 / ms_dispatch 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9e0e09640 / ms_dispatch 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9e260c640 / io_context_pool 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf3829640 / msgr-worker-2 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf402a640 / msgr-worker-1 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf482b640 / msgr-worker-0 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf502c640 / io_context_pool 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf833d800 / radosgw-admin 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:18:38.544 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.107467.log 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: shutdown 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 asok(0x557334de4270) unregister_commands rotate-key 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.545 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding auth protocol: cephx 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.546 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: crc 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x55733500c5f0) adding con mode: secure 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:18:38.419+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: starting msgr at 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: starting objecter 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests hook 0x557335009740 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: setting wanted keys 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:18:38.419+0000 7ffaf833d800 1 librados: calling monclient init 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:18:38.419+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding auth protocol: cephx 2024-09-14T11:18:38.547 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: crc 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:18:38.419+0000 7ffaf833d800 5 AuthRegistry(0x557335006a20) adding con mode: secure 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:18:38.419+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:18:38.420+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:18:38.420+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key hook 0x557335006b68 2024-09-14T11:18:38.548 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x557334e8f5e0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x557334e8f9c0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x557334ebae80 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:18:38.420+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.055210s 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x557334e8f5e0 auth_method 0 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.549 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x557334ebae80 auth_method 0 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x557334e8f9c0 auth_method 0 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.550 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:18:38.420+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:18:38.420+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient(hunting): handle_auth_done global_id 6873 payload 824 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:18:38.420+0000 7ffaf402a640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:18:38.420+0000 7ffaf402a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: dump: 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.551 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.552 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:18:38.421+0000 7ff9e0e09640 10 monclient: dump: 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:18:38.421+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6873 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.553 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:18:38.421+0000 7ff9e260c640 4 set_mon_vals no callback set 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:18:38.421+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:18:38.421+0000 7ffaf833d800 1 librados: init done 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:18:38.423+0000 7ff9e0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:18:38.423+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ff9dc077260 auth_method 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:18:38.423+0000 7ffaf482b640 10 monclient: get_auth_request con 0x557335039a30 auth_method 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:18:38.424+0000 7ffaf402a640 10 monclient: get_auth_request con 0x5573350524a0 auth_method 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:18:38.425+0000 7ffaf3829640 10 monclient: get_auth_request con 0x557335056800 auth_method 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:18:38.426+0000 7ffaf482b640 10 monclient: get_auth_request con 0x557335055d50 auth_method 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:18:38.426+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:18:38.426+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:18:38.426+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.554 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding auth protocol: cephx 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.555 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: crc 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:18:38.426+0000 7ffaf833d800 5 AuthRegistry(0x55733505e9c0) adding con mode: secure 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests cmddesc objecter_requests hook 0x557335061e90 EEXIST 2024-09-14T11:18:38.556 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding auth protocol: cephx 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.557 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: crc 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 AuthRegistry(0x55733505d8b8) adding con mode: secure 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:18:38.427+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:18:38.427+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x55733505da00 EEXIST 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350861b0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x557335086590 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x557335084ec0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.558 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:18:38.427+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.062809s 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350861b0 auth_method 0 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x557335086590 auth_method 0 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:18:38.427+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:18:38.427+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.559 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:18:38.428+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient(hunting): handle_auth_done global_id 6521 payload 824 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:18:38.428+0000 7ffaf3829640 1 monclient: found mon.noname-c 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:18:38.428+0000 7ffaf3829640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:18:38.428+0000 7ffaf402a640 10 monclient: get_auth_request con 0x557335084ec0 auth_method 0 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: dump: 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.560 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:18:38.428+0000 7ff9d9ffb640 10 monclient: dump: 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.561 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:18:38.428+0000 7ffaf502c640 4 set_mon_vals no callback set 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:18:38.428+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6521 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:18:38.428+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:18:38.430+0000 7ff9d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:18:38.430+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ff9cc077140 auth_method 0 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: get_monmap_and_config 2024-09-14T11:18:38.562 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:18:38.430+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:18:38.430+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.563 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding auth protocol: cephx 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: crc 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:18:38.430+0000 7ffaf833d800 5 AuthRegistry(0x5573350a6020) adding con mode: secure 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.564 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding auth protocol: cephx 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: crc 2024-09-14T11:18:38.565 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd360) adding con mode: secure 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:18:38.431+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:18:38.431+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x7fff2befd4a8 EEXIST 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x5573350da650 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x5573350ab660 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350d5b30 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:18:38.431+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.066786s 2024-09-14T11:18:38.566 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x5573350d5b30 auth_method 0 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350da650 auth_method 0 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:18:38.431+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x5573350ab660 auth_method 0 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:18:38.431+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:18:38.431+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.567 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:18:38.432+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:18:38.432+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient(hunting): handle_auth_done global_id 6879 payload 274 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:18:38.432+0000 7ffaf3829640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:18:38.432+0000 7ffaf3829640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: dump: 2024-09-14T11:18:38.568 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:18:38.432+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6879 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:18:38.432+0000 7ffaf833d800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:38.569 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:18:38.432+0000 7ffaf833d800 4 set_mon_vals no callback set 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:18:38.432+0000 7ff9cb7fe640 10 monclient: dump: 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.570 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:18:38.432+0000 7ffaf833d800 10 monclient: shutdown 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: build_initial_monmap 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 build_initial for_mkfs: 0 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: monmap: 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.571 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding auth protocol: cephx 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: crc 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x5573350cc8e0) adding con mode: secure 2024-09-14T11:18:38.572 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: starting msgr at 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: starting objecter 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 asok(0x557334de4270) register_command objecter_requests cmddesc objecter_requests hook 0x5573350aa710 EEXIST 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: setting wanted keys 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:18:38.433+0000 7ffaf833d800 1 librados: calling monclient init 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:18:38.433+0000 7ffaf833d800 10 monclient: init 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding auth protocol: cephx 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.573 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: crc 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:18:38.433+0000 7ffaf833d800 5 AuthRegistry(0x55733509aa70) adding con mode: secure 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:18:38.433+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 asok(0x557334de4270) register_command rotate-key cmddesc rotate-key hook 0x55733509abb8 EEXIST 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-b con 0x5573350ab660 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-a con 0x5573350d5b30 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:18:38.574 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): picked mon.noname-c con 0x5573350da650 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient(hunting): authenticate will time out at 2122.069080s 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): get_auth_request con 0x5573350d5b30 auth_method 0 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): get_auth_request con 0x5573350da650 auth_method 0 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): get_auth_request con 0x5573350ab660 auth_method 0 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:38.575 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:18:38.434+0000 7ffaf402a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:18:38.434+0000 7ffaf3829640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient(hunting): handle_auth_done global_id 6882 payload 824 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient: _finish_hunting 0 2024-09-14T11:18:38.576 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:18:38.434+0000 7ffaf482b640 1 monclient: found mon.noname-a 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:18:38.434+0000 7ffaf482b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: dump: 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.577 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: _finish_auth 0 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:18:38.434+0000 7ff9c9ffb640 10 monclient: dump: 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:18:38.578 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:18:38.434+0000 7ff9cb7fe640 4 set_mon_vals no callback set 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 monclient: authenticate success, global_id 6882 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _renew_subs 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:18:38.434+0000 7ffaf833d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:18:38.434+0000 7ffaf833d800 1 librados: init done 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:18:38.434+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cr dump hook 0x5573350cad18 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:18:38.436+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:18:38.437+0000 7ff9c9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:18:38.437+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ff9bc077260 auth_method 0 2024-09-14T11:18:38.579 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:18:38.437+0000 7ffaf402a640 10 monclient: get_auth_request con 0x5573350f5230 auth_method 0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 realm 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:18:38.438+0000 7ffaf833d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:18:38.438+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:18:38.438+0000 7ffaf3829640 10 monclient: get_auth_request con 0x5573350f9540 auth_method 0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:18:38.439+0000 7ffaf482b640 10 monclient: get_auth_request con 0x5573350fcc60 auth_method 0 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:18:38.439+0000 7ffaf833d800 20 searching for the correct realm 2024-09-14T11:18:38.580 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:18:38.439+0000 7ffaf402a640 10 monclient: get_auth_request con 0x557335101a20 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:18:38.440+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ffae40bfc20 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:18:38.441+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5573350fcc60 msgr2=0x5573350ff070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 1 client.6882.objecter ms_handle_reset 0x5573350fcc60 session 0x5573350f8de0 osd.2 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 10 monclient: _renew_subs 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:18:38.441+0000 7ff9c9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:18:38.441+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ff9bc087890 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:18:38.441+0000 7ffaf482b640 10 monclient: get_auth_request con 0x7ffaec03f020 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:18:38.443+0000 7ffaf402a640 10 monclient: get_auth_request con 0x7ffaec06c6c0 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:18:38.444+0000 7ffaf482b640 0 -- 172.21.15.29:0/2780188738 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7ff9bc087890 msgr2=0x7ff9bc089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:18:38.444+0000 7ff9c9ffb640 1 client.6882.objecter ms_handle_reset 0x7ff9bc087890 session 0x5573350f8de0 osd.2 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:18:38.444+0000 7ffaf482b640 10 monclient: get_auth_request con 0x5573350fcc60 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:18:38.445+0000 7ffaf3829640 10 monclient: get_auth_request con 0x7ffaec0758b0 auth_method 0 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:38.581 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:18:38.450+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zone default found 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Realm: () 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:18:38.451+0000 7ffaf833d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:38.582 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:18:38.451+0000 7ffaf833d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 zonegroup default 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started sync module instance, tier type = 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:18:38.451+0000 7ffaf833d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=0 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=1 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=2 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=3 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=4 2024-09-14T11:18:38.583 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=5 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:18:38.462+0000 7ffaf833d800 20 add_watcher() i=6 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:18:38.463+0000 7ffaf833d800 20 add_watcher() i=7 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:18:38.463+0000 7ffaf833d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding auth protocol: cephx 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.584 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: crc 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:18:38.464+0000 7ffaf833d800 5 AuthRegistry(0x7fff2befd840) adding con mode: secure 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:18:38.464+0000 7ff9aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:18:38.465+0000 7ffaf833d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache list hook 0x5573350c9ff0 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache inspect hook 0x5573350c9ff0 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache erase hook 0x5573350c9ff0 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command cache zap hook 0x5573350c9ff0 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 note: GC not initialized 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:18:38.465+0000 7ff9a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:18:38.585 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace show hook 0x7ffae8071f20 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace history hook 0x7ffae8071f20 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace active hook 0x7ffae8071f20 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:18:38.465+0000 7ffaf833d800 5 asok(0x557334de4270) register_command sync trace active_short hook 0x7ffae8071f20 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 Filter name: none 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:18:38.465+0000 7ff91b7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:18:38.465+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:18:38.465+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : miss 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.586 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:18:38.466+0000 7ffaf833d800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:18:38.466+0000 7ffaf833d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:18:38.471+0000 7ffaf833d800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 93953299865120 notifier 6882 bl.length()=1023 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:18:38.471+0000 7ff9caffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:18:38.587 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:18:38.473+0000 7ffaf833d800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:18:38.474+0000 7ffaf833d800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffaf833d800 time 2024-09-14T11:18:38.474255+0000 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffaf998c76a] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.588 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:18:38.475+0000 7ffaf833d800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7ffaf833d800 thread_name:radosgw-admin 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffaf883e6f0] 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffaf888b99c] 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffaf998c7c4] 2024-09-14T11:18:38.589 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffaf998c928] 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5573326f00b1] 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8900e) [0x557332c0400e] 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5573326ffefd] 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffaf8829590] 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:18:38.590 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:38.591 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:18:38.592 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:18:38.593 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:18:38.594 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:38.595 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff91b7fe640 / http_manager 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9a9fdb640 / http_manager 2024-09-14T11:18:38.596 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9aafdd640 / rgw_dt_lg_renew 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9c9ffb640 / ms_dispatch 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9caffd640 / io_context_pool 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9cb7fe640 / io_context_pool 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9d9ffb640 / ms_dispatch 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9e0e09640 / ms_dispatch 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ff9e260c640 / io_context_pool 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf3829640 / msgr-worker-2 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf402a640 / msgr-worker-1 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf482b640 / msgr-worker-0 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf502c640 / io_context_pool 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: 7ffaf833d800 / radosgw-admin 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:18:38.475916Z_b42a5252-a7bf-485b-8f0b-4769a2affdde/log 2024-09-14T11:18:38.597 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:18:38.598 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.553+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 realm 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.555+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.556+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.556+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.557+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.557+0000 7febeb611800 20 searching for the correct realm 2024-09-14T11:18:38.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.559+0000 7febe7593640 0 -- 172.21.15.29:0/2498317907 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7febd8092b00 msgr2=0x7febd8055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:38.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.764+0000 7febe6591640 0 -- 172.21.15.29:0/2498317907 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7febd807b3f0 msgr2=0x7febd807b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.970+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 zone default found 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 4 Realm: () 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 zonegroup default 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.971+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:38.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 started sync module instance, tier type = 2024-09-14T11:18:38.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.972+0000 7febeb611800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=0 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=1 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=2 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=3 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=4 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=5 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.982+0000 7febeb611800 20 add_watcher() i=6 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.983+0000 7febeb611800 20 add_watcher() i=7 2024-09-14T11:18:38.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.983+0000 7febeb611800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:38.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.985+0000 7fea9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.985+0000 7febeb611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.985+0000 7febeb611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7febeb611800 5 note: GC not initialized 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7fea17fff640 20 reqs_thread_entry: start 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7febeb611800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:38.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7febeb611800 20 Filter name: none 2024-09-14T11:18:38.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7fea15ffb640 20 reqs_thread_entry: start 2024-09-14T11:18:38.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.986+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.987+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.987+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.987+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.987+0000 7febeb611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.987+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.988+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.988+0000 7febeb611800 20 rados->read ofs=0 len=0 2024-09-14T11:18:38.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.988+0000 7febeb611800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:38.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.988+0000 7febeb611800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:38.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.990+0000 7fea9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:38.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.992+0000 7febeb611800 20 remove_watcher() i=0 2024-09-14T11:18:38.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.992+0000 7febeb611800 2 removed watcher, disabling cache 2024-09-14T11:18:38.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.993+0000 7febeb611800 20 remove_watcher() i=1 2024-09-14T11:18:38.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.994+0000 7febeb611800 20 remove_watcher() i=2 2024-09-14T11:18:38.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.995+0000 7febeb611800 20 remove_watcher() i=3 2024-09-14T11:18:38.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.996+0000 7febeb611800 20 remove_watcher() i=4 2024-09-14T11:18:38.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.997+0000 7febeb611800 20 remove_watcher() i=5 2024-09-14T11:18:38.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.998+0000 7febeb611800 20 remove_watcher() i=6 2024-09-14T11:18:38.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:38.999+0000 7febeb611800 20 remove_watcher() i=7 2024-09-14T11:18:39.008 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:39.008 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:18:39.009 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:18:39.009 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:18:39.103 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:39.138 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:39.138 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:39.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.179+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 realm 2024-09-14T11:18:39.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.181+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.182+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:39.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.182+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.183+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:39.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.183+0000 7f7656925800 20 searching for the correct realm 2024-09-14T11:18:39.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.185+0000 7f7652ea3640 0 -- 172.21.15.29:0/1837749856 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55675546f6f0 msgr2=0x556755471ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:39.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.188+0000 7f7652ea3640 0 -- 172.21.15.29:0/1837749856 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f751c087860 msgr2=0x7f751c089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.194+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 zone default found 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 4 Realm: () 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 zonegroup default 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:39.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 started sync module instance, tier type = 2024-09-14T11:18:39.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.195+0000 7f7656925800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:18:39.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=0 2024-09-14T11:18:39.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=1 2024-09-14T11:18:39.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=2 2024-09-14T11:18:39.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=3 2024-09-14T11:18:39.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=4 2024-09-14T11:18:39.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=5 2024-09-14T11:18:39.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.204+0000 7f7656925800 20 add_watcher() i=6 2024-09-14T11:18:39.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.205+0000 7f7656925800 20 add_watcher() i=7 2024-09-14T11:18:39.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.205+0000 7f7656925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:39.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7508fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:39.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7656925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:39.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7656925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:39.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7656925800 5 note: GC not initialized 2024-09-14T11:18:39.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f74837fe640 20 reqs_thread_entry: start 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7656925800 20 init_complete bucket index max shards: 11 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f7656925800 20 Filter name: none 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.207+0000 7f74817fa640 20 reqs_thread_entry: start 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : miss 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 20 rados->read ofs=0 len=0 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:18:39.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.208+0000 7f7656925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:18:39.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.210+0000 7f7656925800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to be held by another RGW process; skipping for now 2024-09-14T11:18:39.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.211+0000 7f7508fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:39.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.213+0000 7f7656925800 20 remove_watcher() i=0 2024-09-14T11:18:39.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.213+0000 7f7656925800 2 removed watcher, disabling cache 2024-09-14T11:18:39.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.214+0000 7f7656925800 20 remove_watcher() i=1 2024-09-14T11:18:39.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.215+0000 7f7656925800 20 remove_watcher() i=2 2024-09-14T11:18:39.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.216+0000 7f7656925800 20 remove_watcher() i=3 2024-09-14T11:18:39.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.217+0000 7f7656925800 20 remove_watcher() i=4 2024-09-14T11:18:39.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.218+0000 7f7656925800 20 remove_watcher() i=5 2024-09-14T11:18:39.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.218+0000 7f7656925800 20 remove_watcher() i=6 2024-09-14T11:18:39.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:18:39.219+0000 7f7656925800 20 remove_watcher() i=7 2024-09-14T11:18:39.228 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:19:09.258 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:09.294 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:09.294 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:09.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.341+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 realm 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.343+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.344+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:09.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.344+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.345+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:09.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.345+0000 7f5578887800 20 searching for the correct realm 2024-09-14T11:19:09.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.348+0000 7f5576b72640 0 -- 172.21.15.29:0/1404312551 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f5570025040 msgr2=0x7f5570025790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:09.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.555+0000 7f5575b70640 0 -- 172.21.15.29:0/1404312551 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f5570011380 msgr2=0x7f5570011800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:09.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:09.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.763+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 zone default found 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 4 Realm: () 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:09.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 zonegroup default 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.764+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.765+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.765+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.765+0000 7f5578887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.765+0000 7f5578887800 20 started sync module instance, tier type = 2024-09-14T11:19:09.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.765+0000 7f5578887800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:09.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=0 2024-09-14T11:19:09.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=1 2024-09-14T11:19:09.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=2 2024-09-14T11:19:09.773 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=3 2024-09-14T11:19:09.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=4 2024-09-14T11:19:09.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=5 2024-09-14T11:19:09.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.775+0000 7f5578887800 20 add_watcher() i=6 2024-09-14T11:19:09.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.776+0000 7f5578887800 20 add_watcher() i=7 2024-09-14T11:19:09.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.776+0000 7f5578887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:09.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.779+0000 7f542cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:09.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.779+0000 7f5578887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:09.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.779+0000 7f5578887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:09.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.779+0000 7f5578887800 5 note: GC not initialized 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.779+0000 7f53a77fe640 20 reqs_thread_entry: start 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 20 Filter name: none 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f53a57fa640 20 reqs_thread_entry: start 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:19:09.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : miss 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.780+0000 7f5578887800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 20 rados_obj.operate() r=0 bl.length=479 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.781+0000 7f5578887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:19:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.782+0000 7f5578887800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:09.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.791+0000 7f5578887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.791+0000 7f5578887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.791+0000 7f5578887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.791+0000 7f5578887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:19:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.792+0000 7f5459ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94405814237344 notifier 6936 bl.length()=1023 2024-09-14T11:19:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.792+0000 7f5459ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.792+0000 7f5459ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.792+0000 7f5459ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.793+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:19:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.793+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:19:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.793+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:19:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.793+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.0 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.0 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.1 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.1 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.2 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.2 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.3 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.3 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.4 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.4 2024-09-14T11:19:09.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.5 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.5 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.6 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.6 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.7 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.7 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.8 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.8 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.9 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.9 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.10 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.10 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.11 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2.11 2024-09-14T11:19:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.798+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.0 2024-09-14T11:19:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.799+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.1 2024-09-14T11:19:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.799+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2 2024-09-14T11:19:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.800+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.3 2024-09-14T11:19:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.800+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.4 2024-09-14T11:19:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.801+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.5 2024-09-14T11:19:09.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.802+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.6 2024-09-14T11:19:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.803+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.7 2024-09-14T11:19:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.803+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.8 2024-09-14T11:19:09.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.804+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.9 2024-09-14T11:19:09.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.804+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.10 2024-09-14T11:19:09.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.810+0000 7f5578887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:09.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.810+0000 7f5578887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:19:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f5578887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f5578887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f5578887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f5578887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:19:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f54597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94405814237344 notifier 6936 bl.length()=1023 2024-09-14T11:19:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f54597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f54597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.811+0000 7f54597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.813+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:19:09.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.813+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:19:09.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.813+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:19:09.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.813+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:19:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.816+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.0 2024-09-14T11:19:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.816+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.1 2024-09-14T11:19:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.816+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.2 2024-09-14T11:19:09.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.817+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.3 2024-09-14T11:19:09.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.817+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.4 2024-09-14T11:19:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.818+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.5 2024-09-14T11:19:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.818+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.6 2024-09-14T11:19:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.818+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.7 2024-09-14T11:19:09.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.819+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.8 2024-09-14T11:19:09.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.819+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.9 2024-09-14T11:19:09.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.819+0000 7f5578887800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.28.10 2024-09-14T11:19:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.820+0000 7f5578887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.820+0000 7f5578887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.821+0000 7f5578887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.821+0000 7f5578887800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.821+0000 7f5578887800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.821+0000 7f5578887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28, ofs0, ns] 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.822+0000 7f54597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94405814237344 notifier 6936 bl.length()=991 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.822+0000 7f54597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 info.flags=0x17 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.822+0000 7f54597fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:11989569-703c-4397-b0f1-7ddb0279a491.4517.28 to cache LRU end 2024-09-14T11:19:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.822+0000 7f54597fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:09.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.823+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_sources= new_sources= 2024-09-14T11:19:09.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.823+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential sources added=[] removed=[] 2024-09-14T11:19:09.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.823+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): orig_dests= new_dests= 2024-09-14T11:19:09.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.823+0000 7f5578887800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[11989569-703c-4397-b0f1-7ddb0279a491.4517.28]): potential dests added=[] removed=[] 2024-09-14T11:19:09.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.826+0000 7f5578887800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:09.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.828+0000 7f542cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:09.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.830+0000 7f5578887800 20 remove_watcher() i=0 2024-09-14T11:19:09.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.830+0000 7f5578887800 2 removed watcher, disabling cache 2024-09-14T11:19:09.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.831+0000 7f5578887800 20 remove_watcher() i=1 2024-09-14T11:19:09.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.832+0000 7f5578887800 20 remove_watcher() i=2 2024-09-14T11:19:09.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.833+0000 7f5578887800 20 remove_watcher() i=3 2024-09-14T11:19:09.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.834+0000 7f5578887800 20 remove_watcher() i=4 2024-09-14T11:19:09.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.835+0000 7f5578887800 20 remove_watcher() i=5 2024-09-14T11:19:09.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.836+0000 7f5578887800 20 remove_watcher() i=6 2024-09-14T11:19:09.835 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.837+0000 7f5578887800 20 remove_watcher() i=7 2024-09-14T11:19:09.848 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:19:09.878 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:09.878 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.920+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 realm 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:09.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:09.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.922+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.923+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:09.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.923+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:09.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.924+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:09.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.924+0000 7f511cf32800 20 searching for the correct realm 2024-09-14T11:19:09.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:09.926+0000 7f51193bd640 0 -- 172.21.15.29:0/3742342611 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f5110077200 msgr2=0x7f5110076180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:10.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.132+0000 7f51183bb640 0 -- 172.21.15.29:0/3742342611 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f51100990d0 msgr2=0x7f511007da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.339+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.340+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.340+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.340+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.340+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 zone default found 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 4 Realm: () 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 zonegroup default 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.341+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.342+0000 7f511cf32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:10.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.342+0000 7f511cf32800 20 started sync module instance, tier type = 2024-09-14T11:19:10.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.342+0000 7f511cf32800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=0 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=1 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=2 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=3 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=4 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=5 2024-09-14T11:19:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.352+0000 7f511cf32800 20 add_watcher() i=6 2024-09-14T11:19:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.353+0000 7f511cf32800 20 add_watcher() i=7 2024-09-14T11:19:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.353+0000 7f511cf32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.354+0000 7f4fcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f511cf32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f511cf32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f511cf32800 5 note: GC not initialized 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f4fcdfe3640 20 reqs_thread_entry: start 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f511cf32800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f511cf32800 20 Filter name: none 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.355+0000 7f4f3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.356+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.356+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:19:10.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.356+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:19:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:19:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 rados->read ofs=0 len=0 2024-09-14T11:19:10.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:19:10.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.357+0000 7f511cf32800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:10.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.359+0000 7f4fcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:10.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.362+0000 7f511cf32800 20 remove_watcher() i=0 2024-09-14T11:19:10.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.362+0000 7f511cf32800 2 removed watcher, disabling cache 2024-09-14T11:19:10.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.363+0000 7f511cf32800 20 remove_watcher() i=1 2024-09-14T11:19:10.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.364+0000 7f511cf32800 20 remove_watcher() i=2 2024-09-14T11:19:10.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.365+0000 7f511cf32800 20 remove_watcher() i=3 2024-09-14T11:19:10.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.366+0000 7f511cf32800 20 remove_watcher() i=4 2024-09-14T11:19:10.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.367+0000 7f511cf32800 20 remove_watcher() i=5 2024-09-14T11:19:10.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.368+0000 7f511cf32800 20 remove_watcher() i=6 2024-09-14T11:19:10.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:10.369+0000 7f511cf32800 20 remove_watcher() i=7 2024-09-14T11:19:10.380 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:10.380 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:10.380 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-trim-reshard-log-entries id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:10.380 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:10.763 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:19:10.764 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:11.627 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:19:11.656 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:11.656 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:11.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.697+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 20 realm 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.699+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.700+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.700+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.700+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:11.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.700+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:11.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.701+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:11.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.701+0000 7f6da853e800 20 searching for the correct realm 2024-09-14T11:19:11.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.703+0000 7f6da4ac1640 0 -- 172.21.15.29:0/2606118 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6d9c02f040 msgr2=0x7f6d9c019430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:11.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:11.908+0000 7f6da3abf640 0 -- 172.21.15.29:0/2606118 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6d9c023930 msgr2=0x7f6d9c053410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:12.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:12.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:12.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:12.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:12.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:12.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 zone default found 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 4 Realm: () 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 zonegroup default 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.115+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.115 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 started sync module instance, tier type = 2024-09-14T11:19:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.116+0000 7f6da853e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=0 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=1 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=2 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=3 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=4 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=5 2024-09-14T11:19:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.126+0000 7f6da853e800 20 add_watcher() i=6 2024-09-14T11:19:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.127+0000 7f6da853e800 20 add_watcher() i=7 2024-09-14T11:19:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.127+0000 7f6da853e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:12.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.128+0000 7f6c5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6da853e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6da853e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6da853e800 5 note: GC not initialized 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6c59fdb640 20 reqs_thread_entry: start 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6da853e800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6da853e800 20 Filter name: none 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.129+0000 7f6bcb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:12.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.130+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.130+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.130+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:12.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:12.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.131+0000 7f6da853e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:12.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.133+0000 7f6c5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.135+0000 7f6da853e800 20 remove_watcher() i=0 2024-09-14T11:19:12.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.135+0000 7f6da853e800 2 removed watcher, disabling cache 2024-09-14T11:19:12.134 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.137+0000 7f6da853e800 20 remove_watcher() i=1 2024-09-14T11:19:12.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.138+0000 7f6da853e800 20 remove_watcher() i=2 2024-09-14T11:19:12.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.139+0000 7f6da853e800 20 remove_watcher() i=3 2024-09-14T11:19:12.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.139+0000 7f6da853e800 20 remove_watcher() i=4 2024-09-14T11:19:12.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.140+0000 7f6da853e800 20 remove_watcher() i=5 2024-09-14T11:19:12.139 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.141+0000 7f6da853e800 20 remove_watcher() i=6 2024-09-14T11:19:12.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.142+0000 7f6da853e800 20 remove_watcher() i=7 2024-09-14T11:19:12.152 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:12.154 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:19:12.189 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:12.189 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:12.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.232+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.233+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.233+0000 7f03a0f46800 20 realm 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.233+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.234+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.234+0000 7f03a0f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.234+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.234+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.234+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.235+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:12.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.235+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.236+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:12.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.236+0000 7f03a0f46800 20 searching for the correct realm 2024-09-14T11:19:12.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.237+0000 7f039f238640 0 -- 172.21.15.29:0/2102706217 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0398095040 msgr2=0x7f0398085430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:12.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.443+0000 7f039e236640 0 -- 172.21.15.29:0/2102706217 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0398085bd0 msgr2=0x7f03980aa920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:12.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:12.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:12.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.651+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 zone default found 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 4 Realm: () 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 zonegroup default 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.652+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.653+0000 7f03a0f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.653+0000 7f03a0f46800 20 started sync module instance, tier type = 2024-09-14T11:19:12.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.653+0000 7f03a0f46800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:12.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=0 2024-09-14T11:19:12.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=1 2024-09-14T11:19:12.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=2 2024-09-14T11:19:12.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=3 2024-09-14T11:19:12.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=4 2024-09-14T11:19:12.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=5 2024-09-14T11:19:12.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.662+0000 7f03a0f46800 20 add_watcher() i=6 2024-09-14T11:19:12.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.663+0000 7f03a0f46800 20 add_watcher() i=7 2024-09-14T11:19:12.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.663+0000 7f03a0f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.665+0000 7f02557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.665+0000 7f03a0f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.665+0000 7f03a0f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.665+0000 7f03a0f46800 5 note: GC not initialized 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.665+0000 7f01cffff640 20 reqs_thread_entry: start 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:12.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 20 Filter name: none 2024-09-14T11:19:12.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f01cdffb640 20 reqs_thread_entry: start 2024-09-14T11:19:12.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:19:12.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : miss 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.666+0000 7f03a0f46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.667+0000 7f03a0f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f03a0f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f03a0f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f03a0f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f03a0f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:12.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f0281ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497028 cookie 93972804390240 notifier 6987 bl.length()=999 2024-09-14T11:19:12.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f0281ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f0281ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.672+0000 7f0281ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.674+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:12.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.674+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:12.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.674+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:12.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.674+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.0 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.0 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.1 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.1 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.2 2024-09-14T11:19:12.678 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.2 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.3 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.3 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.4 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.4 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.5 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.5 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.6 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.6 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.7 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.7 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.8 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.8 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.9 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.9 2024-09-14T11:19:12.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.10 2024-09-14T11:19:12.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.10 2024-09-14T11:19:12.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.11 2024-09-14T11:19:12.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.11 2024-09-14T11:19:12.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.0 2024-09-14T11:19:12.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.680+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.681+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.2 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.681+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.3 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.682+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.4 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.682+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.5 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.683+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.6 2024-09-14T11:19:12.681 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.683+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.7 2024-09-14T11:19:12.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.684+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.8 2024-09-14T11:19:12.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.684+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.9 2024-09-14T11:19:12.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.685+0000 7f03a0f46800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.10 2024-09-14T11:19:12.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.688+0000 7f03a0f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:12.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.688+0000 7f03a0f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:12.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.689+0000 7f03a0f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.689+0000 7f03a0f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.689+0000 7f03a0f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.689+0000 7f03a0f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.690+0000 7f0281ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497029 cookie 93972804390240 notifier 6987 bl.length()=999 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.690+0000 7f0281ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.690+0000 7f0281ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.690+0000 7f0281ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:19:12.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.691+0000 7f03a0f46800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:19:12.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.697+0000 7f03a0f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:12.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.697+0000 7f03a0f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:12.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f03a0f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f03a0f46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f03a0f46800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f03a0f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:12.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f0281ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497030 cookie 93972804390240 notifier 6987 bl.length()=967 2024-09-14T11:19:12.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f0281ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:12.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f0281ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:12.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.698+0000 7f0281ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:12.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.700+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:12.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.700+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:12.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.700+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:12.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.700+0000 7f03a0f46800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:12.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.702+0000 7f03a0f46800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:19:12.702 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.704+0000 7f02557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:12.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.706+0000 7f03a0f46800 20 remove_watcher() i=0 2024-09-14T11:19:12.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.706+0000 7f03a0f46800 2 removed watcher, disabling cache 2024-09-14T11:19:12.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.708+0000 7f03a0f46800 20 remove_watcher() i=1 2024-09-14T11:19:12.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.709+0000 7f03a0f46800 20 remove_watcher() i=2 2024-09-14T11:19:12.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.710+0000 7f03a0f46800 20 remove_watcher() i=3 2024-09-14T11:19:12.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.711+0000 7f03a0f46800 20 remove_watcher() i=4 2024-09-14T11:19:12.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.711+0000 7f03a0f46800 20 remove_watcher() i=5 2024-09-14T11:19:12.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.712+0000 7f03a0f46800 20 remove_watcher() i=6 2024-09-14T11:19:12.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.714+0000 7f03a0f46800 20 remove_watcher() i=7 2024-09-14T11:19:12.725 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:19:12.755 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:12.755 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:12.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.795+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 realm 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:12.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.797+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.798+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:12.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.798+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:12.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.799+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:12.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.799+0000 7fe684b46800 20 searching for the correct realm 2024-09-14T11:19:12.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:12.801+0000 7fe682e38640 0 -- 172.21.15.29:0/1917302234 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe67407c040 msgr2=0x7fe67407c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:13.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.007+0000 7fe681e36640 0 -- 172.21.15.29:0/1917302234 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe67408b3f0 msgr2=0x7fe67408b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:13.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.213+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:13.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:13.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 zone default found 2024-09-14T11:19:13.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 4 Realm: () 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 zonegroup default 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.214+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.215+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.215+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.215+0000 7fe684b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.215+0000 7fe684b46800 20 started sync module instance, tier type = 2024-09-14T11:19:13.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.215+0000 7fe684b46800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=0 2024-09-14T11:19:13.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=1 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=2 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=3 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=4 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=5 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.224+0000 7fe684b46800 20 add_watcher() i=6 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.225+0000 7fe684b46800 20 add_watcher() i=7 2024-09-14T11:19:13.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.225+0000 7fe684b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.227+0000 7fe538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.227+0000 7fe684b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.227+0000 7fe684b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.227+0000 7fe684b46800 5 note: GC not initialized 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe4b37fe640 20 reqs_thread_entry: start 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe684b46800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe684b46800 20 Filter name: none 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe4b17fa640 20 reqs_thread_entry: start 2024-09-14T11:19:13.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.228+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.229+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.229+0000 7fe684b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:13.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.229+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.230+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.230+0000 7fe684b46800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.230+0000 7fe684b46800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:13.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.230+0000 7fe684b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:13.230 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.232+0000 7fe538fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:13.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.234+0000 7fe684b46800 20 remove_watcher() i=0 2024-09-14T11:19:13.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.234+0000 7fe684b46800 2 removed watcher, disabling cache 2024-09-14T11:19:13.233 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.235+0000 7fe684b46800 20 remove_watcher() i=1 2024-09-14T11:19:13.234 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.236+0000 7fe684b46800 20 remove_watcher() i=2 2024-09-14T11:19:13.235 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.237+0000 7fe684b46800 20 remove_watcher() i=3 2024-09-14T11:19:13.236 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.238+0000 7fe684b46800 20 remove_watcher() i=4 2024-09-14T11:19:13.238 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.240+0000 7fe684b46800 20 remove_watcher() i=5 2024-09-14T11:19:13.239 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.241+0000 7fe684b46800 20 remove_watcher() i=6 2024-09-14T11:19:13.240 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.242+0000 7fe684b46800 20 remove_watcher() i=7 2024-09-14T11:19:13.251 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:13.251 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:13.251 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:13.251 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:13.345 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:13.377 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:13.377 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:13.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.419+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.420+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.420+0000 7f6fe3b2c800 20 realm 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.420+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.421+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.421+0000 7f6fe3b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.421+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.421+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.421+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.422+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:13.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.422+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.422+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:13.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.422+0000 7f6fe3b2c800 20 searching for the correct realm 2024-09-14T11:19:13.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.424+0000 7f6fe00ae640 0 -- 172.21.15.29:0/2833414192 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6fd8015030 msgr2=0x7f6fd803d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:13.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.630+0000 7f6fdf0ac640 0 -- 172.21.15.29:0/2833414192 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6fd8047bc0 msgr2=0x7f6fd806a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:13.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:13.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:13.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.838+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:13.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 zone default found 2024-09-14T11:19:13.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 4 Realm: () 2024-09-14T11:19:13.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:13.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 zonegroup default 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.839+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.840+0000 7f6fe3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.840+0000 7f6fe3b2c800 20 started sync module instance, tier type = 2024-09-14T11:19:13.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.840+0000 7f6fe3b2c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=0 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=1 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=2 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=3 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=4 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=5 2024-09-14T11:19:13.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.850+0000 7f6fe3b2c800 20 add_watcher() i=6 2024-09-14T11:19:13.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.851+0000 7f6fe3b2c800 20 add_watcher() i=7 2024-09-14T11:19:13.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.851+0000 7f6fe3b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:13.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.853+0000 7f6e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:13.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:13.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:13.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 5 note: GC not initialized 2024-09-14T11:19:13.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6e94fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:13.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:13.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 20 Filter name: none 2024-09-14T11:19:13.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6e0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:13.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:19:13.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.854+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : miss 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.855+0000 7f6fe3b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6fe3b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6fe3b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6fe3b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6fe3b2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6ebe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94257971725408 notifier 7023 bl.length()=999 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6ebe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6ebe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.862+0000 7f6ebe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.864+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:13.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.864+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:13.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.864+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:13.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.864+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:13.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.0 2024-09-14T11:19:13.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.0 2024-09-14T11:19:13.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.1 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.1 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.2 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.2 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.3 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.3 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.4 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.4 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.5 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.5 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.6 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.6 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.7 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.7 2024-09-14T11:19:13.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.8 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.8 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.9 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.9 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.10 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.10 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.11 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1.11 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.0 2024-09-14T11:19:13.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.872+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.873+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.2 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.873+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.3 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.874+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.4 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.874+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.5 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.875+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.6 2024-09-14T11:19:13.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.875+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.7 2024-09-14T11:19:13.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.876+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.8 2024-09-14T11:19:13.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.876+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.9 2024-09-14T11:19:13.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.877+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.10 2024-09-14T11:19:13.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.881+0000 7f6fe3b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:13.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.881+0000 7f6fe3b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:13.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.882+0000 7f6fe3b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.882+0000 7f6fe3b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.882+0000 7f6fe3b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.882+0000 7f6fe3b2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.883+0000 7f6ebe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497032 cookie 94257971725408 notifier 7023 bl.length()=999 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.883+0000 7f6ebe7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.883+0000 7f6ebe7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.883+0000 7f6ebe7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.885+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:13.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.885+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:13.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.885+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:13.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.885+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:13.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.887+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.0 2024-09-14T11:19:13.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.887+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.1 2024-09-14T11:19:13.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.888+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.2 2024-09-14T11:19:13.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.888+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.3 2024-09-14T11:19:13.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.888+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.4 2024-09-14T11:19:13.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.889+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.5 2024-09-14T11:19:13.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.889+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.6 2024-09-14T11:19:13.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.889+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.7 2024-09-14T11:19:13.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.890+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.8 2024-09-14T11:19:13.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.890+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.9 2024-09-14T11:19:13.888 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.890+0000 7f6fe3b2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.29.10 2024-09-14T11:19:13.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.891+0000 7f6fe3b2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:13.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.891+0000 7f6fe3b2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 2024-09-14T11:19:13.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.892+0000 7f6fe3b2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.892+0000 7f6fe3b2c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.892+0000 7f6fe3b2c800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.892+0000 7f6fe3b2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29, ofs0, ns] 2024-09-14T11:19:13.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.893+0000 7f6ebeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497033 cookie 94257971725408 notifier 7023 bl.length()=967 2024-09-14T11:19:13.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.893+0000 7f6ebeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 info.flags=0x17 2024-09-14T11:19:13.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.893+0000 7f6ebeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.29 to cache LRU end 2024-09-14T11:19:13.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.893+0000 7f6ebeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:13.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.895+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_sources= new_sources= 2024-09-14T11:19:13.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.895+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential sources added=[] removed=[] 2024-09-14T11:19:13.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.895+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): orig_dests= new_dests= 2024-09-14T11:19:13.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.895+0000 7f6fe3b2c800 20 handle_bi_update(): bucket=:error-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.29]): potential dests added=[] removed=[] 2024-09-14T11:19:13.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.898+0000 7f6fe3b2c800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:13.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.900+0000 7f6e95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:13.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.902+0000 7f6fe3b2c800 20 remove_watcher() i=0 2024-09-14T11:19:13.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.902+0000 7f6fe3b2c800 2 removed watcher, disabling cache 2024-09-14T11:19:13.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.903+0000 7f6fe3b2c800 20 remove_watcher() i=1 2024-09-14T11:19:13.903 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.904+0000 7f6fe3b2c800 20 remove_watcher() i=2 2024-09-14T11:19:13.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.906+0000 7f6fe3b2c800 20 remove_watcher() i=3 2024-09-14T11:19:13.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.907+0000 7f6fe3b2c800 20 remove_watcher() i=4 2024-09-14T11:19:13.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.908+0000 7f6fe3b2c800 20 remove_watcher() i=5 2024-09-14T11:19:13.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.909+0000 7f6fe3b2c800 20 remove_watcher() i=6 2024-09-14T11:19:13.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.910+0000 7f6fe3b2c800 20 remove_watcher() i=7 2024-09-14T11:19:13.921 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:19:13.950 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:13.950 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:13.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.992+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 realm 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:13.992 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.994+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.995+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:13.993 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.995+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:13.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.996+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:13.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.996+0000 7fb42b126800 20 searching for the correct realm 2024-09-14T11:19:13.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:13.998+0000 7fb42755e640 0 -- 172.21.15.29:0/2327279562 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fb420032060 msgr2=0x7fb4200666e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:14.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.204+0000 7fb42655c640 0 -- 172.21.15.29:0/2327279562 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fb42007d360 msgr2=0x7fb42006f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:14.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.412+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 zone default found 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 4 Realm: () 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 zonegroup default 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.413+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.414+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.414+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.414+0000 7fb42b126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:14.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.414+0000 7fb42b126800 20 started sync module instance, tier type = 2024-09-14T11:19:14.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.414+0000 7fb42b126800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:14.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=0 2024-09-14T11:19:14.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=1 2024-09-14T11:19:14.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=2 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=3 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=4 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=5 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.424+0000 7fb42b126800 20 add_watcher() i=6 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.425+0000 7fb42b126800 20 add_watcher() i=7 2024-09-14T11:19:14.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.425+0000 7fb42b126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:14.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb42b126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb42b126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb42b126800 5 note: GC not initialized 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb257fff640 20 reqs_thread_entry: start 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb42b126800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.427+0000 7fb42b126800 20 Filter name: none 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.428+0000 7fb255ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:14.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.428+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.428+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:14.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.428+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.429+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:14.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.429+0000 7fb42b126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:14.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.429+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.429+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:14.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.429+0000 7fb42b126800 20 rados->read ofs=0 len=0 2024-09-14T11:19:14.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.430+0000 7fb42b126800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:14.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.430+0000 7fb42b126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:14.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.432+0000 7fb2dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:14.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.434+0000 7fb42b126800 20 remove_watcher() i=0 2024-09-14T11:19:14.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.434+0000 7fb42b126800 2 removed watcher, disabling cache 2024-09-14T11:19:14.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.435+0000 7fb42b126800 20 remove_watcher() i=1 2024-09-14T11:19:14.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.436+0000 7fb42b126800 20 remove_watcher() i=2 2024-09-14T11:19:14.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.437+0000 7fb42b126800 20 remove_watcher() i=3 2024-09-14T11:19:14.437 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.439+0000 7fb42b126800 20 remove_watcher() i=4 2024-09-14T11:19:14.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.440+0000 7fb42b126800 20 remove_watcher() i=5 2024-09-14T11:19:14.439 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.440+0000 7fb42b126800 20 remove_watcher() i=6 2024-09-14T11:19:14.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:14.442+0000 7fb42b126800 20 remove_watcher() i=7 2024-09-14T11:19:14.452 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:14.452 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:14.452 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:14.452 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:14.841 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:19:14.841 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:15.698 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:19:15.727 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:15.728 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:15.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.768+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.770+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.770+0000 7fe233573800 20 realm 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.770+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.770+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.770+0000 7fe233573800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.771+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.771+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.771+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.771+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:15.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.771+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.974+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:15.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.974+0000 7fe233573800 20 searching for the correct realm 2024-09-14T11:19:15.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.975+0000 7fe23085c640 0 -- 172.21.15.29:0/226816178 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fe22406d060 msgr2=0x7fe22406e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:15.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.979+0000 7fe23185e640 0 -- 172.21.15.29:0/226816178 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55f178fb80a0 msgr2=0x55f178fba490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:15.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:15.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.985+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 zone default found 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 4 Realm: () 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:15.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 zonegroup default 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.986+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.987+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.987+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.987+0000 7fe233573800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.987+0000 7fe233573800 20 started sync module instance, tier type = 2024-09-14T11:19:15.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.987+0000 7fe233573800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=0 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=1 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=2 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=3 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=4 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=5 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.995+0000 7fe233573800 20 add_watcher() i=6 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.996+0000 7fe233573800 20 add_watcher() i=7 2024-09-14T11:19:15.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.996+0000 7fe233573800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe0e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe233573800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe233573800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe233573800 5 note: GC not initialized 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe0e6fe5640 20 reqs_thread_entry: start 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.998+0000 7fe233573800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.999+0000 7fe233573800 20 Filter name: none 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.999+0000 7fe0e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:15.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.999+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.999+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:15.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:15.999+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:15.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:15.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:15.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 rados->read ofs=0 len=0 2024-09-14T11:19:15.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:15.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.000+0000 7fe233573800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:16.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.002+0000 7fe0e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:16.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.004+0000 7fe233573800 20 remove_watcher() i=0 2024-09-14T11:19:16.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.004+0000 7fe233573800 2 removed watcher, disabling cache 2024-09-14T11:19:16.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.005+0000 7fe233573800 20 remove_watcher() i=1 2024-09-14T11:19:16.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.006+0000 7fe233573800 20 remove_watcher() i=2 2024-09-14T11:19:16.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.007+0000 7fe233573800 20 remove_watcher() i=3 2024-09-14T11:19:16.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.008+0000 7fe233573800 20 remove_watcher() i=4 2024-09-14T11:19:16.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.009+0000 7fe233573800 20 remove_watcher() i=5 2024-09-14T11:19:16.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.010+0000 7fe233573800 20 remove_watcher() i=6 2024-09-14T11:19:16.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.011+0000 7fe233573800 20 remove_watcher() i=7 2024-09-14T11:19:16.020 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.020 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:16.020 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:16.020 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.022 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:19:16.057 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:16.057 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:16.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.098+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 realm 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.100+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.100+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.101+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:16.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.101+0000 7fa271263800 20 searching for the correct realm 2024-09-14T11:19:16.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.103+0000 7fa26f555640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa268015030 msgr2=0x7fa26803c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.309+0000 7fa26e553640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa268091780 msgr2=0x7fa2680879b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:16.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:16.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 zone default found 2024-09-14T11:19:16.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 4 Realm: () 2024-09-14T11:19:16.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 zonegroup default 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 started sync module instance, tier type = 2024-09-14T11:19:16.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.516+0000 7fa271263800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:16.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=0 2024-09-14T11:19:16.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=1 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=2 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=3 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=4 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=5 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=6 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.526+0000 7fa271263800 20 add_watcher() i=7 2024-09-14T11:19:16.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.526+0000 7fa271263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:16.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.528+0000 7fa1257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:16.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:16.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:16.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.528+0000 7fa271263800 5 note: GC not initialized 2024-09-14T11:19:16.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa09ffff640 20 reqs_thread_entry: start 2024-09-14T11:19:16.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa271263800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:16.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa271263800 20 Filter name: none 2024-09-14T11:19:16.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa09dffb640 20 reqs_thread_entry: start 2024-09-14T11:19:16.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:19:16.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.529+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : miss 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.530+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.0 2024-09-14T11:19:16.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.3 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.4 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.5 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.6 2024-09-14T11:19:16.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.7 2024-09-14T11:19:16.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.8 2024-09-14T11:19:16.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.9 2024-09-14T11:19:16.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.10 2024-09-14T11:19:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.551+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:16.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.551+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.552+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.552+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.552+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.552+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.552 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa271263800 time 2024-09-14T11:19:16.555370+0000 2024-09-14T11:19:16.552 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa27478c76a] 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.553 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fa271263800 thread_name:radosgw-admin 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.555+0000 7fa271263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa271263800 time 2024-09-14T11:19:16.555370+0000 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa27478c76a] 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.554 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:19:16.555 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.572 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.572 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa27343e6f0] 2024-09-14T11:19:16.572 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa27348b99c] 2024-09-14T11:19:16.572 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:16.572 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa27478c7c4] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.556+0000 7fa271263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fa271263800 thread_name:radosgw-admin 2024-09-14T11:19:16.573 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa27343e6f0] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa27348b99c] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa27478c7c4] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:19:16.574 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.717265s 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83ced860 auth_method 0 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83d83550 auth_method 0 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.575 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83cb7d00 auth_method 0 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.576 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:19:16.082+0000 7fa26f555640 1 monclient: found mon.noname-c 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: dump: 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.577 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: dump: 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.578 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:19:16.082+0000 7fa271263800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:19:16.082+0000 7fa15ce09640 4 set_mon_vals no callback set 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:19:16.083+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:19:16.083+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:19:16.083+0000 7fa271263800 1 librados: init done 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:19:16.085+0000 7fa26ed54640 10 monclient: get_auth_request con 0x7fa154077230 auth_method 0 2024-09-14T11:19:16.579 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:19:16.085+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83e83580 auth_method 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:19:16.086+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83e8ced0 auth_method 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:19:16.086+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83e91110 auth_method 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:19:16.087+0000 7fa26f555640 10 monclient: get_auth_request con 0x55ba83e907c0 auth_method 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:19:16.088+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.580 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.581 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:19:16.088+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:19:16.088+0000 7fa271263800 5 asok(0x55ba83c21270) register_command objecter_requests cmddesc objecter_requests hook 0x55ba83e9c820 EEXIST 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.582 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:19:16.089+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:19:16.089+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:19:16.089+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x55ba83e98390 EEXIST 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83ec0b40 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83ec0f20 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83ebf850 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.583 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.724558s 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83ec0b40 auth_method 0 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83ebf850 auth_method 0 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.584 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83ec0f20 auth_method 0 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:19:16.089+0000 7fa26e553640 1 monclient: found mon.noname-a 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.585 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: dump: 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.586 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: dump: 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:19:16.090+0000 7fa271263800 5 monclient: authenticate success, global_id 7068 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.587 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:19:16.090+0000 7fa26fd56640 4 set_mon_vals no callback set 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:19:16.092+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa148077140 auth_method 0 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: get_monmap_and_config 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:19:16.092+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.588 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.589 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:19:16.092+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.590 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:19:16.093+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:19:16.093+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:19:16.093+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x7ffeafc05628 EEXIST 2024-09-14T11:19:16.591 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83f14b90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83f054e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83f0ffc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.728629s 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83f14b90 auth_method 0 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.592 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83f0ffc0 auth_method 0 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83f054e0 auth_method 0 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.593 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_done global_id 7071 payload 274 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:19:16.093+0000 7fa26e553640 1 monclient: found mon.noname-a 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: dump: 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.594 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:19:16.094+0000 7fa271263800 5 monclient: authenticate success, global_id 7071 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:19:16.094+0000 7fa271263800 4 set_mon_vals no callback set 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: dump: 2024-09-14T11:19:16.595 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: shutdown 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:19:16.094+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.596 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.597 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: starting msgr at 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: starting objecter 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:19:16.095+0000 7fa271263800 5 asok(0x55ba83c21270) register_command objecter_requests cmddesc objecter_requests hook 0x55ba83f0ead0 EEXIST 2024-09-14T11:19:16.598 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: setting wanted keys 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: calling monclient init 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.599 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:19:16.095+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x55ba83ed5548 EEXIST 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83f054e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83f0ffc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83f14b90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.730868s 2024-09-14T11:19:16.600 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83f0ffc0 auth_method 0 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:19:16.095+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83f14b90 auth_method 0 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83f054e0 auth_method 0 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.601 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_done global_id 6713 payload 824 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:19:16.096+0000 7fa26f555640 1 monclient: found mon.noname-c 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: dump: 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.602 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: dump: 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.603 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:19:16.096+0000 7fa271263800 5 monclient: authenticate success, global_id 6713 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:19:16.096+0000 7fa1527fc640 4 set_mon_vals no callback set 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.604 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:19:16.096+0000 7fa271263800 1 librados: init done 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:19:16.096+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cr dump hook 0x55ba83f08c58 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:19:16.098+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:19:16.098+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa138077230 auth_method 0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:19:16.098+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83f2f1c0 auth_method 0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:19:16.099+0000 7fa271263800 20 realm 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:19:16.099+0000 7fa271263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.605 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:19:16.100+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83f333e0 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:19:16.100+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:19:16.100+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:19:16.100+0000 7fa26f555640 10 monclient: get_auth_request con 0x55ba83f36c40 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:19:16.101+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:19:16.101+0000 7fa271263800 20 searching for the correct realm 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:19:16.101+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83f3b9e0 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:19:16.102+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa260032040 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:19:16.103+0000 7fa26f555640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa268015030 msgr2=0x7fa26803c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:19:16.103+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa268015030 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:19:16.304+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa268015030 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:19:16.307+0000 7fa26ed54640 10 monclient: get_auth_request con 0x7fa2680a83d0 auth_method 0 2024-09-14T11:19:16.606 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:19:16.309+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa268091780 auth_method 0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:19:16.309+0000 7fa26e553640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa268091780 msgr2=0x7fa2680879b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:19:16.510+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa268091780 auth_method 0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:19:16.516+0000 7fa271263800 20 zone default found 2024-09-14T11:19:16.607 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:19:16.516+0000 7fa271263800 4 Realm: () 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:19:16.516+0000 7fa271263800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:19:16.516+0000 7fa271263800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:19:16.516+0000 7fa271263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:19:16.516+0000 7fa271263800 20 zonegroup default 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:19:16.516+0000 7fa271263800 20 started sync module instance, tier type = 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:19:16.516+0000 7fa271263800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=0 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=1 2024-09-14T11:19:16.608 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=2 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=3 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=4 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=5 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=6 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:19:16.526+0000 7fa271263800 20 add_watcher() i=7 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:19:16.526+0000 7fa271263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.609 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:19:16.528+0000 7fa1257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:19:16.528+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache list hook 0x55ba83f1fa90 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache inspect hook 0x55ba83f1fa90 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache erase hook 0x55ba83f1fa90 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache zap hook 0x55ba83f1fa90 2024-09-14T11:19:16.610 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:19:16.528+0000 7fa271263800 5 note: GC not initialized 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:19:16.529+0000 7fa09ffff640 20 reqs_thread_entry: start 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace show hook 0x7fa268065210 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace history hook 0x7fa268065210 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace active hook 0x7fa268065210 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace active_short hook 0x7fa268065210 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:19:16.529+0000 7fa271263800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:19:16.529+0000 7fa271263800 20 Filter name: none 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:19:16.529+0000 7fa09dffb640 20 reqs_thread_entry: start 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:19:16.529+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:19:16.529+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:19:16.611 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : miss 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:19:16.530+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:19:16.535+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:19:16.535+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:19:16.535+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:19:16.535+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.612 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.613 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.614 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.0 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.3 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.4 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.5 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.6 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.7 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.8 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.9 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.10 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:19:16.551+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:16.615 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:19:16.551+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:19:16.552+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:19:16.552+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:19:16.552+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:19:16.552+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:19:16.555+0000 7fa271263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa271263800 time 2024-09-14T11:19:16.555370+0000 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:16.616 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa27478c76a] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:19:16.556+0000 7fa271263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fa271263800 thread_name:radosgw-admin 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.617 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa27343e6f0] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa27348b99c] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa27478c7c4] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:19:16.618 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:19:16.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:19:16.620 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:19:16.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:19:16.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:16.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:19:16.624 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa09dffb640 / http_manager 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa09ffff640 / http_manager 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa1257e2640 / rgw_dt_lg_renew 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa150ff9640 / ms_dispatch 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa151ffb640 / io_context_pool 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa1527fc640 / io_context_pool 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa158e01640 / ms_dispatch 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa15b606640 / ms_dispatch 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa15ce09640 / io_context_pool 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26e553640 / msgr-worker-2 2024-09-14T11:19:16.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26ed54640 / msgr-worker-1 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26f555640 / msgr-worker-0 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26fd56640 / io_context_pool 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa271263800 / radosgw-admin 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.113947.log 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.717265s 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83ced860 auth_method 0 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.626 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83d83550 auth_method 0 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83cb7d00 auth_method 0 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:19:16.082+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.627 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:19:16.082+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient(hunting): handle_auth_done global_id 6704 payload 824 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:19:16.082+0000 7fa26f555640 1 monclient: found mon.noname-c 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:19:16.082+0000 7fa26f555640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: dump: 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.628 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:19:16.082+0000 7fa15b606640 10 monclient: dump: 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.629 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:19:16.082+0000 7fa271263800 5 monclient: authenticate success, global_id 6704 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:19:16.082+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:19:16.082+0000 7fa15ce09640 4 set_mon_vals no callback set 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:19:16.083+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:19:16.083+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:19:16.083+0000 7fa271263800 1 librados: init done 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.630 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:19:16.084+0000 7fa15b606640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:19:16.085+0000 7fa26ed54640 10 monclient: get_auth_request con 0x7fa154077230 auth_method 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:19:16.085+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83e83580 auth_method 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:19:16.086+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83e8ced0 auth_method 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:19:16.086+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83e91110 auth_method 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:19:16.087+0000 7fa26f555640 10 monclient: get_auth_request con 0x55ba83e907c0 auth_method 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:19:16.088+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.631 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding auth protocol: cephx 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.632 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: crc 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e99350) adding con mode: secure 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:19:16.088+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:19:16.088+0000 7fa271263800 5 asok(0x55ba83c21270) register_command objecter_requests cmddesc objecter_requests hook 0x55ba83e9c820 EEXIST 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:19:16.088+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:19:16.088+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding auth protocol: cephx 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.633 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: crc 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:19:16.089+0000 7fa271263800 5 AuthRegistry(0x55ba83e98248) adding con mode: secure 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:19:16.089+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:19:16.089+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:19:16.089+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x55ba83e98390 EEXIST 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83ec0b40 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83ec0f20 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83ebf850 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.634 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:19:16.089+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.724558s 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83ec0b40 auth_method 0 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83ebf850 auth_method 0 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.635 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83ec0f20 auth_method 0 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:19:16.089+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:19:16.089+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient(hunting): handle_auth_done global_id 7068 payload 824 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:19:16.089+0000 7fa26e553640 1 monclient: found mon.noname-a 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:19:16.089+0000 7fa26e553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:16.636 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: dump: 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.637 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:19:16.090+0000 7fa158e01640 10 monclient: dump: 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:19:16.090+0000 7fa271263800 5 monclient: authenticate success, global_id 7068 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:19:16.090+0000 7fa26fd56640 4 set_mon_vals no callback set 2024-09-14T11:19:16.638 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:19:16.090+0000 7fa271263800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:19:16.092+0000 7fa158e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:19:16.092+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa148077140 auth_method 0 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: get_monmap_and_config 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:19:16.092+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:19:16.092+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.639 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding auth protocol: cephx 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.640 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: crc 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:19:16.092+0000 7fa271263800 5 AuthRegistry(0x55ba83ee0610) adding con mode: secure 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:19:16.092+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding auth protocol: cephx 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.641 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: crc 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:19:16.093+0000 7fa271263800 5 AuthRegistry(0x7ffeafc054e0) adding con mode: secure 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:19:16.093+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:19:16.093+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:19:16.093+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x7ffeafc05628 EEXIST 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83f14b90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83f054e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83f0ffc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.642 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:19:16.093+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.728629s 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83f14b90 auth_method 0 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83f0ffc0 auth_method 0 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.643 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83f054e0 auth_method 0 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:19:16.093+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:19:16.093+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient(hunting): handle_auth_done global_id 7071 payload 274 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:19:16.093+0000 7fa26e553640 1 monclient: found mon.noname-a 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:19:16.093+0000 7fa26e553640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.644 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: dump: 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.645 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:19:16.094+0000 7fa271263800 5 monclient: authenticate success, global_id 7071 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:19:16.094+0000 7fa271263800 4 set_mon_vals no callback set 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:19:16.094+0000 7fa1527fc640 10 monclient: dump: 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.646 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: shutdown 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: build_initial_monmap 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:19:16.094+0000 7fa271263800 1 build_initial for_mkfs: 0 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:19:16.094+0000 7fa271263800 10 monclient: monmap: 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding auth protocol: cephx 2024-09-14T11:19:16.647 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: crc 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:19:16.094+0000 7fa271263800 5 AuthRegistry(0x55ba83ee40f0) adding con mode: secure 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: starting msgr at 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: starting objecter 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:19:16.095+0000 7fa271263800 5 asok(0x55ba83c21270) register_command objecter_requests cmddesc objecter_requests hook 0x55ba83f0ead0 EEXIST 2024-09-14T11:19:16.648 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: setting wanted keys 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:19:16.095+0000 7fa271263800 1 librados: calling monclient init 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: init 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding auth protocol: cephx 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.649 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: crc 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:19:16.095+0000 7fa271263800 5 AuthRegistry(0x55ba83ed5400) adding con mode: secure 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:19:16.095+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:19:16.095+0000 7fa271263800 5 asok(0x55ba83c21270) register_command rotate-key cmddesc rotate-key hook 0x55ba83ed5548 EEXIST 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-b con 0x55ba83f054e0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-c con 0x55ba83f0ffc0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): picked mon.noname-a con 0x55ba83f14b90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:19:16.095+0000 7fa271263800 10 monclient(hunting): authenticate will time out at 2159.730868s 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): get_auth_request con 0x55ba83f0ffc0 auth_method 0 2024-09-14T11:19:16.650 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:19:16.095+0000 7fa26f555640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:19:16.095+0000 7fa26ed54640 10 monclient(hunting): get_auth_request con 0x55ba83f14b90 auth_method 0 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): get_auth_request con 0x55ba83f054e0 auth_method 0 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.651 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:19:16.096+0000 7fa26ed54640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:19:16.096+0000 7fa26e553640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient(hunting): handle_auth_done global_id 6713 payload 824 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient: _finish_hunting 0 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:19:16.096+0000 7fa26f555640 1 monclient: found mon.noname-c 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:19:16.096+0000 7fa26f555640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: dump: 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.652 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: _finish_auth 0 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:19:16.096+0000 7fa150ff9640 10 monclient: dump: 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:16.653 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:19:16.096+0000 7fa271263800 5 monclient: authenticate success, global_id 6713 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:19:16.096+0000 7fa1527fc640 4 set_mon_vals no callback set 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _renew_subs 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:19:16.096+0000 7fa271263800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:19:16.096+0000 7fa271263800 1 librados: init done 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:19:16.096+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cr dump hook 0x55ba83f08c58 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:19:16.098+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.654 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:19:16.098+0000 7fa150ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:19:16.098+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa138077230 auth_method 0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:19:16.098+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83f2f1c0 auth_method 0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:19:16.099+0000 7fa271263800 20 realm 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:19:16.099+0000 7fa271263800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:19:16.099+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:19:16.100+0000 7fa26e553640 10 monclient: get_auth_request con 0x55ba83f333e0 auth_method 0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:19:16.100+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:19:16.100+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:19:16.100+0000 7fa26f555640 10 monclient: get_auth_request con 0x55ba83f36c40 auth_method 0 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:19:16.101+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:19:16.101+0000 7fa271263800 20 searching for the correct realm 2024-09-14T11:19:16.655 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:19:16.101+0000 7fa26ed54640 10 monclient: get_auth_request con 0x55ba83f3b9e0 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:19:16.102+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa260032040 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:19:16.103+0000 7fa26f555640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa268015030 msgr2=0x7fa26803c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:19:16.103+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa268015030 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:19:16.304+0000 7fa26f555640 10 monclient: get_auth_request con 0x7fa268015030 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:19:16.307+0000 7fa26ed54640 10 monclient: get_auth_request con 0x7fa2680a83d0 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:19:16.309+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa268091780 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:19:16.309+0000 7fa26e553640 0 -- 172.21.15.29:0/4139596566 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa268091780 msgr2=0x7fa2680879b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:19:16.510+0000 7fa26e553640 10 monclient: get_auth_request con 0x7fa268091780 auth_method 0 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:19:16.515+0000 7fa271263800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:16.656 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:19:16.515+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:19:16.516+0000 7fa271263800 20 zone default found 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:19:16.516+0000 7fa271263800 4 Realm: () 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:19:16.516+0000 7fa271263800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:19:16.516+0000 7fa271263800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:19:16.516+0000 7fa271263800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:19:16.516+0000 7fa271263800 20 zonegroup default 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.657 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:19:16.516+0000 7fa271263800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:19:16.516+0000 7fa271263800 20 started sync module instance, tier type = 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:19:16.516+0000 7fa271263800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=0 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=1 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=2 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=3 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=4 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=5 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:19:16.525+0000 7fa271263800 20 add_watcher() i=6 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:19:16.526+0000 7fa271263800 20 add_watcher() i=7 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:19:16.526+0000 7fa271263800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.658 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding auth protocol: cephx 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: crc 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:19:16.528+0000 7fa271263800 5 AuthRegistry(0x7ffeafc059c0) adding con mode: secure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:19:16.528+0000 7fa1257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:19:16.528+0000 7fa271263800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:19:16.528+0000 7fa271263800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:16.659 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache list hook 0x55ba83f1fa90 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache inspect hook 0x55ba83f1fa90 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache erase hook 0x55ba83f1fa90 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:19:16.528+0000 7fa271263800 5 asok(0x55ba83c21270) register_command cache zap hook 0x55ba83f1fa90 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:19:16.528+0000 7fa271263800 5 note: GC not initialized 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:19:16.529+0000 7fa09ffff640 20 reqs_thread_entry: start 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace show hook 0x7fa268065210 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace history hook 0x7fa268065210 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace active hook 0x7fa268065210 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:19:16.529+0000 7fa271263800 5 asok(0x55ba83c21270) register_command sync trace active_short hook 0x7fa268065210 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:19:16.529+0000 7fa271263800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:19:16.529+0000 7fa271263800 20 Filter name: none 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:19:16.529+0000 7fa09dffb640 20 reqs_thread_entry: start 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:19:16.529+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:19:16.529+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.660 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : miss 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:19:16.530+0000 7fa271263800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:19:16.530+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:19:16.530+0000 7fa271263800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:19:16.530+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:19:16.530+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:19:16.535+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:19:16.535+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:19:16.535+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:19:16.535+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.661 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:19:16.535+0000 7fa151ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:19:16.537+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.0 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.1 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.662 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.2 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.3 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.4 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:19:16.543+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.5 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:19:16.543+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.6 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.7 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.8 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.9 2024-09-14T11:19:16.663 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.10 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:19:16.544+0000 7fa271263800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1.11 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.0 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:19:16.544+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.3 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:19:16.545+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.4 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.5 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:19:16.546+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.6 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.7 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:19:16.547+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.8 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.9 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:19:16.548+0000 7fa271263800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.10 2024-09-14T11:19:16.664 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:19:16.551+0000 7fa271263800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:19:16.551+0000 7fa271263800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:19:16.552+0000 7fa271263800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:19:16.552+0000 7fa271263800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:19:16.552+0000 7fa271263800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:19:16.552+0000 7fa271263800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94259566094752 notifier 6713 bl.length()=999 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:19:16.553+0000 7fa1527fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:19:16.554+0000 7fa271263800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:19:16.555+0000 7fa271263800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa271263800 time 2024-09-14T11:19:16.555370+0000 2024-09-14T11:19:16.665 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa27478c76a] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:19:16.556+0000 7fa271263800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fa271263800 thread_name:radosgw-admin 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.666 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa27343e6f0] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa27348b99c] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa27478c7c4] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fa27478c928] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ba81b2d0b1] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55ba81b3c18e] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ba81b3cfc4] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fa273429590] 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:16.667 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:19:16.668 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:19:16.669 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:19:16.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:19:16.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:16.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:16.673 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa09dffb640 / http_manager 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa09ffff640 / http_manager 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa1257e2640 / rgw_dt_lg_renew 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa150ff9640 / ms_dispatch 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa151ffb640 / io_context_pool 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa1527fc640 / io_context_pool 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa158e01640 / ms_dispatch 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa15b606640 / ms_dispatch 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa15ce09640 / io_context_pool 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26e553640 / msgr-worker-2 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26ed54640 / msgr-worker-1 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26f555640 / msgr-worker-0 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa26fd56640 / io_context_pool 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa271263800 / radosgw-admin 2024-09-14T11:19:16.674 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:19:16.675 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:19:16.675 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:19:16.557065Z_29ad8e3b-fbb0-4fad-a6ae-933c9a5a05da/log 2024-09-14T11:19:16.675 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:19:16.675 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:19:16.676 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:16.676 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:16.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.637+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.676 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 realm 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.638+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.639+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.639+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.640+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.640+0000 7feb36a0e800 20 searching for the correct realm 2024-09-14T11:19:16.677 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.642+0000 7feb3296c640 0 -- 172.21.15.29:0/1183248889 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7feb2c0e5070 msgr2=0x7feb2c0a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:16.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:16.848+0000 7feb3196a640 0 -- 172.21.15.29:0/1183248889 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7feb2c071410 msgr2=0x7feb2c0902e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:17.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.054+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 zone default found 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 4 Realm: () 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 zonegroup default 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.055+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.056+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.056+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.056+0000 7feb36a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.056+0000 7feb36a0e800 20 started sync module instance, tier type = 2024-09-14T11:19:17.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.056+0000 7feb36a0e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=0 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=1 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=2 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=3 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=4 2024-09-14T11:19:17.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=5 2024-09-14T11:19:17.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.065+0000 7feb36a0e800 20 add_watcher() i=6 2024-09-14T11:19:17.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.066+0000 7feb36a0e800 20 add_watcher() i=7 2024-09-14T11:19:17.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.066+0000 7feb36a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:17.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.067+0000 7fe9e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:17.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 5 note: GC not initialized 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7fe9637fe640 20 reqs_thread_entry: start 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 20 Filter name: none 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7fe9617fa640 20 reqs_thread_entry: start 2024-09-14T11:19:17.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.068+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.069+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.069+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.069+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.069+0000 7feb36a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.069+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.070+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.070+0000 7feb36a0e800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.070+0000 7feb36a0e800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:19:17.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.070+0000 7feb36a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:17.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.072+0000 7fe9e8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.074+0000 7feb36a0e800 20 remove_watcher() i=0 2024-09-14T11:19:17.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.074+0000 7feb36a0e800 2 removed watcher, disabling cache 2024-09-14T11:19:17.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.075+0000 7feb36a0e800 20 remove_watcher() i=1 2024-09-14T11:19:17.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.076+0000 7feb36a0e800 20 remove_watcher() i=2 2024-09-14T11:19:17.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.077+0000 7feb36a0e800 20 remove_watcher() i=3 2024-09-14T11:19:17.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.078+0000 7feb36a0e800 20 remove_watcher() i=4 2024-09-14T11:19:17.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.079+0000 7feb36a0e800 20 remove_watcher() i=5 2024-09-14T11:19:17.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.080+0000 7feb36a0e800 20 remove_watcher() i=6 2024-09-14T11:19:17.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.081+0000 7feb36a0e800 20 remove_watcher() i=7 2024-09-14T11:19:17.090 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:17.090 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:17.090 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:17.090 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:17.184 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:17.216 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:17.216 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:17.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.258+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 20 realm 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.259+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.260+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.260+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.260+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:17.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.260+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.261+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:17.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.261+0000 7f3a08063800 20 searching for the correct realm 2024-09-14T11:19:17.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.263+0000 7f3a06355640 0 -- 172.21.15.29:0/2354819643 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55aaced16570 msgr2=0x55aaced18960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:17.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.266+0000 7f3a06355640 0 -- 172.21.15.29:0/2354819643 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f38d0087860 msgr2=0x7f38d0089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.271+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.270 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:17.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 zone default found 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 4 Realm: () 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 zonegroup default 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.272+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.273+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.273+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.273+0000 7f3a08063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:17.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.273+0000 7f3a08063800 20 started sync module instance, tier type = 2024-09-14T11:19:17.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.273+0000 7f3a08063800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=0 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=1 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=2 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=3 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=4 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=5 2024-09-14T11:19:17.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.282+0000 7f3a08063800 20 add_watcher() i=6 2024-09-14T11:19:17.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.283+0000 7f3a08063800 20 add_watcher() i=7 2024-09-14T11:19:17.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.283+0000 7f3a08063800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:17.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.284+0000 7f38b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:17.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:17.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 5 note: GC not initialized 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f38b67fc640 20 reqs_thread_entry: start 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 20 Filter name: none 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f382bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:19:17.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.285+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : miss 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:17.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.286+0000 7f3a08063800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:17.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.287+0000 7f3a08063800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to be held by another RGW process; skipping for now 2024-09-14T11:19:17.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.288+0000 7f38b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:17.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.290+0000 7f3a08063800 20 remove_watcher() i=0 2024-09-14T11:19:17.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.290+0000 7f3a08063800 2 removed watcher, disabling cache 2024-09-14T11:19:17.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.291+0000 7f3a08063800 20 remove_watcher() i=1 2024-09-14T11:19:17.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.293+0000 7f3a08063800 20 remove_watcher() i=2 2024-09-14T11:19:17.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.293+0000 7f3a08063800 20 remove_watcher() i=3 2024-09-14T11:19:17.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.294+0000 7f3a08063800 20 remove_watcher() i=4 2024-09-14T11:19:17.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.295+0000 7f3a08063800 20 remove_watcher() i=5 2024-09-14T11:19:17.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.296+0000 7f3a08063800 20 remove_watcher() i=6 2024-09-14T11:19:17.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:17.297+0000 7f3a08063800 20 remove_watcher() i=7 2024-09-14T11:19:17.306 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:19:47.334 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:47.370 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:47.371 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:47.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.417+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.418+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.418+0000 7fd6c9726800 20 realm 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.418+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.419+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.419+0000 7fd6c9726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.419+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.419+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.419+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.420+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:47.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.420+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.421+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:47.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.421+0000 7fd6c9726800 20 searching for the correct realm 2024-09-14T11:19:47.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.423+0000 7fd6c5c4c640 0 -- 172.21.15.29:0/3073920613 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd6c0091040 msgr2=0x7fd6c0077410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:47.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.630+0000 7fd6c4c4a640 0 -- 172.21.15.29:0/3073920613 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd6c0055410 msgr2=0x7fd6c0055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:47.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.837+0000 7fd6c9726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:47.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.838+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.838+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.838+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.838+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.838+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 zone default found 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 4 Realm: () 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 zonegroup default 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.839+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.840+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.840+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.840+0000 7fd6c9726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:47.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.840+0000 7fd6c9726800 20 started sync module instance, tier type = 2024-09-14T11:19:47.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.840+0000 7fd6c9726800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:47.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=0 2024-09-14T11:19:47.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=1 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=2 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=3 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=4 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=5 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.851+0000 7fd6c9726800 20 add_watcher() i=6 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.852+0000 7fd6c9726800 20 add_watcher() i=7 2024-09-14T11:19:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.852+0000 7fd6c9726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:47.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd57bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:47.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd6c9726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:47.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd6c9726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:47.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd6c9726800 5 note: GC not initialized 2024-09-14T11:19:47.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd57afe5640 20 reqs_thread_entry: start 2024-09-14T11:19:47.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.855+0000 7fd6c9726800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:47.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 20 Filter name: none 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd578fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : miss 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.856+0000 7fd6c9726800 20 rados->read ofs=0 len=0 2024-09-14T11:19:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 20 rados_obj.operate() r=0 bl.length=467 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.857+0000 7fd6c9726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.858+0000 7fd6c9726800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:47.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.865+0000 7fd6c9726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.865+0000 7fd6c9726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.865+0000 7fd6c9726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.865+0000 7fd6c9726800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.866+0000 7fd597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 93915276525120 notifier 6767 bl.length()=999 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.866+0000 7fd597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.866+0000 7fd597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.866+0000 7fd597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.868+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.868+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.868+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:47.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.868+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.0 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.0 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.1 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.1 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.2 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.2 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.3 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.3 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.4 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.4 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.5 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.5 2024-09-14T11:19:47.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.6 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.6 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.7 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.7 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.8 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.8 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.9 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.9 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.10 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.10 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.11 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2.11 2024-09-14T11:19:47.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.874+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.0 2024-09-14T11:19:47.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.875+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1 2024-09-14T11:19:47.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.875+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2 2024-09-14T11:19:47.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.876+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.3 2024-09-14T11:19:47.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.876+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.4 2024-09-14T11:19:47.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.877+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.5 2024-09-14T11:19:47.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.878+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.6 2024-09-14T11:19:47.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.878+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.7 2024-09-14T11:19:47.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.879+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.8 2024-09-14T11:19:47.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.880+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.9 2024-09-14T11:19:47.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.880+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.10 2024-09-14T11:19:47.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.884+0000 7fd6c9726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:47.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.884+0000 7fd6c9726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:47.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd6c9726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd6c9726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd6c9726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd6c9726800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 93915276525120 notifier 6767 bl.length()=999 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.885+0000 7fd597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.887+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:47.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.887+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:47.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.887+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:47.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.887+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:47.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.890+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.0 2024-09-14T11:19:47.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.890+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.1 2024-09-14T11:19:47.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.891+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.2 2024-09-14T11:19:47.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.891+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.3 2024-09-14T11:19:47.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.891+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.4 2024-09-14T11:19:47.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.892+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.5 2024-09-14T11:19:47.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.892+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.6 2024-09-14T11:19:47.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.893+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.7 2024-09-14T11:19:47.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.893+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.8 2024-09-14T11:19:47.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.893+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.9 2024-09-14T11:19:47.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.894+0000 7fd6c9726800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.30.10 2024-09-14T11:19:47.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.894+0000 7fd6c9726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:47.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.894+0000 7fd6c9726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd6c9726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd6c9726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd6c9726800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd6c9726800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30, ofs0, ns] 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 93915276525120 notifier 6767 bl.length()=967 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 info.flags=0x17 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.30 to cache LRU end 2024-09-14T11:19:47.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.896+0000 7fd597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:47.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.898+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_sources= new_sources= 2024-09-14T11:19:47.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.898+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential sources added=[] removed=[] 2024-09-14T11:19:47.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.898+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): orig_dests= new_dests= 2024-09-14T11:19:47.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.898+0000 7fd6c9726800 20 handle_bi_update(): bucket=:abort-at-block-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.30]): potential dests added=[] removed=[] 2024-09-14T11:19:47.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.901+0000 7fd6c9726800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:47.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.903+0000 7fd57bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:47.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.905+0000 7fd6c9726800 20 remove_watcher() i=0 2024-09-14T11:19:47.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.905+0000 7fd6c9726800 2 removed watcher, disabling cache 2024-09-14T11:19:47.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.907+0000 7fd6c9726800 20 remove_watcher() i=1 2024-09-14T11:19:47.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.908+0000 7fd6c9726800 20 remove_watcher() i=2 2024-09-14T11:19:47.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.909+0000 7fd6c9726800 20 remove_watcher() i=3 2024-09-14T11:19:47.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.910+0000 7fd6c9726800 20 remove_watcher() i=4 2024-09-14T11:19:47.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.911+0000 7fd6c9726800 20 remove_watcher() i=5 2024-09-14T11:19:47.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.912+0000 7fd6c9726800 20 remove_watcher() i=6 2024-09-14T11:19:47.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.914+0000 7fd6c9726800 20 remove_watcher() i=7 2024-09-14T11:19:47.926 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:19:47.957 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:47.957 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:47.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:47.999+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.000+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.000+0000 7f197a063800 20 realm 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.000+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.001+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.001+0000 7f197a063800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:48.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.001+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.001+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.001+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.002+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:48.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.002+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.002+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:48.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.002+0000 7f197a063800 20 searching for the correct realm 2024-09-14T11:19:48.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.004+0000 7f1978355640 0 -- 172.21.15.29:0/233979832 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55b077b061d0 msgr2=0x55b077b085c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:48.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.008+0000 7f1978355640 0 -- 172.21.15.29:0/233979832 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f1840087810 msgr2=0x7f1840089c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:48.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:48.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:48.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:48.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.013+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 zone default found 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 4 Realm: () 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 zonegroup default 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.014+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.015+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.015+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.015+0000 7f197a063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:48.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.015+0000 7f197a063800 20 started sync module instance, tier type = 2024-09-14T11:19:48.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.015+0000 7f197a063800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=0 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=1 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=2 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=3 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=4 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=5 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.024+0000 7f197a063800 20 add_watcher() i=6 2024-09-14T11:19:48.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.025+0000 7f197a063800 20 add_watcher() i=7 2024-09-14T11:19:48.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.025+0000 7f197a063800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:48.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.026+0000 7f182dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:48.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:48.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:48.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 5 note: GC not initialized 2024-09-14T11:19:48.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f182cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:48.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:48.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 20 Filter name: none 2024-09-14T11:19:48.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f17a67fc640 20 reqs_thread_entry: start 2024-09-14T11:19:48.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.027+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=213 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.028+0000 7f197a063800 20 rados->read ofs=0 len=0 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.029+0000 7f197a063800 20 rados_obj.operate() r=0 bl.length=435 2024-09-14T11:19:48.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.029+0000 7f197a063800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:48.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.030+0000 7f182dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:48.032 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.032+0000 7f197a063800 20 remove_watcher() i=0 2024-09-14T11:19:48.032 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.032+0000 7f197a063800 2 removed watcher, disabling cache 2024-09-14T11:19:48.033 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.034+0000 7f197a063800 20 remove_watcher() i=1 2024-09-14T11:19:48.034 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.035+0000 7f197a063800 20 remove_watcher() i=2 2024-09-14T11:19:48.035 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.036+0000 7f197a063800 20 remove_watcher() i=3 2024-09-14T11:19:48.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.037+0000 7f197a063800 20 remove_watcher() i=4 2024-09-14T11:19:48.037 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.038+0000 7f197a063800 20 remove_watcher() i=5 2024-09-14T11:19:48.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.039+0000 7f197a063800 20 remove_watcher() i=6 2024-09-14T11:19:48.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:48.039+0000 7f197a063800 20 remove_watcher() i=7 2024-09-14T11:19:48.049 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:48.049 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:48.049 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-block-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:48.050 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:48.433 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:19:48.433 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:49.306 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:19:49.335 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:49.335 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:49.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.375+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 20 realm 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.377+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.378+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.378+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.378+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.378+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.379+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.379+0000 7fd9ecba2800 20 searching for the correct realm 2024-09-14T11:19:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.379+0000 7fd9ea68c640 0 -- 172.21.15.29:0/3875005883 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x5650b9450bb0 msgr2=0x5650b9453070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:49.583 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.584+0000 7fd9ea68c640 0 -- 172.21.15.29:0/3875005883 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x5650b920b210 msgr2=0x7fd9e40870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:49.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.792+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 zone default found 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 4 Realm: () 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:49.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 zonegroup default 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.793+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.794+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.794+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.794+0000 7fd9ecba2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.794+0000 7fd9ecba2800 20 started sync module instance, tier type = 2024-09-14T11:19:49.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.794+0000 7fd9ecba2800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=0 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=1 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=2 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=3 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=4 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=5 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.803+0000 7fd9ecba2800 20 add_watcher() i=6 2024-09-14T11:19:49.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.804+0000 7fd9ecba2800 20 add_watcher() i=7 2024-09-14T11:19:49.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.804+0000 7fd9ecba2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:49.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.806+0000 7fd8a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:49.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd9ecba2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:49.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd9ecba2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:49.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd9ecba2800 5 note: GC not initialized 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd81b7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd9ecba2800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd9ecba2800 20 Filter name: none 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.807+0000 7fd8197fa640 20 reqs_thread_entry: start 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.808+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.808+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:49.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.808+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.809+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:49.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.809+0000 7fd9ecba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:49.808 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.809+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.809+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:49.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.809+0000 7fd9ecba2800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.810+0000 7fd9ecba2800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:49.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.810+0000 7fd9ecba2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:49.811 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.812+0000 7fd8a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:49.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.815+0000 7fd9ecba2800 20 remove_watcher() i=0 2024-09-14T11:19:49.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.815+0000 7fd9ecba2800 2 removed watcher, disabling cache 2024-09-14T11:19:49.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.816+0000 7fd9ecba2800 20 remove_watcher() i=1 2024-09-14T11:19:49.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.817+0000 7fd9ecba2800 20 remove_watcher() i=2 2024-09-14T11:19:49.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.818+0000 7fd9ecba2800 20 remove_watcher() i=3 2024-09-14T11:19:49.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.819+0000 7fd9ecba2800 20 remove_watcher() i=4 2024-09-14T11:19:49.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.820+0000 7fd9ecba2800 20 remove_watcher() i=5 2024-09-14T11:19:49.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.821+0000 7fd9ecba2800 20 remove_watcher() i=6 2024-09-14T11:19:49.821 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.822+0000 7fd9ecba2800 20 remove_watcher() i=7 2024-09-14T11:19:49.833 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:49.833 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:49.833 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:49.833 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:49.834 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:19:49.870 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:49.870 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:49.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.912+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.913+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.913+0000 7f6aa2f26800 20 realm 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.913+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.914+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.914+0000 7f6aa2f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.914+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.914+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.914+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.915+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:49.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.915+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.915+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:49.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.915+0000 7f6aa2f26800 20 searching for the correct realm 2024-09-14T11:19:49.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:49.917+0000 7f6a9f35e640 0 -- 172.21.15.29:0/3166471861 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6a98061040 msgr2=0x7f6a980a4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.324+0000 7f6a9e35c640 0 -- 172.21.15.29:0/3166471861 >> [v2:172.21.15.73:6816/3705727448,v1:172.21.15.73:6817/3705727448] conn(0x55a4e2d41f30 msgr2=0x55a4e2d44360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.330+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 zone default found 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 4 Realm: () 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:50.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 zonegroup default 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.331+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.332+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.332+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.332+0000 7f6aa2f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.332+0000 7f6aa2f26800 20 started sync module instance, tier type = 2024-09-14T11:19:50.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.332+0000 7f6aa2f26800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:50.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=0 2024-09-14T11:19:50.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=1 2024-09-14T11:19:50.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=2 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=3 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=4 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=5 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.341+0000 7f6aa2f26800 20 add_watcher() i=6 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.342+0000 7f6aa2f26800 20 add_watcher() i=7 2024-09-14T11:19:50.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.342+0000 7f6aa2f26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.343 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.344+0000 7f69557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.344+0000 7f6aa2f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.344+0000 7f6aa2f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.344+0000 7f6aa2f26800 5 note: GC not initialized 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.344+0000 7f68cffff640 20 reqs_thread_entry: start 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 20 Filter name: none 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f68cdffb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:19:50.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:50.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:50.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:19:50.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 : miss 2024-09-14T11:19:50.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.345+0000 7f6aa2f26800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:50.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.346+0000 7f6aa2f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 2024-09-14T11:19:50.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6aa2f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:50.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6aa2f26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:50.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6aa2f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:50.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6aa2f26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31, ofs0, ns] 2024-09-14T11:19:50.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6981ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496985 cookie 94166668617424 notifier 6815 bl.length()=1015 2024-09-14T11:19:50.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6981ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:50.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6981ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:50.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.351+0000 7f6981ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:50.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.353+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_sources= new_sources= 2024-09-14T11:19:50.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.353+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential sources added=[] removed=[] 2024-09-14T11:19:50.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.353+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_dests= new_dests= 2024-09-14T11:19:50.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.353+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential dests added=[] removed=[] 2024-09-14T11:19:50.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.0 2024-09-14T11:19:50.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.0 2024-09-14T11:19:50.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.1 2024-09-14T11:19:50.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.1 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.2 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.2 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.3 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.3 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.4 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.4 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.5 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.5 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.6 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.6 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.7 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.7 2024-09-14T11:19:50.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.8 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.8 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.9 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.9 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.10 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.10 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.11 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1.11 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.0 2024-09-14T11:19:50.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.359+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1 2024-09-14T11:19:50.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.360+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2 2024-09-14T11:19:50.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.360+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.3 2024-09-14T11:19:50.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.361+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.4 2024-09-14T11:19:50.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.361+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.5 2024-09-14T11:19:50.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.362+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.6 2024-09-14T11:19:50.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.362+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.7 2024-09-14T11:19:50.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.363+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.8 2024-09-14T11:19:50.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.364+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.9 2024-09-14T11:19:50.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.364+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.10 2024-09-14T11:19:50.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.367+0000 7f6aa2f26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:50.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.367+0000 7f6aa2f26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 2024-09-14T11:19:50.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.369+0000 7f6aa2f26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.369+0000 7f6aa2f26800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.369+0000 7f6aa2f26800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.369+0000 7f6aa2f26800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31, ofs0, ns] 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.370+0000 7f69827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496986 cookie 94166668617424 notifier 6815 bl.length()=1015 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.370+0000 7f69827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.370+0000 7f69827fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:50.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.370+0000 7f69827fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:50.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.371+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_sources= new_sources= 2024-09-14T11:19:50.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.371+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential sources added=[] removed=[] 2024-09-14T11:19:50.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.371+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_dests= new_dests= 2024-09-14T11:19:50.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.371+0000 7f6aa2f26800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential dests added=[] removed=[] 2024-09-14T11:19:50.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.374+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.0 2024-09-14T11:19:50.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.374+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1 2024-09-14T11:19:50.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.375+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2 2024-09-14T11:19:50.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.375+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.3 2024-09-14T11:19:50.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.375+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.4 2024-09-14T11:19:50.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.376+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.5 2024-09-14T11:19:50.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.376+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.6 2024-09-14T11:19:50.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.376+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.7 2024-09-14T11:19:50.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.376+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.8 2024-09-14T11:19:50.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.377+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.9 2024-09-14T11:19:50.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.377+0000 7f6aa2f26800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.10 2024-09-14T11:19:50.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.377+0000 7f6aa2f26800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:19:50.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.377+0000 7f6aa2f26800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:19:50.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.382+0000 7f69557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.384+0000 7f6aa2f26800 20 remove_watcher() i=0 2024-09-14T11:19:50.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.384+0000 7f6aa2f26800 2 removed watcher, disabling cache 2024-09-14T11:19:50.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.385+0000 7f6aa2f26800 20 remove_watcher() i=1 2024-09-14T11:19:50.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.386+0000 7f6aa2f26800 20 remove_watcher() i=2 2024-09-14T11:19:50.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.387+0000 7f6aa2f26800 20 remove_watcher() i=3 2024-09-14T11:19:50.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.388+0000 7f6aa2f26800 20 remove_watcher() i=4 2024-09-14T11:19:50.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.389+0000 7f6aa2f26800 20 remove_watcher() i=5 2024-09-14T11:19:50.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.390+0000 7f6aa2f26800 20 remove_watcher() i=6 2024-09-14T11:19:50.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.391+0000 7f6aa2f26800 20 remove_watcher() i=7 2024-09-14T11:19:50.403 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:19:50.433 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:50.433 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:50.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.473+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 realm 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.475+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.476+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.476+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.477+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.477+0000 7fce01326800 20 searching for the correct realm 2024-09-14T11:19:50.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.479+0000 7fcdfd7da640 0 -- 172.21.15.29:0/1611038733 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fcdf4048040 msgr2=0x7fcdf4048930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.684+0000 7fcdfc7d8640 0 -- 172.21.15.29:0/1611038733 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fcdf403a3d0 msgr2=0x7fcdf403a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.890+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 zone default found 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 4 Realm: () 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 zonegroup default 2024-09-14T11:19:50.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.891+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 started sync module instance, tier type = 2024-09-14T11:19:50.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.892+0000 7fce01326800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=0 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=1 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=2 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=3 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=4 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=5 2024-09-14T11:19:50.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.902+0000 7fce01326800 20 add_watcher() i=6 2024-09-14T11:19:50.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.903+0000 7fce01326800 20 add_watcher() i=7 2024-09-14T11:19:50.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.903+0000 7fce01326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fccb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fce01326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fce01326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fce01326800 5 note: GC not initialized 2024-09-14T11:19:50.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fccb1fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:50.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fce01326800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:50.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.905+0000 7fce01326800 20 Filter name: none 2024-09-14T11:19:50.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.906+0000 7fcc237fe640 20 reqs_thread_entry: start 2024-09-14T11:19:50.905 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.906+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.906+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.906+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.907+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.907+0000 7fce01326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.907+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.907+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:50.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.907+0000 7fce01326800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.908+0000 7fce01326800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:19:50.907 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.908+0000 7fce01326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.909 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.910+0000 7fccb2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.912+0000 7fce01326800 20 remove_watcher() i=0 2024-09-14T11:19:50.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.912+0000 7fce01326800 2 removed watcher, disabling cache 2024-09-14T11:19:50.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.913+0000 7fce01326800 20 remove_watcher() i=1 2024-09-14T11:19:50.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.914+0000 7fce01326800 20 remove_watcher() i=2 2024-09-14T11:19:50.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.915+0000 7fce01326800 20 remove_watcher() i=3 2024-09-14T11:19:50.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.916+0000 7fce01326800 20 remove_watcher() i=4 2024-09-14T11:19:50.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.917+0000 7fce01326800 20 remove_watcher() i=5 2024-09-14T11:19:50.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.918+0000 7fce01326800 20 remove_watcher() i=6 2024-09-14T11:19:50.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:50.920+0000 7fce01326800 20 remove_watcher() i=7 2024-09-14T11:19:50.930 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:50.930 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:50.930 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:50.930 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:51.025 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:19:51.059 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:51.059 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:51.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.099+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 realm 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.101+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.303+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:51.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.303+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.304+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:51.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.304+0000 7f1e9a336800 20 searching for the correct realm 2024-09-14T11:19:51.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.306+0000 7f1e958b6640 0 -- 172.21.15.29:0/265459085 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f1e880a5960 msgr2=0x7f1e880a43d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:51.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.310+0000 7f1e958b6640 0 -- 172.21.15.29:0/265459085 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f1d60087860 msgr2=0x7f1d60089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:51.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:51.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:51.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.315+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 zone default found 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 4 Realm: () 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:51.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 zonegroup default 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.316+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.317+0000 7f1e9a336800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.317+0000 7f1e9a336800 20 started sync module instance, tier type = 2024-09-14T11:19:51.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.317+0000 7f1e9a336800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=0 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=1 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=2 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=3 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=4 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=5 2024-09-14T11:19:51.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.325+0000 7f1e9a336800 20 add_watcher() i=6 2024-09-14T11:19:51.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.326+0000 7f1e9a336800 20 add_watcher() i=7 2024-09-14T11:19:51.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.326+0000 7f1e9a336800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:51.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.328+0000 7f1d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:51.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.328+0000 7f1e9a336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:51.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.328+0000 7f1e9a336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:51.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1e9a336800 5 note: GC not initialized 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1cc77fe640 20 reqs_thread_entry: start 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1e9a336800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1e9a336800 20 Filter name: none 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1cc57fa640 20 reqs_thread_entry: start 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1e9a336800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:19:51.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.329+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 : miss 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.330+0000 7f1e9a336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 2024-09-14T11:19:51.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.332+0000 7f1e9a336800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:51.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.338+0000 7f1e9a336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.338+0000 7f1e9a336800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.338+0000 7f1e9a336800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.338+0000 7f1e9a336800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31, ofs0, ns] 2024-09-14T11:19:51.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.338+0000 7f1d79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496987 cookie 94902000494112 notifier 7218 bl.length()=1015 2024-09-14T11:19:51.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.339+0000 7f1d79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.339+0000 7f1d79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.339+0000 7f1d79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.340+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_sources= new_sources= 2024-09-14T11:19:51.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.340+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential sources added=[] removed=[] 2024-09-14T11:19:51.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.340+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_dests= new_dests= 2024-09-14T11:19:51.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.340+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential dests added=[] removed=[] 2024-09-14T11:19:51.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.0 2024-09-14T11:19:51.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.0 2024-09-14T11:19:51.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.1 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.1 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.2 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.2 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.3 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.3 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.4 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.4 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.5 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.5 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.6 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.6 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.7 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.7 2024-09-14T11:19:51.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.8 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.8 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.9 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.9 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.10 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.10 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.11 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2.11 2024-09-14T11:19:51.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.0 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.345+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.346+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.346+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.3 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.347+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.4 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.347+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.5 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.348+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.6 2024-09-14T11:19:51.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.348+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.7 2024-09-14T11:19:51.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.349+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.8 2024-09-14T11:19:51.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.349+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.9 2024-09-14T11:19:51.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.350+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.10 2024-09-14T11:19:51.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.352+0000 7f1e9a336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:51.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.352+0000 7f1e9a336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1e9a336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1e9a336800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1e9a336800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1e9a336800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31, ofs0, ns] 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1d79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496988 cookie 94902000494112 notifier 7218 bl.length()=1015 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1d79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1d79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.354+0000 7f1d79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.356+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_sources= new_sources= 2024-09-14T11:19:51.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.356+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential sources added=[] removed=[] 2024-09-14T11:19:51.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.356+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_dests= new_dests= 2024-09-14T11:19:51.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.356+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential dests added=[] removed=[] 2024-09-14T11:19:51.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.358+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.0 2024-09-14T11:19:51.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.359+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.1 2024-09-14T11:19:51.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.359+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.2 2024-09-14T11:19:51.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.359+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.3 2024-09-14T11:19:51.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.360+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.4 2024-09-14T11:19:51.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.360+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.5 2024-09-14T11:19:51.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.360+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.6 2024-09-14T11:19:51.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.360+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.7 2024-09-14T11:19:51.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.361+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.8 2024-09-14T11:19:51.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.361+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.9 2024-09-14T11:19:51.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.361+0000 7f1e9a336800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.31.10 2024-09-14T11:19:51.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.362+0000 7f1e9a336800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:51.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.362+0000 7f1e9a336800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 2024-09-14T11:19:51.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1e9a336800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1e9a336800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1e9a336800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1e9a336800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31, ofs0, ns] 2024-09-14T11:19:51.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1d79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 94902000494112 notifier 7218 bl.length()=983 2024-09-14T11:19:51.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1d79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 info.flags=0x17 2024-09-14T11:19:51.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1d79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.31 to cache LRU end 2024-09-14T11:19:51.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.363+0000 7f1d79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:51.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.365+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_sources= new_sources= 2024-09-14T11:19:51.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.365+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential sources added=[] removed=[] 2024-09-14T11:19:51.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.365+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): orig_dests= new_dests= 2024-09-14T11:19:51.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.365+0000 7f1e9a336800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.31]): potential dests added=[] removed=[] 2024-09-14T11:19:51.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.367+0000 7f1e9a336800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:51.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.369+0000 7f1d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:51.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.371+0000 7f1e9a336800 20 remove_watcher() i=0 2024-09-14T11:19:51.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.371+0000 7f1e9a336800 2 removed watcher, disabling cache 2024-09-14T11:19:51.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.373+0000 7f1e9a336800 20 remove_watcher() i=1 2024-09-14T11:19:51.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.374+0000 7f1e9a336800 20 remove_watcher() i=2 2024-09-14T11:19:51.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.375+0000 7f1e9a336800 20 remove_watcher() i=3 2024-09-14T11:19:51.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.376+0000 7f1e9a336800 20 remove_watcher() i=4 2024-09-14T11:19:51.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.377+0000 7f1e9a336800 20 remove_watcher() i=5 2024-09-14T11:19:51.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.377+0000 7f1e9a336800 20 remove_watcher() i=6 2024-09-14T11:19:51.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.378+0000 7f1e9a336800 20 remove_watcher() i=7 2024-09-14T11:19:51.390 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:19:51.419 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:51.419 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:51.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.460+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 realm 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.462+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.463+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:51.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.463+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.463+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:51.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.463+0000 7f436f31f800 20 searching for the correct realm 2024-09-14T11:19:51.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.465+0000 7f436b793640 0 -- 172.21.15.29:0/4039534010 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f4364043950 msgr2=0x7f4364034410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:51.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.671+0000 7f436a791640 0 -- 172.21.15.29:0/4039534010 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f436405f3f0 msgr2=0x7f436405f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.876+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 zone default found 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 4 Realm: () 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 zonegroup default 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.877+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:51.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 started sync module instance, tier type = 2024-09-14T11:19:51.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.878+0000 7f436f31f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:51.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=0 2024-09-14T11:19:51.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=1 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=2 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=3 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=4 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=5 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.887+0000 7f436f31f800 20 add_watcher() i=6 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.888+0000 7f436f31f800 20 add_watcher() i=7 2024-09-14T11:19:51.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.888+0000 7f436f31f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:51.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.890+0000 7f42217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.890+0000 7f436f31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.890+0000 7f436f31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.890+0000 7f436f31f800 5 note: GC not initialized 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.891+0000 7f419bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.891+0000 7f436f31f800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.891+0000 7f436f31f800 20 Filter name: none 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.891+0000 7f4199ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:51.890 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.891+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.892+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:51.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.892+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.892+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.892+0000 7f436f31f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.892+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.893+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.893+0000 7f436f31f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:51.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.893+0000 7f436f31f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:51.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.893+0000 7f436f31f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:51.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.895+0000 7f42217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:51.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.897+0000 7f436f31f800 20 remove_watcher() i=0 2024-09-14T11:19:51.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.897+0000 7f436f31f800 2 removed watcher, disabling cache 2024-09-14T11:19:51.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.898+0000 7f436f31f800 20 remove_watcher() i=1 2024-09-14T11:19:51.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.898+0000 7f436f31f800 20 remove_watcher() i=2 2024-09-14T11:19:51.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.899+0000 7f436f31f800 20 remove_watcher() i=3 2024-09-14T11:19:51.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.900+0000 7f436f31f800 20 remove_watcher() i=4 2024-09-14T11:19:51.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.901+0000 7f436f31f800 20 remove_watcher() i=5 2024-09-14T11:19:51.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.902+0000 7f436f31f800 20 remove_watcher() i=6 2024-09-14T11:19:51.902 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:51.903+0000 7f436f31f800 20 remove_watcher() i=7 2024-09-14T11:19:51.913 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:51.913 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:51.914 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.31 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:19:51.914 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:52.324 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:19:52.325 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:53.190 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:19:53.219 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:53.219 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:53.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.461+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 realm 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.463+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.464+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:53.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.464+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.464+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:53.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.464+0000 7efe22346800 20 searching for the correct realm 2024-09-14T11:19:53.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.466+0000 7efe1f62f640 0 -- 172.21.15.29:0/1528312119 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7efe1004dbb0 msgr2=0x7efe10064440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:53.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.470+0000 7efe1f62f640 0 -- 172.21.15.29:0/1528312119 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7efce8087860 msgr2=0x7efce8089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:53.476 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 zone default found 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 4 Realm: () 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 zonegroup default 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.476+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.477 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 started sync module instance, tier type = 2024-09-14T11:19:53.478 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.477+0000 7efe22346800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:53.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=0 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=1 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=2 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=3 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=4 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=5 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.486+0000 7efe22346800 20 add_watcher() i=6 2024-09-14T11:19:53.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.488+0000 7efe22346800 20 add_watcher() i=7 2024-09-14T11:19:53.487 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.488+0000 7efe22346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:53.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efcd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:53.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:53.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:53.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 5 note: GC not initialized 2024-09-14T11:19:53.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efcd4fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:53.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:53.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 Filter name: none 2024-09-14T11:19:53.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efc4e7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:53.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:53.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.490+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.492+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:53.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.492+0000 7efe22346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:53.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.492+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.492+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.492+0000 7efe22346800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.493+0000 7efe22346800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.493+0000 7efe22346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:53.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.494+0000 7efcd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:53.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.496+0000 7efe22346800 20 remove_watcher() i=0 2024-09-14T11:19:53.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.496+0000 7efe22346800 2 removed watcher, disabling cache 2024-09-14T11:19:53.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.496+0000 7efe22346800 20 remove_watcher() i=1 2024-09-14T11:19:53.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.498+0000 7efe22346800 20 remove_watcher() i=2 2024-09-14T11:19:53.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.498+0000 7efe22346800 20 remove_watcher() i=3 2024-09-14T11:19:53.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.500+0000 7efe22346800 20 remove_watcher() i=4 2024-09-14T11:19:53.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.501+0000 7efe22346800 20 remove_watcher() i=5 2024-09-14T11:19:53.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.502+0000 7efe22346800 20 remove_watcher() i=6 2024-09-14T11:19:53.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.503+0000 7efe22346800 20 remove_watcher() i=7 2024-09-14T11:19:53.512 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:53.512 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:53.512 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:53.512 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:53.514 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:19:53.551 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:53.551 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:53.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.593+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 realm 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.594+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.595+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:53.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.595+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.596+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:53.594 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.596+0000 7f9299123800 20 searching for the correct realm 2024-09-14T11:19:53.596 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.598+0000 7f9294532640 0 -- 172.21.15.29:0/2589150731 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f92840723b0 msgr2=0x7f9284067c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:53.599 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.601+0000 7f9294532640 0 -- 172.21.15.29:0/2589150731 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f9160087860 msgr2=0x7f9160089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:53.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.606+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 zone default found 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 4 Realm: () 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:53.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 zonegroup default 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.607+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.608+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.608+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.608+0000 7f9299123800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.608+0000 7f9299123800 20 started sync module instance, tier type = 2024-09-14T11:19:53.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.608+0000 7f9299123800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=0 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=1 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=2 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=3 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=4 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=5 2024-09-14T11:19:53.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.617+0000 7f9299123800 20 add_watcher() i=6 2024-09-14T11:19:53.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.618+0000 7f9299123800 20 add_watcher() i=7 2024-09-14T11:19:53.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.618+0000 7f9299123800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:53.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.619+0000 7f914b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.619+0000 7f9299123800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.619+0000 7f9299123800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.619+0000 7f9299123800 5 note: GC not initialized 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f914a7e4640 20 reqs_thread_entry: start 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 20 Filter name: none 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f91437fe640 20 reqs_thread_entry: start 2024-09-14T11:19:53.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 : miss 2024-09-14T11:19:53.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.620+0000 7f9299123800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.621+0000 7f9299123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 2024-09-14T11:19:53.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f9299123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f9299123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f9299123800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f9299123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32, ofs0, ns] 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f916bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 93861170092432 notifier 6905 bl.length()=1015 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f916bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f916bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.626+0000 7f916bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.628+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_sources= new_sources= 2024-09-14T11:19:53.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.628+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential sources added=[] removed=[] 2024-09-14T11:19:53.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.628+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_dests= new_dests= 2024-09-14T11:19:53.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.628+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential dests added=[] removed=[] 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.0 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.0 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.1 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.1 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.2 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.2 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.3 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.3 2024-09-14T11:19:53.632 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.4 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.4 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.5 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.5 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.6 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.6 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.7 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.7 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.8 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.8 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.9 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.9 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.10 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.10 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.11 2024-09-14T11:19:53.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1.11 2024-09-14T11:19:53.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.633+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.0 2024-09-14T11:19:53.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.634+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1 2024-09-14T11:19:53.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.634+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.2 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.635+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.3 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.635+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.4 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.636+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.5 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.636+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.6 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.637+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.7 2024-09-14T11:19:53.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.637+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.8 2024-09-14T11:19:53.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.637+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.9 2024-09-14T11:19:53.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.638+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.10 2024-09-14T11:19:53.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.641+0000 7f9299123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:53.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.641+0000 7f9299123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 2024-09-14T11:19:53.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f9299123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f9299123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f9299123800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f9299123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32, ofs0, ns] 2024-09-14T11:19:53.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f916bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496993 cookie 93861170092432 notifier 6905 bl.length()=1015 2024-09-14T11:19:53.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f916bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f916bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.642+0000 7f916bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.644+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_sources= new_sources= 2024-09-14T11:19:53.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.644+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential sources added=[] removed=[] 2024-09-14T11:19:53.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.644+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_dests= new_dests= 2024-09-14T11:19:53.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.644+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential dests added=[] removed=[] 2024-09-14T11:19:53.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.646+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.0 2024-09-14T11:19:53.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.647+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.1 2024-09-14T11:19:53.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.647+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.2 2024-09-14T11:19:53.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.647+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.3 2024-09-14T11:19:53.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.648+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.4 2024-09-14T11:19:53.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.648+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.5 2024-09-14T11:19:53.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.648+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.6 2024-09-14T11:19:53.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.648+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.7 2024-09-14T11:19:53.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.649+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.8 2024-09-14T11:19:53.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.649+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.9 2024-09-14T11:19:53.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.649+0000 7f9299123800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.32.10 2024-09-14T11:19:53.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.650+0000 7f9299123800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:19:53.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.650+0000 7f9299123800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:53.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.650+0000 7f9299123800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f9299123800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f9299123800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f9299123800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f9299123800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32, ofs0, ns] 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f916bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496994 cookie 93861170092432 notifier 6905 bl.length()=983 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f916bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 info.flags=0x17 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f916bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.32 to cache LRU end 2024-09-14T11:19:53.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.651+0000 7f916bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:53.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.653+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_sources= new_sources= 2024-09-14T11:19:53.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.653+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential sources added=[] removed=[] 2024-09-14T11:19:53.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.653+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): orig_dests= new_dests= 2024-09-14T11:19:53.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.653+0000 7f9299123800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.32]): potential dests added=[] removed=[] 2024-09-14T11:19:53.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.655+0000 7f9299123800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:19:53.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.657+0000 7f914b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:53.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.659+0000 7f9299123800 20 remove_watcher() i=0 2024-09-14T11:19:53.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.659+0000 7f9299123800 2 removed watcher, disabling cache 2024-09-14T11:19:53.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.660+0000 7f9299123800 20 remove_watcher() i=1 2024-09-14T11:19:53.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.661+0000 7f9299123800 20 remove_watcher() i=2 2024-09-14T11:19:53.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.662+0000 7f9299123800 20 remove_watcher() i=3 2024-09-14T11:19:53.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.663+0000 7f9299123800 20 remove_watcher() i=4 2024-09-14T11:19:53.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.664+0000 7f9299123800 20 remove_watcher() i=5 2024-09-14T11:19:53.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.665+0000 7f9299123800 20 remove_watcher() i=6 2024-09-14T11:19:53.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.666+0000 7f9299123800 20 remove_watcher() i=7 2024-09-14T11:19:53.676 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:19:53.707 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:53.707 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:53.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.749+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 realm 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.751+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.752+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:53.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.752+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:53.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.753+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:53.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.753+0000 7ff0f3146800 20 searching for the correct realm 2024-09-14T11:19:53.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.755+0000 7ff0f1431640 0 -- 172.21.15.29:0/92216856 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ff0e803b420 msgr2=0x7ff0e803b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:53.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:53.960+0000 7ff0f042f640 0 -- 172.21.15.29:0/92216856 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ff0e8051400 msgr2=0x7ff0e8051860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:54.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.166+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:54.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 zone default found 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 4 Realm: () 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 zonegroup default 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.167+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.168+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.168+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.168+0000 7ff0f3146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:54.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.168+0000 7ff0f3146800 20 started sync module instance, tier type = 2024-09-14T11:19:54.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.168+0000 7ff0f3146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=0 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=1 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=2 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=3 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=4 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=5 2024-09-14T11:19:54.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.178+0000 7ff0f3146800 20 add_watcher() i=6 2024-09-14T11:19:54.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.179+0000 7ff0f3146800 20 add_watcher() i=7 2024-09-14T11:19:54.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.179+0000 7ff0f3146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:54.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.180+0000 7fefa6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:54.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:54.179 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 5 note: GC not initialized 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7fefa5fe3640 20 reqs_thread_entry: start 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 20 Filter name: none 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7fef177fe640 20 reqs_thread_entry: start 2024-09-14T11:19:54.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.181+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.182+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:54.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.182+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.183+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:54.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.183+0000 7ff0f3146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:54.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.183+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.183+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.183+0000 7ff0f3146800 20 rados->read ofs=0 len=0 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.184+0000 7ff0f3146800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:54.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.184+0000 7ff0f3146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:54.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.187+0000 7fefa6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:54.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.189+0000 7ff0f3146800 20 remove_watcher() i=0 2024-09-14T11:19:54.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.189+0000 7ff0f3146800 2 removed watcher, disabling cache 2024-09-14T11:19:54.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.190+0000 7ff0f3146800 20 remove_watcher() i=1 2024-09-14T11:19:54.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.191+0000 7ff0f3146800 20 remove_watcher() i=2 2024-09-14T11:19:54.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.192+0000 7ff0f3146800 20 remove_watcher() i=3 2024-09-14T11:19:54.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.193+0000 7ff0f3146800 20 remove_watcher() i=4 2024-09-14T11:19:54.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.194+0000 7ff0f3146800 20 remove_watcher() i=5 2024-09-14T11:19:54.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.195+0000 7ff0f3146800 20 remove_watcher() i=6 2024-09-14T11:19:54.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:54.196+0000 7ff0f3146800 20 remove_watcher() i=7 2024-09-14T11:19:54.207 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:54.207 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:54.207 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.32 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:19:54.207 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:54.607 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:19:54.607 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:55.475 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:19:55.504 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:55.504 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:55.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.545+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 realm 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.547+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.548+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:55.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.548+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.549+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:55.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.549+0000 7fdf1b733800 20 searching for the correct realm 2024-09-14T11:19:55.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.551+0000 7fdf17b9a640 0 -- 172.21.15.29:0/1276448263 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fdf10069040 msgr2=0x7fdf10007b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:55.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.757+0000 7fdf16b98640 0 -- 172.21.15.29:0/1276448263 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fdf10092410 msgr2=0x7fdf10089030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:55.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.964+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 zone default found 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 4 Realm: () 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 zonegroup default 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.965+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.966+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.966+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.966+0000 7fdf1b733800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.966+0000 7fdf1b733800 20 started sync module instance, tier type = 2024-09-14T11:19:55.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.966+0000 7fdf1b733800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=0 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=1 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=2 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=3 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=4 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=5 2024-09-14T11:19:55.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.975+0000 7fdf1b733800 20 add_watcher() i=6 2024-09-14T11:19:55.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.976+0000 7fdf1b733800 20 add_watcher() i=7 2024-09-14T11:19:55.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.976+0000 7fdf1b733800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:55.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.978+0000 7fddcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 5 note: GC not initialized 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fddccfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 20 Filter name: none 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-14T11:19:55.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.979+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.980+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:55.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.980+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.980+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.980+0000 7fdf1b733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.980+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.981+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.981+0000 7fdf1b733800 20 rados->read ofs=0 len=0 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.981+0000 7fdf1b733800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:55.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.981+0000 7fdf1b733800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:55.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.983+0000 7fddcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:55.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.985+0000 7fdf1b733800 20 remove_watcher() i=0 2024-09-14T11:19:55.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.985+0000 7fdf1b733800 2 removed watcher, disabling cache 2024-09-14T11:19:55.984 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.986+0000 7fdf1b733800 20 remove_watcher() i=1 2024-09-14T11:19:55.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.988+0000 7fdf1b733800 20 remove_watcher() i=2 2024-09-14T11:19:55.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.989+0000 7fdf1b733800 20 remove_watcher() i=3 2024-09-14T11:19:55.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.990+0000 7fdf1b733800 20 remove_watcher() i=4 2024-09-14T11:19:55.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.991+0000 7fdf1b733800 20 remove_watcher() i=5 2024-09-14T11:19:55.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.992+0000 7fdf1b733800 20 remove_watcher() i=6 2024-09-14T11:19:55.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:55.993+0000 7fdf1b733800 20 remove_watcher() i=7 2024-09-14T11:19:56.002 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.003 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:56.003 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:56.003 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.004 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:19:56.040 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:56.040 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:56.265 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.267+0000 7fb24c1d1640 0 --2- 172.21.15.29:0/1187999254 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x557f2dd992c0 0x557f2ddaf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:19:56.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.284+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 realm 2024-09-14T11:19:56.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.287+0000 7fb24d1d3640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x557f2de5ec10 msgr2=0x557f2de61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.489+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:56.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.489+0000 7fb250d24800 20 searching for the correct realm 2024-09-14T11:19:56.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.492+0000 7fb24c1d1640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb23c061070 msgr2=0x7fb23c04dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:56.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:56.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:56.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 zone default found 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 4 Realm: () 2024-09-14T11:19:56.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 zonegroup default 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 started sync module instance, tier type = 2024-09-14T11:19:56.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.502+0000 7fb250d24800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=0 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=1 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=2 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=3 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=4 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=5 2024-09-14T11:19:56.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=6 2024-09-14T11:19:56.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.512+0000 7fb250d24800 20 add_watcher() i=7 2024-09-14T11:19:56.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.512+0000 7fb250d24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.514+0000 7fb1037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 5 note: GC not initialized 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb1027e4640 20 reqs_thread_entry: start 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 20 Filter name: none 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb0fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:19:56.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.515+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:56.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:56.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:19:56.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : miss 2024-09-14T11:19:56.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.516+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.521+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.521+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.521+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.521+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.530+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.536+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:56.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.536+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.540 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.544 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb250d24800 time 2024-09-14T11:19:56.547203+0000 2024-09-14T11:19:56.544 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb25238c76a] 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.545 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.547+0000 7fb250d24800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb250d24800 time 2024-09-14T11:19:56.547203+0000 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb25238c76a] 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:19:56.546 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.547 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:19:56.547 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:19:56.547 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.547 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:19:56.547 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb250d24800 thread_name:radosgw-admin 2024-09-14T11:19:56.568 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.568 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb25103e6f0] 2024-09-14T11:19:56.568 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb25108b99c] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb25238c7c4] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:19:56.569 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.547+0000 7fb250d24800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb250d24800 thread_name:radosgw-admin 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb25103e6f0] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb25108b99c] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb25238c7c4] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.570 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x7fb238002340 auth_method 0 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:19:56.571 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_done global_id 6941 payload 293 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.572 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: dump: 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.573 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: dump: 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.574 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:19:56.268+0000 7fb250d24800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:19:56.268+0000 7fb13ae0d640 4 set_mon_vals no callback set 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:19:56.268+0000 7fb250d24800 1 librados: init done 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:19:56.270+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2dd992c0 auth_method 0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:19:56.270+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2ddaf6f0 auth_method 0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:19:56.271+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2dd984b0 auth_method 0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:19:56.272+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2ddb8ac0 auth_method 0 2024-09-14T11:19:56.575 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:19:56.273+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2ddb7fe0 auth_method 0 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:19:56.274+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.576 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.577 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:19:56.274+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command objecter_requests cmddesc objecter_requests hook 0x557f2ddc4040 EEXIST 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.578 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:19:56.274+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:19:56.275+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:19:56.275+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x557f2ddbfbb0 EEXIST 2024-09-14T11:19:56.579 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2dde8360 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2dde8740 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2dde7070 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.910229s 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2dde8740 auth_method 0 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.580 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2dde8360 auth_method 0 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2dde7070 auth_method 0 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.581 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: dump: 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.582 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: dump: 2024-09-14T11:19:56.583 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:19:56.275+0000 7fb250d24800 5 monclient: authenticate success, global_id 6944 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.584 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:19:56.275+0000 7fb24d9d4640 4 set_mon_vals no callback set 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:19:56.276+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:19:56.276+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:19:56.278+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb1240770e0 auth_method 0 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: get_monmap_and_config 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:19:56.278+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.585 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.586 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:19:56.278+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.587 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.588 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:19:56.279+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:19:56.279+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:19:56.279+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x7ffe156e6e48 EEXIST 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2de3c660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2de2cfb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2de37a90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.589 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.914352s 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2de3c660 auth_method 0 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2de2cfb0 auth_method 0 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.590 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2de37a90 auth_method 0 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.591 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: dump: 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.592 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: dump: 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.593 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 monclient: authenticate success, global_id 6947 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:19:56.280+0000 7fb250d24800 4 set_mon_vals no callback set 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: shutdown 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:19:56.280+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.594 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.595 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: starting msgr at 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: starting objecter 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command objecter_requests cmddesc objecter_requests hook 0x557f2de0dda0 EEXIST 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: setting wanted keys 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: calling monclient init 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.596 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.597 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x557f2ddfcd68 EEXIST 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2de2cfb0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2de37a90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2de3c660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.916781s 2024-09-14T11:19:56.598 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2de37a90 auth_method 0 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2de3c660 auth_method 0 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2de2cfb0 auth_method 0 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.599 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_done global_id 7326 payload 824 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 1 monclient: found mon.noname-a 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:56.600 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: dump: 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.601 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: dump: 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.602 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:19:56.282+0000 7fb250d24800 5 monclient: authenticate success, global_id 7326 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:19:56.282+0000 7fb123fff640 4 set_mon_vals no callback set 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:19:56.282+0000 7fb250d24800 1 librados: init done 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:19:56.282+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cr dump hook 0x557f2de309b8 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:19:56.284+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:19:56.285+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb118077260 auth_method 0 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:19:56.285+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2de571a0 auth_method 0 2024-09-14T11:19:56.603 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 realm 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:19:56.286+0000 7fb250d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:19:56.286+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2de5b3b0 auth_method 0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:19:56.287+0000 7fb24d1d3640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x557f2de5ec10 msgr2=0x557f2de61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:19:56.287+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2de5ec10 auth_method 0 2024-09-14T11:19:56.604 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:19:56.489+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2de5ec10 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:19:56.489+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:19:56.489+0000 7fb250d24800 20 searching for the correct realm 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:19:56.489+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2de63940 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:19:56.490+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb23c061070 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:19:56.491+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x7fb244045070 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:19:56.492+0000 7fb24c1d1640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb23c061070 msgr2=0x7fb23c04dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:19:56.492+0000 7fb1227fc640 1 client.7326.objecter ms_handle_reset 0x7fb23c061070 session 0x7fb23c0c4040 osd.7 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:19:56.492+0000 7fb1227fc640 10 monclient: _renew_subs 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:19:56.492+0000 7fb1227fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:19:56.493+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb118087810 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:19:56.493+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x7fb24401b040 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:19:56.496+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb238003ab0 auth_method 0 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:56.605 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 zone default found 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 Realm: () 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:56.606 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:19:56.502+0000 7fb250d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 zonegroup default 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 started sync module instance, tier type = 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=0 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=1 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=2 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=3 2024-09-14T11:19:56.607 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=4 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=5 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=6 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:19:56.512+0000 7fb250d24800 20 add_watcher() i=7 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:19:56.512+0000 7fb250d24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.608 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:19:56.514+0000 7fb1037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:19:56.515+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache list hook 0x557f2de32830 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache inspect hook 0x557f2de32830 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache erase hook 0x557f2de32830 2024-09-14T11:19:56.609 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache zap hook 0x557f2de32830 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 note: GC not initialized 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:19:56.515+0000 7fb1027e4640 20 reqs_thread_entry: start 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace show hook 0x7fb244013070 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace history hook 0x7fb244013070 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace active hook 0x7fb244013070 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace active_short hook 0x7fb244013070 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 Filter name: none 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:19:56.515+0000 7fb0fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:19:56.515+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:56.610 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : miss 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.611 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.612 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.613 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:19:56.530+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.614 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:19:56.536+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:19:56.536+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.615 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:19:56.547+0000 7fb250d24800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb250d24800 time 2024-09-14T11:19:56.547203+0000 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:56.616 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb25238c76a] 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:19:56.547+0000 7fb250d24800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb250d24800 thread_name:radosgw-admin 2024-09-14T11:19:56.617 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb25103e6f0] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb25108b99c] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb25238c7c4] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:19:56.618 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:56.619 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:19:56.620 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:19:56.621 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:19:56.622 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:56.623 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:56.624 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb0fb7fe640 / http_manager 2024-09-14T11:19:56.625 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1027e4640 / http_manager 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1037e6640 / rgw_dt_lg_renew 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1227fc640 / ms_dispatch 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1237fe640 / io_context_pool 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb123fff640 / io_context_pool 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1327fc640 / ms_dispatch 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb13960a640 / ms_dispatch 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb13ae0d640 / io_context_pool 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24c1d1640 / msgr-worker-2 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24c9d2640 / msgr-worker-1 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24d1d3640 / msgr-worker-0 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24d9d4640 / io_context_pool 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb250d24800 / radosgw-admin 2024-09-14T11:19:56.626 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.122194.log 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x7fb238002340 auth_method 0 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.627 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:19:56.267+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_done global_id 6941 payload 293 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:19:56.267+0000 7fb24c9d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: dump: 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.628 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:19:56.268+0000 7fb13960a640 10 monclient: dump: 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.629 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:19:56.268+0000 7fb250d24800 5 monclient: authenticate success, global_id 6941 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:19:56.268+0000 7fb13ae0d640 4 set_mon_vals no callback set 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:19:56.268+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:19:56.268+0000 7fb250d24800 1 librados: init done 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.630 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:19:56.270+0000 7fb13960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:19:56.270+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2dd992c0 auth_method 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:19:56.270+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2ddaf6f0 auth_method 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:19:56.271+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2dd984b0 auth_method 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:19:56.272+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2ddb8ac0 auth_method 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:19:56.273+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2ddb7fe0 auth_method 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:19:56.274+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.631 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding auth protocol: cephx 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.632 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: crc 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddc0b70) adding con mode: secure 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:19:56.274+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command objecter_requests cmddesc objecter_requests hook 0x557f2ddc4040 EEXIST 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:19:56.274+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding auth protocol: cephx 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.633 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: crc 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:19:56.274+0000 7fb250d24800 5 AuthRegistry(0x557f2ddbfa68) adding con mode: secure 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:19:56.274+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:19:56.275+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:19:56.275+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x557f2ddbfbb0 EEXIST 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.634 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2dde8360 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2dde8740 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2dde7070 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.910229s 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2dde8740 auth_method 0 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2dde8360 auth_method 0 2024-09-14T11:19:56.635 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2dde7070 auth_method 0 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:19:56.275+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.636 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:19:56.275+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_done global_id 6944 payload 824 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:19:56.275+0000 7fb24d1d3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: dump: 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.637 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:19:56.275+0000 7fb1327fc640 10 monclient: dump: 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.638 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:19:56.275+0000 7fb250d24800 5 monclient: authenticate success, global_id 6944 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:19:56.275+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:19:56.275+0000 7fb24d9d4640 4 set_mon_vals no callback set 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:19:56.276+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:19:56.276+0000 7fb250d24800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:19:56.277+0000 7fb1327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:19:56.278+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb1240770e0 auth_method 0 2024-09-14T11:19:56.639 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: get_monmap_and_config 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:19:56.278+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.640 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding auth protocol: cephx 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: crc 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x557f2de08070) adding con mode: secure 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:19:56.278+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.641 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:19:56.278+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding auth protocol: cephx 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.642 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: crc 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:19:56.278+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e6d00) adding con mode: secure 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:19:56.279+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:19:56.279+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:19:56.279+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x7ffe156e6e48 EEXIST 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2de3c660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2de2cfb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2de37a90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.643 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:19:56.279+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.914352s 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2de3c660 auth_method 0 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2de2cfb0 auth_method 0 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:19:56.279+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.644 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2de37a90 auth_method 0 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:19:56.279+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_done global_id 6947 payload 274 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 1 monclient: found mon.noname-c 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:19:56.279+0000 7fb24c1d1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: dump: 2024-09-14T11:19:56.645 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:56.646 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:19:56.280+0000 7fb123fff640 10 monclient: dump: 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 monclient: authenticate success, global_id 6947 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:19:56.280+0000 7fb250d24800 4 set_mon_vals no callback set 2024-09-14T11:19:56.647 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: shutdown 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: build_initial_monmap 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:19:56.280+0000 7fb250d24800 1 build_initial for_mkfs: 0 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:19:56.280+0000 7fb250d24800 10 monclient: monmap: 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.648 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding auth protocol: cephx 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: crc 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:19:56.280+0000 7fb250d24800 5 AuthRegistry(0x557f2de0bbc0) adding con mode: secure 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: starting msgr at 2024-09-14T11:19:56.649 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: starting objecter 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command objecter_requests cmddesc objecter_requests hook 0x557f2de0dda0 EEXIST 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: setting wanted keys 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:19:56.281+0000 7fb250d24800 1 librados: calling monclient init 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: init 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding auth protocol: cephx 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.650 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: crc 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 AuthRegistry(0x557f2ddfcc20) adding con mode: secure 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:19:56.281+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:19:56.281+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command rotate-key cmddesc rotate-key hook 0x557f2ddfcd68 EEXIST 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-b con 0x557f2de2cfb0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-a con 0x557f2de37a90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): picked mon.noname-c con 0x557f2de3c660 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.651 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:19:56.281+0000 7fb250d24800 10 monclient(hunting): authenticate will time out at 2199.916781s 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request con 0x557f2de37a90 auth_method 0 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request con 0x557f2de3c660 auth_method 0 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request con 0x557f2de2cfb0 auth_method 0 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:56.652 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:19:56.281+0000 7fb24c1d1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:19:56.281+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:19:56.281+0000 7fb24c9d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:19:56.282+0000 7fb24c1d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient(hunting): handle_auth_done global_id 7326 payload 824 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient: _finish_hunting 0 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 1 monclient: found mon.noname-a 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:19:56.282+0000 7fb24d1d3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:56.653 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: dump: 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:56.654 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:19:56.282+0000 7fb1227fc640 10 monclient: dump: 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:19:56.282+0000 7fb250d24800 5 monclient: authenticate success, global_id 7326 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.655 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:19:56.282+0000 7fb123fff640 4 set_mon_vals no callback set 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _renew_subs 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:19:56.282+0000 7fb250d24800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:19:56.282+0000 7fb250d24800 1 librados: init done 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:19:56.282+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cr dump hook 0x557f2de309b8 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:19:56.284+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:19:56.284+0000 7fb1227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:19:56.285+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb118077260 auth_method 0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:19:56.285+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2de571a0 auth_method 0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 realm 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.656 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:19:56.286+0000 7fb250d24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:19:56.286+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:19:56.286+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x557f2de5b3b0 auth_method 0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:19:56.287+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:19:56.287+0000 7fb24d1d3640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x557f2de5ec10 msgr2=0x557f2de61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:19:56.287+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2de5ec10 auth_method 0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:19:56.489+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x557f2de5ec10 auth_method 0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:19:56.489+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:19:56.489+0000 7fb250d24800 20 searching for the correct realm 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:19:56.489+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x557f2de63940 auth_method 0 2024-09-14T11:19:56.657 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:19:56.490+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb23c061070 auth_method 0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:19:56.491+0000 7fb24d1d3640 10 monclient: get_auth_request con 0x7fb244045070 auth_method 0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:19:56.492+0000 7fb24c1d1640 0 -- 172.21.15.29:0/1103558640 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb23c061070 msgr2=0x7fb23c04dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:19:56.492+0000 7fb1227fc640 1 client.7326.objecter ms_handle_reset 0x7fb23c061070 session 0x7fb23c0c4040 osd.7 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:19:56.492+0000 7fb1227fc640 10 monclient: _renew_subs 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:19:56.492+0000 7fb1227fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:19:56.493+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb118087810 auth_method 0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:19:56.493+0000 7fb24c9d2640 10 monclient: get_auth_request con 0x7fb24401b040 auth_method 0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:19:56.496+0000 7fb24c1d1640 10 monclient: get_auth_request con 0x7fb238003ab0 auth_method 0 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:56.658 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:19:56.501+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 zone default found 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 Realm: () 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:19:56.502+0000 7fb250d24800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:19:56.502+0000 7fb250d24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 zonegroup default 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.659 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 started sync module instance, tier type = 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:19:56.502+0000 7fb250d24800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=0 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=1 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=2 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=3 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=4 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=5 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:19:56.511+0000 7fb250d24800 20 add_watcher() i=6 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:19:56.512+0000 7fb250d24800 20 add_watcher() i=7 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:19:56.512+0000 7fb250d24800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.660 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding auth protocol: cephx 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:19:56.514+0000 7fb1037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: crc 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:19:56.514+0000 7fb250d24800 5 AuthRegistry(0x7ffe156e71e0) adding con mode: secure 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:19:56.515+0000 7fb250d24800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:56.661 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache list hook 0x557f2de32830 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache inspect hook 0x557f2de32830 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache erase hook 0x557f2de32830 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command cache zap hook 0x557f2de32830 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 note: GC not initialized 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:19:56.515+0000 7fb1027e4640 20 reqs_thread_entry: start 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace show hook 0x7fb244013070 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace history hook 0x7fb244013070 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace active hook 0x7fb244013070 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:19:56.515+0000 7fb250d24800 5 asok(0x557f2db4f270) register_command sync trace active_short hook 0x7fb244013070 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 Filter name: none 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:19:56.515+0000 7fb0fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:19:56.515+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:19:56.515+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.662 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : miss 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:19:56.516+0000 7fb250d24800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:19:56.516+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:19:56.521+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.663 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497049 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:19:56.522+0000 7fb1237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:19:56.523+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:19:56.664 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:19:56.528+0000 7fb250d24800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.665 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:19:56.528+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:19:56.529+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:19:56.530+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:19:56.531+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:19:56.532+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:19:56.533+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:19:56.536+0000 7fb250d24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:19:56.536+0000 7fb250d24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.666 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:19:56.538+0000 7fb250d24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497050 cookie 94004719300832 notifier 7326 bl.length()=1015 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:19:56.538+0000 7fb123fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:19:56.540+0000 7fb250d24800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:19:56.542+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:19:56.543+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:19:56.667 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:19:56.544+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:19:56.545+0000 7fb250d24800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:19:56.547+0000 7fb250d24800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb250d24800 time 2024-09-14T11:19:56.547203+0000 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb25238c76a] 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:19:56.668 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:19:56.547+0000 7fb250d24800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb250d24800 thread_name:radosgw-admin 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb25103e6f0] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb25108b99c] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb25238c7c4] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb25238c928] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f2cb320b1] 2024-09-14T11:19:56.669 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x557f2cb42217] 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fb251029590] 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:19:56.670 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:56.671 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:19:56.672 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:19:56.673 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:56.674 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:19:56.675 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb0fb7fe640 / http_manager 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1027e4640 / http_manager 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1037e6640 / rgw_dt_lg_renew 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1227fc640 / ms_dispatch 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1237fe640 / io_context_pool 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb123fff640 / io_context_pool 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb1327fc640 / ms_dispatch 2024-09-14T11:19:56.676 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb13960a640 / ms_dispatch 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb13ae0d640 / io_context_pool 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24c1d1640 / msgr-worker-2 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24c9d2640 / msgr-worker-1 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24d1d3640 / msgr-worker-0 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb24d9d4640 / io_context_pool 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb250d24800 / radosgw-admin 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:19:56.548592Z_6a819087-9e19-472a-9b87-becab3d292c3/log 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:19:56.677 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.626+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.627+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.627+0000 7f893352c800 20 realm 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.627+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.628+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.628+0000 7f893352c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.628+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.628+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.628+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.629+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.629+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:56.679 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.629+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:56.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.629+0000 7f893352c800 20 searching for the correct realm 2024-09-14T11:19:56.680 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.631+0000 7f892fadb640 0 -- 172.21.15.29:0/394098945 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f8928069240 msgr2=0x7f8928042a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:56.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:56.836+0000 7f892ead9640 0 -- 172.21.15.29:0/394098945 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f8928093bc0 msgr2=0x7f89280880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.043+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:57.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 zone default found 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 4 Realm: () 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 zonegroup default 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.044+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:57.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 started sync module instance, tier type = 2024-09-14T11:19:57.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.045+0000 7f893352c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=0 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=1 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=2 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=3 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=4 2024-09-14T11:19:57.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=5 2024-09-14T11:19:57.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.055+0000 7f893352c800 20 add_watcher() i=6 2024-09-14T11:19:57.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.056+0000 7f893352c800 20 add_watcher() i=7 2024-09-14T11:19:57.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.056+0000 7f893352c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:57.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.057+0000 7f87e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:57.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 5 note: GC not initialized 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f87e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 20 init_complete bucket index max shards: 11 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 20 Filter name: none 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f875e7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.058+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.059+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:57.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.059+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.060+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:19:57.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.060+0000 7f893352c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:57.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.060+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.060+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:19:57.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.060+0000 7f893352c800 20 rados->read ofs=0 len=0 2024-09-14T11:19:57.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.061+0000 7f893352c800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:19:57.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.061+0000 7f893352c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:57.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.063+0000 7f87e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:57.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.065+0000 7f893352c800 20 remove_watcher() i=0 2024-09-14T11:19:57.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.065+0000 7f893352c800 2 removed watcher, disabling cache 2024-09-14T11:19:57.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.066+0000 7f893352c800 20 remove_watcher() i=1 2024-09-14T11:19:57.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.067+0000 7f893352c800 20 remove_watcher() i=2 2024-09-14T11:19:57.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.068+0000 7f893352c800 20 remove_watcher() i=3 2024-09-14T11:19:57.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.069+0000 7f893352c800 20 remove_watcher() i=4 2024-09-14T11:19:57.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.070+0000 7f893352c800 20 remove_watcher() i=5 2024-09-14T11:19:57.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.071+0000 7f893352c800 20 remove_watcher() i=6 2024-09-14T11:19:57.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:19:57.072+0000 7f893352c800 20 remove_watcher() i=7 2024-09-14T11:19:57.083 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:19:57.083 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:19:57.083 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:19:57.083 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:27.303 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:27.340 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:27.340 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:27.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.383+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 realm 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.384+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.385+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:27.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.385+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.386+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:27.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.386+0000 7f9c91d2e800 20 searching for the correct realm 2024-09-14T11:20:27.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.388+0000 7f9c8e2de640 0 -- 172.21.15.29:0/587502593 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9c8800bc20 msgr2=0x7f9c88062560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:27.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.595+0000 7f9c8d2dc640 0 -- 172.21.15.29:0/587502593 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9c88067df0 msgr2=0x7f9c8807ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.802+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 zone default found 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 4 Realm: () 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 zonegroup default 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.803+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.804+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.804+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.804+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.804+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.805+0000 7f9c91d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.805+0000 7f9c91d2e800 20 started sync module instance, tier type = 2024-09-14T11:20:27.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.805+0000 7f9c91d2e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=0 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=1 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=2 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=3 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=4 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=5 2024-09-14T11:20:27.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.816+0000 7f9c91d2e800 20 add_watcher() i=6 2024-09-14T11:20:27.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.817+0000 7f9c91d2e800 20 add_watcher() i=7 2024-09-14T11:20:27.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.817+0000 7f9c91d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:27.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.819+0000 7f9b3ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:27.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.819+0000 7f9c91d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:27.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.819+0000 7f9c91d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:27.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.819+0000 7f9c91d2e800 5 note: GC not initialized 2024-09-14T11:20:27.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9b3effd640 20 reqs_thread_entry: start 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 20 Filter name: none 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9b3cff9640 20 reqs_thread_entry: start 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : miss 2024-09-14T11:20:27.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.820+0000 7f9c91d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.821+0000 7f9c91d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:20:27.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.829+0000 7f9c91d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.829+0000 7f9c91d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.829+0000 7f9c91d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.829+0000 7f9c91d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:20:27.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.830+0000 7f9b717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497052 cookie 93999166177840 notifier 7356 bl.length()=1015 2024-09-14T11:20:27.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.830+0000 7f9b717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.830+0000 7f9b717fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.830+0000 7f9b717fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.832+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:20:27.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.832+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:20:27.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.832+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:20:27.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.832+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.0 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.1 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.2 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.3 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.4 2024-09-14T11:20:27.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.5 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.6 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.7 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.8 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.9 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.10 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:20:27.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1.11 2024-09-14T11:20:27.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.837+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:20:27.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.838+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:20:27.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.838+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.838+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.839+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.840+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.840+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.840+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:20:27.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.841+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:20:27.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.842+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:20:27.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.842+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:20:27.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.845+0000 7f9c91d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:27.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.845+0000 7f9c91d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:20:27.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9c91d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9c91d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9c91d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9c91d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:20:27.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497053 cookie 93999166177840 notifier 7356 bl.length()=1015 2024-09-14T11:20:27.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9b70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.847+0000 7f9b70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.849+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:20:27.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.849+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:20:27.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.849+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:20:27.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.849+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:20:27.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.852+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.0 2024-09-14T11:20:27.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.853+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.1 2024-09-14T11:20:27.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.853+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.2 2024-09-14T11:20:27.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.853+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.3 2024-09-14T11:20:27.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.854+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.4 2024-09-14T11:20:27.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.854+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.5 2024-09-14T11:20:27.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.854+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.6 2024-09-14T11:20:27.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.855+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.7 2024-09-14T11:20:27.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.855+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.8 2024-09-14T11:20:27.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.855+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.9 2024-09-14T11:20:27.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.856+0000 7f9c91d2e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.33.10 2024-09-14T11:20:27.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.856+0000 7f9c91d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:27.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.856+0000 7f9c91d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 2024-09-14T11:20:27.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9c91d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9c91d2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9c91d2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9c91d2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33, ofs0, ns] 2024-09-14T11:20:27.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9b70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497054 cookie 93999166177840 notifier 7356 bl.length()=983 2024-09-14T11:20:27.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9b70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 info.flags=0x17 2024-09-14T11:20:27.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9b70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:11989569-703c-4397-b0f1-7ddb0279a491.4517.33 to cache LRU end 2024-09-14T11:20:27.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.858+0000 7f9b70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:27.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.860+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_sources= new_sources= 2024-09-14T11:20:27.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.860+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential sources added=[] removed=[] 2024-09-14T11:20:27.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.860+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): orig_dests= new_dests= 2024-09-14T11:20:27.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.860+0000 7f9c91d2e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[11989569-703c-4397-b0f1-7ddb0279a491.4517.33]): potential dests added=[] removed=[] 2024-09-14T11:20:27.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.862+0000 7f9c91d2e800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:27.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.864+0000 7f9b3ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:27.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.867+0000 7f9c91d2e800 20 remove_watcher() i=0 2024-09-14T11:20:27.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.867+0000 7f9c91d2e800 2 removed watcher, disabling cache 2024-09-14T11:20:27.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.868+0000 7f9c91d2e800 20 remove_watcher() i=1 2024-09-14T11:20:27.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.869+0000 7f9c91d2e800 20 remove_watcher() i=2 2024-09-14T11:20:27.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.870+0000 7f9c91d2e800 20 remove_watcher() i=3 2024-09-14T11:20:27.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.871+0000 7f9c91d2e800 20 remove_watcher() i=4 2024-09-14T11:20:27.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.872+0000 7f9c91d2e800 20 remove_watcher() i=5 2024-09-14T11:20:27.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.873+0000 7f9c91d2e800 20 remove_watcher() i=6 2024-09-14T11:20:27.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.874+0000 7f9c91d2e800 20 remove_watcher() i=7 2024-09-14T11:20:27.886 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:20:27.916 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:27.916 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:27.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.958+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 realm 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.960+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.961+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:27.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.961+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:27.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.962+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:27.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.962+0000 7f5edcd73800 20 searching for the correct realm 2024-09-14T11:20:27.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:27.963+0000 7f5eda05c640 0 -- 172.21.15.29:0/3651949783 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f5ec8002340 msgr2=0x7f5ecc060730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:28.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.169+0000 7f5edb05e640 0 -- 172.21.15.29:0/3651949783 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56142d4872f0 msgr2=0x56142d4896e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:28.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:28.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:28.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:28.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.176+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 zone default found 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 4 Realm: () 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 zonegroup default 2024-09-14T11:20:28.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.177+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.178+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.178+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.178+0000 7f5edcd73800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:28.177 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.178+0000 7f5edcd73800 20 started sync module instance, tier type = 2024-09-14T11:20:28.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.178+0000 7f5edcd73800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:28.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=0 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=1 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=2 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=3 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=4 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=5 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.187+0000 7f5edcd73800 20 add_watcher() i=6 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.188+0000 7f5edcd73800 20 add_watcher() i=7 2024-09-14T11:20:28.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.188+0000 7f5edcd73800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:28.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.190+0000 7f5d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.190+0000 7f5edcd73800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.190+0000 7f5edcd73800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.190+0000 7f5edcd73800 5 note: GC not initialized 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5d0bfff640 20 reqs_thread_entry: start 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5edcd73800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5edcd73800 20 Filter name: none 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5d09ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:28.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:28.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.191+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.192+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.192+0000 7f5edcd73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.192+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.193+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.193+0000 7f5edcd73800 20 rados->read ofs=0 len=0 2024-09-14T11:20:28.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.193+0000 7f5edcd73800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:20:28.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.193+0000 7f5edcd73800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:28.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.195+0000 7f5d917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:28.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.198+0000 7f5edcd73800 20 remove_watcher() i=0 2024-09-14T11:20:28.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.198+0000 7f5edcd73800 2 removed watcher, disabling cache 2024-09-14T11:20:28.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.199+0000 7f5edcd73800 20 remove_watcher() i=1 2024-09-14T11:20:28.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.200+0000 7f5edcd73800 20 remove_watcher() i=2 2024-09-14T11:20:28.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.201+0000 7f5edcd73800 20 remove_watcher() i=3 2024-09-14T11:20:28.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.202+0000 7f5edcd73800 20 remove_watcher() i=4 2024-09-14T11:20:28.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.203+0000 7f5edcd73800 20 remove_watcher() i=5 2024-09-14T11:20:28.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.204+0000 7f5edcd73800 20 remove_watcher() i=6 2024-09-14T11:20:28.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:28.205+0000 7f5edcd73800 20 remove_watcher() i=7 2024-09-14T11:20:28.214 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:28.214 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:28.214 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-commit-target-layout id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:28.214 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:28.592 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:20:28.592 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:29.502 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:20:29.531 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:29.531 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:29.570 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.572+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 realm 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.574+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.575+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:29.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.575+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.575+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:29.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.576+0000 7fdf73e16800 20 searching for the correct realm 2024-09-14T11:20:29.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.577+0000 7fdf6fde8640 0 -- 172.21.15.29:0/1124712076 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fdf68027030 msgr2=0x7fdf68089ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:29.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.782+0000 7fdf6ede6640 0 -- 172.21.15.29:0/1124712076 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fdf6806bd50 msgr2=0x7fdf6806d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:29.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:29.987 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.989+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:29.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 zone default found 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 4 Realm: () 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:29.989 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 zonegroup default 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.990+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.991+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.991+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.991+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.991+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.992+0000 7fdf73e16800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.992+0000 7fdf73e16800 20 started sync module instance, tier type = 2024-09-14T11:20:29.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:29.992+0000 7fdf73e16800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:29.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=0 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=1 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=2 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=3 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=4 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=5 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.001+0000 7fdf73e16800 20 add_watcher() i=6 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.002+0000 7fdf73e16800 20 add_watcher() i=7 2024-09-14T11:20:30.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.002+0000 7fdf73e16800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.004+0000 7fde25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.004+0000 7fdf73e16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.004+0000 7fdf73e16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.004+0000 7fdf73e16800 5 note: GC not initialized 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.004+0000 7fde24fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdf73e16800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdf73e16800 20 Filter name: none 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdd9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:30.003 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:30.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.005+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.006+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:30.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.006+0000 7fdf73e16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:30.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.006+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.007+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:30.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.007+0000 7fdf73e16800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.007+0000 7fdf73e16800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:30.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.007+0000 7fdf73e16800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:30.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.009+0000 7fde25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.011+0000 7fdf73e16800 20 remove_watcher() i=0 2024-09-14T11:20:30.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.011+0000 7fdf73e16800 2 removed watcher, disabling cache 2024-09-14T11:20:30.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.013+0000 7fdf73e16800 20 remove_watcher() i=1 2024-09-14T11:20:30.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.014+0000 7fdf73e16800 20 remove_watcher() i=2 2024-09-14T11:20:30.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.015+0000 7fdf73e16800 20 remove_watcher() i=3 2024-09-14T11:20:30.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.016+0000 7fdf73e16800 20 remove_watcher() i=4 2024-09-14T11:20:30.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.018+0000 7fdf73e16800 20 remove_watcher() i=5 2024-09-14T11:20:30.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.019+0000 7fdf73e16800 20 remove_watcher() i=6 2024-09-14T11:20:30.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.020+0000 7fdf73e16800 20 remove_watcher() i=7 2024-09-14T11:20:30.032 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:30.032 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:30.032 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:30.032 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:30.032 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:20:30.067 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:30.067 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:30.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.109+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.109 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 realm 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.110 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.111+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.112+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:30.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.112+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.113+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:30.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.113+0000 7f2cee014800 20 searching for the correct realm 2024-09-14T11:20:30.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.115+0000 7f2ce9ecc640 0 -- 172.21.15.29:0/780287796 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f2ce401c550 msgr2=0x7f2ce4040410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:30.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.321+0000 7f2ce9ecc640 0 -- 172.21.15.29:0/780287796 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5569617419e0 msgr2=0x556961743dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:30.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:30.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:30.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:30.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:30.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:30.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:30.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.326+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 zone default found 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 4 Realm: () 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:30.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 zonegroup default 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.327+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.328+0000 7f2cee014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.328+0000 7f2cee014800 20 started sync module instance, tier type = 2024-09-14T11:20:30.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.328+0000 7f2cee014800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=0 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=1 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=2 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=3 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=4 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.337+0000 7f2cee014800 20 add_watcher() i=5 2024-09-14T11:20:30.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.338+0000 7f2cee014800 20 add_watcher() i=6 2024-09-14T11:20:30.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.338+0000 7f2cee014800 20 add_watcher() i=7 2024-09-14T11:20:30.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.339+0000 7f2cee014800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:30.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.340+0000 7f2b9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:30.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 5 note: GC not initialized 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2b9efe5640 20 reqs_thread_entry: start 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 20 Filter name: none 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2b9cfe1640 20 reqs_thread_entry: start 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:20:30.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.341+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 : miss 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:30.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.342+0000 7f2cee014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 2024-09-14T11:20:30.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2cee014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2cee014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2cee014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2cee014800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34, ofs0, ns] 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2bbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 93911094897072 notifier 7410 bl.length()=995 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2bbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2bbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:30.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.347+0000 7f2bbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:30.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.349+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_sources= new_sources= 2024-09-14T11:20:30.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.349+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential sources added=[] removed=[] 2024-09-14T11:20:30.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.349+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_dests= new_dests= 2024-09-14T11:20:30.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.349+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential dests added=[] removed=[] 2024-09-14T11:20:30.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.354+0000 7f2cee014800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:20:30.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.361+0000 7f2cee014800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:30.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.361+0000 7f2cee014800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 2024-09-14T11:20:30.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2cee014800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:30.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2cee014800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:30.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2cee014800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:30.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2cee014800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34, ofs0, ns] 2024-09-14T11:20:30.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2bbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93911094897072 notifier 7410 bl.length()=963 2024-09-14T11:20:30.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2bbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:30.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2bbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:30.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.362+0000 7f2bbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:30.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.364+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_sources= new_sources= 2024-09-14T11:20:30.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.364+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential sources added=[] removed=[] 2024-09-14T11:20:30.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.364+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_dests= new_dests= 2024-09-14T11:20:30.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.364+0000 7f2cee014800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential dests added=[] removed=[] 2024-09-14T11:20:30.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.364+0000 7f2cee014800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:20:30.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.366+0000 7f2b9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.369+0000 7f2cee014800 20 remove_watcher() i=0 2024-09-14T11:20:30.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.369+0000 7f2cee014800 2 removed watcher, disabling cache 2024-09-14T11:20:30.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.370+0000 7f2cee014800 20 remove_watcher() i=1 2024-09-14T11:20:30.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.371+0000 7f2cee014800 20 remove_watcher() i=2 2024-09-14T11:20:30.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.372+0000 7f2cee014800 20 remove_watcher() i=3 2024-09-14T11:20:30.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.373+0000 7f2cee014800 20 remove_watcher() i=4 2024-09-14T11:20:30.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.374+0000 7f2cee014800 20 remove_watcher() i=5 2024-09-14T11:20:30.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.375+0000 7f2cee014800 20 remove_watcher() i=6 2024-09-14T11:20:30.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.376+0000 7f2cee014800 20 remove_watcher() i=7 2024-09-14T11:20:30.387 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:20:30.416 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:30.416 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:30.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.457+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.459+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.459+0000 7fc08712e800 20 realm 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.459+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.459+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.459+0000 7fc08712e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.460+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.460+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.460+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.460+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:30.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.460+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.461+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:30.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.461+0000 7fc08712e800 20 searching for the correct realm 2024-09-14T11:20:30.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.464+0000 7fc083565640 0 -- 172.21.15.29:0/1714835751 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc07c02c040 msgr2=0x7fc07c010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:30.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.467+0000 7fc082563640 0 -- 172.21.15.29:0/1714835751 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc07c048a80 msgr2=0x7fc07c02b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:30.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.673 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.674+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 zone default found 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 4 Realm: () 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 zonegroup default 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 started sync module instance, tier type = 2024-09-14T11:20:30.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.675+0000 7fc08712e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:30.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=0 2024-09-14T11:20:30.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=1 2024-09-14T11:20:30.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=2 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=3 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=4 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=5 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.685+0000 7fc08712e800 20 add_watcher() i=6 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.686+0000 7fc08712e800 20 add_watcher() i=7 2024-09-14T11:20:30.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.686+0000 7fc08712e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:30.686 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fbf397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fc08712e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fc08712e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fc08712e800 5 note: GC not initialized 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fbeb3fff640 20 reqs_thread_entry: start 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fc08712e800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fc08712e800 20 Filter name: none 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.688+0000 7fbeb1ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:30.687 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.689+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.689+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.689+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:30.688 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:30.689 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.690+0000 7fc08712e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:30.690 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.692+0000 7fbf397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:30.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.695+0000 7fc08712e800 20 remove_watcher() i=0 2024-09-14T11:20:30.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.695+0000 7fc08712e800 2 removed watcher, disabling cache 2024-09-14T11:20:30.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.696+0000 7fc08712e800 20 remove_watcher() i=1 2024-09-14T11:20:30.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.697+0000 7fc08712e800 20 remove_watcher() i=2 2024-09-14T11:20:30.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.698+0000 7fc08712e800 20 remove_watcher() i=3 2024-09-14T11:20:30.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.699+0000 7fc08712e800 20 remove_watcher() i=4 2024-09-14T11:20:30.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.700+0000 7fc08712e800 20 remove_watcher() i=5 2024-09-14T11:20:30.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.701+0000 7fc08712e800 20 remove_watcher() i=6 2024-09-14T11:20:30.700 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.702+0000 7fc08712e800 20 remove_watcher() i=7 2024-09-14T11:20:30.712 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:30.712 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:30.712 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:30.712 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:30.804 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:30.836 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:30.836 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:30.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.877+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 realm 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.879+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.880+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:30.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.880+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:30.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.881+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:30.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.881+0000 7f6142d39800 20 searching for the correct realm 2024-09-14T11:20:30.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:30.883+0000 7f613f1c8640 0 -- 172.21.15.29:0/3531849490 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6138061040 msgr2=0x7f61380b5300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:31.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.089+0000 7f613e1c6640 0 -- 172.21.15.29:0/3531849490 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f61380ac740 msgr2=0x7f61380ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.296+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:31.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:31.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 zone default found 2024-09-14T11:20:31.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 4 Realm: () 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 zonegroup default 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.297+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.298+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.298+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.298+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.298+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.299+0000 7f6142d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.299+0000 7f6142d39800 20 started sync module instance, tier type = 2024-09-14T11:20:31.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.299+0000 7f6142d39800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:31.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.310+0000 7f6142d39800 20 add_watcher() i=0 2024-09-14T11:20:31.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.310+0000 7f6142d39800 20 add_watcher() i=1 2024-09-14T11:20:31.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.310+0000 7f6142d39800 20 add_watcher() i=2 2024-09-14T11:20:31.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.310+0000 7f6142d39800 20 add_watcher() i=3 2024-09-14T11:20:31.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.313+0000 7f6142d39800 20 add_watcher() i=4 2024-09-14T11:20:31.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.313+0000 7f6142d39800 20 add_watcher() i=5 2024-09-14T11:20:31.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.313+0000 7f6142d39800 20 add_watcher() i=6 2024-09-14T11:20:31.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.313+0000 7f6142d39800 20 add_watcher() i=7 2024-09-14T11:20:31.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.313+0000 7f6142d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:31.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.315+0000 7f5ff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:31.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:31.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:31.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 5 note: GC not initialized 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f5f6ffff640 20 reqs_thread_entry: start 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 20 Filter name: none 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f5f6dffb640 20 reqs_thread_entry: start 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.316+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 : miss 2024-09-14T11:20:31.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.317+0000 7f6142d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f6142d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f6142d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f6142d39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f6142d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34, ofs0, ns] 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f60227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497005 cookie 94139592055232 notifier 7446 bl.length()=995 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f60227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f60227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.324+0000 7f60227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.326+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_sources= new_sources= 2024-09-14T11:20:31.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.326+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential sources added=[] removed=[] 2024-09-14T11:20:31.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.326+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_dests= new_dests= 2024-09-14T11:20:31.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.326+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential dests added=[] removed=[] 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.0 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.0 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.1 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.1 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.2 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.2 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.3 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.3 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.4 2024-09-14T11:20:31.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.4 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.5 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.5 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.6 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.6 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.7 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.7 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.8 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.8 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.9 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.9 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.10 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.10 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.11 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1.11 2024-09-14T11:20:31.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.0 2024-09-14T11:20:31.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.332+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1 2024-09-14T11:20:31.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.333+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.2 2024-09-14T11:20:31.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.333+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.3 2024-09-14T11:20:31.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.334+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.4 2024-09-14T11:20:31.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.334+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.5 2024-09-14T11:20:31.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.335+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.6 2024-09-14T11:20:31.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.335+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.7 2024-09-14T11:20:31.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.336+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.8 2024-09-14T11:20:31.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.337+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.9 2024-09-14T11:20:31.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.337+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.10 2024-09-14T11:20:31.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.341+0000 7f6142d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:31.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.341+0000 7f6142d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 2024-09-14T11:20:31.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f6142d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f6142d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f6142d39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f6142d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34, ofs0, ns] 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f60227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497006 cookie 94139592055232 notifier 7446 bl.length()=995 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f60227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f60227fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.342+0000 7f60227fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.344+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_sources= new_sources= 2024-09-14T11:20:31.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.344+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential sources added=[] removed=[] 2024-09-14T11:20:31.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.344+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_dests= new_dests= 2024-09-14T11:20:31.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.344+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential dests added=[] removed=[] 2024-09-14T11:20:31.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.346+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.0 2024-09-14T11:20:31.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.347+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.1 2024-09-14T11:20:31.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.347+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.2 2024-09-14T11:20:31.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.347+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.3 2024-09-14T11:20:31.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.348+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.4 2024-09-14T11:20:31.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.348+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.5 2024-09-14T11:20:31.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.348+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.6 2024-09-14T11:20:31.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.349+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.7 2024-09-14T11:20:31.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.349+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.8 2024-09-14T11:20:31.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.349+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.9 2024-09-14T11:20:31.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.350+0000 7f6142d39800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.34.10 2024-09-14T11:20:31.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.350+0000 7f6142d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:31.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.350+0000 7f6142d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.351+0000 7f6142d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.351+0000 7f6142d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.351+0000 7f6142d39800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.351+0000 7f6142d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34, ofs0, ns] 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.352+0000 7f6021ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497007 cookie 94139592055232 notifier 7446 bl.length()=963 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.352+0000 7f6021ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 info.flags=0x17 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.352+0000 7f6021ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.34 to cache LRU end 2024-09-14T11:20:31.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.352+0000 7f6021ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:31.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.353+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_sources= new_sources= 2024-09-14T11:20:31.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.353+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential sources added=[] removed=[] 2024-09-14T11:20:31.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.353+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): orig_dests= new_dests= 2024-09-14T11:20:31.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.353+0000 7f6142d39800 20 handle_bi_update(): bucket=:error-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.34]): potential dests added=[] removed=[] 2024-09-14T11:20:31.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.356+0000 7f6142d39800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:20:31.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.358+0000 7f5ff57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:31.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.360+0000 7f6142d39800 20 remove_watcher() i=0 2024-09-14T11:20:31.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.360+0000 7f6142d39800 2 removed watcher, disabling cache 2024-09-14T11:20:31.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.361+0000 7f6142d39800 20 remove_watcher() i=1 2024-09-14T11:20:31.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.362+0000 7f6142d39800 20 remove_watcher() i=2 2024-09-14T11:20:31.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.364+0000 7f6142d39800 20 remove_watcher() i=3 2024-09-14T11:20:31.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.365+0000 7f6142d39800 20 remove_watcher() i=4 2024-09-14T11:20:31.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.366+0000 7f6142d39800 20 remove_watcher() i=5 2024-09-14T11:20:31.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.366+0000 7f6142d39800 20 remove_watcher() i=6 2024-09-14T11:20:31.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.367+0000 7f6142d39800 20 remove_watcher() i=7 2024-09-14T11:20:31.379 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:20:31.408 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:31.408 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:31.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.450+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.450 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 realm 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.452+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.453+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:31.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.453+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.454+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:31.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.454+0000 7fc1efa96800 20 searching for the correct realm 2024-09-14T11:20:31.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.456+0000 7fc1edd81640 0 -- 172.21.15.29:0/954738107 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc1e8082070 msgr2=0x7fc1e80ba380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:31.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.662+0000 7fc1ecd7f640 0 -- 172.21.15.29:0/954738107 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc1e80ba9b0 msgr2=0x7fc1e8002c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.869+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.870+0000 7fc1efa96800 20 zone default found 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 4 Realm: () 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 zonegroup default 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.871+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.872+0000 7fc1efa96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:31.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.872+0000 7fc1efa96800 20 started sync module instance, tier type = 2024-09-14T11:20:31.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.872+0000 7fc1efa96800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=0 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=1 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=2 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=3 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=4 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=5 2024-09-14T11:20:31.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.882+0000 7fc1efa96800 20 add_watcher() i=6 2024-09-14T11:20:31.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.884+0000 7fc1efa96800 20 add_watcher() i=7 2024-09-14T11:20:31.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.884+0000 7fc1efa96800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:31.883 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.885+0000 7fc0a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:31.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:31.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 5 note: GC not initialized 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc0a2fe5640 20 reqs_thread_entry: start 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 20 Filter name: none 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc0a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.886+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.887+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:31.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.887+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.887+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.887+0000 7fc1efa96800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.888+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.888+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.888+0000 7fc1efa96800 20 rados->read ofs=0 len=0 2024-09-14T11:20:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.888+0000 7fc1efa96800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.888+0000 7fc1efa96800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:31.889 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.890+0000 7fc0a3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:31.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.893+0000 7fc1efa96800 20 remove_watcher() i=0 2024-09-14T11:20:31.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.893+0000 7fc1efa96800 2 removed watcher, disabling cache 2024-09-14T11:20:31.891 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.893+0000 7fc1efa96800 20 remove_watcher() i=1 2024-09-14T11:20:31.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.894+0000 7fc1efa96800 20 remove_watcher() i=2 2024-09-14T11:20:31.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.896+0000 7fc1efa96800 20 remove_watcher() i=3 2024-09-14T11:20:31.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.897+0000 7fc1efa96800 20 remove_watcher() i=4 2024-09-14T11:20:31.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.898+0000 7fc1efa96800 20 remove_watcher() i=5 2024-09-14T11:20:31.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.899+0000 7fc1efa96800 20 remove_watcher() i=6 2024-09-14T11:20:31.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:31.901+0000 7fc1efa96800 20 remove_watcher() i=7 2024-09-14T11:20:31.910 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:31.911 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:31.911 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:20:31.911 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:32.297 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:20:32.297 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:33.154 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:20:33.184 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:33.184 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.225+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 realm 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.227+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.228+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.228+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.228+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:33.227 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.229+0000 7f6728013800 20 searching for the correct realm 2024-09-14T11:20:33.228 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.230+0000 7f6723f49640 0 -- 172.21.15.29:0/2120473814 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f671c067bc0 msgr2=0x7f671c066630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.435+0000 7f6722f47640 0 -- 172.21.15.29:0/2120473814 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f671c070db0 msgr2=0x7f671c01d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:33.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:33.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:33.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:33.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.641+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 zone default found 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 4 Realm: () 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 zonegroup default 2024-09-14T11:20:33.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.642+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 started sync module instance, tier type = 2024-09-14T11:20:33.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.643+0000 7f6728013800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:33.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=0 2024-09-14T11:20:33.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=1 2024-09-14T11:20:33.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=2 2024-09-14T11:20:33.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=3 2024-09-14T11:20:33.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=4 2024-09-14T11:20:33.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=5 2024-09-14T11:20:33.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.652+0000 7f6728013800 20 add_watcher() i=6 2024-09-14T11:20:33.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.653+0000 7f6728013800 20 add_watcher() i=7 2024-09-14T11:20:33.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.653+0000 7f6728013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f65d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f6728013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f6728013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f6728013800 5 note: GC not initialized 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f65d8fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f6728013800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.655+0000 7f6728013800 20 Filter name: none 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.656+0000 7f65527fc640 20 reqs_thread_entry: start 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.656+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.656+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:33.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.656+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.657+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:33.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.657+0000 7f6728013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:33.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.657+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.658+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:33.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.658+0000 7f6728013800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.658+0000 7f6728013800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:33.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.658+0000 7f6728013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:33.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.660+0000 7f65d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.663+0000 7f6728013800 20 remove_watcher() i=0 2024-09-14T11:20:33.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.663+0000 7f6728013800 2 removed watcher, disabling cache 2024-09-14T11:20:33.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.664+0000 7f6728013800 20 remove_watcher() i=1 2024-09-14T11:20:33.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.665+0000 7f6728013800 20 remove_watcher() i=2 2024-09-14T11:20:33.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.666+0000 7f6728013800 20 remove_watcher() i=3 2024-09-14T11:20:33.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.667+0000 7f6728013800 20 remove_watcher() i=4 2024-09-14T11:20:33.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.668+0000 7f6728013800 20 remove_watcher() i=5 2024-09-14T11:20:33.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.669+0000 7f6728013800 20 remove_watcher() i=6 2024-09-14T11:20:33.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.670+0000 7f6728013800 20 remove_watcher() i=7 2024-09-14T11:20:33.680 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:33.680 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:33.680 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:33.680 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:33.682 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:20:33.717 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:33.717 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:33.758 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.759+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 realm 2024-09-14T11:20:33.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.764+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:33.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.764+0000 7fdaa013e800 20 searching for the correct realm 2024-09-14T11:20:33.762 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.764+0000 7fda9b6ec640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fda8c0618f0 msgr2=0x7fda8c075ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.970+0000 7fda9c6ee640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x555ad2833580 msgr2=0x555ad2835990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.976+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zone default found 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Realm: () 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zonegroup default 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started sync module instance, tier type = 2024-09-14T11:20:33.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:33.985 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=0 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=1 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=2 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=3 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=4 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=5 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=6 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.988+0000 7fdaa013e800 20 add_watcher() i=7 2024-09-14T11:20:33.986 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.988+0000 7fdaa013e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:33.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:33.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:33.988 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fdaa013e800 5 note: GC not initialized 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fd950fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.990+0000 7fdaa013e800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 20 Filter name: none 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fd8ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:20:33.990 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : miss 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:33.991 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:33.992+0000 7fdaa013e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:20:33.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:33.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fdaa013e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:33.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:33.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fdaa013e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:20:34.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 93848567267536 notifier 7121 bl.length()=995 2024-09-14T11:20:34.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:20:34.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:20:34.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:20:34.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:20:34.006 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdaa013e800 time 2024-09-14T11:20:34.008837+0000 2024-09-14T11:20:34.006 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdaa198c76a] 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.008+0000 7fdaa013e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdaa013e800 time 2024-09-14T11:20:34.008837+0000 2024-09-14T11:20:34.007 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdaa198c76a] 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:20:34.008 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fdaa013e800 thread_name:radosgw-admin 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdaa063e6f0] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdaa068b99c] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdaa198c7c4] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.028 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.009+0000 7fdaa013e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fdaa013e800 thread_name:radosgw-admin 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdaa063e6f0] 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdaa068b99c] 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdaa198c7c4] 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.029 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: dump: 2024-09-14T11:20:34.030 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:20:33.741+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:20:33.741+0000 7fdaa013e800 10 monclient: get_monmap_and_config success 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:20:33.741+0000 7fdaa013e800 4 set_mon_vals no callback set 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: shutdown 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 asok(0x555ad251d270) unregister_commands rotate-key 2024-09-14T11:20:34.031 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.032 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:20:33.742+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: starting msgr at 2024-09-14T11:20:34.033 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: starting objecter 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests hook 0x555ad2771b00 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: setting wanted keys 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: calling monclient init 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.034 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:20:33.742+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:20:33.743+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:20:33.743+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key hook 0x555ad273d528 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad2767630 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad2767fb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x7fda84003ab0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.035 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.378224s 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad2767fb0 auth_method 0 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad2767630 auth_method 0 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.036 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:20:33.743+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: dump: 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.037 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: dump: 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.038 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:20:33.743+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:20:33.743+0000 7fd989e0b640 4 set_mon_vals no callback set 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:20:33.743+0000 7fdaa013e800 1 librados: init done 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:20:33.746+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fd984077230 auth_method 0 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:20:33.746+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad2786860 auth_method 0 2024-09-14T11:20:34.039 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:20:33.747+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad2789a40 auth_method 0 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:20:33.747+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad278dda0 auth_method 0 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:20:33.748+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad278d2b0 auth_method 0 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:20:33.749+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:20:33.749+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:20:33.749+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.040 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.041 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:20:33.749+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests cmddesc objecter_requests hook 0x555ad2799220 EEXIST 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.042 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:20:33.750+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:20:33.750+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x555ad2794d90 EEXIST 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad27bd540 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad27bd920 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad27bc250 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.043 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.385620s 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad27bc250 auth_method 0 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad27bd540 auth_method 0 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad27bd920 auth_method 0 2024-09-14T11:20:34.044 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:20:33.750+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: dump: 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.045 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: dump: 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.046 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:20:33.751+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:20:33.751+0000 7fda9ceef640 4 set_mon_vals no callback set 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.047 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:20:33.753+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fd974077140 auth_method 0 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: get_monmap_and_config 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:20:33.753+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.048 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:20:33.753+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.049 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.050 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:20:33.754+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:20:33.754+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:20:33.754+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x7fff4ae88448 EEXIST 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad2811950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad27e28a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad280d1f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.389450s 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad280d1f0 auth_method 0 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.051 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad27e28a0 auth_method 0 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad2811950 auth_method 0 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.052 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7118 payload 274 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:20:33.754+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: dump: 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.053 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.054 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: dump: 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7118 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: get_monmap_and_config success 2024-09-14T11:20:34.055 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:20:33.755+0000 7fdaa013e800 4 set_mon_vals no callback set 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: shutdown 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:20:33.755+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.056 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.057 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: starting msgr at 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: starting objecter 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests cmddesc objecter_requests hook 0x555ad27e1630 EEXIST 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: setting wanted keys 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: calling monclient init 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.058 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x555ad27d1f48 EEXIST 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.059 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad27e28a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad280d1f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad2811950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.391779s 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad280d1f0 auth_method 0 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad27e28a0 auth_method 0 2024-09-14T11:20:34.060 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad2811950 auth_method 0 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:20:34.061 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: dump: 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.062 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: dump: 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.063 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:20:33.757+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:20:33.757+0000 7fd97affd640 4 set_mon_vals no callback set 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:20:33.757+0000 7fdaa013e800 1 librados: init done 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:20:33.757+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cr dump hook 0x555ad2801e48 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:20:33.759+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:20:33.761+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x7fd964077260 auth_method 0 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:20:33.761+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad282bad0 auth_method 0 2024-09-14T11:20:34.064 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 realm 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:20:33.762+0000 7fdaa013e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:20:33.762+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad282fd00 auth_method 0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:20:33.763+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad2833580 auth_method 0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:20:33.764+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:20:33.764+0000 7fdaa013e800 20 searching for the correct realm 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:20:33.764+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad2838360 auth_method 0 2024-09-14T11:20:34.065 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:20:33.764+0000 7fda9b6ec640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fda8c0618f0 msgr2=0x7fda8c075ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:20:33.966+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fda8c0618f0 auth_method 0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:20:33.967+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad25b3d00 auth_method 0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:20:33.969+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad25ea330 auth_method 0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:20:33.970+0000 7fda9c6ee640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x555ad2833580 msgr2=0x555ad2835990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:20:33.970+0000 7fd9797fa640 1 client.7121.objecter ms_handle_reset 0x555ad2833580 session 0x555ad282f090 osd.2 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:20:33.970+0000 7fd9797fa640 10 monclient: _renew_subs 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:20:33.970+0000 7fd9797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:20:33.971+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x7fd964087890 auth_method 0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:20:33.972+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad26803e0 auth_method 0 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.066 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zone default found 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Realm: () 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:20:33.977+0000 7fdaa013e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zonegroup default 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.067 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started sync module instance, tier type = 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=0 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=1 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=2 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=3 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=4 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=5 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=6 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:20:33.988+0000 7fdaa013e800 20 add_watcher() i=7 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:20:33.988+0000 7fdaa013e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.068 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.069 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:20:33.990+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:20:33.990+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache list hook 0x555ad27e3870 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache inspect hook 0x555ad27e3870 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache erase hook 0x555ad27e3870 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache zap hook 0x555ad27e3870 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 note: GC not initialized 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:20:33.990+0000 7fd950fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace show hook 0x7fda84001d30 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace history hook 0x7fda84001d30 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace active hook 0x7fda84001d30 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace active_short hook 0x7fda84001d30 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:34.070 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 Filter name: none 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:20:33.991+0000 7fd8ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : miss 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:20:33.992+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.071 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 93848567267536 notifier 7121 bl.length()=995 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:20:34.008+0000 7fdaa013e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdaa013e800 time 2024-09-14T11:20:34.008837+0000 2024-09-14T11:20:34.072 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdaa198c76a] 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:20:34.009+0000 7fdaa013e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fdaa013e800 thread_name:radosgw-admin 2024-09-14T11:20:34.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdaa063e6f0] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdaa068b99c] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdaa198c7c4] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:34.074 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:20:34.075 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:20:34.076 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:20:34.077 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:20:34.078 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:34.079 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:34.080 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd8ca7fc640 / http_manager 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd950fe1640 / http_manager 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd951fe3640 / rgw_dt_lg_renew 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd9797fa640 / ms_dispatch 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd97affd640 / io_context_pool 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd9817fa640 / ms_dispatch 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd983fff640 / ms_dispatch 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd989e0b640 / io_context_pool 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9b6ec640 / msgr-worker-2 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9beed640 / msgr-worker-1 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9c6ee640 / msgr-worker-0 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9ceef640 / io_context_pool 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: 7fdaa013e800 / radosgw-admin 2024-09-14T11:20:34.081 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.128087.log 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:20:33.741+0000 7fd989e0b640 10 monclient: dump: 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.082 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:20:33.741+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:20:33.741+0000 7fdaa013e800 10 monclient: get_monmap_and_config success 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:20:33.741+0000 7fdaa013e800 4 set_mon_vals no callback set 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: shutdown 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 asok(0x555ad251d270) unregister_commands rotate-key 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.083 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.084 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding auth protocol: cephx 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: crc 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad2742fd0) adding con mode: secure 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:20:33.742+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: starting msgr at 2024-09-14T11:20:34.085 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: starting objecter 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests hook 0x555ad2771b00 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: setting wanted keys 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:20:33.742+0000 7fdaa013e800 1 librados: calling monclient init 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:20:33.742+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding auth protocol: cephx 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.086 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: crc 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:20:33.742+0000 7fdaa013e800 5 AuthRegistry(0x555ad273d3e0) adding con mode: secure 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:20:33.742+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:20:33.743+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:20:33.743+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key hook 0x555ad273d528 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad2767630 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad2767fb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x7fda84003ab0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.087 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.378224s 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad2767fb0 auth_method 0 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad2767630 auth_method 0 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.088 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:20:33.743+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7112 payload 824 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:20:33.743+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:20:33.743+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: dump: 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.089 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:20:33.743+0000 7fd983fff640 10 monclient: dump: 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.090 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:20:33.743+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7112 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:20:33.743+0000 7fd989e0b640 4 set_mon_vals no callback set 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:20:33.743+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:20:33.743+0000 7fdaa013e800 1 librados: init done 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.091 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:20:33.745+0000 7fd983fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:20:33.746+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fd984077230 auth_method 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:20:33.746+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad2786860 auth_method 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:20:33.747+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad2789a40 auth_method 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:20:33.747+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad278dda0 auth_method 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:20:33.748+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad278d2b0 auth_method 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:20:33.749+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:20:33.749+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:20:33.749+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.092 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding auth protocol: cephx 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.093 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: crc 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 AuthRegistry(0x555ad2795d50) adding con mode: secure 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:20:33.749+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:20:33.749+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests cmddesc objecter_requests hook 0x555ad2799220 EEXIST 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding auth protocol: cephx 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.094 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: crc 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 AuthRegistry(0x555ad2794c48) adding con mode: secure 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:20:33.750+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:20:33.750+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:20:33.750+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x555ad2794d90 EEXIST 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad27bd540 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad27bd920 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad27bc250 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.095 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:20:33.750+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.385620s 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad27bc250 auth_method 0 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad27bd540 auth_method 0 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.096 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:20:33.750+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad27bd920 auth_method 0 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:20:33.750+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7115 payload 824 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:20:33.750+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:20:33.750+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: dump: 2024-09-14T11:20:34.097 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.098 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:20:33.751+0000 7fd9817fa640 10 monclient: dump: 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:20:33.751+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7115 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:20:33.751+0000 7fda9ceef640 4 set_mon_vals no callback set 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.099 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:20:33.751+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:20:33.753+0000 7fd9817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:20:33.753+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fd974077140 auth_method 0 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: get_monmap_and_config 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:20:33.753+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.100 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding auth protocol: cephx 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.101 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: crc 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x555ad27dd290) adding con mode: secure 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:20:33.753+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:20:33.753+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding auth protocol: cephx 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.102 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: crc 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:20:33.753+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae88300) adding con mode: secure 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:20:33.754+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:20:33.754+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:20:33.754+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x7fff4ae88448 EEXIST 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:20:34.103 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad2811950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad27e28a0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad280d1f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:20:33.754+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.389450s 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad280d1f0 auth_method 0 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad27e28a0 auth_method 0 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.104 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad2811950 auth_method 0 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:20:33.754+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:20:33.754+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient(hunting): handle_auth_done global_id 7118 payload 274 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.105 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:20:33.754+0000 7fda9beed640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:20:33.754+0000 7fda9beed640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: dump: 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.106 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:20:33.755+0000 7fd97affd640 10 monclient: dump: 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.107 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7118 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: get_monmap_and_config success 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:20:33.755+0000 7fdaa013e800 4 set_mon_vals no callback set 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: shutdown 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: build_initial_monmap 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:20:33.755+0000 7fdaa013e800 1 build_initial for_mkfs: 0 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:20:33.755+0000 7fdaa013e800 10 monclient: monmap: 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:20:34.108 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding auth protocol: cephx 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.109 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: crc 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:20:33.755+0000 7fdaa013e800 5 AuthRegistry(0x555ad2803b80) adding con mode: secure 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: starting msgr at 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: starting objecter 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command objecter_requests cmddesc objecter_requests hook 0x555ad27e1630 EEXIST 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: setting wanted keys 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:20:33.756+0000 7fdaa013e800 1 librados: calling monclient init 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: init 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding auth protocol: cephx 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.110 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: crc 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 AuthRegistry(0x555ad27d1e00) adding con mode: secure 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:20:33.756+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:20:33.756+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command rotate-key cmddesc rotate-key hook 0x555ad27d1f48 EEXIST 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: _reopen_session rank -1 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-c con 0x555ad27e28a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:20:34.111 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-a con 0x555ad280d1f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): picked mon.noname-b con 0x555ad2811950 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): _renew_subs 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:20:33.756+0000 7fdaa013e800 10 monclient(hunting): authenticate will time out at 2237.391779s 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request con 0x555ad280d1f0 auth_method 0 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request con 0x555ad27e28a0 auth_method 0 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.112 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:20:33.756+0000 7fda9c6ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:20:33.756+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): get_auth_request con 0x555ad2811950 auth_method 0 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:20:33.757+0000 7fda9beed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient(hunting): handle_auth_done global_id 7121 payload 824 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient: _finish_hunting 0 2024-09-14T11:20:34.113 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 1 monclient: found mon.noname-c 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:20:33.757+0000 7fda9b6ec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: dump: 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: _finish_auth 0 2024-09-14T11:20:34.114 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: _check_auth_tickets 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:20:33.757+0000 7fd9797fa640 10 monclient: dump: 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:20:33.757+0000 7fdaa013e800 5 monclient: authenticate success, global_id 7121 2024-09-14T11:20:34.115 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:20:33.757+0000 7fd97affd640 4 set_mon_vals no callback set 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _renew_subs 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:20:33.757+0000 7fdaa013e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:20:33.757+0000 7fdaa013e800 1 librados: init done 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:20:33.757+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cr dump hook 0x555ad2801e48 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:20:33.759+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:20:33.761+0000 7fd9797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:20:33.761+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x7fd964077260 auth_method 0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:20:33.761+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad282bad0 auth_method 0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 realm 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.116 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:20:33.762+0000 7fdaa013e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:20:33.762+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:20:33.762+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad282fd00 auth_method 0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:20:33.763+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:20:33.763+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad2833580 auth_method 0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:20:33.764+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:20:33.764+0000 7fdaa013e800 20 searching for the correct realm 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:20:33.764+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad2838360 auth_method 0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:20:33.764+0000 7fda9b6ec640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fda8c0618f0 msgr2=0x7fda8c075ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:20:33.966+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x7fda8c0618f0 auth_method 0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:20:33.967+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x555ad25b3d00 auth_method 0 2024-09-14T11:20:34.117 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:20:33.969+0000 7fda9beed640 10 monclient: get_auth_request con 0x555ad25ea330 auth_method 0 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:20:33.970+0000 7fda9c6ee640 0 -- 172.21.15.29:0/1382998517 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x555ad2833580 msgr2=0x555ad2835990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:20:33.970+0000 7fd9797fa640 1 client.7121.objecter ms_handle_reset 0x555ad2833580 session 0x555ad282f090 osd.2 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:20:33.970+0000 7fd9797fa640 10 monclient: _renew_subs 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:20:33.970+0000 7fd9797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:20:33.971+0000 7fda9c6ee640 10 monclient: get_auth_request con 0x7fd964087890 auth_method 0 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:20:33.972+0000 7fda9b6ec640 10 monclient: get_auth_request con 0x555ad26803e0 auth_method 0 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.118 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:20:33.976+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zone default found 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Realm: () 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:20:33.977+0000 7fdaa013e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:20:33.977+0000 7fdaa013e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 zonegroup default 2024-09-14T11:20:34.119 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:20:33.977+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started sync module instance, tier type = 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:20:33.978+0000 7fdaa013e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=0 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=1 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=2 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=3 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=4 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=5 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:20:33.987+0000 7fdaa013e800 20 add_watcher() i=6 2024-09-14T11:20:34.120 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:20:33.988+0000 7fdaa013e800 20 add_watcher() i=7 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:20:33.988+0000 7fdaa013e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding auth protocol: cephx 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.121 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: crc 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 AuthRegistry(0x7fff4ae887e0) adding con mode: secure 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:20:33.990+0000 7fd951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:20:33.990+0000 7fdaa013e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache list hook 0x555ad27e3870 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache inspect hook 0x555ad27e3870 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache erase hook 0x555ad27e3870 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command cache zap hook 0x555ad27e3870 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 note: GC not initialized 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:20:33.990+0000 7fd950fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace show hook 0x7fda84001d30 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace history hook 0x7fda84001d30 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace active hook 0x7fda84001d30 2024-09-14T11:20:34.122 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:20:33.990+0000 7fdaa013e800 5 asok(0x555ad251d270) register_command sync trace active_short hook 0x7fda84001d30 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:20:33.990+0000 7fdaa013e800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 Filter name: none 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:20:33.991+0000 7fd8ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:20:33.991+0000 7fdaa013e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : miss 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:20:33.991+0000 7fdaa013e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:20:33.992+0000 7fdaa013e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:34.123 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:20:33.992+0000 7fdaa013e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:20:34.001+0000 7fdaa013e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496989 cookie 93848567267536 notifier 7121 bl.length()=995 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:20:34.001+0000 7fd97affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:20:34.003+0000 7fdaa013e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:20:34.124 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:20:34.008+0000 7fdaa013e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdaa013e800 time 2024-09-14T11:20:34.008837+0000 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fdaa198c76a] 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:20:34.009+0000 7fdaa013e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fdaa013e800 thread_name:radosgw-admin 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.125 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fdaa063e6f0] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fdaa068b99c] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fdaa198c7c4] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fdaa198c928] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555ad19a20b1] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x555ad19b1f6a] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fdaa0629590] 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:20:34.126 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:20:34.127 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:20:34.128 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:20:34.129 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:20:34.130 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:20:34.131 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:20:34.132 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd8ca7fc640 / http_manager 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd950fe1640 / http_manager 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd951fe3640 / rgw_dt_lg_renew 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd9797fa640 / ms_dispatch 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd97affd640 / io_context_pool 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd9817fa640 / ms_dispatch 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd983fff640 / ms_dispatch 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd989e0b640 / io_context_pool 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9b6ec640 / msgr-worker-2 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9beed640 / msgr-worker-1 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9c6ee640 / msgr-worker-0 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fda9ceef640 / io_context_pool 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: 7fdaa013e800 / radosgw-admin 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:20:34.133 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:20:34.134 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:20:34.010278Z_4317b436-57d7-426a-a017-4ff9cb246f5f/log 2024-09-14T11:20:34.134 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:20:34.134 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:20:34.135 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:34.135 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:34.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.087+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.135 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 20 realm 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.089+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.090+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.090+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.091+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.091+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.091+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.091+0000 7f475ea0f800 20 searching for the correct realm 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.094+0000 7f4759991640 0 -- 172.21.15.29:0/2557662257 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f474c072030 msgr2=0x7f474c075c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.136 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.097+0000 7f4759991640 0 -- 172.21.15.29:0/2557662257 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f4754046400 msgr2=0x7f4754046880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 zone default found 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 4 Realm: () 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 zonegroup default 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.304+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 started sync module instance, tier type = 2024-09-14T11:20:34.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.305+0000 7f475ea0f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:34.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=0 2024-09-14T11:20:34.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=1 2024-09-14T11:20:34.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=2 2024-09-14T11:20:34.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=3 2024-09-14T11:20:34.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=4 2024-09-14T11:20:34.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=5 2024-09-14T11:20:34.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.314+0000 7f475ea0f800 20 add_watcher() i=6 2024-09-14T11:20:34.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.315+0000 7f475ea0f800 20 add_watcher() i=7 2024-09-14T11:20:34.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.315+0000 7f475ea0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.316+0000 7f4610fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 5 note: GC not initialized 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f458b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 20 Filter name: none 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f45897fa640 20 reqs_thread_entry: start 2024-09-14T11:20:34.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.317+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.318+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.318+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:34.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:20:34.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.319+0000 7f475ea0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:34.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.322+0000 7f4610fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.324+0000 7f475ea0f800 20 remove_watcher() i=0 2024-09-14T11:20:34.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.324+0000 7f475ea0f800 2 removed watcher, disabling cache 2024-09-14T11:20:34.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.325+0000 7f475ea0f800 20 remove_watcher() i=1 2024-09-14T11:20:34.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.326+0000 7f475ea0f800 20 remove_watcher() i=2 2024-09-14T11:20:34.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.327+0000 7f475ea0f800 20 remove_watcher() i=3 2024-09-14T11:20:34.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.328+0000 7f475ea0f800 20 remove_watcher() i=4 2024-09-14T11:20:34.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.329+0000 7f475ea0f800 20 remove_watcher() i=5 2024-09-14T11:20:34.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.330+0000 7f475ea0f800 20 remove_watcher() i=6 2024-09-14T11:20:34.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.331+0000 7f475ea0f800 20 remove_watcher() i=7 2024-09-14T11:20:34.341 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.341 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:20:34.341 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:20:34.341 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:20:34.432 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:20:34.465 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:34.465 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:34.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.506+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.507+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.507+0000 7f76f99a7800 20 realm 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.507+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.508+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.509+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.509+0000 7f76f99a7800 20 searching for the correct realm 2024-09-14T11:20:34.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.511+0000 7f76f7c92640 0 -- 172.21.15.29:0/2735701772 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f76f0031040 msgr2=0x7f76f0014430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:34.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.717+0000 7f76f6c90640 0 -- 172.21.15.29:0/2735701772 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f76f0031420 msgr2=0x7f76f00318a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.924+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 zone default found 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 4 Realm: () 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 zonegroup default 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.925+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 started sync module instance, tier type = 2024-09-14T11:20:34.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.926+0000 7f76f99a7800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:20:34.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=0 2024-09-14T11:20:34.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=1 2024-09-14T11:20:34.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=2 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=3 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=4 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=5 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.936+0000 7f76f99a7800 20 add_watcher() i=6 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.937+0000 7f76f99a7800 20 add_watcher() i=7 2024-09-14T11:20:34.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.937+0000 7f76f99a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.939+0000 7f75adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.939+0000 7f76f99a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.939+0000 7f76f99a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.939+0000 7f76f99a7800 5 note: GC not initialized 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.939+0000 7f75acfe1640 20 reqs_thread_entry: start 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 20 init_complete bucket index max shards: 11 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 20 Filter name: none 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f75267fc640 20 reqs_thread_entry: start 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:20:34.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:20:34.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:20:34.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:20:34.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : miss 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.940+0000 7f76f99a7800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.941+0000 7f76f99a7800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:20:34.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.942+0000 7f76f99a7800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to be held by another RGW process; skipping for now 2024-09-14T11:20:34.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.943+0000 7f75adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.945+0000 7f76f99a7800 20 remove_watcher() i=0 2024-09-14T11:20:34.943 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.945+0000 7f76f99a7800 2 removed watcher, disabling cache 2024-09-14T11:20:34.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.946+0000 7f76f99a7800 20 remove_watcher() i=1 2024-09-14T11:20:34.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.947+0000 7f76f99a7800 20 remove_watcher() i=2 2024-09-14T11:20:34.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.949+0000 7f76f99a7800 20 remove_watcher() i=3 2024-09-14T11:20:34.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.950+0000 7f76f99a7800 20 remove_watcher() i=4 2024-09-14T11:20:34.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.951+0000 7f76f99a7800 20 remove_watcher() i=5 2024-09-14T11:20:34.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.952+0000 7f76f99a7800 20 remove_watcher() i=6 2024-09-14T11:20:34.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:20:34.953+0000 7f76f99a7800 20 remove_watcher() i=7 2024-09-14T11:20:34.962 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:21:04.967 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:05.004 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:05.004 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:05.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.052+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.053+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.053+0000 7fd4c3142800 20 realm 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.053+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.054+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.054+0000 7fd4c3142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.054+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.054+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.054+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.055+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:05.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.055+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.056+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:05.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.056+0000 7fd4c3142800 20 searching for the correct realm 2024-09-14T11:21:05.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.058+0000 7fd4bf687640 0 -- 172.21.15.29:0/3916017306 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd4b805fee0 msgr2=0x7fd4b805f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:05.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.265+0000 7fd4be685640 0 -- 172.21.15.29:0/3916017306 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd4b8099040 msgr2=0x7fd4b80994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:05.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.473+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.474+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.474+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.474+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:05.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.474+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 zone default found 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 4 Realm: () 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 zonegroup default 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.475+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.476+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.476+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.476+0000 7fd4c3142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.476+0000 7fd4c3142800 20 started sync module instance, tier type = 2024-09-14T11:21:05.475 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.476+0000 7fd4c3142800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:05.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=0 2024-09-14T11:21:05.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=1 2024-09-14T11:21:05.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=2 2024-09-14T11:21:05.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=3 2024-09-14T11:21:05.485 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=4 2024-09-14T11:21:05.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=5 2024-09-14T11:21:05.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.487+0000 7fd4c3142800 20 add_watcher() i=6 2024-09-14T11:21:05.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.488+0000 7fd4c3142800 20 add_watcher() i=7 2024-09-14T11:21:05.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.488+0000 7fd4c3142800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:05.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.490+0000 7fd3757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:05.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.490+0000 7fd4c3142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:05.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.490+0000 7fd4c3142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:05.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd4c3142800 5 note: GC not initialized 2024-09-14T11:21:05.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd2effff640 20 reqs_thread_entry: start 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd4c3142800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd4c3142800 20 Filter name: none 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd2edffb640 20 reqs_thread_entry: start 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd4c3142800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.491+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : miss 2024-09-14T11:21:05.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.492+0000 7fd4c3142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:21:05.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.494+0000 7fd4c3142800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.501+0000 7fd4c3142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.501+0000 7fd4c3142800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.501+0000 7fd4c3142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.501+0000 7fd4c3142800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.502+0000 7fd3a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496990 cookie 94543717902368 notifier 7548 bl.length()=995 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.502+0000 7fd3a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.502+0000 7fd3a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.502+0000 7fd3a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.504+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:21:05.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.504+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:21:05.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.504+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:21:05.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.504+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.0 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.0 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.1 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.1 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.2 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.2 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.3 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.3 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.4 2024-09-14T11:21:05.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.4 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.5 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.5 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.6 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.6 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.7 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.7 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.8 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.8 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.9 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.9 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.10 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.10 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.11 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2.11 2024-09-14T11:21:05.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.509+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.0 2024-09-14T11:21:05.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.510+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.1 2024-09-14T11:21:05.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.511+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2 2024-09-14T11:21:05.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.511+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.3 2024-09-14T11:21:05.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.512+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.4 2024-09-14T11:21:05.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.512+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.5 2024-09-14T11:21:05.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.513+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.6 2024-09-14T11:21:05.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.513+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.7 2024-09-14T11:21:05.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.514+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.8 2024-09-14T11:21:05.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.514+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.9 2024-09-14T11:21:05.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.515+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.10 2024-09-14T11:21:05.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.518+0000 7fd4c3142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:05.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.518+0000 7fd4c3142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:21:05.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd4c3142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd4c3142800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd4c3142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd4c3142800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:21:05.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd3a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496991 cookie 94543717902368 notifier 7548 bl.length()=995 2024-09-14T11:21:05.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd3a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd3a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.520+0000 7fd3a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.522+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:21:05.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.522+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:21:05.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.522+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:21:05.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.522+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:21:05.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.525+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.0 2024-09-14T11:21:05.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.525+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.1 2024-09-14T11:21:05.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.526+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.2 2024-09-14T11:21:05.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.526+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.3 2024-09-14T11:21:05.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.527+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.4 2024-09-14T11:21:05.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.527+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.5 2024-09-14T11:21:05.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.527+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.6 2024-09-14T11:21:05.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.528+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.7 2024-09-14T11:21:05.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.528+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.8 2024-09-14T11:21:05.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.528+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.9 2024-09-14T11:21:05.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.529+0000 7fd4c3142800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.35.10 2024-09-14T11:21:05.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.529+0000 7fd4c3142800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:05.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.529+0000 7fd4c3142800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd4c3142800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd4c3142800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd4c3142800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd4c3142800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35, ofs0, ns] 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd3a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496992 cookie 94543717902368 notifier 7548 bl.length()=963 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd3a1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 info.flags=0x17 2024-09-14T11:21:05.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd3a1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:11989569-703c-4397-b0f1-7ddb0279a491.4517.35 to cache LRU end 2024-09-14T11:21:05.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.531+0000 7fd3a1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:05.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.533+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_sources= new_sources= 2024-09-14T11:21:05.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.533+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential sources added=[] removed=[] 2024-09-14T11:21:05.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.533+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): orig_dests= new_dests= 2024-09-14T11:21:05.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.533+0000 7fd4c3142800 20 handle_bi_update(): bucket=:abort-at-do-reshard[11989569-703c-4397-b0f1-7ddb0279a491.4517.35]): potential dests added=[] removed=[] 2024-09-14T11:21:05.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.536+0000 7fd4c3142800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:05.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.538+0000 7fd3757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:05.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.540+0000 7fd4c3142800 20 remove_watcher() i=0 2024-09-14T11:21:05.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.540+0000 7fd4c3142800 2 removed watcher, disabling cache 2024-09-14T11:21:05.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.541+0000 7fd4c3142800 20 remove_watcher() i=1 2024-09-14T11:21:05.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.542+0000 7fd4c3142800 20 remove_watcher() i=2 2024-09-14T11:21:05.542 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.543+0000 7fd4c3142800 20 remove_watcher() i=3 2024-09-14T11:21:05.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.545+0000 7fd4c3142800 20 remove_watcher() i=4 2024-09-14T11:21:05.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.546+0000 7fd4c3142800 20 remove_watcher() i=5 2024-09-14T11:21:05.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.547+0000 7fd4c3142800 20 remove_watcher() i=6 2024-09-14T11:21:05.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.548+0000 7fd4c3142800 20 remove_watcher() i=7 2024-09-14T11:21:05.560 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:21:05.590 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:05.590 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:05.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.633+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.634+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.634+0000 7efdc3d3e800 20 realm 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.634+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.635+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.635+0000 7efdc3d3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.635+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.635+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:05.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.635+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.636+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:05.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.636+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:05.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.636+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:05.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.636+0000 7efdc3d3e800 20 searching for the correct realm 2024-09-14T11:21:05.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.638+0000 7efdc0287640 0 -- 172.21.15.29:0/3941646740 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efdb8069040 msgr2=0x7efdb80bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:05.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:05.844+0000 7efdc0287640 0 -- 172.21.15.29:0/3941646740 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efc88087860 msgr2=0x7efc88089c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.051+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:06.050 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 zone default found 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 4 Realm: () 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 zonegroup default 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.052+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.053+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.053+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.053+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:06.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.053+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.054+0000 7efdc3d3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:06.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.054+0000 7efdc3d3e800 20 started sync module instance, tier type = 2024-09-14T11:21:06.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.054+0000 7efdc3d3e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=0 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=1 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=2 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=3 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=4 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=5 2024-09-14T11:21:06.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.064+0000 7efdc3d3e800 20 add_watcher() i=6 2024-09-14T11:21:06.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.066+0000 7efdc3d3e800 20 add_watcher() i=7 2024-09-14T11:21:06.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.066+0000 7efdc3d3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efdc3d3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efdc3d3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efdc3d3e800 5 note: GC not initialized 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efc74fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efdc3d3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.068+0000 7efdc3d3e800 20 Filter name: none 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.069+0000 7efbee7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:06.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.069+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.069+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:21:06.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.069+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.070+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.070+0000 7efdc3d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.070+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.071+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=211 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.071+0000 7efdc3d3e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.071+0000 7efdc3d3e800 20 rados_obj.operate() r=0 bl.length=433 2024-09-14T11:21:06.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.071+0000 7efdc3d3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:06.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.073+0000 7efc75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:06.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.076+0000 7efdc3d3e800 20 remove_watcher() i=0 2024-09-14T11:21:06.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.076+0000 7efdc3d3e800 2 removed watcher, disabling cache 2024-09-14T11:21:06.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.077+0000 7efdc3d3e800 20 remove_watcher() i=1 2024-09-14T11:21:06.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.078+0000 7efdc3d3e800 20 remove_watcher() i=2 2024-09-14T11:21:06.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.079+0000 7efdc3d3e800 20 remove_watcher() i=3 2024-09-14T11:21:06.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.080+0000 7efdc3d3e800 20 remove_watcher() i=4 2024-09-14T11:21:06.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.081+0000 7efdc3d3e800 20 remove_watcher() i=5 2024-09-14T11:21:06.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.083+0000 7efdc3d3e800 20 remove_watcher() i=6 2024-09-14T11:21:06.082 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:06.084+0000 7efdc3d3e800 20 remove_watcher() i=7 2024-09-14T11:21:06.095 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:06.095 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:06.095 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-do-reshard id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:21:06.095 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:06.484 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:21:06.484 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:07.363 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:21:07.392 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:07.392 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:07.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.626+0000 7f54e45af640 0 --2- 172.21.15.29:0/846108127 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5559060a61f0 0x5559060a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:21:07.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.635+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 20 realm 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.637+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.638+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.638+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.638+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:07.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.638+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.639+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:07.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.639+0000 7f54e8122800 20 searching for the correct realm 2024-09-14T11:21:07.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.640+0000 7f54e3dae640 0 -- 172.21.15.29:0/3959772318 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x555906119e50 msgr2=0x55590611c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:07.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.643+0000 7f54e3dae640 0 -- 172.21.15.29:0/3959772318 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f54dc0c0080 msgr2=0x7f54dc0904a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:07.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:07.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:07.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.853+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 zone default found 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 4 Realm: () 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:07.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 zonegroup default 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.854+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.855+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.855+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.855+0000 7f54e8122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.855+0000 7f54e8122800 20 started sync module instance, tier type = 2024-09-14T11:21:07.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.855+0000 7f54e8122800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=0 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=1 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=2 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=3 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=4 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=5 2024-09-14T11:21:07.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.864+0000 7f54e8122800 20 add_watcher() i=6 2024-09-14T11:21:07.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.865+0000 7f54e8122800 20 add_watcher() i=7 2024-09-14T11:21:07.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.865+0000 7f54e8122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:07.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.866+0000 7f5399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:07.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:07.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:07.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 5 note: GC not initialized 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f5398fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 20 Filter name: none 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f53127fc640 20 reqs_thread_entry: start 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.867+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.868+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:07.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.868+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:07.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:07.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:07.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:07.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.869+0000 7f54e8122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:07.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.871+0000 7f5399fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:07.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.873+0000 7f54e8122800 20 remove_watcher() i=0 2024-09-14T11:21:07.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.873+0000 7f54e8122800 2 removed watcher, disabling cache 2024-09-14T11:21:07.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.874+0000 7f54e8122800 20 remove_watcher() i=1 2024-09-14T11:21:07.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.875+0000 7f54e8122800 20 remove_watcher() i=2 2024-09-14T11:21:07.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.876+0000 7f54e8122800 20 remove_watcher() i=3 2024-09-14T11:21:07.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.877+0000 7f54e8122800 20 remove_watcher() i=4 2024-09-14T11:21:07.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.878+0000 7f54e8122800 20 remove_watcher() i=5 2024-09-14T11:21:07.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.879+0000 7f54e8122800 20 remove_watcher() i=6 2024-09-14T11:21:07.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.880+0000 7f54e8122800 20 remove_watcher() i=7 2024-09-14T11:21:07.890 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:07.890 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:07.890 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:07.890 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:07.891 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:21:07.926 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:07.926 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:07.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.967+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 realm 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.969+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.970+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:07.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.970+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:07.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.971+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:07.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.971+0000 7fd03b52f800 20 searching for the correct realm 2024-09-14T11:21:07.971 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:07.973+0000 7fd037a77640 0 -- 172.21.15.29:0/2961963122 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd03006cc20 msgr2=0x7fd030077d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:08.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.178+0000 7fd036a75640 0 -- 172.21.15.29:0/2961963122 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd0300950f0 msgr2=0x7fd030067400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:08.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.384+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 zone default found 2024-09-14T11:21:08.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 4 Realm: () 2024-09-14T11:21:08.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:08.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:08.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:08.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 zonegroup default 2024-09-14T11:21:08.385 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.385+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 started sync module instance, tier type = 2024-09-14T11:21:08.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.386+0000 7fd03b52f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=0 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=1 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=2 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=3 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=4 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=5 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.396+0000 7fd03b52f800 20 add_watcher() i=6 2024-09-14T11:21:08.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.397+0000 7fd03b52f800 20 add_watcher() i=7 2024-09-14T11:21:08.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.397+0000 7fd03b52f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:08.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.399+0000 7fceedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:08.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:08.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:08.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 5 note: GC not initialized 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fceecfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 20 Filter name: none 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fce667fc640 20 reqs_thread_entry: start 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.400+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:08.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 : miss 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:08.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:08.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.401+0000 7fd03b52f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.407+0000 7fd03b52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.407+0000 7fd03b52f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.407+0000 7fd03b52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.407+0000 7fd03b52f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36, ofs0, ns] 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.408+0000 7fcf1a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497059 cookie 94844292327520 notifier 7602 bl.length()=1007 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.408+0000 7fcf1a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:08.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.408+0000 7fcf1a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:08.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.408+0000 7fcf1a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:08.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.409+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_sources= new_sources= 2024-09-14T11:21:08.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.409+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential sources added=[] removed=[] 2024-09-14T11:21:08.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.409+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_dests= new_dests= 2024-09-14T11:21:08.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.409+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential dests added=[] removed=[] 2024-09-14T11:21:08.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.412+0000 7fd03b52f800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:21:08.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.412+0000 7fd03b52f800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:21:08.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.417+0000 7fd03b52f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:08.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.417+0000 7fd03b52f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 2024-09-14T11:21:08.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fd03b52f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:08.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fd03b52f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:08.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fd03b52f800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:08.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fd03b52f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36, ofs0, ns] 2024-09-14T11:21:08.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fcf1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497060 cookie 94844292327520 notifier 7602 bl.length()=975 2024-09-14T11:21:08.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fcf1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:08.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fcf1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:08.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.418+0000 7fcf1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:08.420 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.420+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_sources= new_sources= 2024-09-14T11:21:08.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.420+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential sources added=[] removed=[] 2024-09-14T11:21:08.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.420+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_dests= new_dests= 2024-09-14T11:21:08.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.420+0000 7fd03b52f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential dests added=[] removed=[] 2024-09-14T11:21:08.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.422+0000 7fceedfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:08.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.424+0000 7fd03b52f800 20 remove_watcher() i=0 2024-09-14T11:21:08.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.424+0000 7fd03b52f800 2 removed watcher, disabling cache 2024-09-14T11:21:08.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.426+0000 7fd03b52f800 20 remove_watcher() i=1 2024-09-14T11:21:08.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.427+0000 7fd03b52f800 20 remove_watcher() i=2 2024-09-14T11:21:08.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.428+0000 7fd03b52f800 20 remove_watcher() i=3 2024-09-14T11:21:08.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.429+0000 7fd03b52f800 20 remove_watcher() i=4 2024-09-14T11:21:08.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.430+0000 7fd03b52f800 20 remove_watcher() i=5 2024-09-14T11:21:08.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.431+0000 7fd03b52f800 20 remove_watcher() i=6 2024-09-14T11:21:08.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.432+0000 7fd03b52f800 20 remove_watcher() i=7 2024-09-14T11:21:08.444 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:21:08.474 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:08.474 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:08.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.516+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.518+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.518+0000 7fcc88940800 20 realm 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.518+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.519+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.519+0000 7fcc88940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.519+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.519+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.519+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.520+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:08.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.520+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.520+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:08.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.520+0000 7fcc88940800 20 searching for the correct realm 2024-09-14T11:21:08.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.523+0000 7fcc84ec8640 0 -- 172.21.15.29:0/192386924 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fcc7c083040 msgr2=0x7fcc7c068010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:08.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.729+0000 7fcc83ec6640 0 -- 172.21.15.29:0/192386924 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fcc7c0695a0 msgr2=0x7fcc7c08b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:08.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.936+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 zone default found 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 4 Realm: () 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:08.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 zonegroup default 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.937+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.938+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.938+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.938+0000 7fcc88940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.938+0000 7fcc88940800 20 started sync module instance, tier type = 2024-09-14T11:21:08.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.938+0000 7fcc88940800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=0 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=1 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=2 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=3 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=4 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=5 2024-09-14T11:21:08.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.948+0000 7fcc88940800 20 add_watcher() i=6 2024-09-14T11:21:08.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.949+0000 7fcc88940800 20 add_watcher() i=7 2024-09-14T11:21:08.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.949+0000 7fcc88940800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:08.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.951+0000 7fcb3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:08.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:08.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:08.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 5 note: GC not initialized 2024-09-14T11:21:08.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcb39fdb640 20 reqs_thread_entry: start 2024-09-14T11:21:08.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:08.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 20 Filter name: none 2024-09-14T11:21:08.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcaab7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:08.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.952+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.953+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:08.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.953+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.954+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:08.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.954+0000 7fcc88940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:08.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.954+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.954+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:08.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.954+0000 7fcc88940800 20 rados->read ofs=0 len=0 2024-09-14T11:21:08.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.955+0000 7fcc88940800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:08.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.955+0000 7fcc88940800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:08.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.957+0000 7fcb3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:08.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.959+0000 7fcc88940800 20 remove_watcher() i=0 2024-09-14T11:21:08.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.959+0000 7fcc88940800 2 removed watcher, disabling cache 2024-09-14T11:21:08.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.960+0000 7fcc88940800 20 remove_watcher() i=1 2024-09-14T11:21:08.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.961+0000 7fcc88940800 20 remove_watcher() i=2 2024-09-14T11:21:08.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.962+0000 7fcc88940800 20 remove_watcher() i=3 2024-09-14T11:21:08.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.964+0000 7fcc88940800 20 remove_watcher() i=4 2024-09-14T11:21:08.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.965+0000 7fcc88940800 20 remove_watcher() i=5 2024-09-14T11:21:08.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.966+0000 7fcc88940800 20 remove_watcher() i=6 2024-09-14T11:21:08.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:08.967+0000 7fcc88940800 20 remove_watcher() i=7 2024-09-14T11:21:08.978 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:08.978 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:08.978 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:08.978 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:09.072 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:09.105 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:09.105 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:09.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.347+0000 7f3cff30b640 0 --2- 172.21.15.29:0/2187452807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8004900 0x7f3bc8006d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:21:09.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.349+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 realm 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.351+0000 7f3cfe309640 0 -- 172.21.15.29:0/2187452807 >> [v2:172.21.15.73:6816/3705727448,v1:172.21.15.73:6817/3705727448] conn(0x5564813ce4c0 msgr2=0x5564813d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:09.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.553+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:09.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.553+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.554+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:09.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.554+0000 7f3d01020800 20 searching for the correct realm 2024-09-14T11:21:09.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.556+0000 7f3cff30b640 0 -- 172.21.15.29:0/2187452807 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x55648116da70 msgr2=0x7f3cf8047550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:09.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:09.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.769+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:09.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 zone default found 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 4 Realm: () 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 zonegroup default 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.770+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.771+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.771+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.771+0000 7f3d01020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.771+0000 7f3d01020800 20 started sync module instance, tier type = 2024-09-14T11:21:09.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.771+0000 7f3d01020800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=0 2024-09-14T11:21:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=1 2024-09-14T11:21:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=2 2024-09-14T11:21:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=3 2024-09-14T11:21:09.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=4 2024-09-14T11:21:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=5 2024-09-14T11:21:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.781+0000 7f3d01020800 20 add_watcher() i=6 2024-09-14T11:21:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.782+0000 7f3d01020800 20 add_watcher() i=7 2024-09-14T11:21:09.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.782+0000 7f3d01020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:09.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.784+0000 7f3bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:09.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.784+0000 7f3d01020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:09.782 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.784+0000 7f3d01020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:09.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.784+0000 7f3d01020800 5 note: GC not initialized 2024-09-14T11:21:09.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.784+0000 7f3b2ffff640 20 reqs_thread_entry: start 2024-09-14T11:21:09.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:09.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 20 Filter name: none 2024-09-14T11:21:09.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3b2dffb640 20 reqs_thread_entry: start 2024-09-14T11:21:09.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:21:09.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.785+0000 7f3d01020800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 : miss 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.786+0000 7f3d01020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 2024-09-14T11:21:09.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.791+0000 7f3d01020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.791+0000 7f3d01020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.791+0000 7f3d01020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.791+0000 7f3d01020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36, ofs0, ns] 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.792+0000 7f3be1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497061 cookie 93890153414384 notifier 7250 bl.length()=1007 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.792+0000 7f3be1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.792+0000 7f3be1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.792+0000 7f3be1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.793+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_sources= new_sources= 2024-09-14T11:21:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.794+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential sources added=[] removed=[] 2024-09-14T11:21:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.794+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_dests= new_dests= 2024-09-14T11:21:09.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.794+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential dests added=[] removed=[] 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.0 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.0 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.1 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.1 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.2 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.2 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.3 2024-09-14T11:21:09.798 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.3 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.4 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.4 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.5 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.5 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.6 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.6 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.7 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.7 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.8 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.8 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.9 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.9 2024-09-14T11:21:09.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.10 2024-09-14T11:21:09.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.10 2024-09-14T11:21:09.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.11 2024-09-14T11:21:09.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1.11 2024-09-14T11:21:09.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.0 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.800+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.801+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.2 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.801+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.3 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.802+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.4 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.803+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.5 2024-09-14T11:21:09.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.803+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.6 2024-09-14T11:21:09.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.804+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.7 2024-09-14T11:21:09.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.804+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.8 2024-09-14T11:21:09.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.805+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.9 2024-09-14T11:21:09.803 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.806+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.10 2024-09-14T11:21:09.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.809+0000 7f3d01020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:09.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.809+0000 7f3d01020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.810+0000 7f3d01020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.810+0000 7f3d01020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.810+0000 7f3d01020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.810+0000 7f3d01020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36, ofs0, ns] 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.811+0000 7f3be1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497062 cookie 93890153414384 notifier 7250 bl.length()=1007 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.811+0000 7f3be1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.811+0000 7f3be1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.809 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.811+0000 7f3be1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.812+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_sources= new_sources= 2024-09-14T11:21:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.812+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential sources added=[] removed=[] 2024-09-14T11:21:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.812+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_dests= new_dests= 2024-09-14T11:21:09.810 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.812+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential dests added=[] removed=[] 2024-09-14T11:21:09.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.815+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.0 2024-09-14T11:21:09.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.815+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.1 2024-09-14T11:21:09.813 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.815+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.2 2024-09-14T11:21:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.816+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.3 2024-09-14T11:21:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.816+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.4 2024-09-14T11:21:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.816+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.5 2024-09-14T11:21:09.814 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.816+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.6 2024-09-14T11:21:09.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.817+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.7 2024-09-14T11:21:09.815 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.817+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.8 2024-09-14T11:21:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.818+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.9 2024-09-14T11:21:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.818+0000 7f3d01020800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.36.10 2024-09-14T11:21:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.818+0000 7f3d01020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:09.816 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.818+0000 7f3d01020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3d01020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3d01020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3d01020800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3d01020800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36, ofs0, ns] 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3be1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497063 cookie 93890153414384 notifier 7250 bl.length()=975 2024-09-14T11:21:09.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3be1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 info.flags=0x17 2024-09-14T11:21:09.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3be1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.36 to cache LRU end 2024-09-14T11:21:09.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.820+0000 7f3be1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.822+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_sources= new_sources= 2024-09-14T11:21:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.822+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential sources added=[] removed=[] 2024-09-14T11:21:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.822+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): orig_dests= new_dests= 2024-09-14T11:21:09.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.822+0000 7f3d01020800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.36]): potential dests added=[] removed=[] 2024-09-14T11:21:09.822 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.824+0000 7f3d01020800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:09.824 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.826+0000 7f3bb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:09.826 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.828+0000 7f3d01020800 20 remove_watcher() i=0 2024-09-14T11:21:09.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.828+0000 7f3d01020800 2 removed watcher, disabling cache 2024-09-14T11:21:09.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.829+0000 7f3d01020800 20 remove_watcher() i=1 2024-09-14T11:21:09.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.831+0000 7f3d01020800 20 remove_watcher() i=2 2024-09-14T11:21:09.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.832+0000 7f3d01020800 20 remove_watcher() i=3 2024-09-14T11:21:09.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.833+0000 7f3d01020800 20 remove_watcher() i=4 2024-09-14T11:21:09.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.834+0000 7f3d01020800 20 remove_watcher() i=5 2024-09-14T11:21:09.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.835+0000 7f3d01020800 20 remove_watcher() i=6 2024-09-14T11:21:09.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.836+0000 7f3d01020800 20 remove_watcher() i=7 2024-09-14T11:21:09.847 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:21:09.876 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:09.876 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:09.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.917+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 realm 2024-09-14T11:21:09.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.917 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.919+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.920+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:09.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.920+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:09.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.921+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:09.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.921+0000 7f86dad1f800 20 searching for the correct realm 2024-09-14T11:21:09.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:09.923+0000 7f86d72a3640 0 -- 172.21.15.29:0/1574414921 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f86d0066040 msgr2=0x7f86d00aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:10.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.130+0000 7f86d62a1640 0 -- 172.21.15.29:0/1574414921 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f86d006f660 msgr2=0x7f86d00a6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:10.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.337+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 zone default found 2024-09-14T11:21:10.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 4 Realm: () 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 zonegroup default 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.338+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.339+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.339+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.339+0000 7f86dad1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.339+0000 7f86dad1f800 20 started sync module instance, tier type = 2024-09-14T11:21:10.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.339+0000 7f86dad1f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:10.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=0 2024-09-14T11:21:10.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=1 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=2 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=3 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=4 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=5 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.349+0000 7f86dad1f800 20 add_watcher() i=6 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.350+0000 7f86dad1f800 20 add_watcher() i=7 2024-09-14T11:21:10.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.350+0000 7f86dad1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:10.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.351+0000 7f858d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 5 note: GC not initialized 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f8507fff640 20 reqs_thread_entry: start 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 20 Filter name: none 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f8505ffb640 20 reqs_thread_entry: start 2024-09-14T11:21:10.351 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.352+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.353+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:10.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.353+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.354+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:10.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.354+0000 7f86dad1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.354+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.354+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.354+0000 7f86dad1f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.355+0000 7f86dad1f800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:10.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.355+0000 7f86dad1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:10.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.357+0000 7f858d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:10.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.359+0000 7f86dad1f800 20 remove_watcher() i=0 2024-09-14T11:21:10.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.359+0000 7f86dad1f800 2 removed watcher, disabling cache 2024-09-14T11:21:10.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.360+0000 7f86dad1f800 20 remove_watcher() i=1 2024-09-14T11:21:10.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.362+0000 7f86dad1f800 20 remove_watcher() i=2 2024-09-14T11:21:10.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.363+0000 7f86dad1f800 20 remove_watcher() i=3 2024-09-14T11:21:10.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.364+0000 7f86dad1f800 20 remove_watcher() i=4 2024-09-14T11:21:10.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.365+0000 7f86dad1f800 20 remove_watcher() i=5 2024-09-14T11:21:10.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.366+0000 7f86dad1f800 20 remove_watcher() i=6 2024-09-14T11:21:10.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:10.367+0000 7f86dad1f800 20 remove_watcher() i=7 2024-09-14T11:21:10.377 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:10.377 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:10.377 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:21:10.377 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:10.764 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:21:10.764 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:11.635 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:21:11.664 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:11.664 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:11.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.709+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 realm 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:11.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.711+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.712+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:11.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.712+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.713+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:11.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.713+0000 7f0194ba9800 20 searching for the correct realm 2024-09-14T11:21:11.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.713+0000 7f0192693640 0 -- 172.21.15.29:0/1059339700 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x5621669027a0 msgr2=0x562166904c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:11.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.918+0000 7f0192693640 0 -- 172.21.15.29:0/1059339700 >> [v2:172.21.15.29:6800/277470273,v1:172.21.15.29:6801/277470273] conn(0x5621668f5f10 msgr2=0x5621668f83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:11.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.926+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 zone default found 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 4 Realm: () 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 zonegroup default 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.927+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.928+0000 7f0194ba9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:11.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.928+0000 7f0194ba9800 20 started sync module instance, tier type = 2024-09-14T11:21:11.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.928+0000 7f0194ba9800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=0 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=1 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=2 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=3 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=4 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=5 2024-09-14T11:21:11.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.937+0000 7f0194ba9800 20 add_watcher() i=6 2024-09-14T11:21:11.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.938+0000 7f0194ba9800 20 add_watcher() i=7 2024-09-14T11:21:11.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.938+0000 7f0194ba9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:11.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.939+0000 7f0048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:11.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:11.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:11.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 5 note: GC not initialized 2024-09-14T11:21:11.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7effc37fe640 20 reqs_thread_entry: start 2024-09-14T11:21:11.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:11.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 20 Filter name: none 2024-09-14T11:21:11.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7effc17fa640 20 reqs_thread_entry: start 2024-09-14T11:21:11.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.940+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.941+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.941+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.941+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.941+0000 7f0194ba9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.941+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.942+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:11.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.942+0000 7f0194ba9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:11.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.942+0000 7f0194ba9800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:11.941 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.942+0000 7f0194ba9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:11.942 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.944+0000 7f0048fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:11.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.946+0000 7f0194ba9800 20 remove_watcher() i=0 2024-09-14T11:21:11.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.946+0000 7f0194ba9800 2 removed watcher, disabling cache 2024-09-14T11:21:11.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.948+0000 7f0194ba9800 20 remove_watcher() i=1 2024-09-14T11:21:11.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.949+0000 7f0194ba9800 20 remove_watcher() i=2 2024-09-14T11:21:11.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.950+0000 7f0194ba9800 20 remove_watcher() i=3 2024-09-14T11:21:11.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.951+0000 7f0194ba9800 20 remove_watcher() i=4 2024-09-14T11:21:11.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.952+0000 7f0194ba9800 20 remove_watcher() i=5 2024-09-14T11:21:11.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.953+0000 7f0194ba9800 20 remove_watcher() i=6 2024-09-14T11:21:11.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:11.954+0000 7f0194ba9800 20 remove_watcher() i=7 2024-09-14T11:21:11.963 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:11.963 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:11.963 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:11.963 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:11.965 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:21:12.000 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:12.000 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:12.040 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.041+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 realm 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.044+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.044+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.045+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:12.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.045+0000 7fd626126800 20 searching for the correct realm 2024-09-14T11:21:12.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.046+0000 7fd6215d8640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fd614047d10 msgr2=0x7fd61403d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.050+0000 7fd6225da640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55862a8eae00 msgr2=0x55862a8ed1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:12.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 zone default found 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 4 Realm: () 2024-09-14T11:21:12.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 zonegroup default 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.057+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.057+0000 7fd626126800 20 started sync module instance, tier type = 2024-09-14T11:21:12.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.057+0000 7fd626126800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:12.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=0 2024-09-14T11:21:12.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=1 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=2 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=3 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=4 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=5 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=6 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.066+0000 7fd626126800 20 add_watcher() i=7 2024-09-14T11:21:12.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.066+0000 7fd626126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:12.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd4d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd626126800 5 note: GC not initialized 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd4d2ffd640 20 reqs_thread_entry: start 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd626126800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd626126800 20 Filter name: none 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.068+0000 7fd4d0ff9640 20 reqs_thread_entry: start 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:21:12.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : miss 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:12.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.070+0000 7fd626126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:12.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd626126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd626126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:12.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94034728015520 notifier 7695 bl.length()=1007 2024-09-14T11:21:12.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:12.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:12.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:12.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:12.077 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd626126800 time 2024-09-14T11:21:12.080696+0000 2024-09-14T11:21:12.078 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:12.078 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd62778c76a] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.080+0000 7fd626126800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd626126800 time 2024-09-14T11:21:12.080696+0000 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:12.079 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd62778c76a] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:21:12.080 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fd626126800 thread_name:radosgw-admin 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd62643e6f0] 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd62648b99c] 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd62778c7c4] 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.097 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.081+0000 7fd626126800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fd626126800 thread_name:radosgw-admin 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd62643e6f0] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd62648b99c] 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:12.098 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd62778c7c4] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:21:12.023+0000 7fd50fe07640 10 monclient: dump: 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.099 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:21:12.024+0000 7fd626126800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:21:12.024+0000 7fd626126800 4 set_mon_vals no callback set 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: shutdown 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:21:12.024+0000 7fd626126800 5 asok(0x55862a5d5270) unregister_commands rotate-key 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:21:12.024+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.100 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.101 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.102 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: starting msgr at 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: starting objecter 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:21:12.025+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests hook 0x55862a7f8e20 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: setting wanted keys 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: calling monclient init 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.103 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:21:12.025+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key hook 0x55862a7f56d8 2024-09-14T11:21:12.104 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a6ad7e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a738650 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a73eef0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.660846s 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a6ad7e0 auth_method 0 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a738650 auth_method 0 2024-09-14T11:21:12.105 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a73eef0 auth_method 0 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.106 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:21:12.026+0000 7fd621dd9640 1 monclient: found mon.noname-c 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: dump: 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.107 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: dump: 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.108 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:21:12.026+0000 7fd626126800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:21:12.026+0000 7fd50fe07640 4 set_mon_vals no callback set 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:21:12.026+0000 7fd626126800 1 librados: init done 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.109 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:21:12.028+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd508077230 auth_method 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:21:12.029+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a83e000 auth_method 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:21:12.029+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8411e0 auth_method 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:21:12.030+0000 7fd6215d8640 10 monclient: get_auth_request con 0x55862a8453d0 auth_method 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:21:12.031+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a844a60 auth_method 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:21:12.032+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.110 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.111 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:21:12.032+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:21:12.032+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests cmddesc objecter_requests hook 0x55862a850990 EEXIST 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.112 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:21:12.032+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:21:12.033+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:21:12.033+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x55862a84c3f0 EEXIST 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.113 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a874cb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a875090 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8739c0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.668184s 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a874cb0 auth_method 0 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8739c0 auth_method 0 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.114 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a875090 auth_method 0 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-14T11:21:12.115 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:21:12.033+0000 7fd621dd9640 1 monclient: found mon.noname-c 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: dump: 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.116 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:21:12.033+0000 7fd626126800 5 monclient: authenticate success, global_id 7289 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: dump: 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.117 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:21:12.033+0000 7fd622ddb640 4 set_mon_vals no callback set 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:21:12.034+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:21:12.034+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: get_monmap_and_config 2024-09-14T11:21:12.118 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:21:12.035+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.119 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:21:12.035+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd4fc077140 auth_method 0 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.120 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.121 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:21:12.036+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x7ffe11d8eef8 EEXIST 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a8c9270 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a8c32d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8c4cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.671869s 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a8c9270 auth_method 0 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8c4cb0 auth_method 0 2024-09-14T11:21:12.122 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a8c32d0 auth_method 0 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_done global_id 7692 payload 274 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:21:12.037+0000 7fd6215d8640 1 monclient: found mon.noname-a 2024-09-14T11:21:12.123 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: dump: 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.124 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:21:12.037+0000 7fd626126800 5 monclient: authenticate success, global_id 7692 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: dump: 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.125 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:21:12.037+0000 7fd626126800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:21:12.037+0000 7fd626126800 4 set_mon_vals no callback set 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: shutdown 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:21:12.038+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.126 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.127 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:21:12.038+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: starting msgr at 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: starting objecter 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:21:12.038+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests cmddesc objecter_requests hook 0x55862a87a5a0 EEXIST 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: setting wanted keys 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: calling monclient init 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.128 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:21:12.039+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:21:12.039+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:21:12.039+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x55862a8896b8 EEXIST 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.129 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a8c32d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a8c4cb0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8c9270 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.674341s 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a8c32d0 auth_method 0 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8c9270 auth_method 0 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.130 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:21:12.039+0000 7fd6215d8640 1 monclient: found mon.noname-a 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:21:12.039+0000 7fd4f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: dump: 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.131 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: dump: 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.132 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:21:12.040+0000 7fd626126800 5 monclient: authenticate success, global_id 7695 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:21:12.040+0000 7fd5057fa640 4 set_mon_vals no callback set 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.133 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:21:12.040+0000 7fd626126800 1 librados: init done 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:21:12.040+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cr dump hook 0x55862a8c25f8 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:21:12.041+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:21:12.042+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd4ec077260 auth_method 0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:21:12.043+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8e33a0 auth_method 0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:21:12.043+0000 7fd626126800 20 realm 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.134 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:21:12.043+0000 7fd626126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:21:12.044+0000 7fd6215d8640 10 monclient: get_auth_request con 0x55862a8e75c0 auth_method 0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:21:12.044+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:21:12.044+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:21:12.044+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a8eae00 auth_method 0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:21:12.045+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:21:12.045+0000 7fd626126800 20 searching for the correct realm 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:21:12.045+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8efba0 auth_method 0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:21:12.046+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd614047d10 auth_method 0 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:21:12.046+0000 7fd6215d8640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fd614047d10 msgr2=0x7fd61403d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 1 client.7695.objecter ms_handle_reset 0x7fd614047d10 session 0x7fd614076f60 osd.7 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 10 monclient: _renew_subs 2024-09-14T11:21:12.135 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:21:12.046+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd4ec087890 auth_method 0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:21:12.047+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd61c02fbe0 auth_method 0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:21:12.049+0000 7fd621dd9640 10 monclient: get_auth_request con 0x7fd61c039950 auth_method 0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:21:12.050+0000 7fd6225da640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55862a8eae00 msgr2=0x55862a8ed1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:21:12.050+0000 7fd4f37fe640 1 client.7695.objecter ms_handle_reset 0x55862a8eae00 session 0x55862a8e6910 osd.2 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:21:12.050+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd614047d10 auth_method 0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:21:12.051+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd61c04d940 auth_method 0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.136 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:21:12.056+0000 7fd626126800 20 zone default found 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:21:12.056+0000 7fd626126800 4 Realm: () 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:21:12.056+0000 7fd626126800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:21:12.056+0000 7fd626126800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:21:12.056+0000 7fd626126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:21:12.056+0000 7fd626126800 20 zonegroup default 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.137 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:21:12.057+0000 7fd626126800 20 started sync module instance, tier type = 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:21:12.057+0000 7fd626126800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=0 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=1 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=2 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=3 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=4 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=5 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=6 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:21:12.066+0000 7fd626126800 20 add_watcher() i=7 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:21:12.066+0000 7fd626126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.138 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:21:12.068+0000 7fd4d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:21:12.068+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:12.139 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache list hook 0x55862a8c25a0 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache inspect hook 0x55862a8c25a0 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache erase hook 0x55862a8c25a0 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache zap hook 0x55862a8c25a0 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:21:12.068+0000 7fd626126800 5 note: GC not initialized 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:21:12.068+0000 7fd4d2ffd640 20 reqs_thread_entry: start 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace show hook 0x7fd610002090 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace history hook 0x7fd610002090 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace active hook 0x7fd610002090 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace active_short hook 0x7fd610002090 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:21:12.068+0000 7fd626126800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:21:12.068+0000 7fd626126800 20 Filter name: none 2024-09-14T11:21:12.140 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:21:12.068+0000 7fd4d0ff9640 20 reqs_thread_entry: start 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:21:12.069+0000 7fd626126800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : miss 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:21:12.070+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:21:12.070+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:21:12.070+0000 7fd626126800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:21:12.070+0000 7fd626126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:21:12.074+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.141 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:21:12.074+0000 7fd626126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:21:12.074+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:21:12.074+0000 7fd626126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94034728015520 notifier 7695 bl.length()=1007 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:21:12.080+0000 7fd626126800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd626126800 time 2024-09-14T11:21:12.080696+0000 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.142 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd62778c76a] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:21:12.081+0000 7fd626126800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fd626126800 thread_name:radosgw-admin 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd62643e6f0] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd62648b99c] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd62778c7c4] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:12.144 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:21:12.145 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:21:12.146 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:21:12.147 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:21:12.148 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:12.149 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:12.150 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d0ff9640 / http_manager 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d2ffd640 / http_manager 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d3fff640 / rgw_dt_lg_renew 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4f37fe640 / ms_dispatch 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd5057fa640 / io_context_pool 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd5077fe640 / ms_dispatch 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd50e604640 / ms_dispatch 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd50fe07640 / io_context_pool 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd6215d8640 / msgr-worker-2 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd621dd9640 / msgr-worker-1 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd6225da640 / msgr-worker-0 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd622ddb640 / io_context_pool 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd626126800 / radosgw-admin 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:21:12.151 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.134566.log 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:21:12.023+0000 7fd50fe07640 10 monclient: dump: 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.152 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:21:12.024+0000 7fd626126800 5 monclient: authenticate success, global_id 7683 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:21:12.024+0000 7fd626126800 4 set_mon_vals no callback set 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: shutdown 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:21:12.024+0000 7fd626126800 5 asok(0x55862a5d5270) unregister_commands rotate-key 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:21:12.024+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:21:12.024+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.153 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding auth protocol: cephx 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.154 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: crc 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:21:12.024+0000 7fd626126800 5 AuthRegistry(0x55862a7fb1a0) adding con mode: secure 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: starting msgr at 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: starting objecter 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:21:12.025+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests hook 0x55862a7f8e20 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: setting wanted keys 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:21:12.025+0000 7fd626126800 1 librados: calling monclient init 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding auth protocol: cephx 2024-09-14T11:21:12.155 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: crc 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:21:12.025+0000 7fd626126800 5 AuthRegistry(0x55862a7f5590) adding con mode: secure 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:21:12.025+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.156 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:21:12.025+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key hook 0x55862a7f56d8 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a6ad7e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a738650 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a73eef0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:21:12.025+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.660846s 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a6ad7e0 auth_method 0 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:21:12.025+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.157 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a738650 auth_method 0 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:21:12.025+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:21:12.026+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a73eef0 auth_method 0 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.158 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:21:12.026+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient(hunting): handle_auth_done global_id 7286 payload 824 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:21:12.026+0000 7fd621dd9640 1 monclient: found mon.noname-c 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:21:12.026+0000 7fd621dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: dump: 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.159 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:21:12.026+0000 7fd50e604640 10 monclient: dump: 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.160 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:21:12.026+0000 7fd626126800 5 monclient: authenticate success, global_id 7286 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:21:12.026+0000 7fd50fe07640 4 set_mon_vals no callback set 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:21:12.026+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:21:12.026+0000 7fd626126800 1 librados: init done 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:21:12.028+0000 7fd50e604640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:21:12.028+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd508077230 auth_method 0 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:21:12.029+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a83e000 auth_method 0 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:21:12.029+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8411e0 auth_method 0 2024-09-14T11:21:12.161 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:21:12.030+0000 7fd6215d8640 10 monclient: get_auth_request con 0x55862a8453d0 auth_method 0 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:21:12.031+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a844a60 auth_method 0 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:21:12.032+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.162 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding auth protocol: cephx 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: crc 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84d4a0) adding con mode: secure 2024-09-14T11:21:12.163 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:21:12.032+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:21:12.032+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests cmddesc objecter_requests hook 0x55862a850990 EEXIST 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:21:12.032+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding auth protocol: cephx 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.164 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: crc 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:21:12.032+0000 7fd626126800 5 AuthRegistry(0x55862a84c2a8) adding con mode: secure 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:21:12.032+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:21:12.033+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:21:12.033+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x55862a84c3f0 EEXIST 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a874cb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a875090 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8739c0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.165 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.668184s 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a874cb0 auth_method 0 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8739c0 auth_method 0 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:21:12.033+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.166 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a875090 auth_method 0 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:21:12.033+0000 7fd6225da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient(hunting): handle_auth_done global_id 7289 payload 824 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:21:12.033+0000 7fd621dd9640 1 monclient: found mon.noname-c 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:21:12.033+0000 7fd621dd9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: dump: 2024-09-14T11:21:12.167 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:21:12.033+0000 7fd626126800 5 monclient: authenticate success, global_id 7289 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:21:12.033+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.168 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:21:12.033+0000 7fd5077fe640 10 monclient: dump: 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:21:12.033+0000 7fd622ddb640 4 set_mon_vals no callback set 2024-09-14T11:21:12.169 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:21:12.034+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:21:12.034+0000 7fd626126800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:21:12.035+0000 7fd5077fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: get_monmap_and_config 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:21:12.035+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:21:12.035+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.170 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding auth protocol: cephx 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.171 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: crc 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:21:12.035+0000 7fd626126800 5 AuthRegistry(0x55862a894bd0) adding con mode: secure 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:21:12.035+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd4fc077140 auth_method 0 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding auth protocol: cephx 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.172 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: crc 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:21:12.036+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8edb0) adding con mode: secure 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:21:12.036+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:21:12.036+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x7ffe11d8eef8 EEXIST 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.173 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a8c9270 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a8c32d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8c4cb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:21:12.036+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.671869s 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a8c9270 auth_method 0 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:21:12.036+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8c4cb0 auth_method 0 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.174 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:21:12.037+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): get_auth_request con 0x55862a8c32d0 auth_method 0 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:21:12.037+0000 7fd6225da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient(hunting): handle_auth_done global_id 7692 payload 274 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:21:12.037+0000 7fd6215d8640 1 monclient: found mon.noname-a 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:21:12.037+0000 7fd6215d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:12.175 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: dump: 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:21:12.037+0000 7fd626126800 5 monclient: authenticate success, global_id 7692 2024-09-14T11:21:12.176 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:21:12.037+0000 7fd5057fa640 10 monclient: dump: 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:21:12.037+0000 7fd626126800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:12.177 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:21:12.037+0000 7fd626126800 4 set_mon_vals no callback set 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: shutdown 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: build_initial_monmap 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:21:12.038+0000 7fd626126800 1 build_initial for_mkfs: 0 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: monmap: 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.178 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding auth protocol: cephx 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: crc 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a899a00) adding con mode: secure 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:21:12.038+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.179 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: starting msgr at 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: starting objecter 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:21:12.038+0000 7fd626126800 5 asok(0x55862a5d5270) register_command objecter_requests cmddesc objecter_requests hook 0x55862a87a5a0 EEXIST 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: setting wanted keys 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:21:12.038+0000 7fd626126800 1 librados: calling monclient init 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:21:12.038+0000 7fd626126800 10 monclient: init 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding auth protocol: cephx 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.180 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: crc 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:21:12.038+0000 7fd626126800 5 AuthRegistry(0x55862a889570) adding con mode: secure 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:21:12.039+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:21:12.039+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:21:12.039+0000 7fd626126800 5 asok(0x55862a5d5270) register_command rotate-key cmddesc rotate-key hook 0x55862a8896b8 EEXIST 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-a con 0x55862a8c32d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-b con 0x55862a8c4cb0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): picked mon.noname-c con 0x55862a8c9270 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.181 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:21:12.039+0000 7fd626126800 10 monclient(hunting): authenticate will time out at 2275.674341s 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): get_auth_request con 0x55862a8c32d0 auth_method 0 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): get_auth_request con 0x55862a8c9270 auth_method 0 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:12.182 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:21:12.039+0000 7fd621dd9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient(hunting): handle_auth_done global_id 7695 payload 824 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient: _finish_hunting 0 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:21:12.039+0000 7fd6215d8640 1 monclient: found mon.noname-a 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:21:12.039+0000 7fd6215d8640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:21:12.039+0000 7fd4f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: dump: 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.183 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: _finish_auth 0 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: _check_auth_tickets 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:21:12.040+0000 7fd4f37fe640 10 monclient: dump: 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:12.184 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:21:12.040+0000 7fd626126800 5 monclient: authenticate success, global_id 7695 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:21:12.040+0000 7fd5057fa640 4 set_mon_vals no callback set 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _renew_subs 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:21:12.040+0000 7fd626126800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:21:12.040+0000 7fd626126800 1 librados: init done 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:21:12.040+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cr dump hook 0x55862a8c25f8 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:21:12.041+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.185 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:21:12.042+0000 7fd4f37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:21:12.042+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd4ec077260 auth_method 0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:21:12.043+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8e33a0 auth_method 0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:21:12.043+0000 7fd626126800 20 realm 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:21:12.043+0000 7fd626126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:21:12.043+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:21:12.044+0000 7fd6215d8640 10 monclient: get_auth_request con 0x55862a8e75c0 auth_method 0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:21:12.044+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:21:12.044+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:21:12.044+0000 7fd6225da640 10 monclient: get_auth_request con 0x55862a8eae00 auth_method 0 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:21:12.045+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:21:12.045+0000 7fd626126800 20 searching for the correct realm 2024-09-14T11:21:12.186 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:21:12.045+0000 7fd621dd9640 10 monclient: get_auth_request con 0x55862a8efba0 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:21:12.046+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd614047d10 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:21:12.046+0000 7fd6215d8640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fd614047d10 msgr2=0x7fd61403d5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 1 client.7695.objecter ms_handle_reset 0x7fd614047d10 session 0x7fd614076f60 osd.7 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 10 monclient: _renew_subs 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:21:12.046+0000 7fd4f37fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:21:12.046+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd4ec087890 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:21:12.047+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd61c02fbe0 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:21:12.049+0000 7fd621dd9640 10 monclient: get_auth_request con 0x7fd61c039950 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:21:12.050+0000 7fd6225da640 0 -- 172.21.15.29:0/4053799862 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55862a8eae00 msgr2=0x55862a8ed1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:21:12.050+0000 7fd4f37fe640 1 client.7695.objecter ms_handle_reset 0x55862a8eae00 session 0x55862a8e6910 osd.2 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:21:12.050+0000 7fd6225da640 10 monclient: get_auth_request con 0x7fd614047d10 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:21:12.051+0000 7fd6215d8640 10 monclient: get_auth_request con 0x7fd61c04d940 auth_method 0 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:12.187 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:21:12.055+0000 7fd626126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:21:12.055+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:21:12.056+0000 7fd626126800 20 zone default found 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:21:12.056+0000 7fd626126800 4 Realm: () 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:21:12.056+0000 7fd626126800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:21:12.056+0000 7fd626126800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:21:12.056+0000 7fd626126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:21:12.056+0000 7fd626126800 20 zonegroup default 2024-09-14T11:21:12.188 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:21:12.056+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:21:12.057+0000 7fd626126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:21:12.057+0000 7fd626126800 20 started sync module instance, tier type = 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:21:12.057+0000 7fd626126800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=0 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=1 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=2 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=3 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=4 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=5 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:21:12.065+0000 7fd626126800 20 add_watcher() i=6 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:21:12.066+0000 7fd626126800 20 add_watcher() i=7 2024-09-14T11:21:12.189 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:21:12.066+0000 7fd626126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding auth protocol: cephx 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:21:12.068+0000 7fd4d3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: crc 2024-09-14T11:21:12.190 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:21:12.068+0000 7fd626126800 5 AuthRegistry(0x7ffe11d8f290) adding con mode: secure 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:21:12.068+0000 7fd626126800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:21:12.068+0000 7fd626126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache list hook 0x55862a8c25a0 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache inspect hook 0x55862a8c25a0 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache erase hook 0x55862a8c25a0 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command cache zap hook 0x55862a8c25a0 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:21:12.068+0000 7fd626126800 5 note: GC not initialized 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:21:12.068+0000 7fd4d2ffd640 20 reqs_thread_entry: start 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace show hook 0x7fd610002090 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace history hook 0x7fd610002090 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace active hook 0x7fd610002090 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:21:12.068+0000 7fd626126800 5 asok(0x55862a5d5270) register_command sync trace active_short hook 0x7fd610002090 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:21:12.068+0000 7fd626126800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:21:12.068+0000 7fd626126800 20 Filter name: none 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:21:12.068+0000 7fd4d0ff9640 20 reqs_thread_entry: start 2024-09-14T11:21:12.191 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:21:12.069+0000 7fd626126800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:21:12.069+0000 7fd626126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : miss 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:21:12.069+0000 7fd626126800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:21:12.070+0000 7fd626126800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:21:12.070+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:21:12.070+0000 7fd626126800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:21:12.070+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:21:12.070+0000 7fd626126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:21:12.074+0000 7fd626126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.192 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:21:12.074+0000 7fd626126800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:21:12.074+0000 7fd626126800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:21:12.074+0000 7fd626126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497067 cookie 94034728015520 notifier 7695 bl.length()=1007 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:21:12.074+0000 7fd5057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:21:12.076+0000 7fd626126800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:21:12.080+0000 7fd626126800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd626126800 time 2024-09-14T11:21:12.080696+0000 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:12.193 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fd62778c76a] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.194 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:21:12.081+0000 7fd626126800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fd626126800 thread_name:radosgw-admin 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fd62643e6f0] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fd62648b99c] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fd62778c7c4] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fd62778c928] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558627efc0b1] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x55862841007c] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x558627f0befd] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fd626429590] 2024-09-14T11:21:12.195 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:12.196 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:21:12.197 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:12.198 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:21:12.199 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:21:12.200 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:21:12.201 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d0ff9640 / http_manager 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d2ffd640 / http_manager 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4d3fff640 / rgw_dt_lg_renew 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd4f37fe640 / ms_dispatch 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd5057fa640 / io_context_pool 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd5077fe640 / ms_dispatch 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd50e604640 / ms_dispatch 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd50fe07640 / io_context_pool 2024-09-14T11:21:12.202 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd6215d8640 / msgr-worker-2 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd621dd9640 / msgr-worker-1 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd6225da640 / msgr-worker-0 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd622ddb640 / io_context_pool 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: 7fd626126800 / radosgw-admin 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:21:12.082410Z_069d8208-ba59-4dec-bc74-2f60ae4339e7/log 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:21:12.203 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.161+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 realm 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.163+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.164+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.164+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.164+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.164+0000 7f573e814800 20 searching for the correct realm 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.165+0000 7f5739fe0640 0 -- 172.21.15.29:0/1857132742 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x560b5bbbde30 msgr2=0x560b5bbc02d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.168+0000 7f5739fe0640 0 -- 172.21.15.29:0/1857132742 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x560b5b96e980 msgr2=0x7f5734068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:12.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.376+0000 7f573e814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:12.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 zone default found 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 4 Realm: () 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 zonegroup default 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.377+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 started sync module instance, tier type = 2024-09-14T11:21:12.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.378+0000 7f573e814800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=0 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=1 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=2 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=3 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=4 2024-09-14T11:21:12.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=5 2024-09-14T11:21:12.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.387+0000 7f573e814800 20 add_watcher() i=6 2024-09-14T11:21:12.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.388+0000 7f573e814800 20 add_watcher() i=7 2024-09-14T11:21:12.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.388+0000 7f573e814800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:12.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.390+0000 7f55eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:12.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.390+0000 7f573e814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:12.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.390+0000 7f573e814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:12.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f573e814800 5 note: GC not initialized 2024-09-14T11:21:12.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f55ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:12.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f573e814800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:12.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f573e814800 20 Filter name: none 2024-09-14T11:21:12.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f555bfff640 20 reqs_thread_entry: start 2024-09-14T11:21:12.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.391+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.392+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.392+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.392+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.392+0000 7f573e814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.392+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.393+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.393+0000 7f573e814800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.393+0000 7f573e814800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:21:12.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.393+0000 7f573e814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:12.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.395+0000 7f55eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:12.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.397+0000 7f573e814800 20 remove_watcher() i=0 2024-09-14T11:21:12.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.397+0000 7f573e814800 2 removed watcher, disabling cache 2024-09-14T11:21:12.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.398+0000 7f573e814800 20 remove_watcher() i=1 2024-09-14T11:21:12.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.399+0000 7f573e814800 20 remove_watcher() i=2 2024-09-14T11:21:12.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.400+0000 7f573e814800 20 remove_watcher() i=3 2024-09-14T11:21:12.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.401+0000 7f573e814800 20 remove_watcher() i=4 2024-09-14T11:21:12.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.402+0000 7f573e814800 20 remove_watcher() i=5 2024-09-14T11:21:12.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.403+0000 7f573e814800 20 remove_watcher() i=6 2024-09-14T11:21:12.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.404+0000 7f573e814800 20 remove_watcher() i=7 2024-09-14T11:21:12.413 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.413 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:12.414 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:12.414 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:12.506 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:12.539 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:12.539 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:12.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.581+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 20 realm 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.582+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.583+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.581 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.583+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.583+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.583+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.584+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:12.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.584+0000 7f46fbb2e800 20 searching for the correct realm 2024-09-14T11:21:12.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.586+0000 7f46f7f65640 0 -- 172.21.15.29:0/298292433 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f46f0061040 msgr2=0x7f46f008ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:12.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.791+0000 7f46f6f63640 0 -- 172.21.15.29:0/298292433 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f46f008b910 msgr2=0x7f46f009d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:12.996 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.998+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:12.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:12.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 zone default found 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 4 Realm: () 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 zonegroup default 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:12.999+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.000+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.000+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.000+0000 7f46fbb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.000+0000 7f46fbb2e800 20 started sync module instance, tier type = 2024-09-14T11:21:12.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.000+0000 7f46fbb2e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=0 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=1 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=2 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=3 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=4 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=5 2024-09-14T11:21:13.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.010+0000 7f46fbb2e800 20 add_watcher() i=6 2024-09-14T11:21:13.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.011+0000 7f46fbb2e800 20 add_watcher() i=7 2024-09-14T11:21:13.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.011+0000 7f46fbb2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:13.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.013+0000 7f45adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:13.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.013+0000 7f46fbb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:13.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.013+0000 7f46fbb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:13.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.013+0000 7f46fbb2e800 5 note: GC not initialized 2024-09-14T11:21:13.012 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f45acfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f46fbb2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f46fbb2e800 20 Filter name: none 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f45267fc640 20 reqs_thread_entry: start 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f46fbb2e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.014+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:21:13.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : miss 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.015+0000 7f46fbb2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.016+0000 7f46fbb2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.016+0000 7f46fbb2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.016+0000 7f46fbb2e800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:13.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.016+0000 7f46fbb2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:13.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.017+0000 7f46fbb2e800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to be held by another RGW process; skipping for now 2024-09-14T11:21:13.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.018+0000 7f45adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:13.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.019+0000 7f46fbb2e800 20 remove_watcher() i=0 2024-09-14T11:21:13.018 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.019+0000 7f46fbb2e800 2 removed watcher, disabling cache 2024-09-14T11:21:13.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.020+0000 7f46fbb2e800 20 remove_watcher() i=1 2024-09-14T11:21:13.020 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.022+0000 7f46fbb2e800 20 remove_watcher() i=2 2024-09-14T11:21:13.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.023+0000 7f46fbb2e800 20 remove_watcher() i=3 2024-09-14T11:21:13.022 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.024+0000 7f46fbb2e800 20 remove_watcher() i=4 2024-09-14T11:21:13.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.025+0000 7f46fbb2e800 20 remove_watcher() i=5 2024-09-14T11:21:13.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.026+0000 7f46fbb2e800 20 remove_watcher() i=6 2024-09-14T11:21:13.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:13.027+0000 7f46fbb2e800 20 remove_watcher() i=7 2024-09-14T11:21:13.037 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:21:43.068 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:43.105 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:43.105 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:43.150 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.151+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.152 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 realm 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.153 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.153+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.154+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:43.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.154+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.155+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:43.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.155+0000 7fec0b840800 20 searching for the correct realm 2024-09-14T11:21:43.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.158+0000 7fec09b2b640 0 -- 172.21.15.29:0/2342817277 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fec0403d040 msgr2=0x7fec04022420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:43.363 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.364+0000 7fec08b29640 0 -- 172.21.15.29:0/2342817277 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fec04018040 msgr2=0x7fec0402b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:43.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:43.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:43.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:43.572 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.572+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:43.573 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 zone default found 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 4 Realm: () 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 zonegroup default 2024-09-14T11:21:43.574 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.573+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.574+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.574+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.574+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.574+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.574+0000 7fec0b840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.575+0000 7fec0b840800 20 started sync module instance, tier type = 2024-09-14T11:21:43.575 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.575+0000 7fec0b840800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=0 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=1 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=2 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=3 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=4 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=5 2024-09-14T11:21:43.585 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.586+0000 7fec0b840800 20 add_watcher() i=6 2024-09-14T11:21:43.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.587+0000 7fec0b840800 20 add_watcher() i=7 2024-09-14T11:21:43.586 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.587+0000 7fec0b840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:43.588 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.589+0000 7feabffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.589+0000 7fec0b840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.589+0000 7fec0b840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.589+0000 7fec0b840800 5 note: GC not initialized 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.589+0000 7feabefe5640 20 reqs_thread_entry: start 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.590+0000 7fec0b840800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.590+0000 7fec0b840800 20 Filter name: none 2024-09-14T11:21:43.589 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.590+0000 7feabcfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:43.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.590+0000 7fec0b840800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:21:43.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.590+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:43.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:21:43.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : miss 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 20 rados_obj.operate() r=0 bl.length=471 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.591+0000 7fec0b840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:43.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.593+0000 7fec0b840800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.600+0000 7fec0b840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.600+0000 7fec0b840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.600+0000 7fec0b840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.600+0000 7fec0b840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.601+0000 7feaecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497068 cookie 94290467759856 notifier 7340 bl.length()=1007 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.601+0000 7feaecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.601+0000 7feaecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.601+0000 7feaecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.603+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:43.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.603+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:43.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.603+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:43.602 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.603+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.0 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.0 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.1 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.1 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.2 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.2 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.3 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.3 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.4 2024-09-14T11:21:43.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.4 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.5 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.5 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.6 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.6 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.7 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.7 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.8 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.8 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.9 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.9 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.10 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.10 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.11 2024-09-14T11:21:43.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2.11 2024-09-14T11:21:43.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.608+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.0 2024-09-14T11:21:43.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.609+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.1 2024-09-14T11:21:43.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.609+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2 2024-09-14T11:21:43.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.610+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.3 2024-09-14T11:21:43.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.610+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.4 2024-09-14T11:21:43.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.611+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.5 2024-09-14T11:21:43.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.612+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.6 2024-09-14T11:21:43.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.612+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.7 2024-09-14T11:21:43.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.613+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.8 2024-09-14T11:21:43.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.613+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.9 2024-09-14T11:21:43.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.614+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.10 2024-09-14T11:21:43.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.617+0000 7fec0b840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:43.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.617+0000 7fec0b840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7fec0b840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7fec0b840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7fec0b840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7fec0b840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:43.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7feadffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497069 cookie 94290467759856 notifier 7340 bl.length()=1007 2024-09-14T11:21:43.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7feadffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7feadffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.619+0000 7feadffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.621+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:43.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.621+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:43.620 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.621+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:43.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.621+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:43.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.624+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.0 2024-09-14T11:21:43.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.624+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.1 2024-09-14T11:21:43.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.624+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.2 2024-09-14T11:21:43.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.625+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.3 2024-09-14T11:21:43.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.625+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.4 2024-09-14T11:21:43.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.625+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.5 2024-09-14T11:21:43.625 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.626+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.6 2024-09-14T11:21:43.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.627+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.7 2024-09-14T11:21:43.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.627+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.8 2024-09-14T11:21:43.626 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.627+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.9 2024-09-14T11:21:43.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.628+0000 7fec0b840800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.37.10 2024-09-14T11:21:43.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.628+0000 7fec0b840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:43.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.628+0000 7fec0b840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7fec0b840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7fec0b840800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7fec0b840800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7fec0b840800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37, ofs0, ns] 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7feaecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497070 cookie 94290467759856 notifier 7340 bl.length()=975 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7feaecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 info.flags=0x17 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7feaecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:11989569-703c-4397-b0f1-7ddb0279a491.4517.37 to cache LRU end 2024-09-14T11:21:43.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.630+0000 7feaecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:43.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.632+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_sources= new_sources= 2024-09-14T11:21:43.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.632+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential sources added=[] removed=[] 2024-09-14T11:21:43.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.632+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): orig_dests= new_dests= 2024-09-14T11:21:43.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.632+0000 7fec0b840800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[11989569-703c-4397-b0f1-7ddb0279a491.4517.37]): potential dests added=[] removed=[] 2024-09-14T11:21:43.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.634+0000 7fec0b840800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:43.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.636+0000 7feabffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:43.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.639+0000 7fec0b840800 20 remove_watcher() i=0 2024-09-14T11:21:43.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.639+0000 7fec0b840800 2 removed watcher, disabling cache 2024-09-14T11:21:43.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.640+0000 7fec0b840800 20 remove_watcher() i=1 2024-09-14T11:21:43.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.641+0000 7fec0b840800 20 remove_watcher() i=2 2024-09-14T11:21:43.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.642+0000 7fec0b840800 20 remove_watcher() i=3 2024-09-14T11:21:43.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.643+0000 7fec0b840800 20 remove_watcher() i=4 2024-09-14T11:21:43.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.644+0000 7fec0b840800 20 remove_watcher() i=5 2024-09-14T11:21:43.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.645+0000 7fec0b840800 20 remove_watcher() i=6 2024-09-14T11:21:43.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.646+0000 7fec0b840800 20 remove_watcher() i=7 2024-09-14T11:21:43.659 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:21:43.690 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:43.690 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:43.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.737+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 20 realm 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.739+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.740+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:43.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.740+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.740+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:43.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.740+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:43.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.741+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:43.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.741+0000 7efeba926800 20 searching for the correct realm 2024-09-14T11:21:43.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.743+0000 7efeb6d0a640 0 -- 172.21.15.29:0/4210766585 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efeb00ac530 msgr2=0x7efeb00aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:43.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:43.950+0000 7efeb5d08640 0 -- 172.21.15.29:0/4210766585 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efeb00e2b00 msgr2=0x7efeb00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:44.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.156+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:44.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 zone default found 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 4 Realm: () 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 zonegroup default 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.157+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.158+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:44.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.158+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.158+0000 7efeba926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:44.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.158+0000 7efeba926800 20 started sync module instance, tier type = 2024-09-14T11:21:44.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.158+0000 7efeba926800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=0 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=1 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=2 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=3 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=4 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=5 2024-09-14T11:21:44.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.169+0000 7efeba926800 20 add_watcher() i=6 2024-09-14T11:21:44.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.170+0000 7efeba926800 20 add_watcher() i=7 2024-09-14T11:21:44.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.170+0000 7efeba926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:44.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.172+0000 7efd6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:44.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.172+0000 7efeba926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:44.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.172+0000 7efeba926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:44.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.172+0000 7efeba926800 5 note: GC not initialized 2024-09-14T11:21:44.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efce77fe640 20 reqs_thread_entry: start 2024-09-14T11:21:44.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efeba926800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:44.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efeba926800 20 Filter name: none 2024-09-14T11:21:44.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efce57fa640 20 reqs_thread_entry: start 2024-09-14T11:21:44.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.173+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.174+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.174+0000 7efeba926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.174+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.174+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=217 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.174+0000 7efeba926800 20 rados->read ofs=0 len=0 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.175+0000 7efeba926800 20 rados_obj.operate() r=0 bl.length=439 2024-09-14T11:21:44.174 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.175+0000 7efeba926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:44.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.177+0000 7efd6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:44.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.179+0000 7efeba926800 20 remove_watcher() i=0 2024-09-14T11:21:44.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.179+0000 7efeba926800 2 removed watcher, disabling cache 2024-09-14T11:21:44.180 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.180+0000 7efeba926800 20 remove_watcher() i=1 2024-09-14T11:21:44.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.182+0000 7efeba926800 20 remove_watcher() i=2 2024-09-14T11:21:44.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.183+0000 7efeba926800 20 remove_watcher() i=3 2024-09-14T11:21:44.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.184+0000 7efeba926800 20 remove_watcher() i=4 2024-09-14T11:21:44.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.186+0000 7efeba926800 20 remove_watcher() i=5 2024-09-14T11:21:44.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.187+0000 7efeba926800 20 remove_watcher() i=6 2024-09-14T11:21:44.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:44.188+0000 7efeba926800 20 remove_watcher() i=7 2024-09-14T11:21:44.199 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:44.199 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:44.199 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-logrecord-writes id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:21:44.200 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:44.582 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:21:44.583 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:45.465 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:21:45.494 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:45.494 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:45.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.534+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.536+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.536+0000 7efeab52e800 20 realm 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.536+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:45.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:45.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.537+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.538+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:45.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.538+0000 7efeab52e800 20 searching for the correct realm 2024-09-14T11:21:45.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.540+0000 7efea7ade640 0 -- 172.21.15.29:0/2028554938 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efea0028020 msgr2=0x7efea0062210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:45.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.745+0000 7efea6adc640 0 -- 172.21.15.29:0/2028554938 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efea007d130 msgr2=0x7efea0099330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:45.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.951+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.952 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 zone default found 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 4 Realm: () 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 zonegroup default 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.952+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.953+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.953+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.953+0000 7efeab52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:45.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.953+0000 7efeab52e800 20 started sync module instance, tier type = 2024-09-14T11:21:45.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.953+0000 7efeab52e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=0 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=1 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=2 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=3 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=4 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=5 2024-09-14T11:21:45.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.962+0000 7efeab52e800 20 add_watcher() i=6 2024-09-14T11:21:45.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.964+0000 7efeab52e800 20 add_watcher() i=7 2024-09-14T11:21:45.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.964+0000 7efeab52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:45.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.965+0000 7efd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efeab52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efeab52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efeab52e800 5 note: GC not initialized 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efd5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efeab52e800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efeab52e800 20 Filter name: none 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.966+0000 7efcd67fc640 20 reqs_thread_entry: start 2024-09-14T11:21:45.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.967+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.967+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.967+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 rados->read ofs=0 len=0 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:45.968 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.968+0000 7efeab52e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:45.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.970+0000 7efd5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:45.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.973+0000 7efeab52e800 20 remove_watcher() i=0 2024-09-14T11:21:45.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.973+0000 7efeab52e800 2 removed watcher, disabling cache 2024-09-14T11:21:45.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.974+0000 7efeab52e800 20 remove_watcher() i=1 2024-09-14T11:21:45.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.975+0000 7efeab52e800 20 remove_watcher() i=2 2024-09-14T11:21:45.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.976+0000 7efeab52e800 20 remove_watcher() i=3 2024-09-14T11:21:45.977 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.977+0000 7efeab52e800 20 remove_watcher() i=4 2024-09-14T11:21:45.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.979+0000 7efeab52e800 20 remove_watcher() i=5 2024-09-14T11:21:45.979 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.980+0000 7efeab52e800 20 remove_watcher() i=6 2024-09-14T11:21:45.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:45.981+0000 7efeab52e800 20 remove_watcher() i=7 2024-09-14T11:21:45.992 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:45.992 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:45.992 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:45.992 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:45.994 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:21:46.031 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:46.031 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:46.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.072+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 realm 2024-09-14T11:21:46.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.074+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.075+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:46.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.075+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.076+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:46.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.076+0000 7fe812932800 20 searching for the correct realm 2024-09-14T11:21:46.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.078+0000 7fe80edbd640 0 -- 172.21.15.29:0/601925016 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe80802d040 msgr2=0x7fe808039400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:46.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.284+0000 7fe80ddbb640 0 -- 172.21.15.29:0/601925016 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe80804b3c0 msgr2=0x7fe80804b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:46.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:46.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:46.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.490+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:46.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 zone default found 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 4 Realm: () 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 zonegroup default 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.491+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 started sync module instance, tier type = 2024-09-14T11:21:46.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.492+0000 7fe812932800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=0 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=1 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=2 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=3 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=4 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=5 2024-09-14T11:21:46.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.502+0000 7fe812932800 20 add_watcher() i=6 2024-09-14T11:21:46.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.503+0000 7fe812932800 20 add_watcher() i=7 2024-09-14T11:21:46.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.503+0000 7fe812932800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:46.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.504+0000 7fe6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:46.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 5 note: GC not initialized 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe63f7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 20 Filter name: none 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe63d7fa640 20 reqs_thread_entry: start 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:21:46.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.505+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.506+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.506+0000 7fe812932800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.506+0000 7fe812932800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.506+0000 7fe812932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 : miss 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.506+0000 7fe812932800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:46.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:46.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:46.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:46.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:46.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.507+0000 7fe812932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 2024-09-14T11:21:46.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe812932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:46.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe812932800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:46.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe812932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:46.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe812932800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38, ofs0, ns] 2024-09-14T11:21:46.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe6f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497074 cookie 94562185799616 notifier 7809 bl.length()=1015 2024-09-14T11:21:46.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe6f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:46.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe6f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:46.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.512+0000 7fe6f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:46.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.514+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_sources= new_sources= 2024-09-14T11:21:46.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.514+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential sources added=[] removed=[] 2024-09-14T11:21:46.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.514+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_dests= new_dests= 2024-09-14T11:21:46.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.514+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential dests added=[] removed=[] 2024-09-14T11:21:46.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.0 2024-09-14T11:21:46.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.0 2024-09-14T11:21:46.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.1 2024-09-14T11:21:46.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.1 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.2 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.2 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.3 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.3 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.4 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.4 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.5 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.5 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.6 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.6 2024-09-14T11:21:46.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.7 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.7 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.8 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.8 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.9 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.9 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.10 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.10 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.11 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.11 2024-09-14T11:21:46.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.519+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.0 2024-09-14T11:21:46.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.520+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1 2024-09-14T11:21:46.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.520+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.2 2024-09-14T11:21:46.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.521+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.3 2024-09-14T11:21:46.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.521+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.4 2024-09-14T11:21:46.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.521+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.5 2024-09-14T11:21:46.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.522+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.6 2024-09-14T11:21:46.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.523+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.7 2024-09-14T11:21:46.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.523+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.8 2024-09-14T11:21:46.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.524+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.9 2024-09-14T11:21:46.523 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.524+0000 7fe812932800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.10 2024-09-14T11:21:46.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.527+0000 7fe812932800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:21:46.527 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.527+0000 7fe812932800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:21:46.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.536+0000 7fe812932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:46.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.536+0000 7fe812932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 2024-09-14T11:21:46.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe812932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:46.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe812932800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:46.537 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe812932800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:46.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe812932800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38, ofs0, ns] 2024-09-14T11:21:46.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe6f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497075 cookie 94562185799616 notifier 7809 bl.length()=983 2024-09-14T11:21:46.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe6f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:46.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe6f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:46.538 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.538+0000 7fe6f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:46.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.540+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_sources= new_sources= 2024-09-14T11:21:46.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.540+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential sources added=[] removed=[] 2024-09-14T11:21:46.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.540+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_dests= new_dests= 2024-09-14T11:21:46.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.540+0000 7fe812932800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential dests added=[] removed=[] 2024-09-14T11:21:46.539 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.540+0000 7fe812932800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:21:46.541 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.542+0000 7fe6c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:46.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.544+0000 7fe812932800 20 remove_watcher() i=0 2024-09-14T11:21:46.543 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.544+0000 7fe812932800 2 removed watcher, disabling cache 2024-09-14T11:21:46.544 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.545+0000 7fe812932800 20 remove_watcher() i=1 2024-09-14T11:21:46.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.546+0000 7fe812932800 20 remove_watcher() i=2 2024-09-14T11:21:46.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.547+0000 7fe812932800 20 remove_watcher() i=3 2024-09-14T11:21:46.547 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.548+0000 7fe812932800 20 remove_watcher() i=4 2024-09-14T11:21:46.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.549+0000 7fe812932800 20 remove_watcher() i=5 2024-09-14T11:21:46.549 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.550+0000 7fe812932800 20 remove_watcher() i=6 2024-09-14T11:21:46.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.551+0000 7fe812932800 20 remove_watcher() i=7 2024-09-14T11:21:46.563 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:21:46.593 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:46.593 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:46.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.633+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 realm 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:46.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.635+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.636+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:46.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.636+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:46.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.637+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:46.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.637+0000 7f53aa9af800 20 searching for the correct realm 2024-09-14T11:21:46.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.639+0000 7f53a8c9a640 0 -- 172.21.15.29:0/2068524037 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f53a00689c0 msgr2=0x7f53a00561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:46.843 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:46.844+0000 7f53a7c98640 0 -- 172.21.15.29:0/2068524037 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f53a0052fb0 msgr2=0x7f53a0059a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:47.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.051+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:47.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 zone default found 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 4 Realm: () 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:47.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 zonegroup default 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.052+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.053+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.053+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.053+0000 7f53aa9af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.053+0000 7f53aa9af800 20 started sync module instance, tier type = 2024-09-14T11:21:47.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.053+0000 7f53aa9af800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=0 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=1 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=2 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=3 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=4 2024-09-14T11:21:47.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=5 2024-09-14T11:21:47.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.062+0000 7f53aa9af800 20 add_watcher() i=6 2024-09-14T11:21:47.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.064+0000 7f53aa9af800 20 add_watcher() i=7 2024-09-14T11:21:47.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.064+0000 7f53aa9af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:47.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.065+0000 7f525efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:47.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 5 note: GC not initialized 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f525dfdb640 20 reqs_thread_entry: start 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 20 Filter name: none 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f51cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:47.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.066+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.067+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.067+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.067+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:47.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:47.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.068+0000 7f53aa9af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:47.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.070+0000 7f525efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.072+0000 7f53aa9af800 20 remove_watcher() i=0 2024-09-14T11:21:47.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.072+0000 7f53aa9af800 2 removed watcher, disabling cache 2024-09-14T11:21:47.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.074+0000 7f53aa9af800 20 remove_watcher() i=1 2024-09-14T11:21:47.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.075+0000 7f53aa9af800 20 remove_watcher() i=2 2024-09-14T11:21:47.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.076+0000 7f53aa9af800 20 remove_watcher() i=3 2024-09-14T11:21:47.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.077+0000 7f53aa9af800 20 remove_watcher() i=4 2024-09-14T11:21:47.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.078+0000 7f53aa9af800 20 remove_watcher() i=5 2024-09-14T11:21:47.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.079+0000 7f53aa9af800 20 remove_watcher() i=6 2024-09-14T11:21:47.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.080+0000 7f53aa9af800 20 remove_watcher() i=7 2024-09-14T11:21:47.091 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:47.091 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:47.091 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:47.091 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:47.186 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:47.219 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:47.219 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:47.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.259+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.260 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 realm 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.261 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.261+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.262+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:47.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.262+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.262+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:47.262 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.262+0000 7f76be216800 20 searching for the correct realm 2024-09-14T11:21:47.263 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.264+0000 7f76b91e6640 0 -- 172.21.15.29:0/2587684463 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f76ac039040 msgr2=0x7f76ac018410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:47.266 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.267+0000 7f76b91e6640 0 -- 172.21.15.29:0/2587684463 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f7584087860 msgr2=0x7f7584089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:47.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:47.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:47.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:47.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.273+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 zone default found 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 4 Realm: () 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 zonegroup default 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.274+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.275+0000 7f76be216800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.275+0000 7f76be216800 20 started sync module instance, tier type = 2024-09-14T11:21:47.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.275+0000 7f76be216800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:47.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=0 2024-09-14T11:21:47.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=1 2024-09-14T11:21:47.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=2 2024-09-14T11:21:47.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=3 2024-09-14T11:21:47.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=4 2024-09-14T11:21:47.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=5 2024-09-14T11:21:47.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.283+0000 7f76be216800 20 add_watcher() i=6 2024-09-14T11:21:47.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.284+0000 7f76be216800 20 add_watcher() i=7 2024-09-14T11:21:47.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.284+0000 7f76be216800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:47.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.285+0000 7f756b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.285+0000 7f76be216800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:47.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.285+0000 7f76be216800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:47.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f76be216800 5 note: GC not initialized 2024-09-14T11:21:47.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f756a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:47.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f76be216800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:47.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f76be216800 20 Filter name: none 2024-09-14T11:21:47.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f74dbfff640 20 reqs_thread_entry: start 2024-09-14T11:21:47.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f76be216800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:21:47.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.286+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 : miss 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:47.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.287+0000 7f76be216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 2024-09-14T11:21:47.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f76be216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f76be216800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f76be216800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f76be216800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38, ofs0, ns] 2024-09-14T11:21:47.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f759cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497076 cookie 94555050400704 notifier 7842 bl.length()=1015 2024-09-14T11:21:47.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f759cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f759cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.292+0000 7f759cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.294+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_sources= new_sources= 2024-09-14T11:21:47.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.294+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential sources added=[] removed=[] 2024-09-14T11:21:47.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.294+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_dests= new_dests= 2024-09-14T11:21:47.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.294+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential dests added=[] removed=[] 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.0 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.0 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.1 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.1 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.2 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.2 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.3 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.3 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.4 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.4 2024-09-14T11:21:47.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.5 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.5 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.6 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.6 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.7 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.7 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.8 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.8 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.9 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.9 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.10 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.10 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.11 2024-09-14T11:21:47.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1.11 2024-09-14T11:21:47.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.298+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.0 2024-09-14T11:21:47.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.299+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1 2024-09-14T11:21:47.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.299+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.2 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.300+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.3 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.300+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.4 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.300+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.5 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.301+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.6 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.301+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.7 2024-09-14T11:21:47.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.302+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.8 2024-09-14T11:21:47.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.303+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.9 2024-09-14T11:21:47.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.303+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.10 2024-09-14T11:21:47.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.306+0000 7f76be216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:47.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.306+0000 7f76be216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 2024-09-14T11:21:47.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f76be216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f76be216800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f76be216800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f76be216800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38, ofs0, ns] 2024-09-14T11:21:47.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f759d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497077 cookie 94555050400704 notifier 7842 bl.length()=1015 2024-09-14T11:21:47.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f759d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f759d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.307+0000 7f759d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.309+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_sources= new_sources= 2024-09-14T11:21:47.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.309+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential sources added=[] removed=[] 2024-09-14T11:21:47.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.309+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_dests= new_dests= 2024-09-14T11:21:47.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.309+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential dests added=[] removed=[] 2024-09-14T11:21:47.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.311+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.0 2024-09-14T11:21:47.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.312+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.1 2024-09-14T11:21:47.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.312+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.2 2024-09-14T11:21:47.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.312+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.3 2024-09-14T11:21:47.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.312+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.4 2024-09-14T11:21:47.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.313+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.5 2024-09-14T11:21:47.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.313+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.6 2024-09-14T11:21:47.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.313+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.7 2024-09-14T11:21:47.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.314+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.8 2024-09-14T11:21:47.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.314+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.9 2024-09-14T11:21:47.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.314+0000 7f76be216800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.38.10 2024-09-14T11:21:47.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.315+0000 7f76be216800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:47.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.315+0000 7f76be216800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f76be216800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f76be216800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f76be216800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f76be216800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38, ofs0, ns] 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f759cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497078 cookie 94555050400704 notifier 7842 bl.length()=983 2024-09-14T11:21:47.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f759cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 info.flags=0x17 2024-09-14T11:21:47.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f759cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.38 to cache LRU end 2024-09-14T11:21:47.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.316+0000 7f759cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:47.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.318+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_sources= new_sources= 2024-09-14T11:21:47.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.318+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential sources added=[] removed=[] 2024-09-14T11:21:47.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.318+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): orig_dests= new_dests= 2024-09-14T11:21:47.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.318+0000 7f76be216800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.38]): potential dests added=[] removed=[] 2024-09-14T11:21:47.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.320+0000 7f76be216800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:47.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.322+0000 7f756b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.324+0000 7f76be216800 20 remove_watcher() i=0 2024-09-14T11:21:47.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.324+0000 7f76be216800 2 removed watcher, disabling cache 2024-09-14T11:21:47.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.325+0000 7f76be216800 20 remove_watcher() i=1 2024-09-14T11:21:47.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.326+0000 7f76be216800 20 remove_watcher() i=2 2024-09-14T11:21:47.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.327+0000 7f76be216800 20 remove_watcher() i=3 2024-09-14T11:21:47.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.328+0000 7f76be216800 20 remove_watcher() i=4 2024-09-14T11:21:47.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.329+0000 7f76be216800 20 remove_watcher() i=5 2024-09-14T11:21:47.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.330+0000 7f76be216800 20 remove_watcher() i=6 2024-09-14T11:21:47.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.331+0000 7f76be216800 20 remove_watcher() i=7 2024-09-14T11:21:47.343 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:21:47.372 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:47.372 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:47.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.411+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 20 realm 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.413+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.414+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.414+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.415+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:47.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.415+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.415+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:47.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.415+0000 7f3768525800 20 searching for the correct realm 2024-09-14T11:21:47.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.417+0000 7f37649af640 0 -- 172.21.15.29:0/1140366086 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f37540b9020 msgr2=0x7f37540ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:47.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.622+0000 7f37639ad640 0 -- 172.21.15.29:0/1140366086 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f3754061070 msgr2=0x7f37540a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.830 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.830+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:47.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 zone default found 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 4 Realm: () 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 zonegroup default 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.831+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.832+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.832+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.832+0000 7f3768525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:47.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.832+0000 7f3768525800 20 started sync module instance, tier type = 2024-09-14T11:21:47.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.832+0000 7f3768525800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:47.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=0 2024-09-14T11:21:47.841 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=1 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=2 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=3 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=4 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=5 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.842+0000 7f3768525800 20 add_watcher() i=6 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.843+0000 7f3768525800 20 add_watcher() i=7 2024-09-14T11:21:47.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.843+0000 7f3768525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:47.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.845+0000 7f361afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.845+0000 7f3768525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:47.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.845+0000 7f3768525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:47.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.845+0000 7f3768525800 5 note: GC not initialized 2024-09-14T11:21:47.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.846+0000 7f3619fdb640 20 reqs_thread_entry: start 2024-09-14T11:21:47.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.846+0000 7f3768525800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:47.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.846+0000 7f3768525800 20 Filter name: none 2024-09-14T11:21:47.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.846+0000 7f358b7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:47.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.846+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.847+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:47.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.847+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.847+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.847+0000 7f3768525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.847+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.848+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.848+0000 7f3768525800 20 rados->read ofs=0 len=0 2024-09-14T11:21:47.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.848+0000 7f3768525800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:47.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.848+0000 7f3768525800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:47.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.850+0000 7f361afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.852+0000 7f3768525800 20 remove_watcher() i=0 2024-09-14T11:21:47.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.852+0000 7f3768525800 2 removed watcher, disabling cache 2024-09-14T11:21:47.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.853+0000 7f3768525800 20 remove_watcher() i=1 2024-09-14T11:21:47.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.854+0000 7f3768525800 20 remove_watcher() i=2 2024-09-14T11:21:47.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.855+0000 7f3768525800 20 remove_watcher() i=3 2024-09-14T11:21:47.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.856+0000 7f3768525800 20 remove_watcher() i=4 2024-09-14T11:21:47.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.857+0000 7f3768525800 20 remove_watcher() i=5 2024-09-14T11:21:47.857 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.858+0000 7f3768525800 20 remove_watcher() i=6 2024-09-14T11:21:47.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:47.859+0000 7f3768525800 20 remove_watcher() i=7 2024-09-14T11:21:47.869 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:47.870 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:47.870 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.38 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:21:47.870 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:48.249 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:21:48.249 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:49.105 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:21:49.134 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:49.134 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:49.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.174+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 realm 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:49.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.176 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.176+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.378+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.378+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.379+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:49.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.379+0000 7feaed746800 20 searching for the correct realm 2024-09-14T11:21:49.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.380+0000 7feaeaa36640 0 -- 172.21.15.29:0/447943605 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7feadc068410 msgr2=0x7feadc039f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:49.584 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.585+0000 7feaeba38640 0 -- 172.21.15.29:0/447943605 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55980d3b4c60 msgr2=0x55980d3b7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:49.590 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.591 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.591+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 zone default found 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 4 Realm: () 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 zonegroup default 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.592 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.592+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.593+0000 7feaed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.593+0000 7feaed746800 20 started sync module instance, tier type = 2024-09-14T11:21:49.593 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.593+0000 7feaed746800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:49.600 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=0 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=1 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=2 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=3 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=4 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=5 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.601+0000 7feaed746800 20 add_watcher() i=6 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.602+0000 7feaed746800 20 add_watcher() i=7 2024-09-14T11:21:49.601 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.602+0000 7feaed746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:49.603 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.604+0000 7fe9a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.604+0000 7feaed746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.604+0000 7feaed746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.604+0000 7feaed746800 5 note: GC not initialized 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.604+0000 7fe9a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.605+0000 7feaed746800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.605+0000 7feaed746800 20 Filter name: none 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.605+0000 7fe91a7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:49.604 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.605+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.606+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:49.605 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.606+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.606+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.606+0000 7feaed746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.606+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.607+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.607+0000 7feaed746800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.607+0000 7feaed746800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:49.606 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.607+0000 7feaed746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:49.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.609+0000 7fe9a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:49.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.612+0000 7feaed746800 20 remove_watcher() i=0 2024-09-14T11:21:49.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.612+0000 7feaed746800 2 removed watcher, disabling cache 2024-09-14T11:21:49.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.612+0000 7feaed746800 20 remove_watcher() i=1 2024-09-14T11:21:49.612 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.613+0000 7feaed746800 20 remove_watcher() i=2 2024-09-14T11:21:49.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.614+0000 7feaed746800 20 remove_watcher() i=3 2024-09-14T11:21:49.614 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.615+0000 7feaed746800 20 remove_watcher() i=4 2024-09-14T11:21:49.615 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.616+0000 7feaed746800 20 remove_watcher() i=5 2024-09-14T11:21:49.616 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.617+0000 7feaed746800 20 remove_watcher() i=6 2024-09-14T11:21:49.617 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.618+0000 7feaed746800 20 remove_watcher() i=7 2024-09-14T11:21:49.628 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:49.629 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:49.629 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:49.629 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:49.630 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:21:49.667 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:49.667 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:49.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.708+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 realm 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.710+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.711+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.710 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.711+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.712+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:49.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.712+0000 7f70e2d28800 20 searching for the correct realm 2024-09-14T11:21:49.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.714+0000 7f70df15e640 0 -- 172.21.15.29:0/854035633 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f70d807c940 msgr2=0x7f70d8055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:49.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:49.920+0000 7f70de15c640 0 -- 172.21.15.29:0/854035633 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f70d809c3f0 msgr2=0x7f70d809c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.127+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 zone default found 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 4 Realm: () 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 zonegroup default 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.128+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.129+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.129+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.129+0000 7f70e2d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.129+0000 7f70e2d28800 20 started sync module instance, tier type = 2024-09-14T11:21:50.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.129+0000 7f70e2d28800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=0 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=1 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=2 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=3 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=4 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=5 2024-09-14T11:21:50.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.139+0000 7f70e2d28800 20 add_watcher() i=6 2024-09-14T11:21:50.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.140+0000 7f70e2d28800 20 add_watcher() i=7 2024-09-14T11:21:50.138 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.140+0000 7f70e2d28800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:50.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.141+0000 7f6f957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.140 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 5 note: GC not initialized 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f6f0ffff640 20 reqs_thread_entry: start 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 20 Filter name: none 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f6f0dffb640 20 reqs_thread_entry: start 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:21:50.141 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.142+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 : miss 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.142 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.143+0000 7f70e2d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f70e2d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f70e2d28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f70e2d28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f70e2d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39, ofs0, ns] 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f6fc1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497081 cookie 94125162106944 notifier 7469 bl.length()=1015 2024-09-14T11:21:50.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f6fc1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f6fc1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.148 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.149+0000 7f6fc1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.151+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_sources= new_sources= 2024-09-14T11:21:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.151+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential sources added=[] removed=[] 2024-09-14T11:21:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.151+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_dests= new_dests= 2024-09-14T11:21:50.149 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.151+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential dests added=[] removed=[] 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.0 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.0 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.1 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.1 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.2 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.2 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.3 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.3 2024-09-14T11:21:50.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.4 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.4 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.5 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.5 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.6 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.6 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.7 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.7 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.8 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.8 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.9 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.9 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.10 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.10 2024-09-14T11:21:50.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.11 2024-09-14T11:21:50.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1.11 2024-09-14T11:21:50.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.155+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.0 2024-09-14T11:21:50.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.156+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1 2024-09-14T11:21:50.156 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.156+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.2 2024-09-14T11:21:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.157+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.3 2024-09-14T11:21:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.157+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.4 2024-09-14T11:21:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.158+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.5 2024-09-14T11:21:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.158+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.6 2024-09-14T11:21:50.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.159+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.7 2024-09-14T11:21:50.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.159+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.8 2024-09-14T11:21:50.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.160+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.9 2024-09-14T11:21:50.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.161+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.10 2024-09-14T11:21:50.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.164+0000 7f70e2d28800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:21:50.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.164+0000 7f70e2d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:50.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.164+0000 7f70e2d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 2024-09-14T11:21:50.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f70e2d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f70e2d28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f70e2d28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.163 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f70e2d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39, ofs0, ns] 2024-09-14T11:21:50.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f6fc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497082 cookie 94125162106944 notifier 7469 bl.length()=1015 2024-09-14T11:21:50.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f6fc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f6fc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.165+0000 7f6fc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.167+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_sources= new_sources= 2024-09-14T11:21:50.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.167+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential sources added=[] removed=[] 2024-09-14T11:21:50.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.167+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_dests= new_dests= 2024-09-14T11:21:50.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.167+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential dests added=[] removed=[] 2024-09-14T11:21:50.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.169+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.0 2024-09-14T11:21:50.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.169+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.1 2024-09-14T11:21:50.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.170+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.2 2024-09-14T11:21:50.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.170+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.3 2024-09-14T11:21:50.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.170+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.4 2024-09-14T11:21:50.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.171+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.5 2024-09-14T11:21:50.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.171+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.6 2024-09-14T11:21:50.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.171+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.7 2024-09-14T11:21:50.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.172+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.8 2024-09-14T11:21:50.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.172+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.9 2024-09-14T11:21:50.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.172+0000 7f70e2d28800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.39.10 2024-09-14T11:21:50.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.173+0000 7f70e2d28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:21:50.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.173+0000 7f70e2d28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 2024-09-14T11:21:50.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f70e2d28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f70e2d28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f70e2d28800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f70e2d28800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39, ofs0, ns] 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f6fc27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497083 cookie 94125162106944 notifier 7469 bl.length()=983 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f6fc27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 info.flags=0x17 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f6fc27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.39 to cache LRU end 2024-09-14T11:21:50.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.174+0000 7f6fc27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:50.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.180+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_sources= new_sources= 2024-09-14T11:21:50.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.180+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential sources added=[] removed=[] 2024-09-14T11:21:50.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.180+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): orig_dests= new_dests= 2024-09-14T11:21:50.178 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.180+0000 7f70e2d28800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.39]): potential dests added=[] removed=[] 2024-09-14T11:21:50.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.183+0000 7f70e2d28800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:21:50.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.184+0000 7f6f957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.186+0000 7f70e2d28800 20 remove_watcher() i=0 2024-09-14T11:21:50.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.187+0000 7f70e2d28800 2 removed watcher, disabling cache 2024-09-14T11:21:50.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.187+0000 7f70e2d28800 20 remove_watcher() i=1 2024-09-14T11:21:50.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.189+0000 7f70e2d28800 20 remove_watcher() i=2 2024-09-14T11:21:50.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.190+0000 7f70e2d28800 20 remove_watcher() i=3 2024-09-14T11:21:50.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.191+0000 7f70e2d28800 20 remove_watcher() i=4 2024-09-14T11:21:50.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.192+0000 7f70e2d28800 20 remove_watcher() i=5 2024-09-14T11:21:50.191 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.193+0000 7f70e2d28800 20 remove_watcher() i=6 2024-09-14T11:21:50.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.194+0000 7f70e2d28800 20 remove_watcher() i=7 2024-09-14T11:21:50.205 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:21:50.234 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:50.234 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:50.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.275+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 realm 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.277+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.278+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.278+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.278+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:50.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.278+0000 7feb4f616800 20 searching for the correct realm 2024-09-14T11:21:50.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.280+0000 7feb4a5e6640 0 -- 172.21.15.29:0/164079792 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fea14087860 msgr2=0x7fea14089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.486+0000 7feb4b5e8640 0 -- 172.21.15.29:0/164079792 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x557903b39a70 msgr2=0x557903b3be60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.492+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 zone default found 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 4 Realm: () 2024-09-14T11:21:50.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 zonegroup default 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.493+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.494+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.494+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.494+0000 7feb4f616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.494+0000 7feb4f616800 20 started sync module instance, tier type = 2024-09-14T11:21:50.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.494+0000 7feb4f616800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=0 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=1 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=2 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=3 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=4 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=5 2024-09-14T11:21:50.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.502+0000 7feb4f616800 20 add_watcher() i=6 2024-09-14T11:21:50.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.503+0000 7feb4f616800 20 add_watcher() i=7 2024-09-14T11:21:50.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.503+0000 7feb4f616800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:50.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.505+0000 7fea017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.505+0000 7feb4f616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.505+0000 7feb4f616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.505+0000 7feb4f616800 5 note: GC not initialized 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.505+0000 7fe97bfff640 20 reqs_thread_entry: start 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7feb4f616800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7feb4f616800 20 Filter name: none 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7fe979ffb640 20 reqs_thread_entry: start 2024-09-14T11:21:50.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:50.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.506+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:50.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:50.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:50.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.507+0000 7feb4f616800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:50.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.508+0000 7feb4f616800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:50.507 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.509+0000 7fea017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.512+0000 7feb4f616800 20 remove_watcher() i=0 2024-09-14T11:21:50.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.512+0000 7feb4f616800 2 removed watcher, disabling cache 2024-09-14T11:21:50.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.513+0000 7feb4f616800 20 remove_watcher() i=1 2024-09-14T11:21:50.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.514+0000 7feb4f616800 20 remove_watcher() i=2 2024-09-14T11:21:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.515+0000 7feb4f616800 20 remove_watcher() i=3 2024-09-14T11:21:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.516+0000 7feb4f616800 20 remove_watcher() i=4 2024-09-14T11:21:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.517+0000 7feb4f616800 20 remove_watcher() i=5 2024-09-14T11:21:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.518+0000 7feb4f616800 20 remove_watcher() i=6 2024-09-14T11:21:50.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:50.519+0000 7feb4f616800 20 remove_watcher() i=7 2024-09-14T11:21:50.528 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:50.528 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:50.528 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: error-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.39 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:21:50.528 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:50.926 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:21:50.926 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:51.791 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:21:51.820 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:51.821 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:51.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.861+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 20 realm 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.863+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.864+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:51.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.864+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:51.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.864+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:51.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.864+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:51.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.865+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:51.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.865+0000 7f546ab25800 20 searching for the correct realm 2024-09-14T11:21:51.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:51.866+0000 7f545df32640 0 -- 172.21.15.29:0/1970231059 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f5458017070 msgr2=0x7f5458062090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:52.070 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.072+0000 7f5466f34640 0 -- 172.21.15.29:0/1970231059 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55ddb918cf20 msgr2=0x55ddb918f310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:52.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:52.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:52.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.078+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 zone default found 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 4 Realm: () 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 zonegroup default 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.079+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.080+0000 7f546ab25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.080+0000 7f546ab25800 20 started sync module instance, tier type = 2024-09-14T11:21:52.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.080+0000 7f546ab25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=0 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=1 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=2 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=3 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=4 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=5 2024-09-14T11:21:52.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.089+0000 7f546ab25800 20 add_watcher() i=6 2024-09-14T11:21:52.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.090+0000 7f546ab25800 20 add_watcher() i=7 2024-09-14T11:21:52.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.090+0000 7f546ab25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:52.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.091+0000 7f531cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 5 note: GC not initialized 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f52977fe640 20 reqs_thread_entry: start 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 20 Filter name: none 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f52957fa640 20 reqs_thread_entry: start 2024-09-14T11:21:52.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.092+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.093+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:52.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.093+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:52.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:52.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:52.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:52.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.094+0000 7f546ab25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:52.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.096+0000 7f531cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:52.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.098+0000 7f546ab25800 20 remove_watcher() i=0 2024-09-14T11:21:52.096 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.098+0000 7f546ab25800 2 removed watcher, disabling cache 2024-09-14T11:21:52.097 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.099+0000 7f546ab25800 20 remove_watcher() i=1 2024-09-14T11:21:52.098 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.100+0000 7f546ab25800 20 remove_watcher() i=2 2024-09-14T11:21:52.099 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.101+0000 7f546ab25800 20 remove_watcher() i=3 2024-09-14T11:21:52.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.102+0000 7f546ab25800 20 remove_watcher() i=4 2024-09-14T11:21:52.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.103+0000 7f546ab25800 20 remove_watcher() i=5 2024-09-14T11:21:52.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.104+0000 7f546ab25800 20 remove_watcher() i=6 2024-09-14T11:21:52.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.105+0000 7f546ab25800 20 remove_watcher() i=7 2024-09-14T11:21:52.114 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.114 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:52.114 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:52.115 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.116 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:21:52.151 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:52.151 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:52.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.192+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.193+0000 7fe443a15800 20 realm 2024-09-14T11:21:52.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.194+0000 7fe443a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:52.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:52.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.195+0000 7fe443a15800 20 searching for the correct realm 2024-09-14T11:21:52.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.197+0000 7fe43f993640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe438064ab0 msgr2=0x7fe438062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.402+0000 7fe43e991640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe438079050 msgr2=0x7fe43806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:52.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.608+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.608 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:52.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 zone default found 2024-09-14T11:21:52.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 4 Realm: () 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 zonegroup default 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 started sync module instance, tier type = 2024-09-14T11:21:52.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.610+0000 7fe443a15800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=0 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=1 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=2 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=3 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=4 2024-09-14T11:21:52.618 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=5 2024-09-14T11:21:52.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=6 2024-09-14T11:21:52.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.621+0000 7fe443a15800 20 add_watcher() i=7 2024-09-14T11:21:52.619 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.621+0000 7fe443a15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:52.621 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.622+0000 7fe2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 5 note: GC not initialized 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe2f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 20 Filter name: none 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe26e7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:21:52.622 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.623+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : miss 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.623 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:52.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:52.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.624 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.624+0000 7fe443a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:21:52.627 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.629+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.629+0000 7fe443a15800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.629+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.629+0000 7fe443a15800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:21:52.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 94335638226144 notifier 7950 bl.length()=1015 2024-09-14T11:21:52.628 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.629 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:21:52.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:21:52.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:21:52.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:21:52.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.0 2024-09-14T11:21:52.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1 2024-09-14T11:21:52.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.3 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.4 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.5 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.640+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.6 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.7 2024-09-14T11:21:52.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.8 2024-09-14T11:21:52.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.9 2024-09-14T11:21:52.640 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.642+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.10 2024-09-14T11:21:52.643 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe443a15800 time 2024-09-14T11:21:52.646050+0000 2024-09-14T11:21:52.643 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe444b8c76a] 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:52.644 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.646+0000 7fe443a15800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe443a15800 time 2024-09-14T11:21:52.646050+0000 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe444b8c76a] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:52.645 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.646 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:52.646 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:52.646 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.646 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:21:52.646 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fe443a15800 thread_name:radosgw-admin 2024-09-14T11:21:52.667 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.667 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe44383e6f0] 2024-09-14T11:21:52.667 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe44388b99c] 2024-09-14T11:21:52.667 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe444b8c7c4] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.646+0000 7fe443a15800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fe443a15800 thread_name:radosgw-admin 2024-09-14T11:21:52.668 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe44383e6f0] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe44388b99c] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe444b8c7c4] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.669 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:21:52.176+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.670 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:21:52.176+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:21:52.176+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key hook 0x55cc3a249798 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a0bfd00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a192b90 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a273d90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.811419s 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a273d90 auth_method 0 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.671 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a192b90 auth_method 0 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a0bfd00 auth_method 0 2024-09-14T11:21:52.672 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:21:52.176+0000 7fe43f993640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: dump: 2024-09-14T11:21:52.673 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.674 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: dump: 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:21:52.177+0000 7fe443a15800 5 monclient: authenticate success, global_id 7941 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.675 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:21:52.177+0000 7fe32d60a640 4 set_mon_vals no callback set 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:21:52.177+0000 7fe443a15800 1 librados: init done 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:21:52.179+0000 7fe43f192640 10 monclient: get_auth_request con 0x7fe324077230 auth_method 0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:21:52.179+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a272580 auth_method 0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:21:52.180+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a295140 auth_method 0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:21:52.181+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a299540 auth_method 0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:21:52.182+0000 7fe43f993640 10 monclient: get_auth_request con 0x55cc3a2989a0 auth_method 0 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:21:52.182+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.676 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:21:52.182+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:21:52.182+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.677 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.678 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command objecter_requests cmddesc objecter_requests hook 0x55cc3a2a4bc0 EEXIST 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.679 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x55cc3a2a0790 EEXIST 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a2c8ee0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a2c92c0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a2c7bf0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.680 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.818819s 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a2c92c0 auth_method 0 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a2c7bf0 auth_method 0 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.681 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2c8ee0 auth_method 0 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:21:52.184+0000 7fe43f993640 1 monclient: found mon.noname-c 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.682 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: dump: 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.683 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: dump: 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.684 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:21:52.184+0000 7fe443a15800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:21:52.184+0000 7fe440194640 4 set_mon_vals no callback set 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:21:52.186+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe318077140 auth_method 0 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: get_monmap_and_config 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:21:52.186+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.685 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.686 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:21:52.186+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.687 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.688 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:21:52.187+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:21:52.187+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x7fffaad8bdd8 EEXIST 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a2ecae0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a317550 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a318900 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.822645s 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a317550 auth_method 0 2024-09-14T11:21:52.689 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a318900 auth_method 0 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2ecae0 auth_method 0 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.690 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7947 payload 274 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:21:52.187+0000 7fe43f993640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: dump: 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.691 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 monclient: authenticate success, global_id 7947 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:21:52.188+0000 7fe443a15800 4 set_mon_vals no callback set 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.692 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: dump: 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: shutdown 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:21:52.188+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.693 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.694 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: starting msgr at 2024-09-14T11:21:52.695 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: starting objecter 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command objecter_requests cmddesc objecter_requests hook 0x55cc3a2ead70 EEXIST 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: setting wanted keys 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: calling monclient init 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.696 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x55cc3a2dd8e8 EEXIST 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a2ecae0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a318900 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a310220 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.697 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.824911s 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2ecae0 auth_method 0 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a310220 auth_method 0 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a318900 auth_method 0 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.698 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_done global_id 7950 payload 824 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:21:52.190+0000 7fe43e991640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.699 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: dump: 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.700 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: dump: 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.701 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:21:52.190+0000 7fe322ffd640 4 set_mon_vals no callback set 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:21:52.190+0000 7fe443a15800 5 monclient: authenticate success, global_id 7950 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:21:52.190+0000 7fe443a15800 1 librados: init done 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:21:52.190+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cr dump hook 0x55cc3a30d2e8 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:21:52.192+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:21:52.192+0000 7fe3217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:21:52.193+0000 7fe3217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:21:52.193+0000 7fe3217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:21:52.193+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe308077230 auth_method 0 2024-09-14T11:21:52.702 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:21:52.193+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a337220 auth_method 0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 realm 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:21:52.194+0000 7fe443a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:21:52.194+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a33b400 auth_method 0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:21:52.195+0000 7fe43f993640 10 monclient: get_auth_request con 0x55cc3a33ec60 auth_method 0 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:52.703 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 searching for the correct realm 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:21:52.195+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a343a20 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:21:52.196+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe430039c20 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:21:52.197+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe438064ab0 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:21:52.197+0000 7fe43f993640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe438064ab0 msgr2=0x7fe438062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:21:52.398+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe438064ab0 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:21:52.400+0000 7fe43f192640 10 monclient: get_auth_request con 0x7fe43806a400 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:21:52.402+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe438079050 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:21:52.402+0000 7fe43e991640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe438079050 msgr2=0x7fe43806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:21:52.603+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe438079050 auth_method 0 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:52.704 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 zone default found 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 Realm: () 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:21:52.609+0000 7fe443a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 zonegroup default 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.705 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 started sync module instance, tier type = 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=0 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=1 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=2 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=3 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=4 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=5 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=6 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:21:52.621+0000 7fe443a15800 20 add_watcher() i=7 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:21:52.621+0000 7fe443a15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:52.706 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.707 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:21:52.622+0000 7fe2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:21:52.623+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache list hook 0x55cc3a310620 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache inspect hook 0x55cc3a310620 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache erase hook 0x55cc3a310620 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache zap hook 0x55cc3a310620 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 note: GC not initialized 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:21:52.623+0000 7fe2f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace show hook 0x7fe430021040 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace history hook 0x7fe430021040 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace active hook 0x7fe430021040 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace active_short hook 0x7fe430021040 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 Filter name: none 2024-09-14T11:21:52.708 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:21:52.623+0000 7fe26e7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:21:52.623+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : miss 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.709 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 94335638226144 notifier 7950 bl.length()=1015 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.710 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.711 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.0 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.3 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.4 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.5 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:21:52.640+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.6 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.7 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.8 2024-09-14T11:21:52.712 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.9 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:21:52.642+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.10 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:21:52.646+0000 7fe443a15800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe443a15800 time 2024-09-14T11:21:52.646050+0000 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe444b8c76a] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:52.713 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:21:52.646+0000 7fe443a15800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fe443a15800 thread_name:radosgw-admin 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe44383e6f0] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe44388b99c] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe444b8c7c4] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:52.714 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:21:52.715 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:21:52.716 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:21:52.717 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:21:52.718 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:52.719 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:52.720 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe26e7fc640 / http_manager 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe2f4fe1640 / http_manager 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe2f5fe3640 / rgw_dt_lg_renew 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe3217fa640 / ms_dispatch 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe322ffd640 / io_context_pool 2024-09-14T11:21:52.721 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe329602640 / ms_dispatch 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe32be07640 / ms_dispatch 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe32d60a640 / io_context_pool 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43e991640 / msgr-worker-2 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43f192640 / msgr-worker-1 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43f993640 / msgr-worker-0 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe440194640 / io_context_pool 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe443a15800 / radosgw-admin 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.142812.log 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.722 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: crc 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:21:52.175+0000 7fe443a15800 5 AuthRegistry(0x55cc3a249650) adding con mode: secure 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:21:52.176+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:21:52.176+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:21:52.176+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key hook 0x55cc3a249798 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a0bfd00 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a192b90 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a273d90 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.723 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:21:52.176+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.811419s 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a273d90 auth_method 0 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a192b90 auth_method 0 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.724 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:21:52.176+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a0bfd00 auth_method 0 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:21:52.176+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7941 payload 824 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:21:52.176+0000 7fe43f993640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.725 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:21:52.176+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: dump: 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.726 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:21:52.177+0000 7fe32be07640 10 monclient: dump: 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.727 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:21:52.177+0000 7fe443a15800 5 monclient: authenticate success, global_id 7941 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:21:52.177+0000 7fe32d60a640 4 set_mon_vals no callback set 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:21:52.177+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:21:52.177+0000 7fe443a15800 1 librados: init done 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:21:52.179+0000 7fe32be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:21:52.179+0000 7fe43f192640 10 monclient: get_auth_request con 0x7fe324077230 auth_method 0 2024-09-14T11:21:52.728 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:21:52.179+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a272580 auth_method 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:21:52.180+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a295140 auth_method 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:21:52.181+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a299540 auth_method 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:21:52.182+0000 7fe43f993640 10 monclient: get_auth_request con 0x55cc3a2989a0 auth_method 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:21:52.182+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:21:52.182+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:21:52.182+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.729 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.731 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.731 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding auth protocol: cephx 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.732 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: crc 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:21:52.182+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a1700) adding con mode: secure 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command objecter_requests cmddesc objecter_requests hook 0x55cc3a2a4bc0 EEXIST 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding auth protocol: cephx 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.733 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: crc 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2a0648) adding con mode: secure 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:21:52.183+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:21:52.183+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x55cc3a2a0790 EEXIST 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a2c8ee0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a2c92c0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.734 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a2c7bf0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:21:52.183+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.818819s 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a2c92c0 auth_method 0 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:21:52.183+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a2c7bf0 auth_method 0 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:21:52.183+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.735 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2c8ee0 auth_method 0 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:21:52.184+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:21:52.184+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-14T11:21:52.736 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:21:52.184+0000 7fe43f993640 1 monclient: found mon.noname-c 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:21:52.184+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: dump: 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.737 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:21:52.184+0000 7fe329602640 10 monclient: dump: 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.738 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:21:52.184+0000 7fe443a15800 5 monclient: authenticate success, global_id 7517 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:21:52.184+0000 7fe440194640 4 set_mon_vals no callback set 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:21:52.184+0000 7fe443a15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:21:52.186+0000 7fe329602640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:21:52.186+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe318077140 auth_method 0 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: get_monmap_and_config 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:21:52.186+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.739 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:21:52.186+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding auth protocol: cephx 2024-09-14T11:21:52.740 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: crc 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:21:52.186+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2e89b0) adding con mode: secure 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:21:52.186+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.741 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding auth protocol: cephx 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: crc 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8bc90) adding con mode: secure 2024-09-14T11:21:52.742 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:21:52.187+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:21:52.187+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:21:52.187+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x7fffaad8bdd8 EEXIST 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a2ecae0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a317550 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a318900 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:21:52.187+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.822645s 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a317550 auth_method 0 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.743 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a318900 auth_method 0 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2ecae0 auth_method 0 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:21:52.187+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.744 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:21:52.187+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient(hunting): handle_auth_done global_id 7947 payload 274 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:21:52.187+0000 7fe43f993640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:21:52.187+0000 7fe43f993640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: dump: 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.745 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 monclient: authenticate success, global_id 7947 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: get_monmap_and_config success 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:21:52.188+0000 7fe443a15800 4 set_mon_vals no callback set 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.746 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:21:52.188+0000 7fe322ffd640 10 monclient: dump: 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: shutdown 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: build_initial_monmap 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:21:52.188+0000 7fe443a15800 1 build_initial for_mkfs: 0 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:21:52.188+0000 7fe443a15800 10 monclient: monmap: 2024-09-14T11:21:52.747 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding auth protocol: cephx 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.748 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: crc 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:21:52.188+0000 7fe443a15800 5 AuthRegistry(0x55cc3a30d700) adding con mode: secure 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: starting msgr at 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: starting objecter 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command objecter_requests cmddesc objecter_requests hook 0x55cc3a2ead70 EEXIST 2024-09-14T11:21:52.749 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: setting wanted keys 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:21:52.189+0000 7fe443a15800 1 librados: calling monclient init 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: init 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding auth protocol: cephx 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.750 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: crc 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 AuthRegistry(0x55cc3a2dd7a0) adding con mode: secure 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:21:52.189+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:21:52.189+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command rotate-key cmddesc rotate-key hook 0x55cc3a2dd8e8 EEXIST 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: _reopen_session rank -1 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-a con 0x55cc3a2ecae0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-b con 0x55cc3a318900 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): picked mon.noname-c con 0x55cc3a310220 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): start opening mon connection 2024-09-14T11:21:52.751 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): _renew_subs 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:21:52.189+0000 7fe443a15800 10 monclient(hunting): authenticate will time out at 2315.824911s 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): get_auth_request con 0x55cc3a2ecae0 auth_method 0 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): get_auth_request con 0x55cc3a310220 auth_method 0 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): get_auth_request con 0x55cc3a318900 auth_method 0 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.752 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:21:52.190+0000 7fe43f192640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:21:52.190+0000 7fe43f993640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient(hunting): handle_auth_done global_id 7950 payload 824 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient: _finish_hunting 0 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:21:52.190+0000 7fe43e991640 1 monclient: found mon.noname-a 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:21:52.190+0000 7fe43e991640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: dump: 2024-09-14T11:21:52.753 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: _finish_auth 0 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:21:52.754 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:21:52.190+0000 7fe3217fa640 10 monclient: dump: 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:21:52.190+0000 7fe322ffd640 4 set_mon_vals no callback set 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:21:52.190+0000 7fe443a15800 5 monclient: authenticate success, global_id 7950 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.755 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _renew_subs 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:21:52.190+0000 7fe443a15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:21:52.190+0000 7fe443a15800 1 librados: init done 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:21:52.190+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cr dump hook 0x55cc3a30d2e8 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:21:52.192+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:21:52.192+0000 7fe3217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:21:52.193+0000 7fe3217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:21:52.193+0000 7fe3217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:21:52.193+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe308077230 auth_method 0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:21:52.193+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a337220 auth_method 0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 realm 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:21:52.193+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:21:52.194+0000 7fe443a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.756 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:21:52.194+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:21:52.194+0000 7fe43e991640 10 monclient: get_auth_request con 0x55cc3a33b400 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:21:52.195+0000 7fe43f993640 10 monclient: get_auth_request con 0x55cc3a33ec60 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:21:52.195+0000 7fe443a15800 20 searching for the correct realm 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:21:52.195+0000 7fe43f192640 10 monclient: get_auth_request con 0x55cc3a343a20 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:21:52.196+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe430039c20 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:21:52.197+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe438064ab0 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:21:52.197+0000 7fe43f993640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe438064ab0 msgr2=0x7fe438062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:21:52.398+0000 7fe43f993640 10 monclient: get_auth_request con 0x7fe438064ab0 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:21:52.400+0000 7fe43f192640 10 monclient: get_auth_request con 0x7fe43806a400 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:21:52.402+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe438079050 auth_method 0 2024-09-14T11:21:52.757 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:21:52.402+0000 7fe43e991640 0 -- 172.21.15.29:0/806978999 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe438079050 msgr2=0x7fe43806b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:21:52.603+0000 7fe43e991640 10 monclient: get_auth_request con 0x7fe438079050 auth_method 0 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:21:52.608+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 zone default found 2024-09-14T11:21:52.758 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 Realm: () 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:21:52.609+0000 7fe443a15800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:21:52.609+0000 7fe443a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 zonegroup default 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:21:52.609+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 started sync module instance, tier type = 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:21:52.610+0000 7fe443a15800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=0 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=1 2024-09-14T11:21:52.759 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=2 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=3 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=4 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=5 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:21:52.620+0000 7fe443a15800 20 add_watcher() i=6 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:21:52.621+0000 7fe443a15800 20 add_watcher() i=7 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:21:52.621+0000 7fe443a15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding auth protocol: cephx 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.760 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: crc 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:21:52.622+0000 7fe443a15800 5 AuthRegistry(0x7fffaad8c170) adding con mode: secure 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:21:52.622+0000 7fe2f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:21:52.623+0000 7fe443a15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache list hook 0x55cc3a310620 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache inspect hook 0x55cc3a310620 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache erase hook 0x55cc3a310620 2024-09-14T11:21:52.761 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command cache zap hook 0x55cc3a310620 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 note: GC not initialized 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:21:52.623+0000 7fe2f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace show hook 0x7fe430021040 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace history hook 0x7fe430021040 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace active hook 0x7fe430021040 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:21:52.623+0000 7fe443a15800 5 asok(0x55cc3a029270) register_command sync trace active_short hook 0x7fe430021040 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 Filter name: none 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:21:52.623+0000 7fe26e7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:21:52.623+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:21:52.623+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:52.762 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : miss 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:21:52.624+0000 7fe443a15800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:21:52.624+0000 7fe443a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:21:52.629+0000 7fe443a15800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497087 cookie 94335638226144 notifier 7950 bl.length()=1015 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:52.763 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:21:52.630+0000 7fe322ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:21:52.631+0000 7fe443a15800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.0 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.1 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.2 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.3 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.764 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.4 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.5 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.6 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.7 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.8 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.9 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.10 2024-09-14T11:21:52.765 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:21:52.637+0000 7fe443a15800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1.11 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:21:52.637+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.0 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:21:52.638+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.3 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.4 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:21:52.639+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.5 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:21:52.640+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.6 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.7 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.8 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:21:52.641+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.9 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:21:52.642+0000 7fe443a15800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.10 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:21:52.646+0000 7fe443a15800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe443a15800 time 2024-09-14T11:21:52.646050+0000 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:21:52.766 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fe444b8c76a] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:21:52.646+0000 7fe443a15800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fe443a15800 thread_name:radosgw-admin 2024-09-14T11:21:52.767 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fe44383e6f0] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fe44388b99c] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fe444b8c7c4] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fe444b8c928] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cc377460b1] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55cc37755124] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55cc37755fc4] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fe443829590] 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:21:52.768 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:21:52.769 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:21:52.770 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:21:52.771 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:21:52.772 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:21:52.773 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:21:52.774 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe26e7fc640 / http_manager 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe2f4fe1640 / http_manager 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe2f5fe3640 / rgw_dt_lg_renew 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe3217fa640 / ms_dispatch 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe322ffd640 / io_context_pool 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe329602640 / ms_dispatch 2024-09-14T11:21:52.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe32be07640 / ms_dispatch 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe32d60a640 / io_context_pool 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43e991640 / msgr-worker-2 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43f192640 / msgr-worker-1 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe43f993640 / msgr-worker-0 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe440194640 / io_context_pool 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: 7fe443a15800 / radosgw-admin 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:21:52.647711Z_65443385-cdd3-40b8-a5e3-e8e00924d02b/log 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:21:52.776 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.726+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 20 realm 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.727+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.728+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.728+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.729+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:52.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.729+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:52.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.729+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:52.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.729+0000 7fa97b728800 20 searching for the correct realm 2024-09-14T11:21:52.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.731+0000 7fa977c70640 0 -- 172.21.15.29:0/997015725 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fa9700ab270 msgr2=0x7fa970069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:52.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:52.938+0000 7fa976c6e640 0 -- 172.21.15.29:0/997015725 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fa97007a2e0 msgr2=0x7fa970073d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:53.143 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.144 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.145+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 zone default found 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 4 Realm: () 2024-09-14T11:21:53.145 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 zonegroup default 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.146+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.147+0000 7fa97b728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.147+0000 7fa97b728800 20 started sync module instance, tier type = 2024-09-14T11:21:53.146 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.147+0000 7fa97b728800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:53.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=0 2024-09-14T11:21:53.154 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=1 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=2 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=3 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=4 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=5 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.156+0000 7fa97b728800 20 add_watcher() i=6 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.157+0000 7fa97b728800 20 add_watcher() i=7 2024-09-14T11:21:53.155 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.157+0000 7fa97b728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:53.157 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.159+0000 7fa82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 5 note: GC not initialized 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa82cfe1640 20 reqs_thread_entry: start 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:53.158 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 20 Filter name: none 2024-09-14T11:21:53.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa7a67fc640 20 reqs_thread_entry: start 2024-09-14T11:21:53.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.160+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.161+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:53.159 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.161+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.161+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.161+0000 7fa97b728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.161+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.162+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.162+0000 7fa97b728800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.162+0000 7fa97b728800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:21:53.160 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.162+0000 7fa97b728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:21:53.162 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.164+0000 7fa82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:53.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.166+0000 7fa97b728800 20 remove_watcher() i=0 2024-09-14T11:21:53.164 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.166+0000 7fa97b728800 2 removed watcher, disabling cache 2024-09-14T11:21:53.165 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.167+0000 7fa97b728800 20 remove_watcher() i=1 2024-09-14T11:21:53.166 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.168+0000 7fa97b728800 20 remove_watcher() i=2 2024-09-14T11:21:53.167 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.169+0000 7fa97b728800 20 remove_watcher() i=3 2024-09-14T11:21:53.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.170+0000 7fa97b728800 20 remove_watcher() i=4 2024-09-14T11:21:53.169 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.171+0000 7fa97b728800 20 remove_watcher() i=5 2024-09-14T11:21:53.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.172+0000 7fa97b728800 20 remove_watcher() i=6 2024-09-14T11:21:53.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.173+0000 7fa97b728800 20 remove_watcher() i=7 2024-09-14T11:21:53.183 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:53.183 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:21:53.183 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.40 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:21:53.183 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:21:53.276 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:21:53.339 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:53.339 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:53.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.352+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.352 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 realm 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.354+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.355+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:53.353 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.355+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.356+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:53.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.356+0000 7ff8d0616800 20 searching for the correct realm 2024-09-14T11:21:53.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.356+0000 7ff8cbde7640 0 -- 172.21.15.29:0/1642167347 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x556ba45a1290 msgr2=0x556ba45a3750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:53.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.562+0000 7ff8cbde7640 0 -- 172.21.15.29:0/1642167347 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7ff8c406c220 msgr2=0x7ff8c406f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:53.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:21:53.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:53.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.771+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 zone default found 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 4 Realm: () 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:53.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 zonegroup default 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.772+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.773+0000 7ff8d0616800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.773+0000 7ff8d0616800 20 started sync module instance, tier type = 2024-09-14T11:21:53.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.773+0000 7ff8d0616800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:21:53.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=0 2024-09-14T11:21:53.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=1 2024-09-14T11:21:53.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=2 2024-09-14T11:21:53.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=3 2024-09-14T11:21:53.780 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=4 2024-09-14T11:21:53.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=5 2024-09-14T11:21:53.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.782+0000 7ff8d0616800 20 add_watcher() i=6 2024-09-14T11:21:53.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.783+0000 7ff8d0616800 20 add_watcher() i=7 2024-09-14T11:21:53.781 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.783+0000 7ff8d0616800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:53.783 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.785+0000 7ff781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.785+0000 7ff8d0616800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.785+0000 7ff8d0616800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.785+0000 7ff8d0616800 5 note: GC not initialized 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff780fe1640 20 reqs_thread_entry: start 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 20 init_complete bucket index max shards: 11 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 20 Filter name: none 2024-09-14T11:21:53.784 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff6fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.786+0000 7ff8d0616800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : miss 2024-09-14T11:21:53.785 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 20 rados->read ofs=0 len=0 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.787+0000 7ff8d0616800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:21:53.786 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.788+0000 7ff8d0616800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to be held by another RGW process; skipping for now 2024-09-14T11:21:53.787 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.789+0000 7ff781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:53.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.791+0000 7ff8d0616800 20 remove_watcher() i=0 2024-09-14T11:21:53.790 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.791+0000 7ff8d0616800 2 removed watcher, disabling cache 2024-09-14T11:21:53.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.793+0000 7ff8d0616800 20 remove_watcher() i=1 2024-09-14T11:21:53.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.794+0000 7ff8d0616800 20 remove_watcher() i=2 2024-09-14T11:21:53.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.795+0000 7ff8d0616800 20 remove_watcher() i=3 2024-09-14T11:21:53.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.796+0000 7ff8d0616800 20 remove_watcher() i=4 2024-09-14T11:21:53.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.797+0000 7ff8d0616800 20 remove_watcher() i=5 2024-09-14T11:21:53.796 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.798+0000 7ff8d0616800 20 remove_watcher() i=6 2024-09-14T11:21:53.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:21:53.799+0000 7ff8d0616800 20 remove_watcher() i=7 2024-09-14T11:21:53.809 INFO:tasks.workunit.client.0.smithi029.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:22:23.841 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:22:23.878 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:23.879 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:23.924 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.926+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 20 realm 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.927+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.928+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:23.926 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.928+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:23.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.929+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:23.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.929+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:23.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.929+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:23.928 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.929+0000 7f4176542800 20 searching for the correct realm 2024-09-14T11:22:23.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:23.932+0000 7f4172a87640 0 -- 172.21.15.29:0/2647782486 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f416c033060 msgr2=0x7f416c066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:24.137 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.139+0000 7f4171a85640 0 -- 172.21.15.29:0/2647782486 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f416c071460 msgr2=0x7f416c088450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:24.346 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:24.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.347 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.347+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:24.348 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 zone default found 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 4 Realm: () 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 zonegroup default 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.348+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.349+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.349+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.349+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.349 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.349+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.350+0000 7f4176542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.350+0000 7f4176542800 20 started sync module instance, tier type = 2024-09-14T11:22:24.350 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.350+0000 7f4176542800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:24.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=0 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=1 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=2 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=3 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=4 2024-09-14T11:22:24.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.362+0000 7f4176542800 20 add_watcher() i=5 2024-09-14T11:22:24.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.364+0000 7f4176542800 20 add_watcher() i=6 2024-09-14T11:22:24.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.364+0000 7f4176542800 20 add_watcher() i=7 2024-09-14T11:22:24.362 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.364+0000 7f4176542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:24.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.366+0000 7f4028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.366+0000 7f4176542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.366+0000 7f4176542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.366+0000 7f4176542800 5 note: GC not initialized 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f3fa37fe640 20 reqs_thread_entry: start 2024-09-14T11:22:24.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 20 Filter name: none 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f3fa17fa640 20 reqs_thread_entry: start 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:22:24.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.367+0000 7f4176542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : miss 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 20 rados_obj.operate() r=0 bl.length=475 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.367 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.368+0000 7f4176542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:22:24.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.370+0000 7f4176542800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:22:24.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.379+0000 7f4176542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.379+0000 7f4176542800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.379+0000 7f4176542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.379+0000 7f4176542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.380+0000 7f4055ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497088 cookie 94046602036080 notifier 7577 bl.length()=1015 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.380+0000 7f4055ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.380+0000 7f4055ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.380+0000 7f4055ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.382+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:22:24.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.382+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:22:24.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.382+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:22:24.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.382+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.0 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.0 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.1 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.1 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.2 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.2 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.3 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.3 2024-09-14T11:22:24.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.4 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.4 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.5 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.5 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.6 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.6 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.7 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.7 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.8 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.8 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.9 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.9 2024-09-14T11:22:24.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.10 2024-09-14T11:22:24.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.10 2024-09-14T11:22:24.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.11 2024-09-14T11:22:24.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2.11 2024-09-14T11:22:24.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.387+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.0 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.388+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.389+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.389+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.3 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.390+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.4 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.390+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.5 2024-09-14T11:22:24.389 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.391+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.6 2024-09-14T11:22:24.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.392+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.7 2024-09-14T11:22:24.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.392+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.8 2024-09-14T11:22:24.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.393+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.9 2024-09-14T11:22:24.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.394+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.10 2024-09-14T11:22:24.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.397+0000 7f4176542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:22:24.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.397+0000 7f4176542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.398+0000 7f4176542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.398+0000 7f4176542800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.398+0000 7f4176542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.398+0000 7f4176542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.399+0000 7f4055ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497089 cookie 94046602036080 notifier 7577 bl.length()=1015 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.399+0000 7f4055ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.399+0000 7f4055ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.399+0000 7f4055ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.401+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:22:24.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.401+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:22:24.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.401+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:22:24.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.401+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:22:24.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.403+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.0 2024-09-14T11:22:24.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.404+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.1 2024-09-14T11:22:24.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.404+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.2 2024-09-14T11:22:24.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.405+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.3 2024-09-14T11:22:24.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.405+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.4 2024-09-14T11:22:24.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.405+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.5 2024-09-14T11:22:24.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.406+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.6 2024-09-14T11:22:24.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.406+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.7 2024-09-14T11:22:24.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.406+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.8 2024-09-14T11:22:24.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.407+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.9 2024-09-14T11:22:24.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.407+0000 7f4176542800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.40.10 2024-09-14T11:22:24.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.408+0000 7f4176542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 : hit (requested=0x17, cached=0x17) 2024-09-14T11:22:24.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.408+0000 7f4176542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 2024-09-14T11:22:24.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.409+0000 7f4176542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.409+0000 7f4176542800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.409+0000 7f4176542800 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.409+0000 7f4176542800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40, ofs0, ns] 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.410+0000 7f40557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497090 cookie 94046602036080 notifier 7577 bl.length()=983 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.410+0000 7f40557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 info.flags=0x17 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.410+0000 7f40557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:11989569-703c-4397-b0f1-7ddb0279a491.4517.40 to cache LRU end 2024-09-14T11:22:24.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.410+0000 7f40557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-09-14T11:22:24.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.411+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_sources= new_sources= 2024-09-14T11:22:24.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.411+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential sources added=[] removed=[] 2024-09-14T11:22:24.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.411+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): orig_dests= new_dests= 2024-09-14T11:22:24.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.411+0000 7f4176542800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[11989569-703c-4397-b0f1-7ddb0279a491.4517.40]): potential dests added=[] removed=[] 2024-09-14T11:22:24.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.415+0000 7f4176542800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:22:24.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.417+0000 7f4028fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:24.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.419+0000 7f4176542800 20 remove_watcher() i=0 2024-09-14T11:22:24.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.419+0000 7f4176542800 2 removed watcher, disabling cache 2024-09-14T11:22:24.418 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.420+0000 7f4176542800 20 remove_watcher() i=1 2024-09-14T11:22:24.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.421+0000 7f4176542800 20 remove_watcher() i=2 2024-09-14T11:22:24.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.423+0000 7f4176542800 20 remove_watcher() i=3 2024-09-14T11:22:24.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.424+0000 7f4176542800 20 remove_watcher() i=4 2024-09-14T11:22:24.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.425+0000 7f4176542800 20 remove_watcher() i=5 2024-09-14T11:22:24.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.426+0000 7f4176542800 20 remove_watcher() i=6 2024-09-14T11:22:24.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.427+0000 7f4176542800 20 remove_watcher() i=7 2024-09-14T11:22:24.439 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:22:24.470 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:24.470 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:24.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.512+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 20 realm 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.514+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.515+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.515+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.516+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:24.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.516+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.516+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:24.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.516+0000 7f9b9a544800 20 searching for the correct realm 2024-09-14T11:22:24.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.518+0000 7f9b96af5640 0 -- 172.21.15.29:0/2500656489 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9b900608c0 msgr2=0x7f9b90077ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:24.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.725+0000 7f9b95af3640 0 -- 172.21.15.29:0/2500656489 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9b900746e0 msgr2=0x7f9b9006b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:24.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:24.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.932+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.933+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.933+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.933+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 zone default found 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 4 Realm: () 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:24.932 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 zonegroup default 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.934+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.935+0000 7f9b9a544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:24.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.935+0000 7f9b9a544800 20 started sync module instance, tier type = 2024-09-14T11:22:24.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.935+0000 7f9b9a544800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=0 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=1 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=2 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=3 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=4 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=5 2024-09-14T11:22:24.944 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.945+0000 7f9b9a544800 20 add_watcher() i=6 2024-09-14T11:22:24.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.946+0000 7f9b9a544800 20 add_watcher() i=7 2024-09-14T11:22:24.945 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.946+0000 7f9b9a544800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:24.946 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.948+0000 7f9a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.948+0000 7f9b9a544800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.948+0000 7f9b9a544800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.948+0000 7f9b9a544800 5 note: GC not initialized 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.948+0000 7f99c77fe640 20 reqs_thread_entry: start 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f9b9a544800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f9b9a544800 20 Filter name: none 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f99c57fa640 20 reqs_thread_entry: start 2024-09-14T11:22:24.947 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:22:24.948 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.949+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.950+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.950+0000 7f9b9a544800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.950+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.951+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=221 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.951+0000 7f9b9a544800 20 rados->read ofs=0 len=0 2024-09-14T11:22:24.949 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.951+0000 7f9b9a544800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:22:24.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.951+0000 7f9b9a544800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:24.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.953+0000 7f9a4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:24.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.955+0000 7f9b9a544800 20 remove_watcher() i=0 2024-09-14T11:22:24.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.955+0000 7f9b9a544800 2 removed watcher, disabling cache 2024-09-14T11:22:24.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.956+0000 7f9b9a544800 20 remove_watcher() i=1 2024-09-14T11:22:24.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.957+0000 7f9b9a544800 20 remove_watcher() i=2 2024-09-14T11:22:24.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.959+0000 7f9b9a544800 20 remove_watcher() i=3 2024-09-14T11:22:24.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.960+0000 7f9b9a544800 20 remove_watcher() i=4 2024-09-14T11:22:24.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.961+0000 7f9b9a544800 20 remove_watcher() i=5 2024-09-14T11:22:24.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.962+0000 7f9b9a544800 20 remove_watcher() i=6 2024-09-14T11:22:24.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:24.963+0000 7f9b9a544800 20 remove_watcher() i=7 2024-09-14T11:22:24.973 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:24.973 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:22:24.973 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: abort-at-change-reshard-state id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.40 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:22:24.974 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:25.359 INFO:tasks.workunit.client.0.smithi029.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:22:25.361 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:25.391 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:25.391 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:25.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.432+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 realm 2024-09-14T11:22:25.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.434+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.435+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:25.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.435+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.436+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:25.434 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.436+0000 7f0c40a98800 20 searching for the correct realm 2024-09-14T11:22:25.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.438+0000 7f0c3ed83640 0 -- 172.21.15.29:0/1568042092 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0c38097040 msgr2=0x7f0c38098940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:25.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.645+0000 7f0c3dd81640 0 -- 172.21.15.29:0/1568042092 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0c38096be0 msgr2=0x7f0c38061400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:25.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:25.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:25.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.852+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 zone default found 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 4 Realm: () 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:25.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 zonegroup default 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.853+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.854+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.854+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.854+0000 7f0c40a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.854+0000 7f0c40a98800 20 started sync module instance, tier type = 2024-09-14T11:22:25.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.854+0000 7f0c40a98800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:25.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=0 2024-09-14T11:22:25.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=1 2024-09-14T11:22:25.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=2 2024-09-14T11:22:25.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=3 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=4 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=5 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.865+0000 7f0c40a98800 20 add_watcher() i=6 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.866+0000 7f0c40a98800 20 add_watcher() i=7 2024-09-14T11:22:25.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.866+0000 7f0c40a98800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:25.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.868+0000 7f0af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:25.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:25.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:25.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 5 note: GC not initialized 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0a6f7fe640 20 reqs_thread_entry: start 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 20 Filter name: none 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0a6d7fa640 20 reqs_thread_entry: start 2024-09-14T11:22:25.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.869+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.870+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.870+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:25.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:25.870 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.871+0000 7f0c40a98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:25.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.874+0000 7f0af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:25.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.876+0000 7f0c40a98800 20 remove_watcher() i=0 2024-09-14T11:22:25.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.876+0000 7f0c40a98800 2 removed watcher, disabling cache 2024-09-14T11:22:25.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.877+0000 7f0c40a98800 20 remove_watcher() i=1 2024-09-14T11:22:25.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.878+0000 7f0c40a98800 20 remove_watcher() i=2 2024-09-14T11:22:25.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.880+0000 7f0c40a98800 20 remove_watcher() i=3 2024-09-14T11:22:25.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.881+0000 7f0c40a98800 20 remove_watcher() i=4 2024-09-14T11:22:25.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.882+0000 7f0c40a98800 20 remove_watcher() i=5 2024-09-14T11:22:25.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.883+0000 7f0c40a98800 20 remove_watcher() i=6 2024-09-14T11:22:25.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.884+0000 7f0c40a98800 20 remove_watcher() i=7 2024-09-14T11:22:25.895 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:25.895 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:22:25.895 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:22:25.895 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:25.897 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:25.927 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:25.928 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:25.970 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.972+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 realm 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.974+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.975+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.975+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.976+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:25.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.976+0000 7fb2ecd2e800 20 searching for the correct realm 2024-09-14T11:22:25.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.976+0000 7fb2e8add640 0 -- 172.21.15.29:0/1006800945 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x5595d4c45cd0 msgr2=0x5595d4c48190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:25.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:25.980+0000 7fb2e8add640 0 -- 172.21.15.29:0/1006800945 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x5595d49f8980 msgr2=0x7fb2e0036910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.189+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 zone default found 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 4 Realm: () 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 zonegroup default 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.190+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.191+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.191+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.191+0000 7fb2ecd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.191+0000 7fb2ecd2e800 20 started sync module instance, tier type = 2024-09-14T11:22:26.190 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.191+0000 7fb2ecd2e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:26.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=0 2024-09-14T11:22:26.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=1 2024-09-14T11:22:26.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=2 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=3 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=4 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=5 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.201+0000 7fb2ecd2e800 20 add_watcher() i=6 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.202+0000 7fb2ecd2e800 20 add_watcher() i=7 2024-09-14T11:22:26.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.202+0000 7fb2ecd2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:26.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.204+0000 7fb19f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:26.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:26.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 5 note: GC not initialized 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb19e7dc640 20 reqs_thread_entry: start 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 20 Filter name: none 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb10ffff640 20 reqs_thread_entry: start 2024-09-14T11:22:26.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.205+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.206+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.206+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.206+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.206+0000 7fb2ecd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.206+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.207+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:26.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.207+0000 7fb2ecd2e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.207+0000 7fb2ecd2e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:26.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.207+0000 7fb2ecd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:26.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.209+0000 7fb19f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:26.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.212+0000 7fb2ecd2e800 20 remove_watcher() i=0 2024-09-14T11:22:26.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.212+0000 7fb2ecd2e800 2 removed watcher, disabling cache 2024-09-14T11:22:26.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.213+0000 7fb2ecd2e800 20 remove_watcher() i=1 2024-09-14T11:22:26.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.214+0000 7fb2ecd2e800 20 remove_watcher() i=2 2024-09-14T11:22:26.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.215+0000 7fb2ecd2e800 20 remove_watcher() i=3 2024-09-14T11:22:26.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.217+0000 7fb2ecd2e800 20 remove_watcher() i=4 2024-09-14T11:22:26.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.218+0000 7fb2ecd2e800 20 remove_watcher() i=5 2024-09-14T11:22:26.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.219+0000 7fb2ecd2e800 20 remove_watcher() i=6 2024-09-14T11:22:26.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.221+0000 7fb2ecd2e800 20 remove_watcher() i=7 2024-09-14T11:22:26.232 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:22:26.267 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:26.267 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:26.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.309+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 realm 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.313+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:26.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.313+0000 7efe19b25800 20 searching for the correct realm 2024-09-14T11:22:26.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.315+0000 7efe15faf640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efe10047070 msgr2=0x7efe1003e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.522+0000 7efe14fad640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe10017070 msgr2=0x7efe10057400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:26.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 zone default found 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 4 Realm: () 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:26.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 zonegroup default 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.732+0000 7efe19b25800 20 started sync module instance, tier type = 2024-09-14T11:22:26.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.732+0000 7efe19b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.743+0000 7efe19b25800 20 add_watcher() i=0 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=1 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=2 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=3 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=4 2024-09-14T11:22:26.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=5 2024-09-14T11:22:26.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=6 2024-09-14T11:22:26.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.745+0000 7efe19b25800 20 add_watcher() i=7 2024-09-14T11:22:26.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.745+0000 7efe19b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:26.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efccb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:26.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:26.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:26.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efe19b25800 5 note: GC not initialized 2024-09-14T11:22:26.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efcca7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.747+0000 7efe19b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 20 Filter name: none 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efc3bfff640 20 reqs_thread_entry: start 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:22:26.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.749+0000 7efe19b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:22:26.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.755+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.755+0000 7efe19b25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.755+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.755+0000 7efe19b25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 93945317478912 notifier 8079 bl.length()=911 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:22:26.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:22:26.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:22:26.756 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.767+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.767+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.770+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.770+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.771+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.771+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.772+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.770 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.772+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.772 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe19b25800 time 2024-09-14T11:22:26.775118+0000 2024-09-14T11:22:26.772 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1b18c76a] 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.773 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.775+0000 7efe19b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe19b25800 time 2024-09-14T11:22:26.775118+0000 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1b18c76a] 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.774 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:22:26.775 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7efe19b25800 thread_name:radosgw-admin 2024-09-14T11:22:26.794 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.794 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe19e3e6f0] 2024-09-14T11:22:26.794 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe19e8b99c] 2024-09-14T11:22:26.794 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1b18c7c4] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.776+0000 7efe19b25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:26.795 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7efe19b25800 thread_name:radosgw-admin 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe19e3e6f0] 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe19e8b99c] 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1b18c7c4] 2024-09-14T11:22:26.796 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.797 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x557159212d00 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x55715921f840 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x5571592b2a20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.798 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.927572s 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x557159212d00 auth_method 0 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x5571592b2a20 auth_method 0 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.799 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715921f840 auth_method 0 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_done global_id 8070 payload 824 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.800 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:22:26.292+0000 7efe157ae640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: dump: 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.801 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: dump: 2024-09-14T11:22:26.802 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.803 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:22:26.293+0000 7efe19b25800 5 monclient: authenticate success, global_id 8070 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:22:26.293+0000 7efd03606640 4 set_mon_vals no callback set 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:22:26.293+0000 7efe19b25800 1 librados: init done 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.804 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:22:26.295+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efcfc077230 auth_method 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:22:26.296+0000 7efe15faf640 10 monclient: get_auth_request con 0x557159392940 auth_method 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:22:26.296+0000 7efe157ae640 10 monclient: get_auth_request con 0x5571593b5310 auth_method 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:22:26.297+0000 7efe14fad640 10 monclient: get_auth_request con 0x5571593b9550 auth_method 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:22:26.298+0000 7efe15faf640 10 monclient: get_auth_request con 0x5571593b8b90 auth_method 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:22:26.299+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.805 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.806 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:22:26.299+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 asok(0x557159147270) register_command objecter_requests cmddesc objecter_requests hook 0x5571593c50e0 EEXIST 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.807 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:22:26.299+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:22:26.300+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.808 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:22:26.300+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x5571593c0730 EEXIST 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x5571593e8dd0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x5571593eb0a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x5571593e75a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.935301s 2024-09-14T11:22:26.809 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x5571593e8dd0 auth_method 0 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x5571593eb0a0 auth_method 0 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x5571593e75a0 auth_method 0 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.810 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_done global_id 8073 payload 824 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:22:26.300+0000 7efe14fad640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.811 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: dump: 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.812 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.813 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.814 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: dump: 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.815 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:22:26.301+0000 7efe19b25800 5 monclient: authenticate success, global_id 8073 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:22:26.301+0000 7efe167b0640 4 set_mon_vals no callback set 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.816 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:22:26.303+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efcf0077140 auth_method 0 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: get_monmap_and_config 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:22:26.303+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.817 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.818 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:22:26.303+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.819 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:22:26.304+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.820 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:22:26.304+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.821 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x7ffca4257ca8 EEXIST 2024-09-14T11:22:26.821 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.821 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:22:26.821 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x55715943d130 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.821 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x55715942da80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x557159438560 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.939574s 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x55715942da80 auth_method 0 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715943d130 auth_method 0 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.824 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x557159438560 auth_method 0 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_done global_id 8076 payload 274 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:22:26.304+0000 7efe15faf640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.825 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: dump: 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.826 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 monclient: authenticate success, global_id 8076 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: get_monmap_and_config success 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:22:26.305+0000 7efe19b25800 4 set_mon_vals no callback set 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: dump: 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.827 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: shutdown 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:22:26.305+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.828 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.829 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: starting msgr at 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: starting objecter 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 asok(0x557159147270) register_command objecter_requests cmddesc objecter_requests hook 0x55715940e870 EEXIST 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: setting wanted keys 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: calling monclient init 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.830 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.831 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x557159400cc8 EEXIST 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x55715942da80 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x557159438560 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x55715943d130 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.941860s 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x55715943d130 auth_method 0 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.832 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x557159438560 auth_method 0 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715942da80 auth_method 0 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.833 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_done global_id 8079 payload 824 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:22:26.307+0000 7efe157ae640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: dump: 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.834 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: dump: 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.835 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:22:26.307+0000 7efcf8ff9640 4 set_mon_vals no callback set 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:22:26.307+0000 7efe19b25800 5 monclient: authenticate success, global_id 8079 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:22:26.307+0000 7efe19b25800 1 librados: init done 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:22:26.307+0000 7efe19b25800 5 asok(0x557159147270) register_command cr dump hook 0x557159431b08 2024-09-14T11:22:26.836 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:22:26.309+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:22:26.310+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efce0077260 auth_method 0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:22:26.310+0000 7efe15faf640 10 monclient: get_auth_request con 0x557159457b30 auth_method 0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 realm 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:22:26.311+0000 7efe19b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.837 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:22:26.311+0000 7efe14fad640 10 monclient: get_auth_request con 0x55715945bd90 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:22:26.312+0000 7efe15faf640 10 monclient: get_auth_request con 0x55715945f5f0 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:22:26.313+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:22:26.313+0000 7efe19b25800 20 searching for the correct realm 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:22:26.313+0000 7efe157ae640 10 monclient: get_auth_request con 0x557159464300 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:22:26.314+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe08046090 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:22:26.315+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efe10047070 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:22:26.315+0000 7efe15faf640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efe10047070 msgr2=0x7efe1003e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:22:26.517+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efe10047070 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:22:26.519+0000 7efe157ae640 10 monclient: get_auth_request con 0x7efe10026040 auth_method 0 2024-09-14T11:22:26.838 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:22:26.522+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe10017070 auth_method 0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:22:26.522+0000 7efe14fad640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe10017070 msgr2=0x7efe10057400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:22:26.724+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe10017070 auth_method 0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:26.839 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 zone default found 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 Realm: () 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:22:26.731+0000 7efe19b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 zonegroup default 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 started sync module instance, tier type = 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:22:26.743+0000 7efe19b25800 20 add_watcher() i=0 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=1 2024-09-14T11:22:26.840 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=2 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=3 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=4 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=5 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=6 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:22:26.745+0000 7efe19b25800 20 add_watcher() i=7 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:22:26.745+0000 7efe19b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.841 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:22:26.747+0000 7efccb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:22:26.747+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache list hook 0x557159433340 2024-09-14T11:22:26.842 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache inspect hook 0x557159433340 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache erase hook 0x557159433340 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache zap hook 0x557159433340 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 note: GC not initialized 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:22:26.747+0000 7efcca7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace show hook 0x7efe10017e20 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace history hook 0x7efe10017e20 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace active hook 0x7efe10017e20 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace active_short hook 0x7efe10017e20 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 Filter name: none 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:22:26.748+0000 7efc3bfff640 20 reqs_thread_entry: start 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.843 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:22:26.749+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.844 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 93945317478912 notifier 8079 bl.length()=911 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.845 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.846 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.847 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.848 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:22:26.767+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:22:26.767+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.849 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:22:26.770+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:22:26.770+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:22:26.771+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:22:26.771+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:22:26.772+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.850 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:22:26.772+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:22:26.775+0000 7efe19b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe19b25800 time 2024-09-14T11:22:26.775118+0000 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1b18c76a] 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.851 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:22:26.776+0000 7efe19b25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7efe19b25800 thread_name:radosgw-admin 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe19e3e6f0] 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe19e8b99c] 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:22:26.852 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1b18c7c4] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:22:26.853 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:22:26.854 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:22:26.855 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:22:26.856 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:26.857 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:22:26.858 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:26.859 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:22:26.860 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efc3bfff640 / http_manager 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcca7e4640 / http_manager 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efccb7e6640 / rgw_dt_lg_renew 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efce6ffd640 / ms_dispatch 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcf8ff9640 / io_context_pool 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcfaffd640 / ms_dispatch 2024-09-14T11:22:26.861 INFO:tasks.workunit.client.0.smithi029.stderr: 7efd01e03640 / ms_dispatch 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efd03606640 / io_context_pool 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe14fad640 / msgr-worker-2 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe157ae640 / msgr-worker-1 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe15faf640 / msgr-worker-0 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe167b0640 / io_context_pool 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe19b25800 / radosgw-admin 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.146935.log 2024-09-14T11:22:26.862 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x557159212d00 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x55715921f840 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x5571592b2a20 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:22:26.292+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.927572s 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x557159212d00 auth_method 0 2024-09-14T11:22:26.863 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x5571592b2a20 auth_method 0 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:22:26.292+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715921f840 auth_method 0 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.864 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:22:26.292+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient(hunting): handle_auth_done global_id 8070 payload 824 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:22:26.292+0000 7efe157ae640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:22:26.292+0000 7efe157ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: dump: 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.865 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.866 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:22:26.293+0000 7efd01e03640 10 monclient: dump: 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.867 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:22:26.293+0000 7efe19b25800 5 monclient: authenticate success, global_id 8070 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.868 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:22:26.293+0000 7efd03606640 4 set_mon_vals no callback set 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:22:26.293+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:22:26.293+0000 7efe19b25800 1 librados: init done 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:22:26.295+0000 7efd01e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:22:26.295+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efcfc077230 auth_method 0 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:22:26.296+0000 7efe15faf640 10 monclient: get_auth_request con 0x557159392940 auth_method 0 2024-09-14T11:22:26.869 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:22:26.296+0000 7efe157ae640 10 monclient: get_auth_request con 0x5571593b5310 auth_method 0 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:22:26.297+0000 7efe14fad640 10 monclient: get_auth_request con 0x5571593b9550 auth_method 0 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:22:26.298+0000 7efe15faf640 10 monclient: get_auth_request con 0x5571593b8b90 auth_method 0 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:22:26.299+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.870 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding auth protocol: cephx 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.871 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: crc 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c16f0) adding con mode: secure 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:22:26.299+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 asok(0x557159147270) register_command objecter_requests cmddesc objecter_requests hook 0x5571593c50e0 EEXIST 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:22:26.299+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding auth protocol: cephx 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.872 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: crc 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:22:26.299+0000 7efe19b25800 5 AuthRegistry(0x5571593c05e8) adding con mode: secure 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:22:26.299+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:22:26.300+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.873 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:22:26.300+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x5571593c0730 EEXIST 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x5571593e8dd0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x5571593eb0a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x5571593e75a0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:22:26.300+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.935301s 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x5571593e8dd0 auth_method 0 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.874 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x5571593eb0a0 auth_method 0 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x5571593e75a0 auth_method 0 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:22:26.300+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.875 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:22:26.300+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient(hunting): handle_auth_done global_id 8073 payload 824 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:22:26.300+0000 7efe14fad640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:22:26.300+0000 7efe14fad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: dump: 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.876 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.877 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:22:26.301+0000 7efcfaffd640 10 monclient: dump: 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:22:26.301+0000 7efe19b25800 5 monclient: authenticate success, global_id 8073 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:22:26.301+0000 7efe167b0640 4 set_mon_vals no callback set 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.878 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:22:26.301+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:22:26.303+0000 7efcfaffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:22:26.303+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efcf0077140 auth_method 0 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: get_monmap_and_config 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:22:26.303+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:22:26.303+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.879 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding auth protocol: cephx 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.880 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: crc 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:22:26.303+0000 7efe19b25800 5 AuthRegistry(0x557159408b10) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:22:26.303+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding auth protocol: cephx 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.881 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: crc 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 AuthRegistry(0x7ffca4257b60) adding con mode: secure 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:22:26.304+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:22:26.304+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:22:26.304+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x7ffca4257ca8 EEXIST 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x55715943d130 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x55715942da80 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x557159438560 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.882 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:22:26.304+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.939574s 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x55715942da80 auth_method 0 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715943d130 auth_method 0 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.883 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:22:26.304+0000 7efe14fad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x557159438560 auth_method 0 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:22:26.304+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient(hunting): handle_auth_done global_id 8076 payload 274 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.884 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:22:26.304+0000 7efe15faf640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:22:26.304+0000 7efe15faf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: dump: 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.885 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 monclient: authenticate success, global_id 8076 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: get_monmap_and_config success 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:22:26.305+0000 7efe19b25800 4 set_mon_vals no callback set 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:22:26.305+0000 7efcf8ff9640 10 monclient: dump: 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.886 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: shutdown 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: build_initial_monmap 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:22:26.305+0000 7efe19b25800 1 build_initial for_mkfs: 0 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:22:26.305+0000 7efe19b25800 10 monclient: monmap: 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:22:26.887 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding auth protocol: cephx 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.888 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: crc 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:22:26.305+0000 7efe19b25800 5 AuthRegistry(0x55715940c690) adding con mode: secure 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: starting msgr at 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: starting objecter 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 asok(0x557159147270) register_command objecter_requests cmddesc objecter_requests hook 0x55715940e870 EEXIST 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: setting wanted keys 2024-09-14T11:22:26.889 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:22:26.306+0000 7efe19b25800 1 librados: calling monclient init 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: init 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding auth protocol: cephx 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.890 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: crc 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 AuthRegistry(0x557159400b80) adding con mode: secure 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:22:26.306+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:22:26.306+0000 7efe19b25800 5 asok(0x557159147270) register_command rotate-key cmddesc rotate-key hook 0x557159400cc8 EEXIST 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: _reopen_session rank -1 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-b con 0x55715942da80 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-c con 0x557159438560 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:22:26.891 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): picked mon.noname-a con 0x55715943d130 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): start opening mon connection 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): _renew_subs 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:22:26.306+0000 7efe19b25800 10 monclient(hunting): authenticate will time out at 2349.941860s 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): get_auth_request con 0x55715943d130 auth_method 0 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:22:26.306+0000 7efe157ae640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.892 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): get_auth_request con 0x557159438560 auth_method 0 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:22:26.307+0000 7efe15faf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): get_auth_request con 0x55715942da80 auth_method 0 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:22:26.893 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:22:26.307+0000 7efe14fad640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient(hunting): handle_auth_done global_id 8079 payload 824 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient: _finish_hunting 0 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:22:26.307+0000 7efe157ae640 1 monclient: found mon.noname-a 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:22:26.307+0000 7efe157ae640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: dump: 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.894 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:22:26.307+0000 7efce6ffd640 10 monclient: dump: 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:22:26.895 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:22:26.307+0000 7efcf8ff9640 4 set_mon_vals no callback set 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:22:26.307+0000 7efe19b25800 5 monclient: authenticate success, global_id 8079 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _renew_subs 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:22:26.307+0000 7efe19b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:22:26.307+0000 7efe19b25800 1 librados: init done 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:22:26.307+0000 7efe19b25800 5 asok(0x557159147270) register_command cr dump hook 0x557159431b08 2024-09-14T11:22:26.896 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:22:26.309+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:22:26.310+0000 7efce6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:22:26.310+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efce0077260 auth_method 0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:22:26.310+0000 7efe15faf640 10 monclient: get_auth_request con 0x557159457b30 auth_method 0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 realm 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:22:26.311+0000 7efe19b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:22:26.311+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:22:26.311+0000 7efe14fad640 10 monclient: get_auth_request con 0x55715945bd90 auth_method 0 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.897 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:22:26.312+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:22:26.312+0000 7efe15faf640 10 monclient: get_auth_request con 0x55715945f5f0 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:22:26.313+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:22:26.313+0000 7efe19b25800 20 searching for the correct realm 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:22:26.313+0000 7efe157ae640 10 monclient: get_auth_request con 0x557159464300 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:22:26.314+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe08046090 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:22:26.315+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efe10047070 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:22:26.315+0000 7efe15faf640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efe10047070 msgr2=0x7efe1003e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:22:26.517+0000 7efe15faf640 10 monclient: get_auth_request con 0x7efe10047070 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:22:26.519+0000 7efe157ae640 10 monclient: get_auth_request con 0x7efe10026040 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:22:26.522+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe10017070 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:22:26.522+0000 7efe14fad640 0 -- 172.21.15.29:0/2279517236 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe10017070 msgr2=0x7efe10057400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:22:26.724+0000 7efe14fad640 10 monclient: get_auth_request con 0x7efe10017070 auth_method 0 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:26.898 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:22:26.730+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 zone default found 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 Realm: () 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:22:26.731+0000 7efe19b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:22:26.731+0000 7efe19b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 zonegroup default 2024-09-14T11:22:26.899 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:22:26.731+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 started sync module instance, tier type = 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:22:26.732+0000 7efe19b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:22:26.743+0000 7efe19b25800 20 add_watcher() i=0 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=1 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=2 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=3 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=4 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=5 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:22:26.744+0000 7efe19b25800 20 add_watcher() i=6 2024-09-14T11:22:26.900 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:22:26.745+0000 7efe19b25800 20 add_watcher() i=7 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:22:26.745+0000 7efe19b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding auth protocol: cephx 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.901 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: crc 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 AuthRegistry(0x7ffca4258040) adding con mode: secure 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:22:26.747+0000 7efccb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:22:26.747+0000 7efe19b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache list hook 0x557159433340 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache inspect hook 0x557159433340 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache erase hook 0x557159433340 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command cache zap hook 0x557159433340 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 note: GC not initialized 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:22:26.747+0000 7efcca7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace show hook 0x7efe10017e20 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace history hook 0x7efe10017e20 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace active hook 0x7efe10017e20 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:22:26.747+0000 7efe19b25800 5 asok(0x557159147270) register_command sync trace active_short hook 0x7efe10017e20 2024-09-14T11:22:26.902 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:22:26.747+0000 7efe19b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 Filter name: none 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:22:26.748+0000 7efc3bfff640 20 reqs_thread_entry: start 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:22:26.748+0000 7efe19b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:22:26.748+0000 7efe19b25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:22:26.749+0000 7efe19b25800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:26.903 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:22:26.749+0000 7efe19b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:22:26.755+0000 7efe19b25800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497093 cookie 93945317478912 notifier 8079 bl.length()=911 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:22:26.756+0000 7efcf8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:22:26.757+0000 7efe19b25800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.904 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.1 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.2 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.3 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.4 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.5 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.905 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.6 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.7 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.8 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.9 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.10 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.11 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.12 2024-09-14T11:22:26.906 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.13 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:22:26.764+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:22:26.764+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:22:26.765+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:22:26.765+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:22:26.766+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:22:26.766+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:22:26.767+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:22:26.767+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.907 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:22:26.768+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:22:26.768+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:22:26.769+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:22:26.769+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:22:26.770+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:22:26.770+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:22:26.771+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:22:26.771+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:22:26.772+0000 7efe19b25800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:22:26.772+0000 7efe19b25800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:22:26.775+0000 7efe19b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efe19b25800 time 2024-09-14T11:22:26.775118+0000 2024-09-14T11:22:26.908 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7efe1b18c76a] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:22:26.776+0000 7efe19b25800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7efe19b25800 thread_name:radosgw-admin 2024-09-14T11:22:26.909 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7efe19e3e6f0] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7efe19e8b99c] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7efe1b18c7c4] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7efe1b18c928] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55715700a0b1] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x557157019124] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x557157019fc4] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7efe19e29590] 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:22:26.910 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:22:26.911 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:22:26.912 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:22:26.913 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:22:26.914 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:22:26.915 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:22:26.916 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:22:26.917 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:22:26.918 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efc3bfff640 / http_manager 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcca7e4640 / http_manager 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efccb7e6640 / rgw_dt_lg_renew 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efce6ffd640 / ms_dispatch 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcf8ff9640 / io_context_pool 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efcfaffd640 / ms_dispatch 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efd01e03640 / ms_dispatch 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efd03606640 / io_context_pool 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe14fad640 / msgr-worker-2 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe157ae640 / msgr-worker-1 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe15faf640 / msgr-worker-0 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe167b0640 / io_context_pool 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: 7efe19b25800 / radosgw-admin 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:22:26.919 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:22:26.776811Z_3b24b296-f52b-4a46-91f3-b0f2ad8e1d33/log 2024-09-14T11:22:26.920 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:22:26.920 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.858+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 20 realm 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.860+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.861+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.861+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.861+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.861+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.862+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.862+0000 7f1b2ba20800 20 searching for the correct realm 2024-09-14T11:22:26.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:26.865+0000 7f1b29d0b640 0 -- 172.21.15.29:0/3106433767 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1b24060980 msgr2=0x7f1b24084440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:27.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.071+0000 7f1b28d09640 0 -- 172.21.15.29:0/3106433767 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1b240a0920 msgr2=0x7f1b2406b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:27.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.277+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.278+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.278+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.278+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.278+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 zone default found 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 4 Realm: () 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 zonegroup default 2024-09-14T11:22:27.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.279+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.280+0000 7f1b2ba20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.280+0000 7f1b2ba20800 20 started sync module instance, tier type = 2024-09-14T11:22:27.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.280+0000 7f1b2ba20800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=0 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=1 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=2 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=3 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=4 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=5 2024-09-14T11:22:27.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.289+0000 7f1b2ba20800 20 add_watcher() i=6 2024-09-14T11:22:27.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.290+0000 7f1b2ba20800 20 add_watcher() i=7 2024-09-14T11:22:27.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.290+0000 7f1b2ba20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:27.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.292+0000 7f19df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:27.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:27.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:27.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 5 note: GC not initialized 2024-09-14T11:22:27.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f19de7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:27.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:27.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 20 Filter name: none 2024-09-14T11:22:27.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f194ffff640 20 reqs_thread_entry: start 2024-09-14T11:22:27.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.293+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.294+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.294+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.294+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.294+0000 7f1b2ba20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.294+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.295+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:27.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.295+0000 7f1b2ba20800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.295+0000 7f1b2ba20800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:27.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.295+0000 7f1b2ba20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:27.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.297+0000 7f19df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:27.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.299+0000 7f1b2ba20800 20 remove_watcher() i=0 2024-09-14T11:22:27.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.299+0000 7f1b2ba20800 2 removed watcher, disabling cache 2024-09-14T11:22:27.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.301+0000 7f1b2ba20800 20 remove_watcher() i=1 2024-09-14T11:22:27.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.302+0000 7f1b2ba20800 20 remove_watcher() i=2 2024-09-14T11:22:27.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.303+0000 7f1b2ba20800 20 remove_watcher() i=3 2024-09-14T11:22:27.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.304+0000 7f1b2ba20800 20 remove_watcher() i=4 2024-09-14T11:22:27.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.305+0000 7f1b2ba20800 20 remove_watcher() i=5 2024-09-14T11:22:27.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.306+0000 7f1b2ba20800 20 remove_watcher() i=6 2024-09-14T11:22:27.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.307+0000 7f1b2ba20800 20 remove_watcher() i=7 2024-09-14T11:22:27.358 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:22:27.387 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:27.388 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:27.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.429+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 realm 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.431+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.432+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:27.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.432+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.433+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:27.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.433+0000 7fab1bf2c800 20 searching for the correct realm 2024-09-14T11:22:27.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.434+0000 7fab1744e640 0 -- 172.21.15.29:0/3009858500 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fab0806e570 msgr2=0x7fab08076cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:27.436 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.438+0000 7fab1744e640 0 -- 172.21.15.29:0/3009858500 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fa9e00877e0 msgr2=0x7fa9e0089c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:27.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.445+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:27.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:27.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 zone default found 2024-09-14T11:22:27.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 4 Realm: () 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 zonegroup default 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.446+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.447+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.447+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.447+0000 7fab1bf2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.447+0000 7fab1bf2c800 20 started sync module instance, tier type = 2024-09-14T11:22:27.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.447+0000 7fab1bf2c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=0 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=1 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=2 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=3 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=4 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=5 2024-09-14T11:22:27.454 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.456+0000 7fab1bf2c800 20 add_watcher() i=6 2024-09-14T11:22:27.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.457+0000 7fab1bf2c800 20 add_watcher() i=7 2024-09-14T11:22:27.455 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.457+0000 7fab1bf2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:27.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.458+0000 7fa9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.458+0000 7fab1bf2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.458+0000 7fab1bf2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.458+0000 7fab1bf2c800 5 note: GC not initialized 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fa9ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:22:27.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fab1bf2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:27.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fab1bf2c800 20 Filter name: none 2024-09-14T11:22:27.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fa9467fc640 20 reqs_thread_entry: start 2024-09-14T11:22:27.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fab1bf2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:27.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.459+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:27.459 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.460+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.461+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:27.460 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.461+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.461+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.461+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.462+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.462+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.462+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.462+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:27.461 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.463+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.463+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.463+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.463+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.464+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.464+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:27.462 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.464+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.464+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:27.463 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:27.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.465+0000 7fab1bf2c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:27.465 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.467+0000 7fa9cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:27.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.469+0000 7fab1bf2c800 20 remove_watcher() i=0 2024-09-14T11:22:27.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.469+0000 7fab1bf2c800 2 removed watcher, disabling cache 2024-09-14T11:22:27.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.470+0000 7fab1bf2c800 20 remove_watcher() i=1 2024-09-14T11:22:27.469 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.471+0000 7fab1bf2c800 20 remove_watcher() i=2 2024-09-14T11:22:27.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.472+0000 7fab1bf2c800 20 remove_watcher() i=3 2024-09-14T11:22:27.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.473+0000 7fab1bf2c800 20 remove_watcher() i=4 2024-09-14T11:22:27.472 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.474+0000 7fab1bf2c800 20 remove_watcher() i=5 2024-09-14T11:22:27.473 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.475+0000 7fab1bf2c800 20 remove_watcher() i=6 2024-09-14T11:22:27.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:27.476+0000 7fab1bf2c800 20 remove_watcher() i=7 2024-09-14T11:22:57.495 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:57.528 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:57.529 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:57.576 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.577+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.577 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 20 realm 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.579+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.580+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:57.578 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.580+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.581+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:57.579 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.581+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.581+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:57.580 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.581+0000 7f690ab42800 20 searching for the correct realm 2024-09-14T11:22:57.582 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.584+0000 7f69070ee640 0 -- 172.21.15.29:0/2086764043 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6900036070 msgr2=0x7f6900068560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:57.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.791+0000 7f69060ec640 0 -- 172.21.15.29:0/2086764043 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f690007f2a0 msgr2=0x7f69000726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:57.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:57.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:57.999+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:57.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:57.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:57.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 zone default found 2024-09-14T11:22:57.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 4 Realm: () 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 zonegroup default 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.000+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 started sync module instance, tier type = 2024-09-14T11:22:58.001 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.001+0000 7f690ab42800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=0 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=1 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=2 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=3 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=4 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=5 2024-09-14T11:22:58.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.012+0000 7f690ab42800 20 add_watcher() i=6 2024-09-14T11:22:58.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.013+0000 7f690ab42800 20 add_watcher() i=7 2024-09-14T11:22:58.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.013+0000 7f690ab42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:58.013 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.015+0000 7f67bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.015+0000 7f690ab42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.015+0000 7f690ab42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.015+0000 7f690ab42800 5 note: GC not initialized 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.016+0000 7f6737fff640 20 reqs_thread_entry: start 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.016+0000 7f690ab42800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:58.014 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.016+0000 7f690ab42800 20 Filter name: none 2024-09-14T11:22:58.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.016+0000 7f6735ffb640 20 reqs_thread_entry: start 2024-09-14T11:22:58.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.016+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.017+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:58.015 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.017+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.018+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:58.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.018+0000 7f690ab42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:58.016 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.018+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.018+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:58.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.018+0000 7f690ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.019+0000 7f690ab42800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:22:58.017 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.019+0000 7f690ab42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:58.019 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.021+0000 7f67bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:58.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.023+0000 7f690ab42800 20 remove_watcher() i=0 2024-09-14T11:22:58.021 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.023+0000 7f690ab42800 2 removed watcher, disabling cache 2024-09-14T11:22:58.023 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.024+0000 7f690ab42800 20 remove_watcher() i=1 2024-09-14T11:22:58.024 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.026+0000 7f690ab42800 20 remove_watcher() i=2 2024-09-14T11:22:58.025 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.027+0000 7f690ab42800 20 remove_watcher() i=3 2024-09-14T11:22:58.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.028+0000 7f690ab42800 20 remove_watcher() i=4 2024-09-14T11:22:58.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.029+0000 7f690ab42800 20 remove_watcher() i=5 2024-09-14T11:22:58.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.030+0000 7f690ab42800 20 remove_watcher() i=6 2024-09-14T11:22:58.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.031+0000 7f690ab42800 20 remove_watcher() i=7 2024-09-14T11:22:58.141 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:22:58.170 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:58.170 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:58.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.211+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.213+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.213+0000 7f055f11f800 20 realm 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.213+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.214+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.214+0000 7f055f11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.214+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.214+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.214+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.215+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:58.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.215+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.215+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:58.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.215+0000 7f055f11f800 20 searching for the correct realm 2024-09-14T11:22:58.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.218+0000 7f055b6aa640 0 -- 172.21.15.29:0/2563729402 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f0554045040 msgr2=0x7f0554039420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:58.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.425+0000 7f055a6a8640 0 -- 172.21.15.29:0/2563729402 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f0554020920 msgr2=0x7f05540583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.632+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.633+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.631 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.633+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.633+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.633+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.633+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 zone default found 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 4 Realm: () 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 zonegroup default 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.633 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.634+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.635+0000 7f055f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.635+0000 7f055f11f800 20 started sync module instance, tier type = 2024-09-14T11:22:58.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.635+0000 7f055f11f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=0 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=1 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=2 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=3 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=4 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=5 2024-09-14T11:22:58.643 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.645+0000 7f055f11f800 20 add_watcher() i=6 2024-09-14T11:22:58.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.646+0000 7f055f11f800 20 add_watcher() i=7 2024-09-14T11:22:58.644 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.646+0000 7f055f11f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:58.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.648+0000 7f0411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:58.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.648+0000 7f055f11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:58.646 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.648+0000 7f055f11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:58.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.648+0000 7f055f11f800 5 note: GC not initialized 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f0410fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 20 Filter name: none 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f0409ffb640 20 reqs_thread_entry: start 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:22:58.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.649+0000 7f055f11f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:58.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:22:58.649 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.650+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.651+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.651+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.651+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:58.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.651+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.652+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.652+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.652+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.652+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:22:58.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:58.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:22:58.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:58.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.653+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:22:58.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.654+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:58.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.654+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:22:58.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.654+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:58.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.654+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:22:58.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.655+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:58.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.655+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:22:58.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.655+0000 7f055f11f800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:58.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.655+0000 7f055f11f800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:22:58.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.657+0000 7f0411fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:58.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.659+0000 7f055f11f800 20 remove_watcher() i=0 2024-09-14T11:22:58.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.659+0000 7f055f11f800 2 removed watcher, disabling cache 2024-09-14T11:22:58.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.660+0000 7f055f11f800 20 remove_watcher() i=1 2024-09-14T11:22:58.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.662+0000 7f055f11f800 20 remove_watcher() i=2 2024-09-14T11:22:58.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.663+0000 7f055f11f800 20 remove_watcher() i=3 2024-09-14T11:22:58.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.664+0000 7f055f11f800 20 remove_watcher() i=4 2024-09-14T11:22:58.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.665+0000 7f055f11f800 20 remove_watcher() i=5 2024-09-14T11:22:58.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.666+0000 7f055f11f800 20 remove_watcher() i=6 2024-09-14T11:22:58.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.667+0000 7f055f11f800 20 remove_watcher() i=7 2024-09-14T11:22:58.678 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:58.708 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:58.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.751+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 realm 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.753+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.754+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.754+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:58.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.755+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:58.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.755+0000 7f45c3d37800 20 searching for the correct realm 2024-09-14T11:22:58.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.757+0000 7f45c027e640 0 -- 172.21.15.29:0/1664675604 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f45b806b6b0 msgr2=0x7f45b80780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:58.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:58.964+0000 7f45bf27c640 0 -- 172.21.15.29:0/1664675604 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f45b805a040 msgr2=0x7f45b8084320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:59.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.170 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.171 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.172+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 zone default found 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 4 Realm: () 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:59.172 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 zonegroup default 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.173+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.174+0000 7f45c3d37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.174+0000 7f45c3d37800 20 started sync module instance, tier type = 2024-09-14T11:22:59.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.174+0000 7f45c3d37800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=0 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=1 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=2 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=3 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=4 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=5 2024-09-14T11:22:59.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.184+0000 7f45c3d37800 20 add_watcher() i=6 2024-09-14T11:22:59.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.185+0000 7f45c3d37800 20 add_watcher() i=7 2024-09-14T11:22:59.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.185+0000 7f45c3d37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f4475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f45c3d37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f45c3d37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f45c3d37800 5 note: GC not initialized 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f4474fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f45c3d37800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.187+0000 7f45c3d37800 20 Filter name: none 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.188+0000 7f43ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.188+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.188+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.188+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:59.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.189+0000 7f45c3d37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.191+0000 7f4475fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.194+0000 7f45c3d37800 20 remove_watcher() i=0 2024-09-14T11:22:59.192 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.194+0000 7f45c3d37800 2 removed watcher, disabling cache 2024-09-14T11:22:59.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.195+0000 7f45c3d37800 20 remove_watcher() i=1 2024-09-14T11:22:59.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.196+0000 7f45c3d37800 20 remove_watcher() i=2 2024-09-14T11:22:59.195 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.197+0000 7f45c3d37800 20 remove_watcher() i=3 2024-09-14T11:22:59.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.198+0000 7f45c3d37800 20 remove_watcher() i=4 2024-09-14T11:22:59.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.199+0000 7f45c3d37800 20 remove_watcher() i=5 2024-09-14T11:22:59.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.200+0000 7f45c3d37800 20 remove_watcher() i=6 2024-09-14T11:22:59.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.201+0000 7f45c3d37800 20 remove_watcher() i=7 2024-09-14T11:22:59.211 INFO:tasks.workunit.client.0.smithi029.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:22:59.213 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:22:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.243 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.284+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 20 realm 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.286+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.287+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.287+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.287+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.287+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.288+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.286 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.288+0000 7fe682013800 20 searching for the correct realm 2024-09-14T11:22:59.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.291+0000 7fe67df49640 0 -- 172.21.15.29:0/936810274 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe67802a070 msgr2=0x7fe67802a450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.497+0000 7fe67cf47640 0 -- 172.21.15.29:0/936810274 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe678046430 msgr2=0x7fe678046890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.705+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 zone default found 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 4 Realm: () 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 zonegroup default 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.706+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 started sync module instance, tier type = 2024-09-14T11:22:59.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.707+0000 7fe682013800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=0 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=1 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=2 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=3 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=4 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=5 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.717+0000 7fe682013800 20 add_watcher() i=6 2024-09-14T11:22:59.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.718+0000 7fe682013800 20 add_watcher() i=7 2024-09-14T11:22:59.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.718+0000 7fe682013800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:59.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.720+0000 7fe5337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:59.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 5 note: GC not initialized 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe5327e4640 20 reqs_thread_entry: start 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 20 init_complete bucket index max shards: 11 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 20 Filter name: none 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe4a3fff640 20 reqs_thread_entry: start 2024-09-14T11:22:59.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.721+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.722+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.722+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.722+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.722+0000 7fe682013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.722+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.723+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.723+0000 7fe682013800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.723+0000 7fe682013800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:22:59.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.723+0000 7fe682013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:22:59.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.725+0000 7fe5337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:59.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.729+0000 7fe682013800 20 remove_watcher() i=0 2024-09-14T11:22:59.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.729+0000 7fe682013800 2 removed watcher, disabling cache 2024-09-14T11:22:59.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.730+0000 7fe682013800 20 remove_watcher() i=1 2024-09-14T11:22:59.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.731+0000 7fe682013800 20 remove_watcher() i=2 2024-09-14T11:22:59.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.732+0000 7fe682013800 20 remove_watcher() i=3 2024-09-14T11:22:59.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.733+0000 7fe682013800 20 remove_watcher() i=4 2024-09-14T11:22:59.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.734+0000 7fe682013800 20 remove_watcher() i=5 2024-09-14T11:22:59.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.735+0000 7fe682013800 20 remove_watcher() i=6 2024-09-14T11:22:59.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.736+0000 7fe682013800 20 remove_watcher() i=7 2024-09-14T11:22:59.746 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:59.746 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:22:59.746 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:22:59.746 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:22:59.748 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:22:59.783 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:59.783 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:59.825 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.827+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 realm 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:59.827 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:59.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:59.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:59.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 searching for the correct realm 2024-09-14T11:22:59.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:22:59.831+0000 7faa174ec640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7faa080c7020 msgr2=0x7faa080a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.036 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.038+0000 7faa184ee640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55932b4a4860 msgr2=0x55932b4a6c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zone default found 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Realm: () 2024-09-14T11:23:00.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zonegroup default 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started sync module instance, tier type = 2024-09-14T11:23:00.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=0 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=1 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=2 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=3 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=4 2024-09-14T11:23:00.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=5 2024-09-14T11:23:00.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=6 2024-09-14T11:23:00.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.057+0000 7faa1bf3e800 20 add_watcher() i=7 2024-09-14T11:23:00.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.057+0000 7faa1bf3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:00.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.059+0000 7fa8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:00.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:00.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 note: GC not initialized 2024-09-14T11:23:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7fa8ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 Filter name: none 2024-09-14T11:23:00.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7fa8467fc640 20 reqs_thread_entry: start 2024-09-14T11:23:00.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:00.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:00.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94090574884224 notifier 8205 bl.length()=911 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:00.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:00.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:00.067 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:00.072 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faa1bf3e800 time 2024-09-14T11:23:00.074868+0000 2024-09-14T11:23:00.072 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:00.072 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faa1d78c76a] 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7faa1bf3e800 thread_name:radosgw-admin 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.074+0000 7faa1bf3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faa1bf3e800 time 2024-09-14T11:23:00.074868+0000 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.073 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faa1d78c76a] 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:23:00.074 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faa1c43e6f0] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faa1c48b99c] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faa1d78c7c4] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.090 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.075+0000 7faa1bf3e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7faa1bf3e800 thread_name:radosgw-admin 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faa1c43e6f0] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faa1c48b99c] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faa1d78c7c4] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.091 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7751 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 4 set_mon_vals no callback set 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: dump: 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.092 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: shutdown 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 asok(0x55932b18c270) unregister_commands rotate-key 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.093 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.094 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 librados: starting msgr at 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 librados: starting objecter 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests hook 0x55932b3b34b0 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 1 librados: setting wanted keys 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 1 librados: calling monclient init 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.095 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.096 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key hook 0x55932b3ae958 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b3b5050 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b3b59d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x7faa00002390 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.445570s 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b3b59d0 auth_method 0 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.097 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b3b5050 auth_method 0 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x7faa00002390 auth_method 0 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.098 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:22:59.810+0000 7faa17ced640 1 monclient: found mon.noname-c 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: dump: 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.099 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7754 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: dump: 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.100 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:22:59.811+0000 7fa905e0b640 4 set_mon_vals no callback set 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 1 librados: init done 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.101 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:22:59.813+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa900077230 auth_method 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:22:59.813+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b3d7730 auth_method 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:22:59.814+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b3fa640 auth_method 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:22:59.815+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b3fece0 auth_method 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:22:59.816+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b3fe3e0 auth_method 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.102 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.103 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests cmddesc objecter_requests hook 0x55932b40a1a0 EEXIST 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.104 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.105 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x55932b405d00 EEXIST 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b42e4c0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b42e8a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b42d1d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.108 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.453155s 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b42e8a0 auth_method 0 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b42e4c0 auth_method 0 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.109 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:22:59.818+0000 7faa184ee640 1 monclient: found mon.noname-c 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: dump: 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.110 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: dump: 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.111 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:22:59.818+0000 7faa18cef640 4 set_mon_vals no callback set 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:22:59.821+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa8f0077140 auth_method 0 2024-09-14T11:23:00.112 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: get_monmap_and_config 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.113 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.114 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.115 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x7ffe55310a08 EEXIST 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b4827f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b453800 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b47dcd0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.457485s 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b47dcd0 auth_method 0 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.116 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b4827f0 auth_method 0 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b453800 auth_method 0 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.117 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 8202 payload 274 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:22:59.822+0000 7faa17ced640 1 monclient: found mon.noname-a 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: dump: 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.118 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: dump: 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.119 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 8202 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 4 set_mon_vals no callback set 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: shutdown 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.120 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.121 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: starting msgr at 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: starting objecter 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests cmddesc objecter_requests hook 0x55932b450af0 EEXIST 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: setting wanted keys 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: calling monclient init 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.122 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.123 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x55932b442ec8 EEXIST 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b453800 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b47dcd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b4827f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.459817s 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b453800 auth_method 0 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.124 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b4827f0 auth_method 0 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:22:59.824+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b47dcd0 auth_method 0 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.125 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:22:59.825+0000 7faa17ced640 1 monclient: found mon.noname-a 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: dump: 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.126 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 8205 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:22:59.825+0000 7fa8f6ffd640 4 set_mon_vals no callback set 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:00.127 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: dump: 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 1 librados: init done 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cr dump hook 0x55932b479598 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:22:59.827+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.128 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:22:59.827+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa8e0077230 auth_method 0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:22:59.828+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b49cd60 auth_method 0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 realm 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:22:59.829+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b4a10f0 auth_method 0 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.129 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:22:59.830+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b4a4860 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 searching for the correct realm 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:22:59.830+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b4a9560 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:22:59.831+0000 7faa174ec640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7faa080c7020 msgr2=0x7faa080a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:23:00.033+0000 7faa174ec640 10 monclient: get_auth_request con 0x7faa080c7020 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:23:00.035+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b222d00 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:23:00.037+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b2570b0 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:23:00.038+0000 7faa184ee640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55932b4a4860 msgr2=0x55932b4a6c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 1 client.8205.objecter ms_handle_reset 0x55932b4a4860 session 0x55932b4a0950 osd.2 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 10 monclient: _renew_subs 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:23:00.038+0000 7faa184ee640 10 monclient: get_auth_request con 0x7fa8e0087860 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:23:00.039+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b2ee4f0 auth_method 0 2024-09-14T11:23:00.130 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zone default found 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Realm: () 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:00.131 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zonegroup default 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started sync module instance, tier type = 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=0 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=1 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=2 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=3 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=4 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=5 2024-09-14T11:23:00.132 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=6 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:23:00.057+0000 7faa1bf3e800 20 add_watcher() i=7 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:23:00.057+0000 7faa1bf3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:23:00.059+0000 7fa8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.133 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache list hook 0x55932b473250 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache inspect hook 0x55932b473250 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache erase hook 0x55932b473250 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache zap hook 0x55932b473250 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 note: GC not initialized 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:23:00.060+0000 7fa8ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace show hook 0x7faa0c001430 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace history hook 0x7faa0c001430 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace active hook 0x7faa0c001430 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace active_short hook 0x7faa0c001430 2024-09-14T11:23:00.134 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 Filter name: none 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:23:00.060+0000 7fa8467fc640 20 reqs_thread_entry: start 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:00.135 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94090574884224 notifier 8205 bl.length()=911 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:23:00.074+0000 7faa1bf3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faa1bf3e800 time 2024-09-14T11:23:00.074868+0000 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:00.136 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faa1d78c76a] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:23:00.075+0000 7faa1bf3e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7faa1bf3e800 thread_name:radosgw-admin 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faa1c43e6f0] 2024-09-14T11:23:00.137 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faa1c48b99c] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faa1d78c7c4] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:23:00.138 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:23:00.139 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:23:00.140 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:23:00.141 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:23:00.142 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:23:00.143 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8467fc640 / http_manager 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8ccfe1640 / http_manager 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8cdfe3640 / rgw_dt_lg_renew 2024-09-14T11:23:00.144 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8f57fa640 / ms_dispatch 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8f6ffd640 / io_context_pool 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8fd7fa640 / ms_dispatch 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8fffff640 / ms_dispatch 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa905e0b640 / io_context_pool 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa174ec640 / msgr-worker-2 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa17ced640 / msgr-worker-1 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa184ee640 / msgr-worker-0 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa18cef640 / io_context_pool 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa1bf3e800 / radosgw-admin 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.151058.log 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:23:00.145 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7751 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:22:59.808+0000 7faa1bf3e800 4 set_mon_vals no callback set 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:22:59.808+0000 7fa905e0b640 10 monclient: dump: 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.146 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: shutdown 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 asok(0x55932b18c270) unregister_commands rotate-key 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.147 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding auth protocol: cephx 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: crc 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3b4300) adding con mode: secure 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.148 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 librados: starting msgr at 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 1 librados: starting objecter 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:22:59.809+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests hook 0x55932b3b34b0 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 1 librados: setting wanted keys 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 1 librados: calling monclient init 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding auth protocol: cephx 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.149 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: crc 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 AuthRegistry(0x55932b3ae810) adding con mode: secure 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key hook 0x55932b3ae958 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b3b5050 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b3b59d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x7faa00002390 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.150 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:22:59.810+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.445570s 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b3b59d0 auth_method 0 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b3b5050 auth_method 0 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:22:59.810+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.151 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x7faa00002390 auth_method 0 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:22:59.810+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 7754 payload 824 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:22:59.810+0000 7faa17ced640 1 monclient: found mon.noname-c 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:22:59.810+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: dump: 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.152 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7754 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.153 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:22:59.811+0000 7fa8fffff640 10 monclient: dump: 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:22:59.811+0000 7fa905e0b640 4 set_mon_vals no callback set 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:22:59.811+0000 7faa1bf3e800 1 librados: init done 2024-09-14T11:23:00.154 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:22:59.813+0000 7fa8fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:22:59.813+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa900077230 auth_method 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:22:59.813+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b3d7730 auth_method 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:22:59.814+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b3fa640 auth_method 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:22:59.815+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b3fece0 auth_method 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:22:59.816+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b3fe3e0 auth_method 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.155 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding auth protocol: cephx 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.156 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: crc 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b406d60) adding con mode: secure 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests cmddesc objecter_requests hook 0x55932b40a1a0 EEXIST 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding auth protocol: cephx 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.157 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: crc 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 5 AuthRegistry(0x55932b405bb8) adding con mode: secure 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:22:59.817+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x55932b405d00 EEXIST 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b42e4c0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.158 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b42e8a0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b42d1d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.453155s 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b42e8a0 auth_method 0 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b42e4c0 auth_method 0 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.159 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:22:59.818+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient(hunting): handle_auth_done global_id 7757 payload 824 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:22:59.818+0000 7faa184ee640 1 monclient: found mon.noname-c 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:22:59.818+0000 7faa184ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: dump: 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.160 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:22:59.818+0000 7fa8fd7fa640 10 monclient: dump: 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.161 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 7757 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:22:59.818+0000 7faa18cef640 4 set_mon_vals no callback set 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:22:59.818+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:22:59.821+0000 7fa8fd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:22:59.821+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa8f0077140 auth_method 0 2024-09-14T11:23:00.162 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: get_monmap_and_config 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.163 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding auth protocol: cephx 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: crc 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x55932b44e190) adding con mode: secure 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.164 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding auth protocol: cephx 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: crc 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:22:59.821+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe553108c0) adding con mode: secure 2024-09-14T11:23:00.165 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x7ffe55310a08 EEXIST 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b4827f0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b453800 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b47dcd0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:22:59.822+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.457485s 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b47dcd0 auth_method 0 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.166 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b4827f0 auth_method 0 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b453800 auth_method 0 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:22:59.822+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.167 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:22:59.822+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 8202 payload 274 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:22:59.822+0000 7faa17ced640 1 monclient: found mon.noname-a 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:22:59.822+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: dump: 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.168 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:22:59.823+0000 7fa8f6ffd640 10 monclient: dump: 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.169 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 8202 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 4 set_mon_vals no callback set 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: shutdown 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: build_initial_monmap 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 1 build_initial for_mkfs: 0 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 10 monclient: monmap: 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:00.170 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding auth protocol: cephx 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.171 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: crc 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:22:59.823+0000 7faa1bf3e800 5 AuthRegistry(0x55932b474a80) adding con mode: secure 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: starting msgr at 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: starting objecter 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command objecter_requests cmddesc objecter_requests hook 0x55932b450af0 EEXIST 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: setting wanted keys 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 1 librados: calling monclient init 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: init 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.172 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding auth protocol: cephx 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: crc 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 AuthRegistry(0x55932b442d80) adding con mode: secure 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command rotate-key cmddesc rotate-key hook 0x55932b442ec8 EEXIST 2024-09-14T11:23:00.173 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-c con 0x55932b453800 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-b con 0x55932b47dcd0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): picked mon.noname-a con 0x55932b4827f0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:22:59.824+0000 7faa1bf3e800 10 monclient(hunting): authenticate will time out at 2383.459817s 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): get_auth_request con 0x55932b453800 auth_method 0 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:22:59.824+0000 7faa174ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): get_auth_request con 0x55932b4827f0 auth_method 0 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.174 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:22:59.824+0000 7faa17ced640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:22:59.824+0000 7faa184ee640 10 monclient(hunting): get_auth_request con 0x55932b47dcd0 auth_method 0 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:22:59.825+0000 7faa174ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:00.175 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:22:59.825+0000 7faa184ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient: _finish_hunting 0 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:22:59.825+0000 7faa17ced640 1 monclient: found mon.noname-a 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:22:59.825+0000 7faa17ced640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: dump: 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.176 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 5 monclient: authenticate success, global_id 8205 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:22:59.825+0000 7fa8f6ffd640 4 set_mon_vals no callback set 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:22:59.825+0000 7fa8f57fa640 10 monclient: dump: 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:00.177 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _renew_subs 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 1 librados: init done 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:22:59.825+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cr dump hook 0x55932b479598 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:22:59.827+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.178 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:22:59.827+0000 7fa8f57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:22:59.827+0000 7faa174ec640 10 monclient: get_auth_request con 0x7fa8e0077230 auth_method 0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:22:59.828+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b49cd60 auth_method 0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 realm 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:22:59.828+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:22:59.829+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b4a10f0 auth_method 0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:22:59.829+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:22:59.830+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b4a4860 auth_method 0 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:00.179 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:22:59.830+0000 7faa1bf3e800 20 searching for the correct realm 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:22:59.830+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b4a9560 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:22:59.831+0000 7faa174ec640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7faa080c7020 msgr2=0x7faa080a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:23:00.033+0000 7faa174ec640 10 monclient: get_auth_request con 0x7faa080c7020 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:23:00.035+0000 7faa184ee640 10 monclient: get_auth_request con 0x55932b222d00 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:23:00.037+0000 7faa17ced640 10 monclient: get_auth_request con 0x55932b2570b0 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:23:00.038+0000 7faa184ee640 0 -- 172.21.15.29:0/3690387518 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55932b4a4860 msgr2=0x55932b4a6c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 1 client.8205.objecter ms_handle_reset 0x55932b4a4860 session 0x55932b4a0950 osd.2 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 10 monclient: _renew_subs 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:23:00.038+0000 7fa8f57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:23:00.038+0000 7faa184ee640 10 monclient: get_auth_request con 0x7fa8e0087860 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:23:00.039+0000 7faa174ec640 10 monclient: get_auth_request con 0x55932b2ee4f0 auth_method 0 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:00.180 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:23:00.044+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zone default found 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Realm: () 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 zonegroup default 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.181 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:23:00.045+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started sync module instance, tier type = 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:23:00.046+0000 7faa1bf3e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=0 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=1 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=2 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=3 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=4 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=5 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:23:00.056+0000 7faa1bf3e800 20 add_watcher() i=6 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:23:00.057+0000 7faa1bf3e800 20 add_watcher() i=7 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:23:00.057+0000 7faa1bf3e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:00.182 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding auth protocol: cephx 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:23:00.059+0000 7fa8cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: crc 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 AuthRegistry(0x7ffe55310da0) adding con mode: secure 2024-09-14T11:23:00.183 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache list hook 0x55932b473250 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache inspect hook 0x55932b473250 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache erase hook 0x55932b473250 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command cache zap hook 0x55932b473250 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:23:00.059+0000 7faa1bf3e800 5 note: GC not initialized 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:23:00.060+0000 7fa8ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace show hook 0x7faa0c001430 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace history hook 0x7faa0c001430 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace active hook 0x7faa0c001430 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 5 asok(0x55932b18c270) register_command sync trace active_short hook 0x7faa0c001430 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 Filter name: none 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:23:00.060+0000 7fa8467fc640 20 reqs_thread_entry: start 2024-09-14T11:23:00.184 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:23:00.060+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:23:00.061+0000 7faa1bf3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.185 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:23:00.067+0000 7faa1bf3e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497095 cookie 94090574884224 notifier 8205 bl.length()=911 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:23:00.067+0000 7fa8f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:23:00.068+0000 7faa1bf3e800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:23:00.074+0000 7faa1bf3e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7faa1bf3e800 time 2024-09-14T11:23:00.074868+0000 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7faa1d78c76a] 2024-09-14T11:23:00.186 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:23:00.075+0000 7faa1bf3e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7faa1bf3e800 thread_name:radosgw-admin 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7faa1c43e6f0] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7faa1c48b99c] 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:00.187 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7faa1d78c7c4] 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7faa1d78c928] 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5593291310b1] 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559329140f6a] 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7faa1c429590] 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:23:00.188 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:23:00.189 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:23:00.190 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:23:00.191 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:23:00.192 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:23:00.193 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8467fc640 / http_manager 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8ccfe1640 / http_manager 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8cdfe3640 / rgw_dt_lg_renew 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8f57fa640 / ms_dispatch 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8f6ffd640 / io_context_pool 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8fd7fa640 / ms_dispatch 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa8fffff640 / ms_dispatch 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7fa905e0b640 / io_context_pool 2024-09-14T11:23:00.194 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa174ec640 / msgr-worker-2 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa17ced640 / msgr-worker-1 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa184ee640 / msgr-worker-0 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa18cef640 / io_context_pool 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: 7faa1bf3e800 / radosgw-admin 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:23:00.076269Z_79508f91-753e-49c0-a35f-c5fb0cd8af2f/log 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:23:00.195 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:00.196 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:00.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.338+0000 7f801a426640 0 --2- 172.21.15.29:0/4026116001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5643a26914e0 0x5643a2772d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:23:00.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.357+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 realm 2024-09-14T11:23:00.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:00.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.358 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.359+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.360+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.360+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.359 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.361+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:00.360 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.361+0000 7f801df39800 20 searching for the correct realm 2024-09-14T11:23:00.361 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.363+0000 7f801a426640 0 -- 172.21.15.29:0/2521121456 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f8014020070 msgr2=0x7f8014061420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.569+0000 7f8019424640 0 -- 172.21.15.29:0/2521121456 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f801407c1c0 msgr2=0x7f8014060b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:00.775 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.777+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 zone default found 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 4 Realm: () 2024-09-14T11:23:00.777 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 zonegroup default 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.778+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.779+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.778 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.779+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.779+0000 7f801df39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.779+0000 7f801df39800 20 started sync module instance, tier type = 2024-09-14T11:23:00.779 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.779+0000 7f801df39800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:00.788 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=0 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=1 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=2 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=3 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=4 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=5 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.790+0000 7f801df39800 20 add_watcher() i=6 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.791+0000 7f801df39800 20 add_watcher() i=7 2024-09-14T11:23:00.789 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.791+0000 7f801df39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:00.791 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.793+0000 7f7ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:00.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.793+0000 7f801df39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:00.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.793+0000 7f801df39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:00.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.793+0000 7f801df39800 5 note: GC not initialized 2024-09-14T11:23:00.792 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.794+0000 7f7eca7fc640 20 reqs_thread_entry: start 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.794+0000 7f801df39800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.794+0000 7f801df39800 20 Filter name: none 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.794+0000 7f7e3bfff640 20 reqs_thread_entry: start 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.794+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.795+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:00.793 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.795+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.796+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:00.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.796+0000 7f801df39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:00.794 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.796+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.796+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:00.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.796+0000 7f801df39800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.797+0000 7f801df39800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:00.795 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.797+0000 7f801df39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:23:00.797 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.799+0000 7f7ecb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:00.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.801+0000 7f801df39800 20 remove_watcher() i=0 2024-09-14T11:23:00.799 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.801+0000 7f801df39800 2 removed watcher, disabling cache 2024-09-14T11:23:00.800 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.802+0000 7f801df39800 20 remove_watcher() i=1 2024-09-14T11:23:00.801 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.803+0000 7f801df39800 20 remove_watcher() i=2 2024-09-14T11:23:00.802 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.804+0000 7f801df39800 20 remove_watcher() i=3 2024-09-14T11:23:00.804 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.806+0000 7f801df39800 20 remove_watcher() i=4 2024-09-14T11:23:00.805 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.807+0000 7f801df39800 20 remove_watcher() i=5 2024-09-14T11:23:00.806 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.808+0000 7f801df39800 20 remove_watcher() i=6 2024-09-14T11:23:00.807 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.809+0000 7f801df39800 20 remove_watcher() i=7 2024-09-14T11:23:00.863 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:23:00.893 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:00.893 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:00.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.936+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 20 realm 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.937+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.938+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:00.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.938+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.939+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:00.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.939+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:00.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.939+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:00.938 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.939+0000 7f57be346800 20 searching for the correct realm 2024-09-14T11:23:00.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:00.941+0000 7f57bc638640 0 -- 172.21.15.29:0/805899906 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f57b4028070 msgr2=0x7f57b4019940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:01.147 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.148+0000 7f57bb636640 0 -- 172.21.15.29:0/805899906 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f57b40423c0 msgr2=0x7f57b4042840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:01.354 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.354+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 zone default found 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 4 Realm: () 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 zonegroup default 2024-09-14T11:23:01.355 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.355+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:01.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.356 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:01.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:01.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 started sync module instance, tier type = 2024-09-14T11:23:01.357 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.356+0000 7f57be346800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:01.364 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=0 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=1 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=2 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=3 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=4 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=5 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.366+0000 7f57be346800 20 add_watcher() i=6 2024-09-14T11:23:01.365 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.367+0000 7f57be346800 20 add_watcher() i=7 2024-09-14T11:23:01.366 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.367+0000 7f57be346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:01.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.369+0000 7f5671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:01.368 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 5 note: GC not initialized 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f5670fe1640 20 reqs_thread_entry: start 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 20 Filter name: none 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f55ea7fc640 20 reqs_thread_entry: start 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:01.369 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.370+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.371+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:01.370 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.371+0000 7f57be346800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.371+0000 7f57be346800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.371+0000 7f57be346800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.371+0000 7f57be346800 20 rados->read ofs=0 len=0 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:23:01.371 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:23:01.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:23:01.372 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.372+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.373+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.373+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.373+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.373+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:23:01.373 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.374+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.375+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:23:01.374 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.375+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.375+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.375+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:23:01.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:23:01.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.376+0000 7f57be346800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:23:01.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.378+0000 7f5671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:01.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.380+0000 7f57be346800 20 remove_watcher() i=0 2024-09-14T11:23:01.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.380+0000 7f57be346800 2 removed watcher, disabling cache 2024-09-14T11:23:01.379 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.381+0000 7f57be346800 20 remove_watcher() i=1 2024-09-14T11:23:01.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.382+0000 7f57be346800 20 remove_watcher() i=2 2024-09-14T11:23:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.383+0000 7f57be346800 20 remove_watcher() i=3 2024-09-14T11:23:01.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.384+0000 7f57be346800 20 remove_watcher() i=4 2024-09-14T11:23:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.385+0000 7f57be346800 20 remove_watcher() i=5 2024-09-14T11:23:01.384 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.386+0000 7f57be346800 20 remove_watcher() i=6 2024-09-14T11:23:01.386 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:01.387+0000 7f57be346800 20 remove_watcher() i=7 2024-09-14T11:23:31.421 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:23:31.460 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:31.460 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:31.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.508+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 realm 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.512+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:31.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.512+0000 7fb9da146800 20 searching for the correct realm 2024-09-14T11:23:31.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.514+0000 7fb9d7436640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb9c8062f80 msgr2=0x7fb9c80619f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:31.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.720+0000 7fb9d8438640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56115d5bdd00 msgr2=0x56115d5c00f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:31.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:31.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:31.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 zone default found 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 4 Realm: () 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:31.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 zonegroup default 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 started sync module instance, tier type = 2024-09-14T11:23:31.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.729+0000 7fb9da146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=0 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=1 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=2 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=3 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=4 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=5 2024-09-14T11:23:31.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=6 2024-09-14T11:23:31.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.741+0000 7fb9da146800 20 add_watcher() i=7 2024-09-14T11:23:31.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.741+0000 7fb9da146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:31.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb9da146800 5 note: GC not initialized 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb88cfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb9da146800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.743+0000 7fb9da146800 20 Filter name: none 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb8067fc640 20 reqs_thread_entry: start 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:31.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.745+0000 7fb9da146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:31.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.747+0000 7fb9da146800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.754+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.754+0000 7fb9da146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.754+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.754+0000 7fb9da146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94632580771360 notifier 8259 bl.length()=911 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.754 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:31.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:31.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:31.755 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:31.758 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9da146800 time 2024-09-14T11:23:31.761696+0000 2024-09-14T11:23:31.759 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:31.759 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.759 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9dd78c76a] 2024-09-14T11:23:31.759 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.761+0000 7fb9da146800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9da146800 time 2024-09-14T11:23:31.761696+0000 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.760 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9dd78c76a] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:23:31.761 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb9da146800 thread_name:radosgw-admin 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9dc43e6f0] 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9dc48b99c] 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9dd78c7c4] 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.775 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.762+0000 7fb9da146800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb9da146800 thread_name:radosgw-admin 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9dc43e6f0] 2024-09-14T11:23:31.776 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9dc48b99c] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9dd78c7c4] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.777 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:23:31.488+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:23:31.488+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.778 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.779 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:23:31.488+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 librados: starting msgr at 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 librados: starting objecter 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests hook 0x56115d4cc7a0 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:23:31.489+0000 7fb9da146800 1 librados: setting wanted keys 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:23:31.489+0000 7fb9da146800 1 librados: calling monclient init 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.780 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:23:31.489+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:23:31.489+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key hook 0x56115d4c7598 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d375050 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d380790 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.781 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d40a9f0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.124828s 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d375050 auth_method 0 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d380790 auth_method 0 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.782 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d40a9f0 auth_method 0 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_done global_id 7805 payload 824 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.783 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 1 monclient: found mon.noname-c 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: dump: 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.784 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: dump: 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.785 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:23:31.490+0000 7fb9da146800 5 monclient: authenticate success, global_id 7805 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:23:31.490+0000 7fb8c5e0b640 4 set_mon_vals no callback set 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:23:31.490+0000 7fb9da146800 1 librados: init done 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:23:31.493+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8c0077230 auth_method 0 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:23:31.493+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d4f55e0 auth_method 0 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:23:31.494+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5140d0 auth_method 0 2024-09-14T11:23:31.786 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:23:31.495+0000 7fb9d7436640 10 monclient: get_auth_request con 0x56115d518430 auth_method 0 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:23:31.496+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5179c0 auth_method 0 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:23:31.497+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.787 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.788 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:23:31.497+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests cmddesc objecter_requests hook 0x56115d5239d0 EEXIST 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.789 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:23:31.498+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:23:31.498+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:23:31.498+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x56115d51f570 EEXIST 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d547cf0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d5480d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d546a00 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.790 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.133514s 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d5480d0 auth_method 0 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d546a00 auth_method 0 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d547cf0 auth_method 0 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.791 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:23:31.498+0000 7fb9d8438640 1 monclient: found mon.noname-c 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.792 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: dump: 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.793 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:23:31.499+0000 7fb9da146800 5 monclient: authenticate success, global_id 7808 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: dump: 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.794 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:23:31.499+0000 7fb9d8c39640 4 set_mon_vals no callback set 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:23:31.501+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8b0077140 auth_method 0 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: get_monmap_and_config 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:23:31.502+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.795 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.796 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:23:31.502+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.797 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:23:31.503+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.798 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:23:31.503+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:23:31.503+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x7ffd0c4a5db8 EEXIST 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d56bd90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d596800 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d597bb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.138349s 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d596800 auth_method 0 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.799 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d597bb0 auth_method 0 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d56bd90 auth_method 0 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.800 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:23:31.503+0000 7fb9d8438640 1 monclient: found mon.noname-a 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:23:31.503+0000 7fb8b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: dump: 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.801 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: dump: 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.802 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 monclient: authenticate success, global_id 8256 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:23:31.504+0000 7fb9da146800 4 set_mon_vals no callback set 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: shutdown 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:23:31.504+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.803 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.804 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: starting msgr at 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: starting objecter 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests cmddesc objecter_requests hook 0x56115d5678f0 EEXIST 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: setting wanted keys 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: calling monclient init 2024-09-14T11:23:31.805 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.806 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x56115d55c6f8 EEXIST 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d56bd90 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d597bb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d59a6d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.807 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.140838s 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d597bb0 auth_method 0 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d56bd90 auth_method 0 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.808 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d59a6d0 auth_method 0 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:23:31.506+0000 7fb9d8438640 1 monclient: found mon.noname-a 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: dump: 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.809 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: dump: 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.810 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:23:31.506+0000 7fb9da146800 5 monclient: authenticate success, global_id 8259 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:23:31.506+0000 7fb8b6ffd640 4 set_mon_vals no callback set 2024-09-14T11:23:31.811 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:23:31.506+0000 7fb9da146800 1 librados: init done 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:23:31.506+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cr dump hook 0x56115d59c6f8 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:23:31.508+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:23:31.509+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8a0077230 auth_method 0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:23:31.509+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5b61e0 auth_method 0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.812 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 realm 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:23:31.510+0000 7fb9da146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:23:31.510+0000 7fb9d7436640 10 monclient: get_auth_request con 0x56115d5ba4a0 auth_method 0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:23:31.511+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5bdd00 auth_method 0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:23:31.512+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:23:31.512+0000 7fb9da146800 20 searching for the correct realm 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:23:31.512+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5c2a80 auth_method 0 2024-09-14T11:23:31.813 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 1 client.8259.objecter ms_handle_reset 0x56115d5c2a80 session 0x56115d5c2400 osd.3 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 10 monclient: _renew_subs 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:23:31.513+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x7fb8a0087860 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:23:31.514+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9c8062f80 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:23:31.514+0000 7fb9d7436640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb9c8062f80 msgr2=0x7fb9c80619f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:23:31.715+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9c8062f80 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:23:31.716+0000 7fb9d8438640 10 monclient: get_auth_request con 0x7fb9d00c4b60 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:23:31.718+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x7fb9d0007d70 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:23:31.720+0000 7fb9d8438640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56115d5bdd00 msgr2=0x56115d5c00f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:23:31.720+0000 7fb8b57fa640 1 client.8259.objecter ms_handle_reset 0x56115d5bdd00 session 0x56115d5b97f0 osd.2 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:23:31.720+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5c2a80 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:23:31.721+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9d00b3360 auth_method 0 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:31.814 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 zone default found 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 Realm: () 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:31.815 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:23:31.728+0000 7fb9da146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 zonegroup default 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 started sync module instance, tier type = 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=0 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=1 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=2 2024-09-14T11:23:31.816 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=3 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=4 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=5 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=6 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:23:31.741+0000 7fb9da146800 20 add_watcher() i=7 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:23:31.741+0000 7fb9da146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.817 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:23:31.743+0000 7fb88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:23:31.743+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache list hook 0x56115d59aaf0 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache inspect hook 0x56115d59aaf0 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache erase hook 0x56115d59aaf0 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache zap hook 0x56115d59aaf0 2024-09-14T11:23:31.818 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 note: GC not initialized 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:23:31.743+0000 7fb88cfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace show hook 0x7fb9c801d070 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace history hook 0x7fb9c801d070 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace active hook 0x7fb9c801d070 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace active_short hook 0x7fb9c801d070 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 Filter name: none 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:23:31.744+0000 7fb8067fc640 20 reqs_thread_entry: start 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:31.819 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:23:31.745+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:23:31.747+0000 7fb9da146800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94632580771360 notifier 8259 bl.length()=911 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.820 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:23:31.761+0000 7fb9da146800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9da146800 time 2024-09-14T11:23:31.761696+0000 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9dd78c76a] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.821 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:23:31.762+0000 7fb9da146800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb9da146800 thread_name:radosgw-admin 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9dc43e6f0] 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9dc48b99c] 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9dd78c7c4] 2024-09-14T11:23:31.822 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:23:31.823 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:23:31.824 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:23:31.825 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:23:31.826 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:23:31.827 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:23:31.828 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:23:31.829 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8067fc640 / http_manager 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb88cfe1640 / http_manager 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb88dfe3640 / rgw_dt_lg_renew 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8b57fa640 / ms_dispatch 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8b6ffd640 / io_context_pool 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8bd7fa640 / ms_dispatch 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8bffff640 / ms_dispatch 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8c5e0b640 / io_context_pool 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d7436640 / msgr-worker-2 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d7c37640 / msgr-worker-1 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d8438640 / msgr-worker-0 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d8c39640 / io_context_pool 2024-09-14T11:23:31.830 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9da146800 / radosgw-admin 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.152825.log 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:23:31.488+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:23:31.488+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.831 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding auth protocol: cephx 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.832 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: crc 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:23:31.488+0000 7fb9da146800 5 AuthRegistry(0x56115d4c9750) adding con mode: secure 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:23:31.488+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 librados: starting msgr at 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:23:31.488+0000 7fb9da146800 1 librados: starting objecter 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests hook 0x56115d4cc7a0 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:23:31.489+0000 7fb9da146800 1 librados: setting wanted keys 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:23:31.489+0000 7fb9da146800 1 librados: calling monclient init 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.833 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding auth protocol: cephx 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: crc 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 AuthRegistry(0x56115d4c7450) adding con mode: secure 2024-09-14T11:23:31.834 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:23:31.489+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:23:31.489+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:23:31.489+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key hook 0x56115d4c7598 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d375050 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d380790 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d40a9f0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:23:31.489+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.124828s 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d375050 auth_method 0 2024-09-14T11:23:31.835 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:23:31.489+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d380790 auth_method 0 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:23:31.489+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:23:31.490+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d40a9f0 auth_method 0 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.836 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:23:31.490+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_done global_id 7805 payload 824 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 1 monclient: found mon.noname-c 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:23:31.490+0000 7fb9d7c37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: dump: 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.837 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:23:31.490+0000 7fb8bffff640 10 monclient: dump: 2024-09-14T11:23:31.838 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:23:31.490+0000 7fb9da146800 5 monclient: authenticate success, global_id 7805 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:23:31.490+0000 7fb8c5e0b640 4 set_mon_vals no callback set 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.839 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:23:31.490+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:23:31.490+0000 7fb9da146800 1 librados: init done 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:23:31.493+0000 7fb8bffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:23:31.493+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8c0077230 auth_method 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:23:31.493+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d4f55e0 auth_method 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:23:31.494+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5140d0 auth_method 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:23:31.495+0000 7fb9d7436640 10 monclient: get_auth_request con 0x56115d518430 auth_method 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:23:31.496+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5179c0 auth_method 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:23:31.497+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.840 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding auth protocol: cephx 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.841 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: crc 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d520530) adding con mode: secure 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:23:31.497+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests cmddesc objecter_requests hook 0x56115d5239d0 EEXIST 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:23:31.497+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.842 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding auth protocol: cephx 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: crc 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:23:31.497+0000 7fb9da146800 5 AuthRegistry(0x56115d51f428) adding con mode: secure 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:23:31.498+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.843 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:23:31.498+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:23:31.498+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x56115d51f570 EEXIST 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d547cf0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d5480d0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d546a00 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:23:31.498+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.133514s 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d5480d0 auth_method 0 2024-09-14T11:23:31.844 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d546a00 auth_method 0 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d547cf0 auth_method 0 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.845 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:23:31.498+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:23:31.498+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 7808 payload 824 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:23:31.498+0000 7fb9d8438640 1 monclient: found mon.noname-c 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:23:31.498+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: dump: 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.846 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:23:31.499+0000 7fb9da146800 5 monclient: authenticate success, global_id 7808 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.847 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:23:31.499+0000 7fb8bd7fa640 10 monclient: dump: 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:23:31.499+0000 7fb9d8c39640 4 set_mon_vals no callback set 2024-09-14T11:23:31.848 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:23:31.499+0000 7fb9da146800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:23:31.501+0000 7fb8bd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:23:31.501+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8b0077140 auth_method 0 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: get_monmap_and_config 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:23:31.502+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.849 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding auth protocol: cephx 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.850 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: crc 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x56115d567c00) adding con mode: secure 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:23:31.502+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:23:31.502+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding auth protocol: cephx 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.851 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: crc 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:23:31.502+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a5c70) adding con mode: secure 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:23:31.503+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:23:31.503+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:23:31.503+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x7ffd0c4a5db8 EEXIST 2024-09-14T11:23:31.852 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d56bd90 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d596800 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d597bb0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:23:31.503+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.138349s 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d596800 auth_method 0 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.853 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d597bb0 auth_method 0 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:23:31.503+0000 7fb9d7c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d56bd90 auth_method 0 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:23:31.503+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-14T11:23:31.854 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:23:31.503+0000 7fb9d8438640 1 monclient: found mon.noname-a 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:23:31.503+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:23:31.503+0000 7fb8b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: dump: 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.855 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:23:31.504+0000 7fb8b6ffd640 10 monclient: dump: 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.856 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 monclient: authenticate success, global_id 8256 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: get_monmap_and_config success 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:23:31.504+0000 7fb9da146800 4 set_mon_vals no callback set 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: shutdown 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: build_initial_monmap 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:23:31.504+0000 7fb9da146800 1 build_initial for_mkfs: 0 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:23:31.504+0000 7fb9da146800 10 monclient: monmap: 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:23:31.857 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding auth protocol: cephx 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.858 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: crc 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:23:31.504+0000 7fb9da146800 5 AuthRegistry(0x56115d58e500) adding con mode: secure 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: starting msgr at 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: starting objecter 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command objecter_requests cmddesc objecter_requests hook 0x56115d5678f0 EEXIST 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: setting wanted keys 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:23:31.505+0000 7fb9da146800 1 librados: calling monclient init 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: init 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.859 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding auth protocol: cephx 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: crc 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 AuthRegistry(0x56115d55c5b0) adding con mode: secure 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.860 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:23:31.505+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:23:31.505+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command rotate-key cmddesc rotate-key hook 0x56115d55c6f8 EEXIST 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: _reopen_session rank -1 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-c con 0x56115d56bd90 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-a con 0x56115d597bb0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): picked mon.noname-b con 0x56115d59a6d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): start opening mon connection 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): _renew_subs 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:23:31.505+0000 7fb9da146800 10 monclient(hunting): authenticate will time out at 2415.140838s 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): get_auth_request con 0x56115d597bb0 auth_method 0 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.861 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:23:31.505+0000 7fb9d8438640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): get_auth_request con 0x56115d56bd90 auth_method 0 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:23:31.505+0000 7fb9d7436640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:23:31.506+0000 7fb9d7436640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request con 0x56115d59a6d0 auth_method 0 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:23:31.862 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:23:31.506+0000 7fb9d7c37640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient: _finish_hunting 0 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:23:31.506+0000 7fb9d8438640 1 monclient: found mon.noname-a 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:23:31.506+0000 7fb9d8438640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: dump: 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.863 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: _finish_auth 0 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:23:31.506+0000 7fb8b57fa640 10 monclient: dump: 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:23:31.864 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:23:31.506+0000 7fb9da146800 5 monclient: authenticate success, global_id 8259 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:23:31.506+0000 7fb8b6ffd640 4 set_mon_vals no callback set 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _renew_subs 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:23:31.506+0000 7fb9da146800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:23:31.506+0000 7fb9da146800 1 librados: init done 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:23:31.506+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cr dump hook 0x56115d59c6f8 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:23:31.508+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.865 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:23:31.509+0000 7fb8b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:23:31.509+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb8a0077230 auth_method 0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:23:31.509+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5b61e0 auth_method 0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 realm 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:23:31.510+0000 7fb9da146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:23:31.510+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:23:31.510+0000 7fb9d7436640 10 monclient: get_auth_request con 0x56115d5ba4a0 auth_method 0 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.866 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:23:31.511+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:23:31.511+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5bdd00 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:23:31.512+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:23:31.512+0000 7fb9da146800 20 searching for the correct realm 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:23:31.512+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x56115d5c2a80 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 1 client.8259.objecter ms_handle_reset 0x56115d5c2a80 session 0x56115d5c2400 osd.3 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 10 monclient: _renew_subs 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:23:31.513+0000 7fb8b57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:23:31.513+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x7fb8a0087860 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:23:31.514+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9c8062f80 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:23:31.514+0000 7fb9d7436640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fb9c8062f80 msgr2=0x7fb9c80619f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:23:31.715+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9c8062f80 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:23:31.716+0000 7fb9d8438640 10 monclient: get_auth_request con 0x7fb9d00c4b60 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:23:31.718+0000 7fb9d7c37640 10 monclient: get_auth_request con 0x7fb9d0007d70 auth_method 0 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:23:31.720+0000 7fb9d8438640 0 -- 172.21.15.29:0/2257738094 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56115d5bdd00 msgr2=0x56115d5c00f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:31.867 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:23:31.720+0000 7fb8b57fa640 1 client.8259.objecter ms_handle_reset 0x56115d5bdd00 session 0x56115d5b97f0 osd.2 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:23:31.720+0000 7fb9d8438640 10 monclient: get_auth_request con 0x56115d5c2a80 auth_method 0 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:23:31.721+0000 7fb9d7436640 10 monclient: get_auth_request con 0x7fb9d00b3360 auth_method 0 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:23:31.727+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.868 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 zone default found 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 Realm: () 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:23:31.728+0000 7fb9da146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:23:31.728+0000 7fb9da146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 zonegroup default 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:23:31.728+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.869 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 started sync module instance, tier type = 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:23:31.729+0000 7fb9da146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=0 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=1 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=2 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=3 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=4 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=5 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:23:31.740+0000 7fb9da146800 20 add_watcher() i=6 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:23:31.741+0000 7fb9da146800 20 add_watcher() i=7 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:23:31.741+0000 7fb9da146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding auth protocol: cephx 2024-09-14T11:23:31.870 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: crc 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 AuthRegistry(0x7ffd0c4a6150) adding con mode: secure 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:23:31.743+0000 7fb88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:23:31.743+0000 7fb9da146800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:23:31.871 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache list hook 0x56115d59aaf0 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache inspect hook 0x56115d59aaf0 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache erase hook 0x56115d59aaf0 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command cache zap hook 0x56115d59aaf0 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 note: GC not initialized 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:23:31.743+0000 7fb88cfe1640 20 reqs_thread_entry: start 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace show hook 0x7fb9c801d070 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace history hook 0x7fb9c801d070 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace active hook 0x7fb9c801d070 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:23:31.743+0000 7fb9da146800 5 asok(0x56115d2a8270) register_command sync trace active_short hook 0x7fb9c801d070 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:23:31.743+0000 7fb9da146800 20 Filter name: none 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:23:31.744+0000 7fb8067fc640 20 reqs_thread_entry: start 2024-09-14T11:23:31.872 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:23:31.744+0000 7fb9da146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:23:31.744+0000 7fb9da146800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:23:31.745+0000 7fb9da146800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:23:31.745+0000 7fb9da146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:31.873 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:23:31.747+0000 7fb9da146800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:23:31.754+0000 7fb9da146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497096 cookie 94632580771360 notifier 8259 bl.length()=911 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:23:31.755+0000 7fb8b6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:23:31.757+0000 7fb9da146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:23:31.761+0000 7fb9da146800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fb9da146800 time 2024-09-14T11:23:31.761696+0000 2024-09-14T11:23:31.874 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fb9dd78c76a] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 4: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 6: main() 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 8: __libc_start_main() 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 9: _start() 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:23:31.762+0000 7fb9da146800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:23:31.875 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7fb9da146800 thread_name:radosgw-admin 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fb9dc43e6f0] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fb9dc48b99c] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fb9dd78c7c4] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fb9dd78c928] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56115b46e0b1] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 8: radosgw-admin(+0xd8907c) [0x56115b98207c] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56115b47defd] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 10: main() 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fb9dc429590] 2024-09-14T11:23:31.876 INFO:tasks.workunit.client.0.smithi029.stderr: 12: __libc_start_main() 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 13: _start() 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:23:31.877 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:23:31.878 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:23:31.879 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:23:31.880 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:23:31.881 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:23:31.882 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8067fc640 / http_manager 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb88cfe1640 / http_manager 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb88dfe3640 / rgw_dt_lg_renew 2024-09-14T11:23:31.883 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8b57fa640 / ms_dispatch 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8b6ffd640 / io_context_pool 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8bd7fa640 / ms_dispatch 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8bffff640 / ms_dispatch 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb8c5e0b640 / io_context_pool 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d7436640 / msgr-worker-2 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d7c37640 / msgr-worker-1 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d8438640 / msgr-worker-0 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9d8c39640 / io_context_pool 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: 7fb9da146800 / radosgw-admin 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:23:31.763396Z_ffab383c-44d9-43f9-9bd6-8b2fc8dc040e/log 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:23:31.884 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.846+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 20 realm 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.847+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.848+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.848+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.848+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.849+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.849+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.849+0000 7f9df4326800 20 searching for the correct realm 2024-09-14T11:23:31.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:31.850+0000 7f9def84a640 0 -- 172.21.15.29:0/4223510230 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f9ddc002340 msgr2=0x7f9de0061600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:32.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.055+0000 7f9df084c640 0 -- 172.21.15.29:0/4223510230 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5640e8742c40 msgr2=0x5640e8745030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:32.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.062+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 zone default found 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 4 Realm: () 2024-09-14T11:23:32.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 zonegroup default 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.063+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.064+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.064+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.064+0000 7f9df4326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.064+0000 7f9df4326800 20 started sync module instance, tier type = 2024-09-14T11:23:32.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.064+0000 7f9df4326800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:23:32.071 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=0 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=1 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=2 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=3 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=4 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=5 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.073+0000 7f9df4326800 20 add_watcher() i=6 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.074+0000 7f9df4326800 20 add_watcher() i=7 2024-09-14T11:23:32.072 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.074+0000 7f9df4326800 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:32.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.076+0000 7f9ca6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.076+0000 7f9df4326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.076+0000 7f9df4326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.076+0000 7f9df4326800 5 note: GC not initialized 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.076+0000 7f9ca5fdb640 20 reqs_thread_entry: start 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 20 init_complete bucket index max shards: 11 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 20 Filter name: none 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9c177fe640 20 reqs_thread_entry: start 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:23:32.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.077+0000 7f9df4326800 20 rados->read ofs=0 len=0 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:23:32.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.078+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.079+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:23:32.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.079+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.079+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.079+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.080+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.081+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:23:32.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.081+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:23:32.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:23:32.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:23:32.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:23:32.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.082+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.083+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.083+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.083+0000 7f9df4326800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:23:32.081 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.083+0000 7f9df4326800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:23:32.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.084+0000 7f9ca6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:32.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.087+0000 7f9df4326800 20 remove_watcher() i=0 2024-09-14T11:23:32.085 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.087+0000 7f9df4326800 2 removed watcher, disabling cache 2024-09-14T11:23:32.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.088+0000 7f9df4326800 20 remove_watcher() i=1 2024-09-14T11:23:32.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.089+0000 7f9df4326800 20 remove_watcher() i=2 2024-09-14T11:23:32.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.090+0000 7f9df4326800 20 remove_watcher() i=3 2024-09-14T11:23:32.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.091+0000 7f9df4326800 20 remove_watcher() i=4 2024-09-14T11:23:32.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.092+0000 7f9df4326800 20 remove_watcher() i=5 2024-09-14T11:23:32.091 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.093+0000 7f9df4326800 20 remove_watcher() i=6 2024-09-14T11:23:32.092 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:23:32.094+0000 7f9df4326800 20 remove_watcher() i=7 2024-09-14T11:23:32.103 INFO:tasks.workunit.client.0.smithi029.stderr: test: duplicated entries can be purged manually 2024-09-14T11:24:02.132 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:24:02.165 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:02.165 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:02.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.213+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 realm 2024-09-14T11:24:02.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.213 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:02.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.215+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.216+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:02.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.216+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.217+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:02.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.217+0000 7f4868926800 20 searching for the correct realm 2024-09-14T11:24:02.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.220+0000 7f4864dda640 0 -- 172.21.15.29:0/3660875318 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f485c048040 msgr2=0x7f485c09a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:02.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.427+0000 7f4863dd8640 0 -- 172.21.15.29:0/3660875318 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f485c0709f0 msgr2=0x7f485c061130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.634 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.635 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.636+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 zone default found 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 4 Realm: () 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 zonegroup default 2024-09-14T11:24:02.636 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.637+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.638+0000 7f4868926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.638+0000 7f4868926800 20 started sync module instance, tier type = 2024-09-14T11:24:02.637 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.638+0000 7f4868926800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=0 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=1 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=2 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=3 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=4 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.648+0000 7f4868926800 20 add_watcher() i=5 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.649+0000 7f4868926800 20 add_watcher() i=6 2024-09-14T11:24:02.647 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.650+0000 7f4868926800 20 add_watcher() i=7 2024-09-14T11:24:02.648 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.650+0000 7f4868926800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:02.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.652+0000 7f471afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.652+0000 7f4868926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.652+0000 7f4868926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.652+0000 7f4868926800 5 note: GC not initialized 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.653+0000 7f4719fdb640 20 reqs_thread_entry: start 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.653+0000 7f4868926800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:02.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.653+0000 7f4868926800 20 Filter name: none 2024-09-14T11:24:02.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.653+0000 7f468b7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:02.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.653+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.654+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:02.652 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.654+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.654+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:02.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.654+0000 7f4868926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:02.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.654+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.655+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:02.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.655+0000 7f4868926800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.656+0000 7f4868926800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:02.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.656+0000 7f4868926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:02.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.658+0000 7f471afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:02.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.661+0000 7f4868926800 20 remove_watcher() i=0 2024-09-14T11:24:02.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.661+0000 7f4868926800 2 removed watcher, disabling cache 2024-09-14T11:24:02.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.662+0000 7f4868926800 20 remove_watcher() i=1 2024-09-14T11:24:02.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.663+0000 7f4868926800 20 remove_watcher() i=2 2024-09-14T11:24:02.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.664+0000 7f4868926800 20 remove_watcher() i=3 2024-09-14T11:24:02.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.666+0000 7f4868926800 20 remove_watcher() i=4 2024-09-14T11:24:02.665 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.667+0000 7f4868926800 20 remove_watcher() i=5 2024-09-14T11:24:02.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.668+0000 7f4868926800 20 remove_watcher() i=6 2024-09-14T11:24:02.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.669+0000 7f4868926800 20 remove_watcher() i=7 2024-09-14T11:24:02.680 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:02.680 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:24:02.680 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:24:02.680 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:02.682 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:24:02.719 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:02.719 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:02.761 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.763+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.763 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 realm 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:02.764 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:02.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.767+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:02.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.767+0000 7f134a72c800 20 searching for the correct realm 2024-09-14T11:24:02.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.769+0000 7f1346c50640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1340046030 msgr2=0x7f1340032720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:02.973 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:02.975+0000 7f1345c4e640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f13400765c0 msgr2=0x7f1340074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.181 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.182 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:03.183 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 zone default found 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 4 Realm: () 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 zonegroup default 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.185+0000 7f134a72c800 20 started sync module instance, tier type = 2024-09-14T11:24:03.184 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.185+0000 7f134a72c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:03.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=0 2024-09-14T11:24:03.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=1 2024-09-14T11:24:03.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=2 2024-09-14T11:24:03.193 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=3 2024-09-14T11:24:03.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=4 2024-09-14T11:24:03.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=5 2024-09-14T11:24:03.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=6 2024-09-14T11:24:03.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.196+0000 7f134a72c800 20 add_watcher() i=7 2024-09-14T11:24:03.194 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.196+0000 7f134a72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.198+0000 7f11fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:03.196 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.198+0000 7f134a72c800 5 note: GC not initialized 2024-09-14T11:24:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f11777fe640 20 reqs_thread_entry: start 2024-09-14T11:24:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f134a72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f134a72c800 20 Filter name: none 2024-09-14T11:24:03.197 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f11757fa640 20 reqs_thread_entry: start 2024-09-14T11:24:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.199+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:03.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.200+0000 7f134a72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:03.200 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.202+0000 7f134a72c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:24:03.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.209+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.209+0000 7f134a72c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.209+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.209+0000 7f134a72c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 93892538576192 notifier 8313 bl.length()=911 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:03.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:03.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:03.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.212+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f134a72c800 time 2024-09-14T11:24:03.218884+0000 2024-09-14T11:24:03.216 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:24:03.216 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f134bf8c76a] 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.218+0000 7f134a72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f134a72c800 time 2024-09-14T11:24:03.218884+0000 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.217 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f134bf8c76a] 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:24:03.218 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f134a72c800 thread_name:radosgw-admin 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f134ac3e6f0] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f134ac8b99c] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f134bf8c7c4] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.231 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.219+0000 7f134a72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f134a72c800 thread_name:radosgw-admin 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f134ac3e6f0] 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f134ac8b99c] 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f134bf8c7c4] 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.232 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8301 payload 274 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:24:02.744+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.233 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: dump: 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.234 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: dump: 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:24:02.744+0000 7f134a72c800 5 monclient: authenticate success, global_id 8301 2024-09-14T11:24:03.235 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:24:02.744+0000 7f134a72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:24:02.744+0000 7f134a72c800 4 set_mon_vals no callback set 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: shutdown 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 asok(0x55650f368270) unregister_commands rotate-key 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:24:02.745+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.236 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.237 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:24:02.745+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: starting msgr at 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: starting objecter 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests hook 0x55650f5b9ba0 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: setting wanted keys 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: calling monclient init 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.238 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:24:02.746+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:24:02.746+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key hook 0x55650f5888d8 2024-09-14T11:24:03.239 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f4360e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f4d1940 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f4d2260 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.381759s 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f4360e0 auth_method 0 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.240 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f4d2260 auth_method 0 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:24:02.747+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f4d1940 auth_method 0 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient(hunting): handle_auth_done global_id 7856 payload 824 2024-09-14T11:24:03.241 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:24:02.747+0000 7f134644f640 1 monclient: found mon.noname-c 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: dump: 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.242 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: dump: 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.243 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:24:02.747+0000 7f134a72c800 5 monclient: authenticate success, global_id 7856 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:24:02.747+0000 7f1234608640 4 set_mon_vals no callback set 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:24:02.747+0000 7f134a72c800 1 librados: init done 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:24:02.750+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f122c077230 auth_method 0 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:24:02.750+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f5d1120 auth_method 0 2024-09-14T11:24:03.244 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:24:02.751+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f5d4300 auth_method 0 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:24:02.751+0000 7f1345c4e640 10 monclient: get_auth_request con 0x55650f5d84f0 auth_method 0 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:24:02.752+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f5d7bb0 auth_method 0 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:24:02.753+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:24:02.753+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:24:02.753+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.245 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.246 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:24:02.753+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests cmddesc objecter_requests hook 0x55650f5e3f70 EEXIST 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.247 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:24:02.754+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:24:02.754+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x55650f5df600 EEXIST 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f607c60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f609f30 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f606430 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.248 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.389669s 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f607c60 auth_method 0 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f606430 auth_method 0 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.249 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient(hunting): handle_auth_done global_id 7859 payload 824 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:24:02.755+0000 7f1345c4e640 1 monclient: found mon.noname-c 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:24:02.755+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f609f30 auth_method 0 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: dump: 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.250 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: dump: 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.251 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:24:02.755+0000 7f134a72c800 5 monclient: authenticate success, global_id 7859 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:24:02.755+0000 7f1347451640 4 set_mon_vals no callback set 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.252 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: get_monmap_and_config 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:24:02.757+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.253 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:24:02.757+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1220077140 auth_method 0 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.254 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.255 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x7ffd929795c8 EEXIST 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f65c080 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f64c9d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f6574b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.256 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.393952s 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f64c9d0 auth_method 0 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f65c080 auth_method 0 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.257 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8310 payload 274 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:24:02.759+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: dump: 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.258 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: dump: 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.259 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:24:02.759+0000 7f134a72c800 5 monclient: authenticate success, global_id 8310 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:24:02.759+0000 7f134a72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:24:02.759+0000 7f134a72c800 4 set_mon_vals no callback set 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: shutdown 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.260 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.261 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:24:02.760+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: starting msgr at 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: starting objecter 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests cmddesc objecter_requests hook 0x55650f628a40 EEXIST 2024-09-14T11:24:03.262 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: setting wanted keys 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: calling monclient init 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.263 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:24:02.761+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:24:02.761+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:24:02.761+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x55650f61fb58 EEXIST 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f64c9d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f6574b0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f65c080 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.264 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.396355s 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f6574b0 auth_method 0 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f65c080 auth_method 0 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.265 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f64c9d0 auth_method 0 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8313 payload 824 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:24:02.761+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: dump: 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.266 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: dump: 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.267 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:24:02.762+0000 7f134a72c800 5 monclient: authenticate success, global_id 8313 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:24:02.762+0000 7f1229ffb640 4 set_mon_vals no callback set 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.268 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:24:02.762+0000 7f134a72c800 1 librados: init done 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:24:02.762+0000 7f134a72c800 5 asok(0x55650f368270) register_command cr dump hook 0x55650f653128 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:24:02.763+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:24:02.764+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f1210077230 auth_method 0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:24:02.764+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f676620 auth_method 0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 realm 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:24:02.765+0000 7f134a72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:03.269 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:24:02.766+0000 7f1345c4e640 10 monclient: get_auth_request con 0x55650f67a810 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:24:02.766+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f67e070 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:24:02.767+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:24:02.767+0000 7f134a72c800 20 searching for the correct realm 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:24:02.767+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f682e10 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:24:02.768+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f1338062290 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:24:02.769+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1340046030 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:24:02.769+0000 7f1346c50640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1340046030 msgr2=0x7f1340032720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:24:02.970+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1340046030 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:24:02.972+0000 7f134644f640 10 monclient: get_auth_request con 0x7f134006d3d0 auth_method 0 2024-09-14T11:24:03.270 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:24:02.975+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f13400765c0 auth_method 0 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:24:02.975+0000 7f1345c4e640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f13400765c0 msgr2=0x7f1340074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:24:03.176+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f13400765c0 auth_method 0 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.271 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 zone default found 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 Realm: () 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:24:03.184+0000 7f134a72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 zonegroup default 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.272 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 started sync module instance, tier type = 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=0 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=1 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=2 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=3 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=4 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=5 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=6 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:24:03.196+0000 7f134a72c800 20 add_watcher() i=7 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:24:03.196+0000 7f134a72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.273 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:24:03.198+0000 7f11fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:24:03.198+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache list hook 0x55650f650040 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache inspect hook 0x55650f650040 2024-09-14T11:24:03.274 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache erase hook 0x55650f650040 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache zap hook 0x55650f650040 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 note: GC not initialized 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:24:03.199+0000 7f11777fe640 20 reqs_thread_entry: start 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace show hook 0x7f1330001d30 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace history hook 0x7f1330001d30 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace active hook 0x7f1330001d30 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace active_short hook 0x7f1330001d30 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 Filter name: none 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:24:03.199+0000 7f11757fa640 20 reqs_thread_entry: start 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:24:03.199+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:03.275 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:24:03.202+0000 7f134a72c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 93892538576192 notifier 8313 bl.length()=911 2024-09-14T11:24:03.276 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:24:03.212+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:24:03.218+0000 7f134a72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f134a72c800 time 2024-09-14T11:24:03.218884+0000 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f134bf8c76a] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.277 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:24:03.219+0000 7f134a72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f134a72c800 thread_name:radosgw-admin 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f134ac3e6f0] 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f134ac8b99c] 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f134bf8c7c4] 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.278 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:24:03.279 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:24:03.280 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:24:03.281 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:24:03.282 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:24:03.283 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:24:03.284 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11757fa640 / http_manager 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11777fe640 / http_manager 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11fcfe1640 / rgw_dt_lg_renew 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1217fff640 / ms_dispatch 2024-09-14T11:24:03.285 INFO:tasks.workunit.client.0.smithi029.stderr: 7f12297fa640 / io_context_pool 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1229ffb640 / io_context_pool 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f122bfff640 / ms_dispatch 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1232e05640 / ms_dispatch 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1234608640 / io_context_pool 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1345c4e640 / msgr-worker-2 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f134644f640 / msgr-worker-1 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1346c50640 / msgr-worker-0 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1347451640 / io_context_pool 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: 7f134a72c800 / radosgw-admin 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/log/ceph/ceph-client.admin.154592.log 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr:--- begin dump of recent events --- 2024-09-14T11:24:03.286 INFO:tasks.workunit.client.0.smithi029.stderr: -499> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8301 payload 274 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -498> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -497> 2024-09-14T11:24:02.744+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -496> 2024-09-14T11:24:02.744+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -495> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -494> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr: -493> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: dump: 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.287 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -492> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -491> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -490> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -489> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -488> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr: -487> 2024-09-14T11:24:02.744+0000 7f1234608640 10 monclient: dump: 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.288 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -486> 2024-09-14T11:24:02.744+0000 7f134a72c800 5 monclient: authenticate success, global_id 8301 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -485> 2024-09-14T11:24:02.744+0000 7f134a72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -484> 2024-09-14T11:24:02.744+0000 7f134a72c800 4 set_mon_vals no callback set 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -483> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: shutdown 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -482> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 asok(0x55650f368270) unregister_commands rotate-key 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -481> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -480> 2024-09-14T11:24:02.745+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr: -479> 2024-09-14T11:24:02.745+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.289 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -478> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -477> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -476> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding auth protocol: cephx 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -475> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -474> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -473> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -472> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -471> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -470> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.290 INFO:tasks.workunit.client.0.smithi029.stderr: -469> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -468> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -467> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -466> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -465> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: crc 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -464> 2024-09-14T11:24:02.745+0000 7f134a72c800 5 AuthRegistry(0x55650f5ba0c0) adding con mode: secure 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -463> 2024-09-14T11:24:02.745+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -462> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: starting msgr at 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -461> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: starting objecter 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -460> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests hook 0x55650f5b9ba0 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -459> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: setting wanted keys 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -458> 2024-09-14T11:24:02.746+0000 7f134a72c800 1 librados: calling monclient init 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -457> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -456> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -455> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.291 INFO:tasks.workunit.client.0.smithi029.stderr: -454> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding auth protocol: cephx 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -453> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -452> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -451> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -450> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -449> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -448> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -447> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -446> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -445> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -444> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -443> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: crc 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -442> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 AuthRegistry(0x55650f588790) adding con mode: secure 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -441> 2024-09-14T11:24:02.746+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -440> 2024-09-14T11:24:02.746+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.292 INFO:tasks.workunit.client.0.smithi029.stderr: -439> 2024-09-14T11:24:02.746+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key hook 0x55650f5888d8 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -438> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -437> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -436> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f4360e0 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -435> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f4d1940 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -434> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f4d2260 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -433> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -432> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -431> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -430> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -429> 2024-09-14T11:24:02.746+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.381759s 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -428> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f4360e0 auth_method 0 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -427> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -426> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -425> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.293 INFO:tasks.workunit.client.0.smithi029.stderr: -424> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f4d2260 auth_method 0 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -423> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -422> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -421> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -420> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -419> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -418> 2024-09-14T11:24:02.746+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -417> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -416> 2024-09-14T11:24:02.746+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -415> 2024-09-14T11:24:02.747+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -414> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f4d1940 auth_method 0 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -413> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -412> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -411> 2024-09-14T11:24:02.747+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -410> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient(hunting): handle_auth_done global_id 7856 payload 824 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -409> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.294 INFO:tasks.workunit.client.0.smithi029.stderr: -408> 2024-09-14T11:24:02.747+0000 7f134644f640 1 monclient: found mon.noname-c 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: -407> 2024-09-14T11:24:02.747+0000 7f134644f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: -406> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: -405> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: -404> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: dump: 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.295 INFO:tasks.workunit.client.0.smithi029.stderr: -403> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr: -402> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr: -401> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr: -400> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr: -399> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr: -398> 2024-09-14T11:24:02.747+0000 7f1232e05640 10 monclient: dump: 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.296 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -397> 2024-09-14T11:24:02.747+0000 7f134a72c800 5 monclient: authenticate success, global_id 7856 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -396> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -395> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -394> 2024-09-14T11:24:02.747+0000 7f1234608640 4 set_mon_vals no callback set 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -393> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -392> 2024-09-14T11:24:02.747+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -391> 2024-09-14T11:24:02.747+0000 7f134a72c800 1 librados: init done 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -390> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -389> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -388> 2024-09-14T11:24:02.749+0000 7f1232e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -387> 2024-09-14T11:24:02.750+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f122c077230 auth_method 0 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -386> 2024-09-14T11:24:02.750+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f5d1120 auth_method 0 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -385> 2024-09-14T11:24:02.751+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f5d4300 auth_method 0 2024-09-14T11:24:03.297 INFO:tasks.workunit.client.0.smithi029.stderr: -384> 2024-09-14T11:24:02.751+0000 7f1345c4e640 10 monclient: get_auth_request con 0x55650f5d84f0 auth_method 0 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -383> 2024-09-14T11:24:02.752+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f5d7bb0 auth_method 0 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -382> 2024-09-14T11:24:02.753+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -381> 2024-09-14T11:24:02.753+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -380> 2024-09-14T11:24:02.753+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -379> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.298 INFO:tasks.workunit.client.0.smithi029.stderr: -378> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -377> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding auth protocol: cephx 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -376> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -375> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -374> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -373> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -372> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -371> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -370> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -369> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -368> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -367> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -366> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: crc 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -365> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 AuthRegistry(0x55650f5e05c0) adding con mode: secure 2024-09-14T11:24:03.299 INFO:tasks.workunit.client.0.smithi029.stderr: -364> 2024-09-14T11:24:02.753+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -363> 2024-09-14T11:24:02.753+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests cmddesc objecter_requests hook 0x55650f5e3f70 EEXIST 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -362> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -361> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -360> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -359> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding auth protocol: cephx 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -358> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -357> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -356> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -355> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -354> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -353> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -352> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -351> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.300 INFO:tasks.workunit.client.0.smithi029.stderr: -350> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -349> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -348> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: crc 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -347> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 AuthRegistry(0x55650f5df4b8) adding con mode: secure 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -346> 2024-09-14T11:24:02.754+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -345> 2024-09-14T11:24:02.754+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -344> 2024-09-14T11:24:02.754+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x55650f5df600 EEXIST 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -343> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -342> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -341> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f607c60 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -340> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f609f30 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -339> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f606430 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -338> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -337> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.301 INFO:tasks.workunit.client.0.smithi029.stderr: -336> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -335> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -334> 2024-09-14T11:24:02.754+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.389669s 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -333> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f607c60 auth_method 0 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -332> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -331> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -330> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -329> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f606430 auth_method 0 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -328> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -327> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -326> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -325> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -324> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -323> 2024-09-14T11:24:02.754+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -322> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.302 INFO:tasks.workunit.client.0.smithi029.stderr: -321> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -320> 2024-09-14T11:24:02.754+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -319> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient(hunting): handle_auth_done global_id 7859 payload 824 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -318> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -317> 2024-09-14T11:24:02.755+0000 7f1345c4e640 1 monclient: found mon.noname-c 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -316> 2024-09-14T11:24:02.755+0000 7f1345c4e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -315> 2024-09-14T11:24:02.755+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f609f30 auth_method 0 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -314> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -313> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr: -312> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: dump: 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.303 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -311> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -310> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -309> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -308> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -307> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr: -306> 2024-09-14T11:24:02.755+0000 7f122bfff640 10 monclient: dump: 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.304 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -305> 2024-09-14T11:24:02.755+0000 7f134a72c800 5 monclient: authenticate success, global_id 7859 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -304> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -303> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -302> 2024-09-14T11:24:02.755+0000 7f1347451640 4 set_mon_vals no callback set 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -301> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -300> 2024-09-14T11:24:02.755+0000 7f134a72c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.29:3301/0 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -299> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -298> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.305 INFO:tasks.workunit.client.0.smithi029.stderr: -297> 2024-09-14T11:24:02.757+0000 7f122bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: -296> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: get_monmap_and_config 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: -295> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: -294> 2024-09-14T11:24:02.757+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: -293> 2024-09-14T11:24:02.757+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.306 INFO:tasks.workunit.client.0.smithi029.stderr: -292> 2024-09-14T11:24:02.757+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1220077140 auth_method 0 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -291> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -290> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -289> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding auth protocol: cephx 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -288> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -287> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -286> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -285> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -284> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -283> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -282> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -281> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -280> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -279> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -278> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: crc 2024-09-14T11:24:03.307 INFO:tasks.workunit.client.0.smithi029.stderr: -277> 2024-09-14T11:24:02.757+0000 7f134a72c800 5 AuthRegistry(0x55650f627aa0) adding con mode: secure 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -276> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -275> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -274> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -273> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -272> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding auth protocol: cephx 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -271> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -270> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -269> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -268> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -267> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -266> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -265> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -264> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -263> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.308 INFO:tasks.workunit.client.0.smithi029.stderr: -262> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -261> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: crc 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -260> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979480) adding con mode: secure 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -259> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -258> 2024-09-14T11:24:02.758+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -257> 2024-09-14T11:24:02.758+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x7ffd929795c8 EEXIST 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -256> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -255> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -254> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f65c080 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -253> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f64c9d0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -252> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f6574b0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -251> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -250> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -249> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -248> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -247> 2024-09-14T11:24:02.758+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.393952s 2024-09-14T11:24:03.309 INFO:tasks.workunit.client.0.smithi029.stderr: -246> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f64c9d0 auth_method 0 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -245> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -244> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -243> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -242> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f65c080 auth_method 0 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -241> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -240> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -239> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -238> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -237> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -236> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -235> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -234> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -233> 2024-09-14T11:24:02.759+0000 7f1345c4e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.310 INFO:tasks.workunit.client.0.smithi029.stderr: -232> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8310 payload 274 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -231> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -230> 2024-09-14T11:24:02.759+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -229> 2024-09-14T11:24:02.759+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -228> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -227> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr: -226> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: dump: 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.311 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -225> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -224> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -223> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -222> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -221> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr: -220> 2024-09-14T11:24:02.759+0000 7f1229ffb640 10 monclient: dump: 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.312 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -219> 2024-09-14T11:24:02.759+0000 7f134a72c800 5 monclient: authenticate success, global_id 8310 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -218> 2024-09-14T11:24:02.759+0000 7f134a72c800 10 monclient: get_monmap_and_config success 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -217> 2024-09-14T11:24:02.759+0000 7f134a72c800 4 set_mon_vals no callback set 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -216> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: shutdown 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -215> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: build_initial_monmap 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -214> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 build_initial for_mkfs: 0 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr: -213> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: monmap: 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 0 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 0.000000 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:created 0.000000 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 0 (unknown) 2024-09-14T11:24:03.313 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.noname-a 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.noname-b 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.noname-c 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -212> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -211> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -210> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding auth protocol: cephx 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -209> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -208> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -207> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -206> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -205> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -204> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -203> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.314 INFO:tasks.workunit.client.0.smithi029.stderr: -202> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -201> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -200> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -199> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: crc 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -198> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f64ce80) adding con mode: secure 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -197> 2024-09-14T11:24:02.760+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -196> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: starting msgr at 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -195> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: starting objecter 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -194> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 asok(0x55650f368270) register_command objecter_requests cmddesc objecter_requests hook 0x55650f628a40 EEXIST 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -193> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: setting wanted keys 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -192> 2024-09-14T11:24:02.760+0000 7f134a72c800 1 librados: calling monclient init 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -191> 2024-09-14T11:24:02.760+0000 7f134a72c800 10 monclient: init 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -190> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -189> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -188> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding auth protocol: cephx 2024-09-14T11:24:03.315 INFO:tasks.workunit.client.0.smithi029.stderr: -187> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -186> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -185> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -184> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -183> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -182> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -181> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -180> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -179> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -178> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -177> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: crc 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -176> 2024-09-14T11:24:02.760+0000 7f134a72c800 5 AuthRegistry(0x55650f61fa10) adding con mode: secure 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -175> 2024-09-14T11:24:02.761+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -174> 2024-09-14T11:24:02.761+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -173> 2024-09-14T11:24:02.761+0000 7f134a72c800 5 asok(0x55650f368270) register_command rotate-key cmddesc rotate-key hook 0x55650f61fb58 EEXIST 2024-09-14T11:24:03.316 INFO:tasks.workunit.client.0.smithi029.stderr: -172> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient: _reopen_session rank -1 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -171> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -170> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-b con 0x55650f64c9d0 addr [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -169> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-a con 0x55650f6574b0 addr [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -168> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): picked mon.noname-c con 0x55650f65c080 addr [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -167> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -166> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -165> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -164> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): _renew_subs 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -163> 2024-09-14T11:24:02.761+0000 7f134a72c800 10 monclient(hunting): authenticate will time out at 2446.396355s 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -162> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): get_auth_request con 0x55650f6574b0 auth_method 0 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -161> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -160> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -159> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -158> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): get_auth_request con 0x55650f65c080 auth_method 0 2024-09-14T11:24:03.317 INFO:tasks.workunit.client.0.smithi029.stderr: -157> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -156> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -155> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -154> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -153> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -152> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -151> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -150> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -149> 2024-09-14T11:24:02.761+0000 7f134644f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -148> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): get_auth_request con 0x55650f64c9d0 auth_method 0 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -147> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -146> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -145> 2024-09-14T11:24:02.761+0000 7f1345c4e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -144> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient(hunting): handle_auth_done global_id 8313 payload 824 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -143> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient: _finish_hunting 0 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -142> 2024-09-14T11:24:02.761+0000 7f1346c50640 1 monclient: found mon.noname-a 2024-09-14T11:24:03.318 INFO:tasks.workunit.client.0.smithi029.stderr: -141> 2024-09-14T11:24:02.761+0000 7f1346c50640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: -140> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: -139> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: -138> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: dump: 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: -137> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: _finish_auth 0 2024-09-14T11:24:03.319 INFO:tasks.workunit.client.0.smithi029.stderr: -136> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: _check_auth_tickets 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr: -135> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr: -134> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr: -133> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr: -132> 2024-09-14T11:24:02.762+0000 7f1217fff640 10 monclient: dump: 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:epoch 1 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:fsid e989b7a3-862f-4ff0-8d06-d31959c32218 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:last_changed 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:created 2024-09-14T10:55:35.413471+0000 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:min_mon_release 19 (squid) 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:election_strategy: 1 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:0: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.a 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2024-09-14T11:24:03.320 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -131> 2024-09-14T11:24:02.762+0000 7f134a72c800 5 monclient: authenticate success, global_id 8313 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -130> 2024-09-14T11:24:02.762+0000 7f1229ffb640 4 set_mon_vals no callback set 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -129> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -128> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -127> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _renew_subs 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -126> 2024-09-14T11:24:02.762+0000 7f134a72c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.29:3300/0 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -125> 2024-09-14T11:24:02.762+0000 7f134a72c800 1 librados: init done 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -124> 2024-09-14T11:24:02.762+0000 7f134a72c800 5 asok(0x55650f368270) register_command cr dump hook 0x55650f653128 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -123> 2024-09-14T11:24:02.763+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -122> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -121> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -120> 2024-09-14T11:24:02.764+0000 7f1217fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.73:6832/4184533150,v1:172.21.15.73:6833/4184533150] 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -119> 2024-09-14T11:24:02.764+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f1210077230 auth_method 0 2024-09-14T11:24:03.321 INFO:tasks.workunit.client.0.smithi029.stderr: -118> 2024-09-14T11:24:02.764+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f676620 auth_method 0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -117> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -116> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 realm 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -115> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -114> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -113> 2024-09-14T11:24:02.765+0000 7f134a72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -112> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -111> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -110> 2024-09-14T11:24:02.765+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -109> 2024-09-14T11:24:02.766+0000 7f1345c4e640 10 monclient: get_auth_request con 0x55650f67a810 auth_method 0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -108> 2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -107> 2024-09-14T11:24:02.766+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -106> 2024-09-14T11:24:02.766+0000 7f1346c50640 10 monclient: get_auth_request con 0x55650f67e070 auth_method 0 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -105> 2024-09-14T11:24:02.767+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:03.322 INFO:tasks.workunit.client.0.smithi029.stderr: -104> 2024-09-14T11:24:02.767+0000 7f134a72c800 20 searching for the correct realm 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -103> 2024-09-14T11:24:02.767+0000 7f134644f640 10 monclient: get_auth_request con 0x55650f682e10 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -102> 2024-09-14T11:24:02.768+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f1338062290 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -101> 2024-09-14T11:24:02.769+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1340046030 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -100> 2024-09-14T11:24:02.769+0000 7f1346c50640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1340046030 msgr2=0x7f1340032720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -99> 2024-09-14T11:24:02.970+0000 7f1346c50640 10 monclient: get_auth_request con 0x7f1340046030 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -98> 2024-09-14T11:24:02.972+0000 7f134644f640 10 monclient: get_auth_request con 0x7f134006d3d0 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -97> 2024-09-14T11:24:02.975+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f13400765c0 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -96> 2024-09-14T11:24:02.975+0000 7f1345c4e640 0 -- 172.21.15.29:0/286534102 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f13400765c0 msgr2=0x7f1340074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -95> 2024-09-14T11:24:03.176+0000 7f1345c4e640 10 monclient: get_auth_request con 0x7f13400765c0 auth_method 0 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -94> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:03.323 INFO:tasks.workunit.client.0.smithi029.stderr: -93> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -92> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -91> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -90> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -89> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -88> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -87> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -86> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -85> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -84> 2024-09-14T11:24:03.183+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -83> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -82> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 zone default found 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -81> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 Realm: () 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -80> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:03.324 INFO:tasks.workunit.client.0.smithi029.stderr: -79> 2024-09-14T11:24:03.184+0000 7f134a72c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -78> 2024-09-14T11:24:03.184+0000 7f134a72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -77> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 zonegroup default 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -76> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -75> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -74> 2024-09-14T11:24:03.184+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -73> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -72> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -71> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -70> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 started sync module instance, tier type = 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -69> 2024-09-14T11:24:03.185+0000 7f134a72c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -68> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=0 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -67> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=1 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -66> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=2 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -65> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=3 2024-09-14T11:24:03.325 INFO:tasks.workunit.client.0.smithi029.stderr: -64> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=4 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -63> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=5 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -62> 2024-09-14T11:24:03.195+0000 7f134a72c800 20 add_watcher() i=6 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -61> 2024-09-14T11:24:03.196+0000 7f134a72c800 20 add_watcher() i=7 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -60> 2024-09-14T11:24:03.196+0000 7f134a72c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -59> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -58> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -57> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding auth protocol: cephx 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -56> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -55> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -54> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -53> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -52> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -51> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -50> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -49> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.326 INFO:tasks.workunit.client.0.smithi029.stderr: -48> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -47> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -46> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: crc 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -45> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 AuthRegistry(0x7ffd92979960) adding con mode: secure 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -44> 2024-09-14T11:24:03.198+0000 7f11fcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -43> 2024-09-14T11:24:03.198+0000 7f134a72c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -42> 2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -41> 2024-09-14T11:24:03.198+0000 7f134a72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -40> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache list hook 0x55650f650040 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -39> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache inspect hook 0x55650f650040 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -38> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache erase hook 0x55650f650040 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -37> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 asok(0x55650f368270) register_command cache zap hook 0x55650f650040 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -36> 2024-09-14T11:24:03.198+0000 7f134a72c800 5 note: GC not initialized 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -35> 2024-09-14T11:24:03.199+0000 7f11777fe640 20 reqs_thread_entry: start 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -34> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace show hook 0x7f1330001d30 2024-09-14T11:24:03.327 INFO:tasks.workunit.client.0.smithi029.stderr: -33> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace history hook 0x7f1330001d30 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -32> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace active hook 0x7f1330001d30 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -31> 2024-09-14T11:24:03.199+0000 7f134a72c800 5 asok(0x55650f368270) register_command sync trace active_short hook 0x7f1330001d30 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -30> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -29> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 Filter name: none 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -28> 2024-09-14T11:24:03.199+0000 7f11757fa640 20 reqs_thread_entry: start 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -27> 2024-09-14T11:24:03.199+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -26> 2024-09-14T11:24:03.199+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -25> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -24> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -23> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -22> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -21> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -20> 2024-09-14T11:24:03.200+0000 7f134a72c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -19> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.328 INFO:tasks.workunit.client.0.smithi029.stderr: -18> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -17> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -16> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -15> 2024-09-14T11:24:03.200+0000 7f134a72c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -14> 2024-09-14T11:24:03.202+0000 7f134a72c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -13> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -12> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -11> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -10> 2024-09-14T11:24:03.209+0000 7f134a72c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -9> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497097 cookie 93892538576192 notifier 8313 bl.length()=911 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -8> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -7> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -6> 2024-09-14T11:24:03.210+0000 7f12297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -5> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -4> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:03.329 INFO:tasks.workunit.client.0.smithi029.stderr: -3> 2024-09-14T11:24:03.211+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: -2> 2024-09-14T11:24:03.212+0000 7f134a72c800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: -1> 2024-09-14T11:24:03.218+0000 7f134a72c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f134a72c800 time 2024-09-14T11:24:03.218884+0000 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f134bf8c76a] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 5: main() 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 7: __libc_start_main() 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 8: _start() 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.330 INFO:tasks.workunit.client.0.smithi029.stderr: 0> 2024-09-14T11:24:03.219+0000 7f134a72c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: in thread 7f134a72c800 thread_name:radosgw-admin 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f134ac3e6f0] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f134ac8b99c] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 3: raise() 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 4: abort() 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f134bf8c7c4] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f134bf8c928] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55650c9c90b1] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55650c9d8f6a] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 9: main() 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f134ac29590] 2024-09-14T11:24:03.331 INFO:tasks.workunit.client.0.smithi029.stderr: 11: __libc_start_main() 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 12: _start() 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr:--- logging levels --- 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 none 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 lockdep 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 context 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 crush 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_balancer 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_locker 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_log_expire 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mds_migrator 2024-09-14T11:24:03.332 INFO:tasks.workunit.client.0.smithi029.stderr: 3/ 5 mds_quiesce 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 buffer 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 timer 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 filer 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 striper 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 1 objecter 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rados 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_mirror 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_replay 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 rbd_pwl 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 journaler 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objectcacher 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 client 2024-09-14T11:24:03.333 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 osd 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 optracker 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 objclass 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 filestore 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 journal 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 ms 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mon 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 0/10 monc 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 paxos 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 tp 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 auth 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 crypto 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 finisher 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 reserver 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 heartbeatmap 2024-09-14T11:24:03.334 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 perfcounter 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_sync 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_datacache 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_access 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_flight 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 20/20 rgw_notification 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 javaclient 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 asok 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 1 throttle 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 0 refs 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 compressor 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluestore 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 bluefs 2024-09-14T11:24:03.335 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 3 bdev 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 kstore 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 4/ 5 rocksdb 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 fuse 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 2/ 5 mgr 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mgrc 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 dpdk 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 eventtrace 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 prioritycache 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 test 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cephsqlite 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore 2024-09-14T11:24:03.336 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_onode 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_odata 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_omap 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_tm 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_t 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_epm 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_lba 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_cache 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_journal 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_device 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 seastore_backref 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 alienstore 2024-09-14T11:24:03.337 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 mclock 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 cyanstore 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 ceph_exporter 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 memstore 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 1/ 5 trace 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 0/ 5 ceph_dedup 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: -2/-2 (syslog threshold) 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 99/99 (stderr threshold) 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11757fa640 / http_manager 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11777fe640 / http_manager 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f11fcfe1640 / rgw_dt_lg_renew 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1217fff640 / ms_dispatch 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f12297fa640 / io_context_pool 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1229ffb640 / io_context_pool 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f122bfff640 / ms_dispatch 2024-09-14T11:24:03.338 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1232e05640 / ms_dispatch 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1234608640 / io_context_pool 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1345c4e640 / msgr-worker-2 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f134644f640 / msgr-worker-1 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1346c50640 / msgr-worker-0 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f1347451640 / io_context_pool 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: 7f134a72c800 / radosgw-admin 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: max_recent 500 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: max_new 1000 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:24:03.220380Z_838d8e45-c5bd-4be4-94a9-4bb078bc3de5/log 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr:--- end dump of recent events --- 2024-09-14T11:24:03.339 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:24:03.340 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.303+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 20 realm 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.305+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.306+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.306+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.306+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.306+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.307+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:03.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.307+0000 7f6c4060d800 20 searching for the correct realm 2024-09-14T11:24:03.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.309+0000 7f6c3e8f8640 0 -- 172.21.15.29:0/3512912606 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6c3802f060 msgr2=0x7f6c38065c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:03.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.515+0000 7f6c3d8f6640 0 -- 172.21.15.29:0/3512912606 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6c3806cb70 msgr2=0x7f6c3809d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.723+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:03.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 zone default found 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 4 Realm: () 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 zonegroup default 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.724+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.725+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.725+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.725+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.725+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.726+0000 7f6c4060d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.726+0000 7f6c4060d800 20 started sync module instance, tier type = 2024-09-14T11:24:03.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.726+0000 7f6c4060d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=0 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=1 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=2 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=3 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=4 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=5 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.736+0000 7f6c4060d800 20 add_watcher() i=6 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.737+0000 7f6c4060d800 20 add_watcher() i=7 2024-09-14T11:24:03.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.737+0000 7f6c4060d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:03.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.739+0000 7f6af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:03.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:03.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 5 note: GC not initialized 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6a6f7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 20 Filter name: none 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6a6d7fa640 20 reqs_thread_entry: start 2024-09-14T11:24:03.739 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.740+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.741+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:03.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.741+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.742+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:03.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.742+0000 7f6c4060d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:03.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.742+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.742+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:03.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.742+0000 7f6c4060d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.743+0000 7f6c4060d800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:03.741 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.743+0000 7f6c4060d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:03.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.745+0000 7f6af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:03.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.747+0000 7f6c4060d800 20 remove_watcher() i=0 2024-09-14T11:24:03.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.747+0000 7f6c4060d800 2 removed watcher, disabling cache 2024-09-14T11:24:03.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.749+0000 7f6c4060d800 20 remove_watcher() i=1 2024-09-14T11:24:03.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.750+0000 7f6c4060d800 20 remove_watcher() i=2 2024-09-14T11:24:03.749 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.751+0000 7f6c4060d800 20 remove_watcher() i=3 2024-09-14T11:24:03.750 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.752+0000 7f6c4060d800 20 remove_watcher() i=4 2024-09-14T11:24:03.751 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.753+0000 7f6c4060d800 20 remove_watcher() i=5 2024-09-14T11:24:03.752 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.754+0000 7f6c4060d800 20 remove_watcher() i=6 2024-09-14T11:24:03.753 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.755+0000 7f6c4060d800 20 remove_watcher() i=7 2024-09-14T11:24:03.810 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:24:03.839 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:03.839 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:03.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.880+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 realm 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:03.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.882+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.883+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:03.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.883+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:03.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.884+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:03.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.884+0000 7fd51c52e800 20 searching for the correct realm 2024-09-14T11:24:03.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:03.886+0000 7fd518ade640 0 -- 172.21.15.29:0/825373829 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd510017070 msgr2=0x7fd5100029e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:04.090 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.091+0000 7fd517adc640 0 -- 172.21.15.29:0/825373829 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd510083c10 msgr2=0x7fd510073320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:04.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.298+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:04.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 zone default found 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 4 Realm: () 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 zonegroup default 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.299+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 started sync module instance, tier type = 2024-09-14T11:24:04.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.300+0000 7fd51c52e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=0 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=1 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=2 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=3 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=4 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=5 2024-09-14T11:24:04.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.311+0000 7fd51c52e800 20 add_watcher() i=6 2024-09-14T11:24:04.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.312+0000 7fd51c52e800 20 add_watcher() i=7 2024-09-14T11:24:04.310 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.312+0000 7fd51c52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:04.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd3cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:04.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd51c52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd51c52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd51c52e800 5 note: GC not initialized 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd3cdfdb640 20 reqs_thread_entry: start 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.314+0000 7fd51c52e800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 20 Filter name: none 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd33f7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:04.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:04.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:04.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:04.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:04.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.315+0000 7fd51c52e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:04.316 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.316+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.317+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.318+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:04.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.318+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.318+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.318+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.319+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.319+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.319+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.319+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:04.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.320+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.321+0000 7fd51c52e800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:04.319 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.321+0000 7fd51c52e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:04.320 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.322+0000 7fd3cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:04.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.325+0000 7fd51c52e800 20 remove_watcher() i=0 2024-09-14T11:24:04.323 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.325+0000 7fd51c52e800 2 removed watcher, disabling cache 2024-09-14T11:24:04.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.326+0000 7fd51c52e800 20 remove_watcher() i=1 2024-09-14T11:24:04.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.327+0000 7fd51c52e800 20 remove_watcher() i=2 2024-09-14T11:24:04.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.328+0000 7fd51c52e800 20 remove_watcher() i=3 2024-09-14T11:24:04.327 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.330+0000 7fd51c52e800 20 remove_watcher() i=4 2024-09-14T11:24:04.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.331+0000 7fd51c52e800 20 remove_watcher() i=5 2024-09-14T11:24:04.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.332+0000 7fd51c52e800 20 remove_watcher() i=6 2024-09-14T11:24:04.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:04.333+0000 7fd51c52e800 20 remove_watcher() i=7 2024-09-14T11:24:34.347 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:24:34.381 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:34.381 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:34.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.430+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 realm 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.431+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.432+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:34.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.432+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.433+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:34.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.433+0000 7fb7d5b0c800 20 searching for the correct realm 2024-09-14T11:24:34.433 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.433+0000 7fb7d35f6640 0 -- 172.21.15.29:0/1669469385 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x5583649d8ff0 msgr2=0x5583649db4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:34.638 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.638+0000 7fb7d35f6640 0 -- 172.21.15.29:0/1669469385 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x558364766140 msgr2=0x7fb7cc077940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.850+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:34.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 zone default found 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 4 Realm: () 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 zonegroup default 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.851+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.852+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.852+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.852+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.852+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.853+0000 7fb7d5b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.853+0000 7fb7d5b0c800 20 started sync module instance, tier type = 2024-09-14T11:24:34.853 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.853+0000 7fb7d5b0c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:34.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=0 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=1 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=2 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=3 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=4 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=5 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.863+0000 7fb7d5b0c800 20 add_watcher() i=6 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.864+0000 7fb7d5b0c800 20 add_watcher() i=7 2024-09-14T11:24:34.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.864+0000 7fb7d5b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:34.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.866+0000 7fb689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:34.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb7d5b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:34.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb7d5b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:34.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb7d5b0c800 5 note: GC not initialized 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb688fe1640 20 reqs_thread_entry: start 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb7d5b0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.867+0000 7fb7d5b0c800 20 Filter name: none 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb6027fc640 20 reqs_thread_entry: start 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.867 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.868+0000 7fb7d5b0c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:34.868 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:34.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:34.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.869+0000 7fb7d5b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:34.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.874+0000 7fb689fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:34.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.877+0000 7fb7d5b0c800 20 remove_watcher() i=0 2024-09-14T11:24:34.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.877+0000 7fb7d5b0c800 2 removed watcher, disabling cache 2024-09-14T11:24:34.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.878+0000 7fb7d5b0c800 20 remove_watcher() i=1 2024-09-14T11:24:34.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.879+0000 7fb7d5b0c800 20 remove_watcher() i=2 2024-09-14T11:24:34.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.880+0000 7fb7d5b0c800 20 remove_watcher() i=3 2024-09-14T11:24:34.880 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.881+0000 7fb7d5b0c800 20 remove_watcher() i=4 2024-09-14T11:24:34.881 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.882+0000 7fb7d5b0c800 20 remove_watcher() i=5 2024-09-14T11:24:34.882 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.883+0000 7fb7d5b0c800 20 remove_watcher() i=6 2024-09-14T11:24:34.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.885+0000 7fb7d5b0c800 20 remove_watcher() i=7 2024-09-14T11:24:34.898 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:24:34.929 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:34.930 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:34.972 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.973+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.974 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 realm 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.975+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.976+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:34.975 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.976+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:34.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.977+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:34.976 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.977+0000 7f76cbabb800 20 searching for the correct realm 2024-09-14T11:24:34.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:34.979+0000 7f76c9da6640 0 -- 172.21.15.29:0/4028563328 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f76c4018070 msgr2=0x7f76c4060df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:35.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.186+0000 7f76c8da4640 0 -- 172.21.15.29:0/4028563328 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f76c406b620 msgr2=0x7f76c40604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:35.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.395+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 zone default found 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 4 Realm: () 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 zonegroup default 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.396+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.397+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.397+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.397+0000 7f76cbabb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.397+0000 7f76cbabb800 20 started sync module instance, tier type = 2024-09-14T11:24:35.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.397+0000 7f76cbabb800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=0 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=1 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=2 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=3 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=4 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=5 2024-09-14T11:24:35.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.408+0000 7f76cbabb800 20 add_watcher() i=6 2024-09-14T11:24:35.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.409+0000 7f76cbabb800 20 add_watcher() i=7 2024-09-14T11:24:35.408 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.409+0000 7f76cbabb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:35.410 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.411+0000 7f757f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.411+0000 7f76cbabb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.411+0000 7f76cbabb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.411+0000 7f76cbabb800 5 note: GC not initialized 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.411+0000 7f757e7e4640 20 reqs_thread_entry: start 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 20 Filter name: none 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f74effff640 20 reqs_thread_entry: start 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:35.411 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:35.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:35.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:35.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:35.412 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.412+0000 7f76cbabb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 20 rados_obj.operate() r=0 bl.length=454 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:35.413 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.413+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.414+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.414+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.414+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.414+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.415+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:35.414 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.415+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.415+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.415+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.416+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.416+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.416+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:35.415 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.416+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:35.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:35.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:35.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:35.416 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.417+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.418+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.418+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.418+0000 7f76cbabb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:35.417 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.418+0000 7f76cbabb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:35.419 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.420+0000 7f757f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:35.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.422+0000 7f76cbabb800 20 remove_watcher() i=0 2024-09-14T11:24:35.422 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.422+0000 7f76cbabb800 2 removed watcher, disabling cache 2024-09-14T11:24:35.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.424+0000 7f76cbabb800 20 remove_watcher() i=1 2024-09-14T11:24:35.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.425+0000 7f76cbabb800 20 remove_watcher() i=2 2024-09-14T11:24:35.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.426+0000 7f76cbabb800 20 remove_watcher() i=3 2024-09-14T11:24:35.426 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.427+0000 7f76cbabb800 20 remove_watcher() i=4 2024-09-14T11:24:35.427 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.428+0000 7f76cbabb800 20 remove_watcher() i=5 2024-09-14T11:24:35.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.429+0000 7f76cbabb800 20 remove_watcher() i=6 2024-09-14T11:24:35.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.430+0000 7f76cbabb800 20 remove_watcher() i=7 2024-09-14T11:24:35.443 INFO:tasks.workunit.client.0.smithi029.stderr:check reshard logrecord successfully 2024-09-14T11:24:35.443 INFO:tasks.workunit.client.0.smithi029.stderr: test: reshard versioned bucket 2024-09-14T11:24:35.445 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:24:35.476 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:35.476 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:35.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.518+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 20 realm 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.520+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.521+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.521+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.522+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:35.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.522+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.522+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:35.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.522+0000 7f44faf40800 20 searching for the correct realm 2024-09-14T11:24:35.524 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.525+0000 7f44f7487640 0 -- 172.21.15.29:0/3089801668 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f44f0072020 msgr2=0x7f44f00a5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:35.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.731+0000 7f44f6485640 0 -- 172.21.15.29:0/3089801668 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f44f009f9e0 msgr2=0x7f44f00c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.937+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 zone default found 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 4 Realm: () 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 zonegroup default 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.938+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.939+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.939+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.939+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.939+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.940+0000 7f44faf40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:35.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.940+0000 7f44faf40800 20 started sync module instance, tier type = 2024-09-14T11:24:35.940 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.940+0000 7f44faf40800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=0 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=1 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=2 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=3 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=4 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.950+0000 7f44faf40800 20 add_watcher() i=5 2024-09-14T11:24:35.950 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.951+0000 7f44faf40800 20 add_watcher() i=6 2024-09-14T11:24:35.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.951+0000 7f44faf40800 20 add_watcher() i=7 2024-09-14T11:24:35.951 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.952+0000 7f44faf40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:35.953 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.953+0000 7f43ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f44faf40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f44faf40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f44faf40800 5 note: GC not initialized 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f4327fff640 20 reqs_thread_entry: start 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f44faf40800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f44faf40800 20 Filter name: none 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.954+0000 7f4325ffb640 20 reqs_thread_entry: start 2024-09-14T11:24:35.954 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.955+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.955+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:35.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.955+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.956+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:35.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.956+0000 7f44faf40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:35.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.956+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.956+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:35.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.956+0000 7f44faf40800 20 rados->read ofs=0 len=0 2024-09-14T11:24:35.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.957+0000 7f44faf40800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:35.956 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.957+0000 7f44faf40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:35.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.959+0000 7f43ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:35.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.961+0000 7f44faf40800 20 remove_watcher() i=0 2024-09-14T11:24:35.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.961+0000 7f44faf40800 2 removed watcher, disabling cache 2024-09-14T11:24:35.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.963+0000 7f44faf40800 20 remove_watcher() i=1 2024-09-14T11:24:35.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.964+0000 7f44faf40800 20 remove_watcher() i=2 2024-09-14T11:24:35.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.965+0000 7f44faf40800 20 remove_watcher() i=3 2024-09-14T11:24:35.965 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.966+0000 7f44faf40800 20 remove_watcher() i=4 2024-09-14T11:24:35.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.967+0000 7f44faf40800 20 remove_watcher() i=5 2024-09-14T11:24:35.967 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.968+0000 7f44faf40800 20 remove_watcher() i=6 2024-09-14T11:24:35.969 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:35.970+0000 7f44faf40800 20 remove_watcher() i=7 2024-09-14T11:24:35.981 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:35.981 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:24:35.981 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: myver id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:24:35.981 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:35.983 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:24:36.016 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:36.016 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:36.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.059+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.060+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.060+0000 7ff3e7cbb800 20 realm 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.060+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.061+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.061+0000 7ff3e7cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.061+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.061+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.060 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.061+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.062+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:36.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.062+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.061 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.062+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:36.062 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.062+0000 7ff3e7cbb800 20 searching for the correct realm 2024-09-14T11:24:36.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.064+0000 7ff3e4fa4640 0 -- 172.21.15.29:0/3188696055 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7ff3d801e070 msgr2=0x7ff3d8068d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:36.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.067+0000 7ff3e4fa4640 0 -- 172.21.15.29:0/3188696055 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7ff2b0087860 msgr2=0x7ff2b0089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:36.073 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:36.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:36.074 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.074+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 zone default found 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 4 Realm: () 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 zonegroup default 2024-09-14T11:24:36.075 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 started sync module instance, tier type = 2024-09-14T11:24:36.076 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.075+0000 7ff3e7cbb800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:36.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=0 2024-09-14T11:24:36.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=1 2024-09-14T11:24:36.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=2 2024-09-14T11:24:36.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=3 2024-09-14T11:24:36.083 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=4 2024-09-14T11:24:36.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=5 2024-09-14T11:24:36.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.084+0000 7ff3e7cbb800 20 add_watcher() i=6 2024-09-14T11:24:36.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.085+0000 7ff3e7cbb800 20 add_watcher() i=7 2024-09-14T11:24:36.084 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.085+0000 7ff3e7cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:36.086 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff29b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff3e7cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff3e7cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff3e7cbb800 5 note: GC not initialized 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff29a7e4640 20 reqs_thread_entry: start 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff3e7cbb800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff3e7cbb800 20 Filter name: none 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.087+0000 7ff20bfff640 20 reqs_thread_entry: start 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:24:36.087 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : miss 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.088+0000 7ff3e7cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.088 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:36.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 10 adding default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:36.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.089 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.089+0000 7ff3e7cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:36.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff3e7cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff3e7cbb800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff3e7cbb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff3e7cbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:36.093 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff2b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496996 cookie 94671454978080 notifier 7967 bl.length()=905 2024-09-14T11:24:36.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff2b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff2b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.094 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.094+0000 7ff2b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.096+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:36.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.096+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:36.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.096+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:36.095 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.096+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:36.100 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:36.101 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.100+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.0 2024-09-14T11:24:36.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.101+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1 2024-09-14T11:24:36.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.101+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2 2024-09-14T11:24:36.102 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.102+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.102+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.4 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.103+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.5 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.103+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.6 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.104+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.7 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.104+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.8 2024-09-14T11:24:36.103 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.104+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.9 2024-09-14T11:24:36.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.105+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.10 2024-09-14T11:24:36.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.106+0000 7ff3e7cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:36.105 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.106+0000 7ff3e7cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.107+0000 7ff3e7cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.107+0000 7ff3e7cbb800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.107+0000 7ff3e7cbb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.107+0000 7ff3e7cbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.108+0000 7ff2b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496997 cookie 94671454978080 notifier 7967 bl.length()=905 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.108+0000 7ff2b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.108+0000 7ff2b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.107 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.108+0000 7ff2b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.109+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:36.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.109+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:36.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.109+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:36.108 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.109+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:36.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.112+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.0 2024-09-14T11:24:36.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.112+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1 2024-09-14T11:24:36.111 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.112+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2 2024-09-14T11:24:36.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.113+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3 2024-09-14T11:24:36.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.113+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.4 2024-09-14T11:24:36.112 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.113+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.5 2024-09-14T11:24:36.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.113+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.6 2024-09-14T11:24:36.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.114+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.7 2024-09-14T11:24:36.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.114+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.8 2024-09-14T11:24:36.113 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.114+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.9 2024-09-14T11:24:36.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.115+0000 7ff3e7cbb800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.10 2024-09-14T11:24:36.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.115+0000 7ff3e7cbb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:36.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.115+0000 7ff3e7cbb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff3e7cbb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff3e7cbb800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff3e7cbb800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff3e7cbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff2b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496998 cookie 94671454978080 notifier 7967 bl.length()=873 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff2b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff2b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:36.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.117+0000 7ff2b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:36.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.118+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:36.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.118+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:36.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.118+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:36.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.118+0000 7ff3e7cbb800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:36.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.121+0000 7ff3e7cbb800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:24:36.121 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.122+0000 7ff29b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:36.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.125+0000 7ff3e7cbb800 20 remove_watcher() i=0 2024-09-14T11:24:36.124 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.125+0000 7ff3e7cbb800 2 removed watcher, disabling cache 2024-09-14T11:24:36.125 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.126+0000 7ff3e7cbb800 20 remove_watcher() i=1 2024-09-14T11:24:36.126 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.127+0000 7ff3e7cbb800 20 remove_watcher() i=2 2024-09-14T11:24:36.127 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.128+0000 7ff3e7cbb800 20 remove_watcher() i=3 2024-09-14T11:24:36.128 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.129+0000 7ff3e7cbb800 20 remove_watcher() i=4 2024-09-14T11:24:36.129 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.130+0000 7ff3e7cbb800 20 remove_watcher() i=5 2024-09-14T11:24:36.130 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.131+0000 7ff3e7cbb800 20 remove_watcher() i=6 2024-09-14T11:24:36.131 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.132+0000 7ff3e7cbb800 20 remove_watcher() i=7 2024-09-14T11:24:36.144 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:24:36.172 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:36.173 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:36.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.213+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 realm 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.215+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.216+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:36.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.216+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.216+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:36.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.216+0000 7f97a532e800 20 searching for the correct realm 2024-09-14T11:24:36.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.219+0000 7f97a176c640 0 -- 172.21.15.29:0/2059316773 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9798010440 msgr2=0x7f9798010880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:36.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.223+0000 7f97a076a640 0 -- 172.21.15.29:0/2059316773 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9798030b70 msgr2=0x7f979802d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.429+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.429 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:36.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.430 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 zone default found 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 4 Realm: () 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 zonegroup default 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.430+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.431+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.431+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.431+0000 7f97a532e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.431 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.431+0000 7f97a532e800 20 started sync module instance, tier type = 2024-09-14T11:24:36.432 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.431+0000 7f97a532e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:36.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=0 2024-09-14T11:24:36.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=1 2024-09-14T11:24:36.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=2 2024-09-14T11:24:36.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=3 2024-09-14T11:24:36.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=4 2024-09-14T11:24:36.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=5 2024-09-14T11:24:36.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.441+0000 7f97a532e800 20 add_watcher() i=6 2024-09-14T11:24:36.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.442+0000 7f97a532e800 20 add_watcher() i=7 2024-09-14T11:24:36.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.442+0000 7f97a532e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:36.443 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f9656fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f97a532e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f97a532e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f97a532e800 5 note: GC not initialized 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f9655fe3640 20 reqs_thread_entry: start 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f97a532e800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.444+0000 7f97a532e800 20 Filter name: none 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.445+0000 7f95c77fe640 20 reqs_thread_entry: start 2024-09-14T11:24:36.444 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.445+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.445+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:36.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.445+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.446+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:36.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.446+0000 7f97a532e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:36.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.446+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.446+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:36.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.446+0000 7f97a532e800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.447+0000 7f97a532e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:36.446 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.447+0000 7f97a532e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:36.448 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.450+0000 7f9656fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:36.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.452+0000 7f97a532e800 20 remove_watcher() i=0 2024-09-14T11:24:36.451 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.452+0000 7f97a532e800 2 removed watcher, disabling cache 2024-09-14T11:24:36.452 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.453+0000 7f97a532e800 20 remove_watcher() i=1 2024-09-14T11:24:36.453 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.454+0000 7f97a532e800 20 remove_watcher() i=2 2024-09-14T11:24:36.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.455+0000 7f97a532e800 20 remove_watcher() i=3 2024-09-14T11:24:36.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.456+0000 7f97a532e800 20 remove_watcher() i=4 2024-09-14T11:24:36.456 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.457+0000 7f97a532e800 20 remove_watcher() i=5 2024-09-14T11:24:36.457 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.458+0000 7f97a532e800 20 remove_watcher() i=6 2024-09-14T11:24:36.458 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.459+0000 7f97a532e800 20 remove_watcher() i=7 2024-09-14T11:24:36.470 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:36.470 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:24:36.470 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: myver id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:24:36.470 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:36.548 INFO:tasks.workunit.client.0.smithi029.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:24:36.888 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:24:36.917 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:36.917 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:36.955 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.956+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.958+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.958+0000 7f53328b7800 20 realm 2024-09-14T11:24:36.957 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.958+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.959+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.959+0000 7f53328b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:36.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.959+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.959+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:36.958 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.959+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.960+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:36.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.960+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:36.959 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.960+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:36.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.960+0000 7f53328b7800 20 searching for the correct realm 2024-09-14T11:24:36.961 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:36.962+0000 7f5330ba2640 0 -- 172.21.15.29:0/2456999723 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f5328061040 msgr2=0x7f5328086950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:37.168 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.169+0000 7f532fba0640 0 -- 172.21.15.29:0/2456999723 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f5328055920 msgr2=0x7f53280943e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:37.375 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.376 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.376+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 zone default found 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 4 Realm: () 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:37.377 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 zonegroup default 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.377+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.378+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.378+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.378+0000 7f53328b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.378+0000 7f53328b7800 20 started sync module instance, tier type = 2024-09-14T11:24:37.378 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.378+0000 7f53328b7800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=0 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=1 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=2 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=3 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=4 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=5 2024-09-14T11:24:37.387 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.388+0000 7f53328b7800 20 add_watcher() i=6 2024-09-14T11:24:37.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.389+0000 7f53328b7800 20 add_watcher() i=7 2024-09-14T11:24:37.388 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.389+0000 7f53328b7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:37.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.391+0000 7f51e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:37.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.391+0000 7f53328b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:37.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.391+0000 7f53328b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:37.390 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.391+0000 7f53328b7800 5 note: GC not initialized 2024-09-14T11:24:37.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.391+0000 7f51e5fdb640 20 reqs_thread_entry: start 2024-09-14T11:24:37.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f53328b7800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:37.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f53328b7800 20 Filter name: none 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f51577fe640 20 reqs_thread_entry: start 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.392+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.393+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.393+0000 7f53328b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:37.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.393+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.394+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:37.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.394+0000 7f53328b7800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.394+0000 7f53328b7800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:37.393 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.394+0000 7f53328b7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:37.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.397+0000 7f51e6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:37.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.399+0000 7f53328b7800 20 remove_watcher() i=0 2024-09-14T11:24:37.398 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.399+0000 7f53328b7800 2 removed watcher, disabling cache 2024-09-14T11:24:37.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.400+0000 7f53328b7800 20 remove_watcher() i=1 2024-09-14T11:24:37.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.402+0000 7f53328b7800 20 remove_watcher() i=2 2024-09-14T11:24:37.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.403+0000 7f53328b7800 20 remove_watcher() i=3 2024-09-14T11:24:37.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.404+0000 7f53328b7800 20 remove_watcher() i=4 2024-09-14T11:24:37.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.405+0000 7f53328b7800 20 remove_watcher() i=5 2024-09-14T11:24:37.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.406+0000 7f53328b7800 20 remove_watcher() i=6 2024-09-14T11:24:37.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.407+0000 7f53328b7800 20 remove_watcher() i=7 2024-09-14T11:24:37.417 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:37.417 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:24:37.417 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: a-bucket id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:24:37.418 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:37.419 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:24:37.449 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:37.449 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:37.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.490+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 realm 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.492+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.493+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:37.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.493+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.493+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:37.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.493+0000 7f2237328800 20 searching for the correct realm 2024-09-14T11:24:37.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.494+0000 7f22328d5640 0 -- 172.21.15.29:0/3588874990 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f221c002340 msgr2=0x7f22240243f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:37.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.699+0000 7f22338d7640 0 -- 172.21.15.29:0/3588874990 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x561dd3f558b0 msgr2=0x561dd3f57ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.707+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:37.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:37.708 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 zone default found 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 4 Realm: () 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 zonegroup default 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.708+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.709+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.709+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.709+0000 7f2237328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.709+0000 7f2237328800 20 started sync module instance, tier type = 2024-09-14T11:24:37.709 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.709+0000 7f2237328800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=0 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=1 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=2 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=3 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=4 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=5 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=6 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 20 add_watcher() i=7 2024-09-14T11:24:37.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.719+0000 7f2237328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:37.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.721+0000 7f20e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:37.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:37.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:37.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 5 note: GC not initialized 2024-09-14T11:24:37.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f20e8fe1640 20 reqs_thread_entry: start 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 20 Filter name: none 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f20627fc640 20 reqs_thread_entry: start 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.722+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.723+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:37.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.723+0000 7f2237328800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.723+0000 7f2237328800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:37.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.723+0000 7f2237328800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:37.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.724+0000 7f20e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:37.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.727+0000 7f2237328800 20 remove_watcher() i=0 2024-09-14T11:24:37.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.727+0000 7f2237328800 2 removed watcher, disabling cache 2024-09-14T11:24:37.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.728+0000 7f2237328800 20 remove_watcher() i=1 2024-09-14T11:24:37.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.729+0000 7f2237328800 20 remove_watcher() i=2 2024-09-14T11:24:37.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.730+0000 7f2237328800 20 remove_watcher() i=3 2024-09-14T11:24:37.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.731+0000 7f2237328800 20 remove_watcher() i=4 2024-09-14T11:24:37.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.732+0000 7f2237328800 20 remove_watcher() i=5 2024-09-14T11:24:37.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.733+0000 7f2237328800 20 remove_watcher() i=6 2024-09-14T11:24:37.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.734+0000 7f2237328800 20 remove_watcher() i=7 2024-09-14T11:24:37.745 INFO:tasks.workunit.client.0.smithi029.stderr:rados -p default.rgw.buckets.index setomapval .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:24:37.772 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:37.772 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:37.788 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:24:37.817 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:37.817 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:37.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.857+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 20 realm 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.859+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.860+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:37.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.860+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.861+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:37.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.861+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:37.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.861+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:37.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.861+0000 7f686530c800 20 searching for the correct realm 2024-09-14T11:24:37.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:37.863+0000 7f68635f7640 0 -- 172.21.15.29:0/2757873209 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f685c03bc20 msgr2=0x7f685c039670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:38.069 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.070+0000 7f68625f5640 0 -- 172.21.15.29:0/2757873209 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f685c045350 msgr2=0x7f685c0437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:38.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:38.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.277+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 zone default found 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 4 Realm: () 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 zonegroup default 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.278+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.279+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.279+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.279+0000 7f686530c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.279+0000 7f686530c800 20 started sync module instance, tier type = 2024-09-14T11:24:38.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.279+0000 7f686530c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=0 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=1 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=2 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=3 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=4 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=5 2024-09-14T11:24:38.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.289+0000 7f686530c800 20 add_watcher() i=6 2024-09-14T11:24:38.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.290+0000 7f686530c800 20 add_watcher() i=7 2024-09-14T11:24:38.289 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.290+0000 7f686530c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:38.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f67197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f686530c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f686530c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f686530c800 5 note: GC not initialized 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f6693fff640 20 reqs_thread_entry: start 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f686530c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.292+0000 7f686530c800 20 Filter name: none 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.293+0000 7f6691ffb640 20 reqs_thread_entry: start 2024-09-14T11:24:38.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.293+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.293+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.293+0000 7f686530c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 INFO: main: starting shard=0 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:24:38.294 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 INFO: main: starting shard=1 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.294+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 INFO: main: starting shard=2 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 INFO: main: starting shard=3 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.295 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.295+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 INFO: main: starting shard=4 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 INFO: main: starting shard=5 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.296+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.297+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.297+0000 7f686530c800 20 INFO: main: starting shard=6 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.297+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.297+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.297+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 20 INFO: main: starting shard=7 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 20 INFO: main: starting shard=8 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.298+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 INFO: main: starting shard=9 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 INFO: main: starting shard=10 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.299+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 INFO: main: starting shard=11 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 INFO: main: starting shard=12 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.300+0000 7f686530c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.301+0000 7f686530c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:38.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.301+0000 7f686530c800 20 INFO: main: done 2024-09-14T11:24:38.301 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.302+0000 7f67197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:38.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.304+0000 7f686530c800 20 remove_watcher() i=0 2024-09-14T11:24:38.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.304+0000 7f686530c800 2 removed watcher, disabling cache 2024-09-14T11:24:38.304 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.305+0000 7f686530c800 20 remove_watcher() i=1 2024-09-14T11:24:38.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.306+0000 7f686530c800 20 remove_watcher() i=2 2024-09-14T11:24:38.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.308+0000 7f686530c800 20 remove_watcher() i=3 2024-09-14T11:24:38.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.309+0000 7f686530c800 20 remove_watcher() i=4 2024-09-14T11:24:38.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.310+0000 7f686530c800 20 remove_watcher() i=5 2024-09-14T11:24:38.309 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.311+0000 7f686530c800 20 remove_watcher() i=6 2024-09-14T11:24:38.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.312+0000 7f686530c800 20 remove_watcher() i=7 2024-09-14T11:24:38.324 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:24:38.356 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:38.357 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:38.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.398+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.399+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.399+0000 7fb3bb146800 20 realm 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.399+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.400+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.400+0000 7fb3bb146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.400+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.400+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.399 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.400+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.401+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:38.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.401+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.401+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:38.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.401+0000 7fb3bb146800 20 searching for the correct realm 2024-09-14T11:24:38.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.403+0000 7fb3b9431640 0 -- 172.21.15.29:0/1121416620 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fb3b00bf040 msgr2=0x7fb3b00c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:38.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.610+0000 7fb3b842f640 0 -- 172.21.15.29:0/1121416620 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fb3b00ae210 msgr2=0x7fb3b0059af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.817 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.817+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.818 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 zone default found 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 4 Realm: () 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 zonegroup default 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.818+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 started sync module instance, tier type = 2024-09-14T11:24:38.820 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.819+0000 7fb3bb146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:38.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=0 2024-09-14T11:24:38.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=1 2024-09-14T11:24:38.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=2 2024-09-14T11:24:38.828 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=3 2024-09-14T11:24:38.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=4 2024-09-14T11:24:38.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=5 2024-09-14T11:24:38.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.829+0000 7fb3bb146800 20 add_watcher() i=6 2024-09-14T11:24:38.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.830+0000 7fb3bb146800 20 add_watcher() i=7 2024-09-14T11:24:38.829 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.830+0000 7fb3bb146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:38.831 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.832+0000 7fb26efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:38.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:38.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:38.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 5 note: GC not initialized 2024-09-14T11:24:38.832 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb26dfe3640 20 reqs_thread_entry: start 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 20 Filter name: none 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb1df7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.833+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.833 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : miss 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.834 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.834+0000 7fb3bb146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:38.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb3bb146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb3bb146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.837 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb3bb146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb3bb146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:38.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb28f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497099 cookie 94352790255888 notifier 8063 bl.length()=911 2024-09-14T11:24:38.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb28f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb28f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.838+0000 7fb28f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.840+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:38.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.840+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:38.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.840+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:38.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.840+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:38.844 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.845+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.845+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.845+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.845+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.846+0000 7fb3bb146800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.846+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.845 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.846+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.847+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.847+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.847+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.846 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.847+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.848+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.848+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.848+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.847 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.848+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.849+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.849+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.849+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.848 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.849+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.850+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.850+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.850+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.849 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.850+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.851+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.851+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.850 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.851+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.852+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.852+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.851 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.852+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.853+0000 7fb3bb146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:38.852 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.853+0000 7fb3bb146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.854+0000 7fb3bb146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.854+0000 7fb3bb146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.854+0000 7fb3bb146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.854+0000 7fb3bb146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.855+0000 7fb28f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497100 cookie 94352790255888 notifier 8063 bl.length()=911 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.855+0000 7fb28f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.855+0000 7fb28f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.854 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.855+0000 7fb28f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.856+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:38.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.856+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:38.855 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.856+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:38.856 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.856+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:38.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.859+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.859+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.0 2024-09-14T11:24:38.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.859+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.859+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.1 2024-09-14T11:24:38.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.2 2024-09-14T11:24:38.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.3 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.860+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.4 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.861+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.861+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.5 2024-09-14T11:24:38.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.861+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.861+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.6 2024-09-14T11:24:38.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.7 2024-09-14T11:24:38.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.8 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.862+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.9 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.10 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.11 2024-09-14T11:24:38.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.863+0000 7fb3bb146800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.2.12 2024-09-14T11:24:38.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.864+0000 7fb3bb146800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:38.863 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.864+0000 7fb3bb146800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 2024-09-14T11:24:38.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.865+0000 7fb3bb146800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.865+0000 7fb3bb146800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.865+0000 7fb3bb146800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.864 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.865+0000 7fb3bb146800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18, ofs0, ns] 2024-09-14T11:24:38.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.866+0000 7fb28ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497101 cookie 94352790255888 notifier 8063 bl.length()=879 2024-09-14T11:24:38.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.866+0000 7fb28ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 info.flags=0x17 2024-09-14T11:24:38.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.866+0000 7fb28ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.18 to cache LRU end 2024-09-14T11:24:38.865 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.866+0000 7fb28ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:38.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.867+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_sources= new_sources= 2024-09-14T11:24:38.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.867+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential sources added=[] removed=[] 2024-09-14T11:24:38.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.867+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): orig_dests= new_dests= 2024-09-14T11:24:38.866 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.867+0000 7fb3bb146800 20 handle_bi_update(): bucket=:a-bucket[11989569-703c-4397-b0f1-7ddb0279a491.4517.18]): potential dests added=[] removed=[] 2024-09-14T11:24:38.869 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.870+0000 7fb3bb146800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:24:38.871 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.872+0000 7fb26efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:38.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.874+0000 7fb3bb146800 20 remove_watcher() i=0 2024-09-14T11:24:38.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.874+0000 7fb3bb146800 2 removed watcher, disabling cache 2024-09-14T11:24:38.874 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.875+0000 7fb3bb146800 20 remove_watcher() i=1 2024-09-14T11:24:38.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.876+0000 7fb3bb146800 20 remove_watcher() i=2 2024-09-14T11:24:38.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.877+0000 7fb3bb146800 20 remove_watcher() i=3 2024-09-14T11:24:38.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.878+0000 7fb3bb146800 20 remove_watcher() i=4 2024-09-14T11:24:38.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.879+0000 7fb3bb146800 20 remove_watcher() i=5 2024-09-14T11:24:38.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.880+0000 7fb3bb146800 20 remove_watcher() i=6 2024-09-14T11:24:38.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.880+0000 7fb3bb146800 20 remove_watcher() i=7 2024-09-14T11:24:38.892 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:24:38.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:38.921 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:38.960 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.961+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 realm 2024-09-14T11:24:38.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.962 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:38.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:38.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.963+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.964+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:38.963 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.964+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:38.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.965+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:38.964 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.965+0000 7ffa96c13800 20 searching for the correct realm 2024-09-14T11:24:38.966 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:38.967+0000 7ffa92b49640 0 -- 172.21.15.29:0/351363280 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ffa8c037b20 msgr2=0x7ffa8c02e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:39.173 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.174+0000 7ffa91b47640 0 -- 172.21.15.29:0/351363280 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ffa8c01f410 msgr2=0x7ffa8c01f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.380+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.380 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.381 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 zone default found 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 4 Realm: () 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 zonegroup default 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.381+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.382 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 started sync module instance, tier type = 2024-09-14T11:24:39.383 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.382+0000 7ffa96c13800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=0 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=1 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=2 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=3 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=4 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=5 2024-09-14T11:24:39.391 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.392+0000 7ffa96c13800 20 add_watcher() i=6 2024-09-14T11:24:39.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.393+0000 7ffa96c13800 20 add_watcher() i=7 2024-09-14T11:24:39.392 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.393+0000 7ffa96c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:39.394 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ff948fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ffa96c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ffa96c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ffa96c13800 5 note: GC not initialized 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ff8c37fe640 20 reqs_thread_entry: start 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ffa96c13800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.395+0000 7ffa96c13800 20 Filter name: none 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.396+0000 7ff8c17fa640 20 reqs_thread_entry: start 2024-09-14T11:24:39.395 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.396+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.396+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=200 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.396+0000 7ffa96c13800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 20 rados_obj.operate() r=0 bl.length=422 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:24:39.396 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 20 INFO: main: starting shard=0 2024-09-14T11:24:39.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:24:39.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.397+0000 7ffa96c13800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.18.3.0 2024-09-14T11:24:39.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.398+0000 7ffa96c13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:39.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.398+0000 7ffa96c13800 20 INFO: main: done 2024-09-14T11:24:39.397 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.399+0000 7ff948fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:39.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.401+0000 7ffa96c13800 20 remove_watcher() i=0 2024-09-14T11:24:39.400 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.401+0000 7ffa96c13800 2 removed watcher, disabling cache 2024-09-14T11:24:39.401 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.402+0000 7ffa96c13800 20 remove_watcher() i=1 2024-09-14T11:24:39.402 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.403+0000 7ffa96c13800 20 remove_watcher() i=2 2024-09-14T11:24:39.403 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.404+0000 7ffa96c13800 20 remove_watcher() i=3 2024-09-14T11:24:39.404 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.405+0000 7ffa96c13800 20 remove_watcher() i=4 2024-09-14T11:24:39.405 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.406+0000 7ffa96c13800 20 remove_watcher() i=5 2024-09-14T11:24:39.406 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.407+0000 7ffa96c13800 20 remove_watcher() i=6 2024-09-14T11:24:39.407 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.408+0000 7ffa96c13800 20 remove_watcher() i=7 2024-09-14T11:24:39.419 INFO:tasks.workunit.client.0.smithi029.stderr: test: PUT succeeds during reshard 2024-09-14T11:24:39.420 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:24:39.450 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:39.450 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:39.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.490+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 realm 2024-09-14T11:24:39.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.491 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.492+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.493+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:39.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.493+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:39.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.494+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:39.493 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.494+0000 7fd3ffb23800 20 searching for the correct realm 2024-09-14T11:24:39.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:39.496+0000 7fd3fc00d640 0 -- 172.21.15.29:0/2514325027 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd3f4066140 msgr2=0x7fd3f406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:40.104 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.104+0000 7fd3fb00b640 0 -- 172.21.15.29:0/2514325027 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd3f409a5f0 msgr2=0x7fd3f4098560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:40.312 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:40.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.313+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 zone default found 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 4 Realm: () 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 zonegroup default 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.314+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.315+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.315+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.315+0000 7fd3ffb23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.315+0000 7fd3ffb23800 20 started sync module instance, tier type = 2024-09-14T11:24:40.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.315+0000 7fd3ffb23800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=0 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=1 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=2 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=3 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=4 2024-09-14T11:24:40.325 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=5 2024-09-14T11:24:40.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.326+0000 7fd3ffb23800 20 add_watcher() i=6 2024-09-14T11:24:40.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.327+0000 7fd3ffb23800 20 add_watcher() i=7 2024-09-14T11:24:40.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.327+0000 7fd3ffb23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:40.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.329+0000 7fd2b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:40.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:40.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:40.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 5 note: GC not initialized 2024-09-14T11:24:40.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd2b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:24:40.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:40.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 20 Filter name: none 2024-09-14T11:24:40.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd22a7fc640 20 reqs_thread_entry: start 2024-09-14T11:24:40.330 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.330+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.331+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.331+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.331+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.332+0000 7fd3ffb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.332+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.331 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.332+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:40.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.332+0000 7fd3ffb23800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.332+0000 7fd3ffb23800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:40.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.333+0000 7fd3ffb23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:40.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.335+0000 7fd2b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:40.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.337+0000 7fd3ffb23800 20 remove_watcher() i=0 2024-09-14T11:24:40.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.337+0000 7fd3ffb23800 2 removed watcher, disabling cache 2024-09-14T11:24:40.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.338+0000 7fd3ffb23800 20 remove_watcher() i=1 2024-09-14T11:24:40.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.340+0000 7fd3ffb23800 20 remove_watcher() i=2 2024-09-14T11:24:40.340 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.341+0000 7fd3ffb23800 20 remove_watcher() i=3 2024-09-14T11:24:40.341 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.342+0000 7fd3ffb23800 20 remove_watcher() i=4 2024-09-14T11:24:40.342 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.343+0000 7fd3ffb23800 20 remove_watcher() i=5 2024-09-14T11:24:40.344 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.345+0000 7fd3ffb23800 20 remove_watcher() i=6 2024-09-14T11:24:40.345 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.346+0000 7fd3ffb23800 20 remove_watcher() i=7 2024-09-14T11:24:40.359 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:40.359 INFO:tasks.workunit.client.0.smithi029.stderr:BUCKET_STATS: 2024-09-14T11:24:40.359 INFO:tasks.workunit.client.0.smithi029.stderr:bucket: myver id: 11989569-703c-4397-b0f1-7ddb0279a491.4517.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:24:40.359 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:40.360 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:24:40.396 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:40.396 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:40.438 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.439+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.440 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 realm 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.441+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.441 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.442+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:40.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.442+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.443+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:40.442 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.443+0000 7f7c2253c800 20 searching for the correct realm 2024-09-14T11:24:40.445 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.446+0000 7f7c1ea82640 0 -- 172.21.15.29:0/1822007184 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f7c1808b020 msgr2=0x7f7c180b9d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:40.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.652+0000 7f7c1da80640 0 -- 172.21.15.29:0/1822007184 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f7c180e76a0 msgr2=0x7f7c180e90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:40.858 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.859 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.859+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 zone default found 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 4 Realm: () 2024-09-14T11:24:40.860 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 zonegroup default 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.860+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.861 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:40.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 started sync module instance, tier type = 2024-09-14T11:24:40.862 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.861+0000 7f7c2253c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:40.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=0 2024-09-14T11:24:40.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=1 2024-09-14T11:24:40.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=2 2024-09-14T11:24:40.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=3 2024-09-14T11:24:40.872 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=4 2024-09-14T11:24:40.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=5 2024-09-14T11:24:40.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.873+0000 7f7c2253c800 20 add_watcher() i=6 2024-09-14T11:24:40.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.874+0000 7f7c2253c800 20 add_watcher() i=7 2024-09-14T11:24:40.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.874+0000 7f7c2253c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:40.875 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.876+0000 7f7ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:40.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7c2253c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:40.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7c2253c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:40.876 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7c2253c800 5 note: GC not initialized 2024-09-14T11:24:40.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7a4f7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:40.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7c2253c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:40.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.877+0000 7f7c2253c800 20 Filter name: none 2024-09-14T11:24:40.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7a4d7fa640 20 reqs_thread_entry: start 2024-09-14T11:24:40.877 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : miss 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.878+0000 7f7c2253c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:40.878 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:40.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 10 adding default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:40.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:40.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:40.879 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.879+0000 7f7c2253c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:40.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7c2253c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:40.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7c2253c800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:40.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7c2253c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:40.884 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7c2253c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:40.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7b01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691496999 cookie 94130214290064 notifier 8577 bl.length()=905 2024-09-14T11:24:40.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7b01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:40.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7b01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:40.885 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.885+0000 7f7b01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:40.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.887+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:40.886 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.887+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:40.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.887+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:40.887 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.887+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:40.892 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:40.893+0000 7f7c2253c800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:24:41.429 INFO:tasks.workunit.client.0.smithi029.stderr:put object successful 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:45.893 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:45.894 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.894+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.895+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:45.895 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.895+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:45.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.897+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:45.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.897+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:45.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.897+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:45.896 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.897+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:45.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.898+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:45.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.898+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:45.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.898+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:45.897 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.898+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:45.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.899+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:45.898 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.899+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:45.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.900+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:45.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.900+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:45.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.900+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:45.899 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.900+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:45.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.901+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:45.900 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.901+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:45.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.902+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:45.901 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.902+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:45.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.905+0000 7f7c2253c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:45.904 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.905+0000 7f7c2253c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7c2253c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7c2253c800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7c2253c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7c2253c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7b01ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497000 cookie 94130214290064 notifier 8577 bl.length()=905 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7b01ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7b01ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:45.906 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.907+0000 7f7b01ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:45.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.909+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:45.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.909+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:45.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.909+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:45.908 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.909+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:45.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.912+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:45.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.912+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.0 2024-09-14T11:24:45.911 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.912+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:45.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.912+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.1 2024-09-14T11:24:45.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.913+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:45.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.913+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.2 2024-09-14T11:24:45.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.913+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:45.912 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.913+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.3 2024-09-14T11:24:45.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.914+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:45.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.914+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.4 2024-09-14T11:24:45.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.914+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:45.913 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.914+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.5 2024-09-14T11:24:45.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:45.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.6 2024-09-14T11:24:45.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:45.914 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.7 2024-09-14T11:24:45.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:45.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.915+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.8 2024-09-14T11:24:45.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.916+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:45.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.916+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.9 2024-09-14T11:24:45.915 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.916+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:45.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.916+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.10 2024-09-14T11:24:45.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.917+0000 7f7c2253c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:45.916 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.917+0000 7f7c2253c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.1.11 2024-09-14T11:24:45.918 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.920+0000 7f7c2253c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:45.919 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.920+0000 7f7c2253c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.921+0000 7f7c2253c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.921+0000 7f7c2253c800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.921+0000 7f7c2253c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:45.920 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.921+0000 7f7c2253c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:45.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.922+0000 7f7b017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497001 cookie 94130214290064 notifier 8577 bl.length()=873 2024-09-14T11:24:45.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.922+0000 7f7b017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:45.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.922+0000 7f7b017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:45.921 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.922+0000 7f7b017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:45.922 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.923+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:45.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.923+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:45.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.923+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:45.923 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.923+0000 7f7c2253c800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:45.925 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.926+0000 7f7c2253c800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:24:45.927 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.928+0000 7f7ad4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:45.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.931+0000 7f7c2253c800 20 remove_watcher() i=0 2024-09-14T11:24:45.930 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.931+0000 7f7c2253c800 2 removed watcher, disabling cache 2024-09-14T11:24:45.931 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.932+0000 7f7c2253c800 20 remove_watcher() i=1 2024-09-14T11:24:45.933 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.934+0000 7f7c2253c800 20 remove_watcher() i=2 2024-09-14T11:24:45.934 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.935+0000 7f7c2253c800 20 remove_watcher() i=3 2024-09-14T11:24:45.935 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.936+0000 7f7c2253c800 20 remove_watcher() i=4 2024-09-14T11:24:45.936 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.937+0000 7f7c2253c800 20 remove_watcher() i=5 2024-09-14T11:24:45.937 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.939+0000 7f7c2253c800 20 remove_watcher() i=6 2024-09-14T11:24:45.939 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:45.940+0000 7f7c2253c800 20 remove_watcher() i=7 2024-09-14T11:24:46.434 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:24:46.434 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:24:46.774 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:24:47.186 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:24:48.687 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:24:48.688 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:24:48.722 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:48.722 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:48.765 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.767+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:48.766 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.768+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.768+0000 7f8fee723800 20 realm 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.768+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.769+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.769+0000 7f8fee723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.769+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.769+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:48.767 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.769+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:48.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.770+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:48.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.770+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:48.768 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.771+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:48.769 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.771+0000 7f8fee723800 20 searching for the correct realm 2024-09-14T11:24:48.771 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.773+0000 7f8feac45640 0 -- 172.21.15.29:0/2205256120 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f8fe4015480 msgr2=0x7f8fe40158c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:48.978 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:48.980+0000 7f8fe9c43640 0 -- 172.21.15.29:0/2205256120 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f8fe403f8e0 msgr2=0x7f8fe40223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:49.185 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.186 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.187+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.188+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.188+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 zone default found 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 4 Realm: () 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:49.187 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 zonegroup default 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.189+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.188 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.190+0000 7f8fee723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.190+0000 7f8fee723800 20 started sync module instance, tier type = 2024-09-14T11:24:49.189 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.190+0000 7f8fee723800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:49.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=0 2024-09-14T11:24:49.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=1 2024-09-14T11:24:49.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=2 2024-09-14T11:24:49.198 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=3 2024-09-14T11:24:49.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=4 2024-09-14T11:24:49.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=5 2024-09-14T11:24:49.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.200+0000 7f8fee723800 20 add_watcher() i=6 2024-09-14T11:24:49.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.201+0000 7f8fee723800 20 add_watcher() i=7 2024-09-14T11:24:49.199 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.201+0000 7f8fee723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:49.201 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.203+0000 7f8ea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:49.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:49.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:49.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 5 note: GC not initialized 2024-09-14T11:24:49.202 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8e1b7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:49.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:49.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 20 Filter name: none 2024-09-14T11:24:49.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8e197fa640 20 reqs_thread_entry: start 2024-09-14T11:24:49.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.204+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.203 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.205+0000 7f8fee723800 20 INFO: main: starting shard=0 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:49.204 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 20 INFO: main: starting shard=1 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.206+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 INFO: main: starting shard=2 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:49.205 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 INFO: main: starting shard=3 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.207+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 INFO: main: starting shard=4 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:49.206 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:49.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 INFO: main: starting shard=5 2024-09-14T11:24:49.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:49.207 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.208+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.209+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.209+0000 7f8fee723800 20 INFO: main: starting shard=6 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.209+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.209+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: starting shard=7 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:49.208 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: starting shard=8 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 INFO: main: starting shard=9 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:49.209 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.210+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.211+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.211+0000 7f8fee723800 20 INFO: main: starting shard=10 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.211+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.211+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 INFO: main: starting shard=11 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:49.210 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 INFO: main: starting shard=12 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.212+0000 7f8fee723800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.213+0000 7f8fee723800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.211 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.213+0000 7f8fee723800 20 INFO: main: done 2024-09-14T11:24:49.212 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.214+0000 7f8ea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:49.214 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.216+0000 7f8fee723800 20 remove_watcher() i=0 2024-09-14T11:24:49.215 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.216+0000 7f8fee723800 2 removed watcher, disabling cache 2024-09-14T11:24:49.216 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.218+0000 7f8fee723800 20 remove_watcher() i=1 2024-09-14T11:24:49.217 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.219+0000 7f8fee723800 20 remove_watcher() i=2 2024-09-14T11:24:49.218 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.220+0000 7f8fee723800 20 remove_watcher() i=3 2024-09-14T11:24:49.219 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.221+0000 7f8fee723800 20 remove_watcher() i=4 2024-09-14T11:24:49.220 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.222+0000 7f8fee723800 20 remove_watcher() i=5 2024-09-14T11:24:49.221 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.223+0000 7f8fee723800 20 remove_watcher() i=6 2024-09-14T11:24:49.222 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.224+0000 7f8fee723800 20 remove_watcher() i=7 2024-09-14T11:24:49.348 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:24:49.350 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:24:49.381 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:49.381 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:49.421 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.423+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 20 realm 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.424+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.425+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.423 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.425+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.425+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.426+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.426+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:49.424 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.426+0000 7fb31cc87800 20 searching for the correct realm 2024-09-14T11:24:49.425 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.427+0000 7fb31a771640 0 -- 172.21.15.29:0/1493700012 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55db77127f10 msgr2=0x55db7712a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:49.428 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.431+0000 7fb31a771640 0 -- 172.21.15.29:0/1493700012 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x55db76ee1b80 msgr2=0x7fb314015450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.640+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.639 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 zone default found 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 4 Realm: () 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 zonegroup default 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.641 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.641+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 started sync module instance, tier type = 2024-09-14T11:24:49.642 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.642+0000 7fb31cc87800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=0 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=1 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=2 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=3 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=4 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=5 2024-09-14T11:24:49.650 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.652+0000 7fb31cc87800 20 add_watcher() i=6 2024-09-14T11:24:49.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.653+0000 7fb31cc87800 20 add_watcher() i=7 2024-09-14T11:24:49.651 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.653+0000 7fb31cc87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:49.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb1d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:49.653 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb31cc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb31cc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb31cc87800 5 note: GC not initialized 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb14b7fe640 20 reqs_thread_entry: start 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb31cc87800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb31cc87800 20 Filter name: none 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.655+0000 7fb1497fa640 20 reqs_thread_entry: start 2024-09-14T11:24:49.654 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 rados->read ofs=0 len=0 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:24:49.655 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 INFO: main: starting shard=0 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.656+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.657+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.657+0000 7fb31cc87800 20 INFO: main: starting shard=1 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.657+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:49.656 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.657+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 INFO: main: starting shard=2 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 INFO: main: starting shard=3 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:49.657 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.658+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.659+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.659+0000 7fb31cc87800 20 INFO: main: starting shard=4 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.659+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.659+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.660+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.660+0000 7fb31cc87800 20 INFO: main: starting shard=5 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.660+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:49.658 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.660+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:49.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 INFO: main: starting shard=6 2024-09-14T11:24:49.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:49.659 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 INFO: main: starting shard=7 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.661+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.660 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 INFO: main: starting shard=8 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 INFO: main: starting shard=9 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:49.661 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.662+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.663+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.663+0000 7fb31cc87800 20 INFO: main: starting shard=10 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.663+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.663+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 INFO: main: starting shard=11 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:49.662 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 INFO: main: starting shard=12 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.664+0000 7fb31cc87800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.665+0000 7fb31cc87800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:49.663 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.665+0000 7fb31cc87800 20 INFO: main: done 2024-09-14T11:24:49.664 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.666+0000 7fb1d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:49.666 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.668+0000 7fb31cc87800 20 remove_watcher() i=0 2024-09-14T11:24:49.667 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.668+0000 7fb31cc87800 2 removed watcher, disabling cache 2024-09-14T11:24:49.668 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.670+0000 7fb31cc87800 20 remove_watcher() i=1 2024-09-14T11:24:49.669 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.671+0000 7fb31cc87800 20 remove_watcher() i=2 2024-09-14T11:24:49.670 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.672+0000 7fb31cc87800 20 remove_watcher() i=3 2024-09-14T11:24:49.671 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.673+0000 7fb31cc87800 20 remove_watcher() i=4 2024-09-14T11:24:49.672 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.674+0000 7fb31cc87800 20 remove_watcher() i=5 2024-09-14T11:24:49.674 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.676+0000 7fb31cc87800 20 remove_watcher() i=6 2024-09-14T11:24:49.675 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.677+0000 7fb31cc87800 20 remove_watcher() i=7 2024-09-14T11:24:49.800 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:24:49.802 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:24:49.833 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:49.833 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:49.873 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:49.875+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 20 realm 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.078+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.079+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.077 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.079+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.080+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:50.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.080+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.078 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.081+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:50.079 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.081+0000 7f3b62126800 20 searching for the correct realm 2024-09-14T11:24:50.080 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.083+0000 7f3b5e5da640 0 -- 172.21.15.29:0/2708496525 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f3b5807b040 msgr2=0x7f3b58094930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:50.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.290+0000 7f3b57fff640 0 -- 172.21.15.29:0/2708496525 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f3b58055410 msgr2=0x7f3b58055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:50.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:50.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:50.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:50.496 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.497+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:50.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 zone default found 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 4 Realm: () 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 zonegroup default 2024-09-14T11:24:50.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.498+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 started sync module instance, tier type = 2024-09-14T11:24:50.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.499+0000 7f3b62126800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:50.508 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=0 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=1 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=2 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=3 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=4 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=5 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.510+0000 7f3b62126800 20 add_watcher() i=6 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.511+0000 7f3b62126800 20 add_watcher() i=7 2024-09-14T11:24:50.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.511+0000 7f3b62126800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:50.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.513+0000 7f3a0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:50.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:50.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 5 note: GC not initialized 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3a0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 20 Filter name: none 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f397ffff640 20 reqs_thread_entry: start 2024-09-14T11:24:50.513 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.514+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 rados->read ofs=0 len=0 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 INFO: main: starting shard=0 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:50.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.515+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.516+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.516+0000 7f3b62126800 20 INFO: main: starting shard=1 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.516+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.516+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 INFO: main: starting shard=2 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:50.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 INFO: main: starting shard=3 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.517+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.518+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.518+0000 7f3b62126800 20 INFO: main: starting shard=4 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.518+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:50.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.518+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:50.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 INFO: main: starting shard=5 2024-09-14T11:24:50.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:50.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 INFO: main: starting shard=6 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.519+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 INFO: main: starting shard=7 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:50.518 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 INFO: main: starting shard=8 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.520+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.521+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.521+0000 7f3b62126800 20 INFO: main: starting shard=9 2024-09-14T11:24:50.519 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.521+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.521+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 INFO: main: starting shard=10 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:50.520 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 INFO: main: starting shard=11 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.522+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 20 INFO: main: starting shard=12 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:50.521 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:50.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:24:50.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.523+0000 7f3b62126800 20 INFO: main: done 2024-09-14T11:24:50.522 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.525+0000 7f3a0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:50.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.527+0000 7f3b62126800 20 remove_watcher() i=0 2024-09-14T11:24:50.525 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.527+0000 7f3b62126800 2 removed watcher, disabling cache 2024-09-14T11:24:50.526 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.528+0000 7f3b62126800 20 remove_watcher() i=1 2024-09-14T11:24:50.528 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.529+0000 7f3b62126800 20 remove_watcher() i=2 2024-09-14T11:24:50.529 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.531+0000 7f3b62126800 20 remove_watcher() i=3 2024-09-14T11:24:50.530 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.532+0000 7f3b62126800 20 remove_watcher() i=4 2024-09-14T11:24:50.531 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.533+0000 7f3b62126800 20 remove_watcher() i=5 2024-09-14T11:24:50.532 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.534+0000 7f3b62126800 20 remove_watcher() i=6 2024-09-14T11:24:50.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:50.535+0000 7f3b62126800 20 remove_watcher() i=7 2024-09-14T11:24:50.573 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:24:50.986 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:24:51.391 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:24:51.424 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:51.424 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:51.464 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.466+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 realm 2024-09-14T11:24:51.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.466 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.468+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.469+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:51.467 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.469+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.470+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:51.468 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.470+0000 7f273bd3d800 20 searching for the correct realm 2024-09-14T11:24:51.471 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.473+0000 7f2737229640 0 -- 172.21.15.29:0/475301157 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f272806c070 msgr2=0x7f27280b8a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:51.474 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.476+0000 7f2737229640 0 -- 172.21.15.29:0/475301157 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f273004c460 msgr2=0x7f273004c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:51.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:51.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:51.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:51.682 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.683+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 zone default found 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 4 Realm: () 2024-09-14T11:24:51.683 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 zonegroup default 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.684 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.684+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.685+0000 7f273bd3d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.685+0000 7f273bd3d800 20 started sync module instance, tier type = 2024-09-14T11:24:51.685 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.685+0000 7f273bd3d800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:51.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=0 2024-09-14T11:24:51.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=1 2024-09-14T11:24:51.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=2 2024-09-14T11:24:51.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=3 2024-09-14T11:24:51.693 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=4 2024-09-14T11:24:51.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=5 2024-09-14T11:24:51.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.695+0000 7f273bd3d800 20 add_watcher() i=6 2024-09-14T11:24:51.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.696+0000 7f273bd3d800 20 add_watcher() i=7 2024-09-14T11:24:51.694 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.696+0000 7f273bd3d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:51.695 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.697+0000 7f25edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:51.696 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 5 note: GC not initialized 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f25ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 20 Filter name: none 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f25667fc640 20 reqs_thread_entry: start 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:24:51.697 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.698+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : miss 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.698 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 adding default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:51.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.699 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.699+0000 7f273bd3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:51.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f273bd3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f273bd3d800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f273bd3d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.703 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f273bd3d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:51.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f26167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497002 cookie 93851031652720 notifier 8673 bl.length()=905 2024-09-14T11:24:51.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f26167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f26167fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.705+0000 7f26167fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.707+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:51.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.707+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:51.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.707+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:51.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.707+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.0 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.0 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.1 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.1 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.2 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.2 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.3 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.3 2024-09-14T11:24:51.711 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.4 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.4 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.5 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.5 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.6 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.6 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.7 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.7 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.8 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.8 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:51.712 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.10 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.10 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.11 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.11 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.12 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.12 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.13 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.13 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.14 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.14 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.15 2024-09-14T11:24:51.713 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.15 2024-09-14T11:24:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.16 2024-09-14T11:24:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.16 2024-09-14T11:24:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:51.714 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.712+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:51.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.713+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:51.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.713+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:51.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.713+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:51.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.713+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:51.715 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.714+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.714+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.715+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.715+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.715+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.715+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.716+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.716+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.716+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.716+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.717+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:51.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.717+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.717+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.717+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.718+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.718+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:51.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.718+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:51.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.718+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:51.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.719+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:51.718 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.719+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:51.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.721+0000 7f273bd3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:51.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.721+0000 7f273bd3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.722+0000 7f273bd3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.722+0000 7f273bd3d800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.722+0000 7f273bd3d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.722+0000 7f273bd3d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.723+0000 7f2616ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497003 cookie 93851031652720 notifier 8673 bl.length()=905 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.723+0000 7f2616ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.723+0000 7f2616ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.723+0000 7f2616ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.724+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:51.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.724+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:51.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.724+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:51.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.724+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.0 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.1 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:51.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.728+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.2 2024-09-14T11:24:51.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:51.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.3 2024-09-14T11:24:51.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:51.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.4 2024-09-14T11:24:51.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:51.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.729+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.5 2024-09-14T11:24:51.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:51.728 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.6 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.7 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.730+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.8 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.9 2024-09-14T11:24:51.729 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.10 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.731+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.11 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.732+0000 7f273bd3d800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.732+0000 7f273bd3d800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.2.12 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.732+0000 7f273bd3d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:24:51.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.732+0000 7f273bd3d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.733+0000 7f273bd3d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.733+0000 7f273bd3d800 10 moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.733+0000 7f273bd3d800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.733+0000 7f273bd3d800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19, ofs0, ns] 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.734+0000 7f2616ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497004 cookie 93851031652720 notifier 8673 bl.length()=873 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.734+0000 7f2616ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.734+0000 7f2616ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:51.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.734+0000 7f2616ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:51.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.735+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_sources= new_sources= 2024-09-14T11:24:51.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.735+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential sources added=[] removed=[] 2024-09-14T11:24:51.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.735+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): orig_dests= new_dests= 2024-09-14T11:24:51.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.735+0000 7f273bd3d800 20 handle_bi_update(): bucket=:myver[11989569-703c-4397-b0f1-7ddb0279a491.4517.19]): potential dests added=[] removed=[] 2024-09-14T11:24:51.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.738+0000 7f273bd3d800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:24:51.738 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.740+0000 7f25edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:51.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.742+0000 7f273bd3d800 20 remove_watcher() i=0 2024-09-14T11:24:51.740 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.742+0000 7f273bd3d800 2 removed watcher, disabling cache 2024-09-14T11:24:51.742 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.744+0000 7f273bd3d800 20 remove_watcher() i=1 2024-09-14T11:24:51.743 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.745+0000 7f273bd3d800 20 remove_watcher() i=2 2024-09-14T11:24:51.744 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.746+0000 7f273bd3d800 20 remove_watcher() i=3 2024-09-14T11:24:51.745 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.747+0000 7f273bd3d800 20 remove_watcher() i=4 2024-09-14T11:24:51.746 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.748+0000 7f273bd3d800 20 remove_watcher() i=5 2024-09-14T11:24:51.747 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.749+0000 7f273bd3d800 20 remove_watcher() i=6 2024-09-14T11:24:51.748 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.750+0000 7f273bd3d800 20 remove_watcher() i=7 2024-09-14T11:24:51.761 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:24:51.796 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:51.796 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:51.836 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.838+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.839+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.839+0000 7fd70950c800 20 realm 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.839+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.840+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.840+0000 7fd70950c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.840+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.838 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.840+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:51.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.840+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.841+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:51.839 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.841+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:51.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.841+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:51.840 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.841+0000 7fd70950c800 20 searching for the correct realm 2024-09-14T11:24:51.842 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:51.844+0000 7fd7077fe640 0 -- 172.21.15.29:0/2375738466 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd700017020 msgr2=0x7fd7000695c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:52.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.050+0000 7fd7067fc640 0 -- 172.21.15.29:0/2375738466 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd70006cb80 msgr2=0x7fd7000807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:52.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:52.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:52.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:52.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:52.256 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.257+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:52.257 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 zone default found 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 4 Realm: () 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 zonegroup default 2024-09-14T11:24:52.258 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.258+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 started sync module instance, tier type = 2024-09-14T11:24:52.259 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.259+0000 7fd70950c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:52.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=0 2024-09-14T11:24:52.268 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=1 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=2 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=3 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=4 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=5 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.270+0000 7fd70950c800 20 add_watcher() i=6 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.271+0000 7fd70950c800 20 add_watcher() i=7 2024-09-14T11:24:52.269 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.271+0000 7fd70950c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:52.271 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.273+0000 7fd5bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.273+0000 7fd70950c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.273+0000 7fd70950c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.273+0000 7fd70950c800 5 note: GC not initialized 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.273+0000 7fd537fff640 20 reqs_thread_entry: start 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 20 Filter name: none 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd535ffb640 20 reqs_thread_entry: start 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:24:52.272 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:52.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:24:52.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:24:52.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 : miss 2024-09-14T11:24:52.273 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.274+0000 7fd70950c800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 info.flags=0x17 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 adding default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 to cache LRU end 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:11989569-703c-4397-b0f1-7ddb0279a491.4517.19 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.0 2024-09-14T11:24:52.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.275+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.0 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.1 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.1 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.2 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.276+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.2 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.3 2024-09-14T11:24:52.275 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.3 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.4 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.277+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.4 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.278+0000 7fd70950c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.278+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.5 2024-09-14T11:24:52.276 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.278+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.5 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.6 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.6 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.7 2024-09-14T11:24:52.277 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.7 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.8 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.279+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.8 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.280+0000 7fd70950c800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.280+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.278 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.280+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.281+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.10 2024-09-14T11:24:52.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.281+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.10 2024-09-14T11:24:52.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.281+0000 7fd70950c800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:24:52.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.281+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.11 2024-09-14T11:24:52.279 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.281+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.11 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.12 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.12 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.13 2024-09-14T11:24:52.280 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.282+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.13 2024-09-14T11:24:52.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:24:52.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.14 2024-09-14T11:24:52.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.14 2024-09-14T11:24:52.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:24:52.281 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.15 2024-09-14T11:24:52.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.283+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.15 2024-09-14T11:24:52.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.284+0000 7fd70950c800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:24:52.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.284+0000 7fd70950c800 10 bucket_obj is .dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.16 2024-09-14T11:24:52.282 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.284+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.16 2024-09-14T11:24:52.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.284+0000 7fd70950c800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:24:52.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.285+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.283 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.285+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:x state=0x55ccdfc4d9e8 s->prefetch_data=0 2024-09-14T11:24:52.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.286+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to st9u0qjz5yh13lafa9jf4xuk0tbfzy7u 2024-09-14T11:24:52.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.286+0000 7fd70950c800 20 get_obj_state_impl: setting s->olh_tag to 4qgey37sushxwgsx3chc56ef2jbefuer 2024-09-14T11:24:52.284 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.286+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4qgey37sushxwgsx3chc56ef2jbefuer 2024-09-14T11:24:52.285 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.287+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:24:52.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=3 key=x[rQisNF14dqH995VXP9PB8EYhAKEvUmG] 2024-09-14T11:24:52.287 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:rQisNF14dqH995VXP9PB8EYhAKEvUmG_x state=0x55ccdfc89ff8 s->prefetch_data=0 2024-09-14T11:24:52.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 10 manifest: total_size = 9 2024-09-14T11:24:52.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.7587584541571934533 2024-09-14T11:24:52.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:rQisNF14dqH995VXP9PB8EYhAKEvUmG_x state=0x55ccdfc89ff8 s->prefetch_data=0 2024-09-14T11:24:52.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.289+0000 7fd70950c800 20 prepare_atomic_modification: state is not atomic. state=0x55ccdfc89ff8 2024-09-14T11:24:52.288 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.290+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.292+0000 7fd70950c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:24:52.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.292+0000 7fd70950c800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:24:52.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.292+0000 7fd70950c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:24:52.290 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.292+0000 7fd70950c800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:rQisNF14dqH995VXP9PB8EYhAKEvUmG_.y99itglWWarJ8QRpGn6aIYBikOFtV-o_0 2024-09-14T11:24:52.291 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.293+0000 7fd5ea7fc640 20 handle_completion(): completion ok for obj=x[rQisNF14dqH995VXP9PB8EYhAKEvUmG] 2024-09-14T11:24:52.292 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.294+0000 7fd70950c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:24:52.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.295+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:x state=0x55ccdfc4d9e8 s->prefetch_data=0 2024-09-14T11:24:52.293 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.295+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4qgey37sushxwgsx3chc56ef2jbefuer 2024-09-14T11:24:52.296 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.298+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.297 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.300+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.300+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.298 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.300+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:y state=0x55ccdfc4e898 s->prefetch_data=0 2024-09-14T11:24:52.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.301+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to n20129xgzeakqml90ns6qs4ys463i3ol 2024-09-14T11:24:52.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.301+0000 7fd70950c800 20 get_obj_state_impl: setting s->olh_tag to hkbrg4ost56rfkki68pjnfofkfnsxv78 2024-09-14T11:24:52.299 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.301+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hkbrg4ost56rfkki68pjnfofkfnsxv78 2024-09-14T11:24:52.300 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.302+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.304+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.304+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:24:52.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.304+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=3 key=y[1iIFiCyaQNX3fVhCOFR6S5NqBgZzKTZ] 2024-09-14T11:24:52.302 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.304+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:1iIFiCyaQNX3fVhCOFR6S5NqBgZzKTZ_y state=0x55ccdfc90478 s->prefetch_data=0 2024-09-14T11:24:52.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.305+0000 7fd70950c800 10 manifest: total_size = 12 2024-09-14T11:24:52.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.305+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.17102798331599175752 2024-09-14T11:24:52.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.305+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:1iIFiCyaQNX3fVhCOFR6S5NqBgZzKTZ_y state=0x55ccdfc90478 s->prefetch_data=0 2024-09-14T11:24:52.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.305+0000 7fd70950c800 20 prepare_atomic_modification: state is not atomic. state=0x55ccdfc90478 2024-09-14T11:24:52.303 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.305+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.305 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.308+0000 7fd70950c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:24:52.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.308+0000 7fd70950c800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T11:24:52.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.308+0000 7fd70950c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:24:52.306 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.308+0000 7fd70950c800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:1iIFiCyaQNX3fVhCOFR6S5NqBgZzKTZ_.vvZ1N4qjtx48XQBG0zUWOP2_3wnDQ8y_0 2024-09-14T11:24:52.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.309+0000 7fd70950c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:24:52.307 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.309+0000 7fd5e9ffb640 20 handle_completion(): completion ok for obj=y[1iIFiCyaQNX3fVhCOFR6S5NqBgZzKTZ] 2024-09-14T11:24:52.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.310+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:y state=0x55ccdfc4e898 s->prefetch_data=0 2024-09-14T11:24:52.308 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.310+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=hkbrg4ost56rfkki68pjnfofkfnsxv78 2024-09-14T11:24:52.311 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.313+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.315+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.315+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.313 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.315+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:z state=0x55ccdfc4e898 s->prefetch_data=0 2024-09-14T11:24:52.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.316+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to wsv5osz3ta0wdmb2sysd1xasg9s0dlda 2024-09-14T11:24:52.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.316+0000 7fd70950c800 20 get_obj_state_impl: setting s->olh_tag to l5dldyq6d6hqpaxcq8w2wbkc07in5uyt 2024-09-14T11:24:52.314 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.316+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l5dldyq6d6hqpaxcq8w2wbkc07in5uyt 2024-09-14T11:24:52.315 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.317+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.319+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.319+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:24:52.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.319+0000 7fd70950c800 20 olh_log_entry: epoch=2 op=3 key=z[13fU1nm-utriFyEZ8n0lW9wL-uuwC4r] 2024-09-14T11:24:52.317 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.319+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:13fU1nm-utriFyEZ8n0lW9wL-uuwC4r_z state=0x55ccdfc88308 s->prefetch_data=0 2024-09-14T11:24:52.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.320+0000 7fd70950c800 10 manifest: total_size = 22 2024-09-14T11:24:52.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.320+0000 7fd70950c800 20 get_obj_state: setting s->obj_tag to 11989569-703c-4397-b0f1-7ddb0279a491.4517.7149688804366610016 2024-09-14T11:24:52.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.320+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:_:13fU1nm-utriFyEZ8n0lW9wL-uuwC4r_z state=0x55ccdfc88308 s->prefetch_data=0 2024-09-14T11:24:52.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.320+0000 7fd70950c800 20 prepare_atomic_modification: state is not atomic. state=0x55ccdfc88308 2024-09-14T11:24:52.318 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.320+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.322+0000 7fd70950c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:24:52.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.322+0000 7fd70950c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:24:52.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.322+0000 7fd70950c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:24:52.321 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.322+0000 7fd70950c800 5 delete_objs_inline: removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:13fU1nm-utriFyEZ8n0lW9wL-uuwC4r_.Ch1u8HUsyIk2QCxKg_iTVdb2YhIVz62_0 2024-09-14T11:24:52.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.324+0000 7fd70950c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:24:52.322 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.324+0000 7fd5e9ffb640 20 handle_completion(): completion ok for obj=z[13fU1nm-utriFyEZ8n0lW9wL-uuwC4r] 2024-09-14T11:24:52.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.325+0000 7fd70950c800 20 get_obj_state: octx=0x55ccdf97d380 obj=myver:z state=0x55ccdfc4e898 s->prefetch_data=0 2024-09-14T11:24:52.324 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.326+0000 7fd70950c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l5dldyq6d6hqpaxcq8w2wbkc07in5uyt 2024-09-14T11:24:52.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.329+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.330+0000 7fd70950c800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.19.3.9 2024-09-14T11:24:52.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.330+0000 7fd70950c800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:24:52.328 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.330+0000 7fd70950c800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:24:52.329 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.331+0000 7fd5bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:52.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.334+0000 7fd70950c800 20 remove_watcher() i=0 2024-09-14T11:24:52.332 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.334+0000 7fd70950c800 2 removed watcher, disabling cache 2024-09-14T11:24:52.333 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.335+0000 7fd70950c800 20 remove_watcher() i=1 2024-09-14T11:24:52.334 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.336+0000 7fd70950c800 20 remove_watcher() i=2 2024-09-14T11:24:52.335 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.337+0000 7fd70950c800 20 remove_watcher() i=3 2024-09-14T11:24:52.336 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.338+0000 7fd70950c800 20 remove_watcher() i=4 2024-09-14T11:24:52.337 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.339+0000 7fd70950c800 20 remove_watcher() i=5 2024-09-14T11:24:52.338 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.340+0000 7fd70950c800 20 remove_watcher() i=6 2024-09-14T11:24:52.339 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.341+0000 7fd70950c800 20 remove_watcher() i=7 2024-09-14T11:24:52.492 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:24:52.521 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:24:52.521 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:24:52.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.562+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 realm 2024-09-14T11:24:52.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:24:52.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.564+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.565+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:52.563 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.565+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.566+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:24:52.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.566+0000 7f3a89f39800 20 searching for the correct realm 2024-09-14T11:24:52.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.568+0000 7f3a863c8640 0 -- 172.21.15.29:0/1053286708 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f3a80018c10 msgr2=0x7f3a80037980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:24:52.772 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.774+0000 7f3a7ffff640 0 -- 172.21.15.29:0/1053286708 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f3a80026880 msgr2=0x7f3a800363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.981+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.980 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:24:52.981 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 zone default found 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 4 Realm: () 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 zonegroup default 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.982+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.983+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.983+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.983+0000 7f3a89f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:24:52.982 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.983+0000 7f3a89f39800 20 started sync module instance, tier type = 2024-09-14T11:24:52.983 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.983+0000 7f3a89f39800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:24:52.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=0 2024-09-14T11:24:52.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=1 2024-09-14T11:24:52.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=2 2024-09-14T11:24:52.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=3 2024-09-14T11:24:52.994 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=4 2024-09-14T11:24:52.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=5 2024-09-14T11:24:52.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.996+0000 7f3a89f39800 20 add_watcher() i=6 2024-09-14T11:24:52.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.997+0000 7f3a89f39800 20 add_watcher() i=7 2024-09-14T11:24:52.995 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.997+0000 7f3a89f39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:24:52.997 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f39377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f3a89f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f3a89f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f3a89f39800 5 note: GC not initialized 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f39367fc640 20 reqs_thread_entry: start 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:52.999+0000 7f3a89f39800 20 init_complete bucket index max shards: 11 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.000+0000 7f3a89f39800 20 Filter name: none 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.000+0000 7f38a7fff640 20 reqs_thread_entry: start 2024-09-14T11:24:52.998 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.000+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.000+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:52.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.000+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:52.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.001+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:52.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.001+0000 7f3a89f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:52.999 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.001+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:53.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.001+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:24:53.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.001+0000 7f3a89f39800 20 rados->read ofs=0 len=0 2024-09-14T11:24:53.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.002+0000 7f3a89f39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:24:53.000 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.002+0000 7f3a89f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:24:53.002 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.004+0000 7f39377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:24:53.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.006+0000 7f3a89f39800 20 remove_watcher() i=0 2024-09-14T11:24:53.004 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.006+0000 7f3a89f39800 2 removed watcher, disabling cache 2024-09-14T11:24:53.005 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.007+0000 7f3a89f39800 20 remove_watcher() i=1 2024-09-14T11:24:53.006 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.008+0000 7f3a89f39800 20 remove_watcher() i=2 2024-09-14T11:24:53.007 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.009+0000 7f3a89f39800 20 remove_watcher() i=3 2024-09-14T11:24:53.008 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.010+0000 7f3a89f39800 20 remove_watcher() i=4 2024-09-14T11:24:53.009 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.011+0000 7f3a89f39800 20 remove_watcher() i=5 2024-09-14T11:24:53.010 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.012+0000 7f3a89f39800 20 remove_watcher() i=6 2024-09-14T11:24:53.011 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:24:53.013+0000 7f3a89f39800 20 remove_watcher() i=7 2024-09-14T11:24:53.024 INFO:tasks.workunit.client.0.smithi029.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:24:53.024 INFO:tasks.workunit.client.0.smithi029.stderr:Deleting bucket a-bucket 2024-09-14T11:24:53.107 INFO:tasks.workunit.client.0.smithi029.stderr:Deleting bucket myver 2024-09-14T11:24:53.352 INFO:tasks.workunit.client.0.smithi029.stderr:Completed resharding tests 2024-09-14T11:24:53.353 INFO:tasks.workunit.client.0.smithi029.stdout:connected to http://localhost:80 2024-09-14T11:24:53.432 INFO:tasks.workunit.client.0.smithi029.stderr:+ deactivate 2024-09-14T11:24:53.432 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ hash -r 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset -f deactivate 2024-09-14T11:24:53.433 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK. 2024-09-14T11:24:53.434 INFO:tasks.workunit.client.0.smithi029.stdout:OK. 2024-09-14T11:24:53.435 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:24:53.435 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:24:53.516 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:24:53.517 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:24:53.972 DEBUG:teuthology.parallel:result is None 2024-09-14T11:24:53.972 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:24:54.012 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:24:54.012 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:24:54.083 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:24:54.083 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:24:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:24:54.097 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:24:54.097 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:24:54.098 DEBUG:teuthology.orchestra.run.smithi029:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:24:54.152 INFO:teuthology.orchestra.run.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:25:00.006 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:25:00.006 DEBUG:teuthology.orchestra.run.smithi029:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:25:02.138 INFO:teuthology.orchestra.run.smithi029.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:25:02.727 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:32:04 ago on Sat 14 Sep 2024 10:52:58 AM UTC. 2024-09-14T11:25:02.873 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:25:02.874 INFO:teuthology.orchestra.run.smithi029.stdout:Installing weak dependencies: 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout:================================================================================ 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout:Install 5 Packages 2024-09-14T11:25:02.875 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:02.876 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 46 M 2024-09-14T11:25:02.876 INFO:teuthology.orchestra.run.smithi029.stdout:Installed size: 166 M 2024-09-14T11:25:02.876 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2024-09-14T11:25:03.386 INFO:teuthology.orchestra.run.smithi029.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.9 MB/s | 426 kB 00:00 2024-09-14T11:25:03.525 INFO:teuthology.orchestra.run.smithi029.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 9.8 MB/s | 3.5 MB 00:00 2024-09-14T11:25:03.576 INFO:teuthology.orchestra.run.smithi029.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 517 kB/s | 26 kB 00:00 2024-09-14T11:25:03.759 INFO:teuthology.orchestra.run.smithi029.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 16 MB/s | 9.3 MB 00:00 2024-09-14T11:25:04.468 INFO:teuthology.orchestra.run.smithi029.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 30 MB/s | 32 MB 00:01 2024-09-14T11:25:04.468 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:25:04.469 INFO:teuthology.orchestra.run.smithi029.stdout:Total 29 MB/s | 46 MB 00:01 2024-09-14T11:25:04.909 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2024-09-14T11:25:04.932 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2024-09-14T11:25:04.932 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2024-09-14T11:25:05.436 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2024-09-14T11:25:05.436 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2024-09-14T11:25:05.976 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:25:06.132 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2024-09-14T11:25:06.318 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:25:06.971 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:25:07.035 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:25:07.289 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:25:07.329 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:25:07.569 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:25:07.613 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:25:07.621 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:25:07.630 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:25:07.675 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:25:12.408 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:25:12.409 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:25:12.409 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:25:12.409 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:25:12.409 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:25:12.842 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:25:12.842 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:12.843 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2024-09-14T11:25:13.379 INFO:teuthology.orchestra.run.smithi029.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:25:13.466 INFO:teuthology.orchestra.run.smithi029.stderr:--2024-09-14 11:25:13-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:25:13.874 INFO:teuthology.orchestra.run.smithi029.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-14T11:25:13.887 INFO:teuthology.orchestra.run.smithi029.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:25:13.988 INFO:teuthology.orchestra.run.smithi029.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:25:13.988 INFO:teuthology.orchestra.run.smithi029.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:25:13.989 INFO:teuthology.orchestra.run.smithi029.stderr:--2024-09-14 11:25:13-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:25:13.989 INFO:teuthology.orchestra.run.smithi029.stderr:Resolving github.com (github.com)... 140.82.113.3 2024-09-14T11:25:13.997 INFO:teuthology.orchestra.run.smithi029.stderr:Connecting to github.com (github.com)|140.82.113.3|:443... connected. 2024-09-14T11:25:14.135 INFO:teuthology.orchestra.run.smithi029.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:25:14.135 INFO:teuthology.orchestra.run.smithi029.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112514Z&X-Amz-Expires=300&X-Amz-Signature=b133c36eac9e4728269cf2dac24f480d0604b6df936c2b5a7319a0a0487b0bf5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:25:14.135 INFO:teuthology.orchestra.run.smithi029.stderr:--2024-09-14 11:25:14-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112514Z&X-Amz-Expires=300&X-Amz-Signature=b133c36eac9e4728269cf2dac24f480d0604b6df936c2b5a7319a0a0487b0bf5&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:25:14.135 INFO:teuthology.orchestra.run.smithi029.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.110.133, ... 2024-09-14T11:25:14.147 INFO:teuthology.orchestra.run.smithi029.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-14T11:25:14.219 INFO:teuthology.orchestra.run.smithi029.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:25:14.219 INFO:teuthology.orchestra.run.smithi029.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:25:14.219 INFO:teuthology.orchestra.run.smithi029.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:25:14.219 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T11:25:14.232 INFO:teuthology.orchestra.run.smithi029.stderr: 0K .......... .......... .......... .......... .......... 0% 3.46M 26s 2024-09-14T11:25:14.245 INFO:teuthology.orchestra.run.smithi029.stderr: 50K .......... .......... .......... .......... .......... 0% 3.88M 25s 2024-09-14T11:25:14.254 INFO:teuthology.orchestra.run.smithi029.stderr: 100K .......... .......... .......... .......... .......... 0% 5.38M 22s 2024-09-14T11:25:14.256 INFO:teuthology.orchestra.run.smithi029.stderr: 150K .......... .......... .......... .......... .......... 0% 19.0M 18s 2024-09-14T11:25:14.258 INFO:teuthology.orchestra.run.smithi029.stderr: 200K .......... .......... .......... .......... .......... 0% 23.2M 15s 2024-09-14T11:25:14.264 INFO:teuthology.orchestra.run.smithi029.stderr: 250K .......... .......... .......... .......... .......... 0% 7.92M 14s 2024-09-14T11:25:14.266 INFO:teuthology.orchestra.run.smithi029.stderr: 300K .......... .......... .......... .......... .......... 0% 30.5M 13s 2024-09-14T11:25:14.268 INFO:teuthology.orchestra.run.smithi029.stderr: 350K .......... .......... .......... .......... .......... 0% 28.8M 12s 2024-09-14T11:25:14.268 INFO:teuthology.orchestra.run.smithi029.stderr: 400K .......... .......... .......... .......... .......... 0% 77.3M 10s 2024-09-14T11:25:14.270 INFO:teuthology.orchestra.run.smithi029.stderr: 450K .......... .......... .......... .......... .......... 0% 29.9M 10s 2024-09-14T11:25:14.271 INFO:teuthology.orchestra.run.smithi029.stderr: 500K .......... .......... .......... .......... .......... 0% 56.6M 9s 2024-09-14T11:25:14.276 INFO:teuthology.orchestra.run.smithi029.stderr: 550K .......... .......... .......... .......... .......... 0% 9.48M 9s 2024-09-14T11:25:14.277 INFO:teuthology.orchestra.run.smithi029.stderr: 600K .......... .......... .......... .......... .......... 0% 337M 8s 2024-09-14T11:25:14.278 INFO:teuthology.orchestra.run.smithi029.stderr: 650K .......... .......... .......... .......... .......... 0% 30.0M 8s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 700K .......... .......... .......... .......... .......... 0% 55.4M 7s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 750K .......... .......... .......... .......... .......... 0% 59.6M 7s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 800K .......... .......... .......... .......... .......... 0% 145M 7s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 850K .......... .......... .......... .......... .......... 0% 276M 6s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 900K .......... .......... .......... .......... .......... 1% 33.3M 6s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 950K .......... .......... .......... .......... .......... 1% 150M 6s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 1000K .......... .......... .......... .......... .......... 1% 76.0M 6s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 1050K .......... .......... .......... .......... .......... 1% 288M 5s 2024-09-14T11:25:14.285 INFO:teuthology.orchestra.run.smithi029.stderr: 1100K .......... .......... .......... .......... .......... 1% 81.7M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1150K .......... .......... .......... .......... .......... 1% 10.4M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1200K .......... .......... .......... .......... .......... 1% 322M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1250K .......... .......... .......... .......... .......... 1% 42.0M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1300K .......... .......... .......... .......... .......... 1% 286M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1350K .......... .......... .......... .......... .......... 1% 293M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1400K .......... .......... .......... .......... .......... 1% 100M 5s 2024-09-14T11:25:15.719 INFO:teuthology.orchestra.run.smithi029.stderr: 1450K .......... .......... .......... .......... .......... 1% 130M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1500K .......... .......... .......... .......... .......... 1% 322M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1550K .......... .......... .......... .......... .......... 1% 74.1M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1600K .......... .......... .......... .......... .......... 1% 263M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1650K .......... .......... .......... .......... .......... 1% 135M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1700K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1750K .......... .......... .......... .......... .......... 1% 270M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1800K .......... .......... .......... .......... .......... 1% 65.2M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1850K .......... .......... .......... .......... .......... 2% 267M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1900K .......... .......... .......... .......... .......... 2% 88.7M 4s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 1950K .......... .......... .......... .......... .......... 2% 208M 3s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 2000K .......... .......... .......... .......... .......... 2% 291M 3s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 2050K .......... .......... .......... .......... .......... 2% 329M 3s 2024-09-14T11:25:15.720 INFO:teuthology.orchestra.run.smithi029.stderr: 2100K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2150K .......... .......... .......... .......... .......... 2% 133M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2200K .......... .......... .......... .......... .......... 2% 342M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2250K .......... .......... .......... .......... .......... 2% 334M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2300K .......... .......... .......... .......... .......... 2% 11.8M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2350K .......... .......... .......... .......... .......... 2% 253M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2400K .......... .......... .......... .......... .......... 2% 355M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2450K .......... .......... .......... .......... .......... 2% 327M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2500K .......... .......... .......... .......... .......... 2% 349M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2550K .......... .......... .......... .......... .......... 2% 60.6M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2600K .......... .......... .......... .......... .......... 2% 198M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2650K .......... .......... .......... .......... .......... 2% 317M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2700K .......... .......... .......... .......... .......... 2% 338M 3s 2024-09-14T11:25:15.721 INFO:teuthology.orchestra.run.smithi029.stderr: 2750K .......... .......... .......... .......... .......... 3% 269M 3s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 2800K .......... .......... .......... .......... .......... 3% 256M 3s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 2850K .......... .......... .......... .......... .......... 3% 175M 3s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 2900K .......... .......... .......... .......... .......... 3% 343M 3s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 2950K .......... .......... .......... .......... .......... 3% 291M 3s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3000K .......... .......... .......... .......... .......... 3% 187M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3050K .......... .......... .......... .......... .......... 3% 337M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3100K .......... .......... .......... .......... .......... 3% 267M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3150K .......... .......... .......... .......... .......... 3% 232M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3200K .......... .......... .......... .......... .......... 3% 266M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3250K .......... .......... .......... .......... .......... 3% 281M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3300K .......... .......... .......... .......... .......... 3% 261M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3350K .......... .......... .......... .......... .......... 3% 256M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3400K .......... .......... .......... .......... .......... 3% 325M 2s 2024-09-14T11:25:15.722 INFO:teuthology.orchestra.run.smithi029.stderr: 3450K .......... .......... .......... .......... .......... 3% 330M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3500K .......... .......... .......... .......... .......... 3% 336M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3550K .......... .......... .......... .......... .......... 3% 269M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3600K .......... .......... .......... .......... .......... 3% 325M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3650K .......... .......... .......... .......... .......... 3% 342M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3700K .......... .......... .......... .......... .......... 4% 342M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3750K .......... .......... .......... .......... .......... 4% 298M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3800K .......... .......... .......... .......... .......... 4% 347M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3850K .......... .......... .......... .......... .......... 4% 352M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3900K .......... .......... .......... .......... .......... 4% 203M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 3950K .......... .......... .......... .......... .......... 4% 271M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 4000K .......... .......... .......... .......... .......... 4% 343M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 4050K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 4100K .......... .......... .......... .......... .......... 4% 345M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 4150K .......... .......... .......... .......... .......... 4% 246M 2s 2024-09-14T11:25:15.723 INFO:teuthology.orchestra.run.smithi029.stderr: 4200K .......... .......... .......... .......... .......... 4% 261M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4250K .......... .......... .......... .......... .......... 4% 302M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4300K .......... .......... .......... .......... .......... 4% 290M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4350K .......... .......... .......... .......... .......... 4% 237M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4400K .......... .......... .......... .......... .......... 4% 326M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4450K .......... .......... .......... .......... .......... 4% 367M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4500K .......... .......... .......... .......... .......... 4% 343M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4550K .......... .......... .......... .......... .......... 4% 15.4M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4600K .......... .......... .......... .......... .......... 5% 254M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4650K .......... .......... .......... .......... .......... 5% 269M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4700K .......... .......... .......... .......... .......... 5% 303M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4750K .......... .......... .......... .......... .......... 5% 269M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4800K .......... .......... .......... .......... .......... 5% 322M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4850K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-14T11:25:15.724 INFO:teuthology.orchestra.run.smithi029.stderr: 4900K .......... .......... .......... .......... .......... 5% 354M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 4950K .......... .......... .......... .......... .......... 5% 318M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5000K .......... .......... .......... .......... .......... 5% 346M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5050K .......... .......... .......... .......... .......... 5% 349M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5100K .......... .......... .......... .......... .......... 5% 340M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5150K .......... .......... .......... .......... .......... 5% 266M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5200K .......... .......... .......... .......... .......... 5% 347M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5250K .......... .......... .......... .......... .......... 5% 336M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5300K .......... .......... .......... .......... .......... 5% 320M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5350K .......... .......... .......... .......... .......... 5% 292M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5400K .......... .......... .......... .......... .......... 5% 330M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5450K .......... .......... .......... .......... .......... 5% 319M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5500K .......... .......... .......... .......... .......... 5% 335M 2s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5550K .......... .......... .......... .......... .......... 6% 264M 1s 2024-09-14T11:25:15.725 INFO:teuthology.orchestra.run.smithi029.stderr: 5600K .......... .......... .......... .......... .......... 6% 320M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5650K .......... .......... .......... .......... .......... 6% 341M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5700K .......... .......... .......... .......... .......... 6% 231M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5750K .......... .......... .......... .......... .......... 6% 206M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5800K .......... .......... .......... .......... .......... 6% 335M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5850K .......... .......... .......... .......... .......... 6% 345M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5900K .......... .......... .......... .......... .......... 6% 334M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 5950K .......... .......... .......... .......... .......... 6% 286M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6000K .......... .......... .......... .......... .......... 6% 342M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6050K .......... .......... .......... .......... .......... 6% 316M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6100K .......... .......... .......... .......... .......... 6% 348M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6150K .......... .......... .......... .......... .......... 6% 301M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6200K .......... .......... .......... .......... .......... 6% 336M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6250K .......... .......... .......... .......... .......... 6% 356M 1s 2024-09-14T11:25:15.726 INFO:teuthology.orchestra.run.smithi029.stderr: 6300K .......... .......... .......... .......... .......... 6% 338M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6350K .......... .......... .......... .......... .......... 6% 277M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6400K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6450K .......... .......... .......... .......... .......... 6% 320M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6500K .......... .......... .......... .......... .......... 7% 332M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6550K .......... .......... .......... .......... .......... 7% 299M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6600K .......... .......... .......... .......... .......... 7% 344M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6650K .......... .......... .......... .......... .......... 7% 283M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6700K .......... .......... .......... .......... .......... 7% 258M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6750K .......... .......... .......... .......... .......... 7% 303M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6800K .......... .......... .......... .......... .......... 7% 294M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6850K .......... .......... .......... .......... .......... 7% 300M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6900K .......... .......... .......... .......... .......... 7% 323M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 6950K .......... .......... .......... .......... .......... 7% 339M 1s 2024-09-14T11:25:15.727 INFO:teuthology.orchestra.run.smithi029.stderr: 7000K .......... .......... .......... .......... .......... 7% 329M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7050K .......... .......... .......... .......... .......... 7% 270M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7100K .......... .......... .......... .......... .......... 7% 337M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7150K .......... .......... .......... .......... .......... 7% 357M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7200K .......... .......... .......... .......... .......... 7% 355M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7250K .......... .......... .......... .......... .......... 7% 322M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7300K .......... .......... .......... .......... .......... 7% 364M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7350K .......... .......... .......... .......... .......... 7% 354M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7400K .......... .......... .......... .......... .......... 8% 357M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7450K .......... .......... .......... .......... .......... 8% 271M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7500K .......... .......... .......... .......... .......... 8% 19.6M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7550K .......... .......... .......... .......... .......... 8% 311M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7600K .......... .......... .......... .......... .......... 8% 315M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7650K .......... .......... .......... .......... .......... 8% 289M 1s 2024-09-14T11:25:15.728 INFO:teuthology.orchestra.run.smithi029.stderr: 7700K .......... .......... .......... .......... .......... 8% 346M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 7750K .......... .......... .......... .......... .......... 8% 369M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 7800K .......... .......... .......... .......... .......... 8% 335M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 7850K .......... .......... .......... .......... .......... 8% 241M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 7900K .......... .......... .......... .......... .......... 8% 319M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 7950K .......... .......... .......... .......... .......... 8% 251M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8000K .......... .......... .......... .......... .......... 8% 264M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8050K .......... .......... .......... .......... .......... 8% 237M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8100K .......... .......... .......... .......... .......... 8% 292M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8150K .......... .......... .......... .......... .......... 8% 242M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8200K .......... .......... .......... .......... .......... 8% 278M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8250K .......... .......... .......... .......... .......... 8% 302M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8300K .......... .......... .......... .......... .......... 8% 307M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8350K .......... .......... .......... .......... .......... 9% 269M 1s 2024-09-14T11:25:15.729 INFO:teuthology.orchestra.run.smithi029.stderr: 8400K .......... .......... .......... .......... .......... 9% 299M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8450K .......... .......... .......... .......... .......... 9% 287M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8500K .......... .......... .......... .......... .......... 9% 347M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8550K .......... .......... .......... .......... .......... 9% 330M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8600K .......... .......... .......... .......... .......... 9% 347M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8650K .......... .......... .......... .......... .......... 9% 290M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8700K .......... .......... .......... .......... .......... 9% 358M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8750K .......... .......... .......... .......... .......... 9% 359M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8800K .......... .......... .......... .......... .......... 9% 354M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8850K .......... .......... .......... .......... .......... 9% 303M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8900K .......... .......... .......... .......... .......... 9% 334M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 8950K .......... .......... .......... .......... .......... 9% 347M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 9000K .......... .......... .......... .......... .......... 9% 349M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 9050K .......... .......... .......... .......... .......... 9% 285M 1s 2024-09-14T11:25:15.730 INFO:teuthology.orchestra.run.smithi029.stderr: 9100K .......... .......... .......... .......... .......... 9% 353M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9150K .......... .......... .......... .......... .......... 9% 342M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9200K .......... .......... .......... .......... .......... 9% 347M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9250K .......... .......... .......... .......... .......... 10% 322M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9300K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9350K .......... .......... .......... .......... .......... 10% 340M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9400K .......... .......... .......... .......... .......... 10% 366M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9450K .......... .......... .......... .......... .......... 10% 307M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9500K .......... .......... .......... .......... .......... 10% 301M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9550K .......... .......... .......... .......... .......... 10% 258M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9600K .......... .......... .......... .......... .......... 10% 326M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9650K .......... .......... .......... .......... .......... 10% 294M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9700K .......... .......... .......... .......... .......... 10% 264M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9750K .......... .......... .......... .......... .......... 10% 333M 1s 2024-09-14T11:25:15.731 INFO:teuthology.orchestra.run.smithi029.stderr: 9800K .......... .......... .......... .......... .......... 10% 262M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 9850K .......... .......... .......... .......... .......... 10% 236M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 9900K .......... .......... .......... .......... .......... 10% 312M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 9950K .......... .......... .......... .......... .......... 10% 353M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10000K .......... .......... .......... .......... .......... 10% 354M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10050K .......... .......... .......... .......... .......... 10% 323M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10100K .......... .......... .......... .......... .......... 10% 338M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10150K .......... .......... .......... .......... .......... 10% 368M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10200K .......... .......... .......... .......... .......... 11% 331M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10250K .......... .......... .......... .......... .......... 11% 407M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10300K .......... .......... .......... .......... .......... 11% 16.4M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10350K .......... .......... .......... .......... .......... 11% 313M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10400K .......... .......... .......... .......... .......... 11% 324M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10450K .......... .......... .......... .......... .......... 11% 337M 1s 2024-09-14T11:25:15.732 INFO:teuthology.orchestra.run.smithi029.stderr: 10500K .......... .......... .......... .......... .......... 11% 288M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10550K .......... .......... .......... .......... .......... 11% 332M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10600K .......... .......... .......... .......... .......... 11% 350M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10650K .......... .......... .......... .......... .......... 11% 332M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10700K .......... .......... .......... .......... .......... 11% 286M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10750K .......... .......... .......... .......... .......... 11% 351M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10800K .......... .......... .......... .......... .......... 11% 330M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10850K .......... .......... .......... .......... .......... 11% 320M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10900K .......... .......... .......... .......... .......... 11% 313M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 10950K .......... .......... .......... .......... .......... 11% 345M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 11000K .......... .......... .......... .......... .......... 11% 306M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 11050K .......... .......... .......... .......... .......... 11% 346M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 11100K .......... .......... .......... .......... .......... 12% 284M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 11150K .......... .......... .......... .......... .......... 12% 345M 1s 2024-09-14T11:25:15.733 INFO:teuthology.orchestra.run.smithi029.stderr: 11200K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11250K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11300K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11350K .......... .......... .......... .......... .......... 12% 348M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11400K .......... .......... .......... .......... .......... 12% 348M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11450K .......... .......... .......... .......... .......... 12% 350M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11500K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11550K .......... .......... .......... .......... .......... 12% 352M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11600K .......... .......... .......... .......... .......... 12% 351M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11650K .......... .......... .......... .......... .......... 12% 363M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11700K .......... .......... .......... .......... .......... 12% 318M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11750K .......... .......... .......... .......... .......... 12% 308M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11800K .......... .......... .......... .......... .......... 12% 323M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11850K .......... .......... .......... .......... .......... 12% 343M 1s 2024-09-14T11:25:15.734 INFO:teuthology.orchestra.run.smithi029.stderr: 11900K .......... .......... .......... .......... .......... 12% 288M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 11950K .......... .......... .......... .......... .......... 12% 347M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12000K .......... .......... .......... .......... .......... 12% 318M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12050K .......... .......... .......... .......... .......... 13% 340M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12100K .......... .......... .......... .......... .......... 13% 303M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12150K .......... .......... .......... .......... .......... 13% 329M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12200K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12250K .......... .......... .......... .......... .......... 13% 357M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12300K .......... .......... .......... .......... .......... 13% 259M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12350K .......... .......... .......... .......... .......... 13% 338M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12400K .......... .......... .......... .......... .......... 13% 309M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12450K .......... .......... .......... .......... .......... 13% 333M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12500K .......... .......... .......... .......... .......... 13% 311M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12550K .......... .......... .......... .......... .......... 13% 353M 1s 2024-09-14T11:25:15.735 INFO:teuthology.orchestra.run.smithi029.stderr: 12600K .......... .......... .......... .......... .......... 13% 352M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12650K .......... .......... .......... .......... .......... 13% 349M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12700K .......... .......... .......... .......... .......... 13% 293M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12750K .......... .......... .......... .......... .......... 13% 358M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12800K .......... .......... .......... .......... .......... 13% 347M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12850K .......... .......... .......... .......... .......... 13% 339M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12900K .......... .......... .......... .......... .......... 13% 263M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 12950K .......... .......... .......... .......... .......... 13% 305M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13000K .......... .......... .......... .......... .......... 14% 351M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13050K .......... .......... .......... .......... .......... 14% 322M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13100K .......... .......... .......... .......... .......... 14% 312M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13150K .......... .......... .......... .......... .......... 14% 352M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13200K .......... .......... .......... .......... .......... 14% 16.7M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13250K .......... .......... .......... .......... .......... 14% 277M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13300K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-14T11:25:15.736 INFO:teuthology.orchestra.run.smithi029.stderr: 13350K .......... .......... .......... .......... .......... 14% 348M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13400K .......... .......... .......... .......... .......... 14% 320M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13450K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13500K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13550K .......... .......... .......... .......... .......... 14% 339M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13600K .......... .......... .......... .......... .......... 14% 349M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13650K .......... .......... .......... .......... .......... 14% 343M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13700K .......... .......... .......... .......... .......... 14% 297M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13750K .......... .......... .......... .......... .......... 14% 317M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13800K .......... .......... .......... .......... .......... 14% 340M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13850K .......... .......... .......... .......... .......... 14% 308M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13900K .......... .......... .......... .......... .......... 15% 284M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 13950K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-14T11:25:15.737 INFO:teuthology.orchestra.run.smithi029.stderr: 14000K .......... .......... .......... .......... .......... 15% 331M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14050K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14100K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14150K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14200K .......... .......... .......... .......... .......... 15% 342M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14250K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14300K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14350K .......... .......... .......... .......... .......... 15% 342M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14400K .......... .......... .......... .......... .......... 15% 351M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14450K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14500K .......... .......... .......... .......... .......... 15% 300M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14550K .......... .......... .......... .......... .......... 15% 339M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14600K .......... .......... .......... .......... .......... 15% 311M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14650K .......... .......... .......... .......... .......... 15% 364M 1s 2024-09-14T11:25:15.738 INFO:teuthology.orchestra.run.smithi029.stderr: 14700K .......... .......... .......... .......... .......... 15% 288M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 14750K .......... .......... .......... .......... .......... 15% 348M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 14800K .......... .......... .......... .......... .......... 15% 353M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 14850K .......... .......... .......... .......... .......... 16% 325M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 14900K .......... .......... .......... .......... .......... 16% 253M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 14950K .......... .......... .......... .......... .......... 16% 291M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15000K .......... .......... .......... .......... .......... 16% 365M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15050K .......... .......... .......... .......... .......... 16% 345M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15100K .......... .......... .......... .......... .......... 16% 294M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15150K .......... .......... .......... .......... .......... 16% 324M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15200K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15250K .......... .......... .......... .......... .......... 16% 349M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15300K .......... .......... .......... .......... .......... 16% 292M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15350K .......... .......... .......... .......... .......... 16% 344M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15400K .......... .......... .......... .......... .......... 16% 348M 1s 2024-09-14T11:25:15.739 INFO:teuthology.orchestra.run.smithi029.stderr: 15450K .......... .......... .......... .......... .......... 16% 346M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15500K .......... .......... .......... .......... .......... 16% 302M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15550K .......... .......... .......... .......... .......... 16% 347M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15600K .......... .......... .......... .......... .......... 16% 345M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15650K .......... .......... .......... .......... .......... 16% 358M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15700K .......... .......... .......... .......... .......... 16% 307M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15750K .......... .......... .......... .......... .......... 17% 343M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15800K .......... .......... .......... .......... .......... 17% 353M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15850K .......... .......... .......... .......... .......... 17% 341M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15900K .......... .......... .......... .......... .......... 17% 319M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 15950K .......... .......... .......... .......... .......... 17% 360M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 16000K .......... .......... .......... .......... .......... 17% 375M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 16050K .......... .......... .......... .......... .......... 17% 337M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 16100K .......... .......... .......... .......... .......... 17% 15.5M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 16150K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-14T11:25:15.740 INFO:teuthology.orchestra.run.smithi029.stderr: 16200K .......... .......... .......... .......... .......... 17% 274M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16250K .......... .......... .......... .......... .......... 17% 337M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16300K .......... .......... .......... .......... .......... 17% 281M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16350K .......... .......... .......... .......... .......... 17% 336M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16400K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16450K .......... .......... .......... .......... .......... 17% 284M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16500K .......... .......... .......... .......... .......... 17% 289M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16550K .......... .......... .......... .......... .......... 17% 347M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16600K .......... .......... .......... .......... .......... 17% 356M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16650K .......... .......... .......... .......... .......... 17% 352M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16700K .......... .......... .......... .......... .......... 18% 284M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16750K .......... .......... .......... .......... .......... 18% 341M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16800K .......... .......... .......... .......... .......... 18% 334M 1s 2024-09-14T11:25:15.741 INFO:teuthology.orchestra.run.smithi029.stderr: 16850K .......... .......... .......... .......... .......... 18% 332M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 16900K .......... .......... .......... .......... .......... 18% 279M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 16950K .......... .......... .......... .......... .......... 18% 263M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17000K .......... .......... .......... .......... .......... 18% 268M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17050K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17100K .......... .......... .......... .......... .......... 18% 238M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17150K .......... .......... .......... .......... .......... 18% 313M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17200K .......... .......... .......... .......... .......... 18% 338M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17250K .......... .......... .......... .......... .......... 18% 351M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17300K .......... .......... .......... .......... .......... 18% 302M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17350K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17400K .......... .......... .......... .......... .......... 18% 366M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17450K .......... .......... .......... .......... .......... 18% 352M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17500K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-14T11:25:15.742 INFO:teuthology.orchestra.run.smithi029.stderr: 17550K .......... .......... .......... .......... .......... 18% 366M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17600K .......... .......... .......... .......... .......... 18% 251M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17650K .......... .......... .......... .......... .......... 19% 317M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17700K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17750K .......... .......... .......... .......... .......... 19% 323M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17800K .......... .......... .......... .......... .......... 19% 347M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17850K .......... .......... .......... .......... .......... 19% 329M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17900K .......... .......... .......... .......... .......... 19% 287M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 17950K .......... .......... .......... .......... .......... 19% 345M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18000K .......... .......... .......... .......... .......... 19% 363M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18050K .......... .......... .......... .......... .......... 19% 346M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18100K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18150K .......... .......... .......... .......... .......... 19% 358M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18200K .......... .......... .......... .......... .......... 19% 349M 1s 2024-09-14T11:25:15.743 INFO:teuthology.orchestra.run.smithi029.stderr: 18250K .......... .......... .......... .......... .......... 19% 279M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18300K .......... .......... .......... .......... .......... 19% 237M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18350K .......... .......... .......... .......... .......... 19% 276M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18400K .......... .......... .......... .......... .......... 19% 268M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18450K .......... .......... .......... .......... .......... 19% 354M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18500K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18550K .......... .......... .......... .......... .......... 20% 341M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18600K .......... .......... .......... .......... .......... 20% 349M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18650K .......... .......... .......... .......... .......... 20% 360M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18700K .......... .......... .......... .......... .......... 20% 294M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18750K .......... .......... .......... .......... .......... 20% 333M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18800K .......... .......... .......... .......... .......... 20% 360M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18850K .......... .......... .......... .......... .......... 20% 365M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18900K .......... .......... .......... .......... .......... 20% 325M 1s 2024-09-14T11:25:15.744 INFO:teuthology.orchestra.run.smithi029.stderr: 18950K .......... .......... .......... .......... .......... 20% 371M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19000K .......... .......... .......... .......... .......... 20% 18.3M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19050K .......... .......... .......... .......... .......... 20% 315M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19100K .......... .......... .......... .......... .......... 20% 291M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19150K .......... .......... .......... .......... .......... 20% 361M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19200K .......... .......... .......... .......... .......... 20% 174M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19250K .......... .......... .......... .......... .......... 20% 332M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19300K .......... .......... .......... .......... .......... 20% 314M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19350K .......... .......... .......... .......... .......... 20% 302M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19400K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19450K .......... .......... .......... .......... .......... 20% 311M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19500K .......... .......... .......... .......... .......... 21% 262M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19550K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19600K .......... .......... .......... .......... .......... 21% 259M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19650K .......... .......... .......... .......... .......... 21% 215M 1s 2024-09-14T11:25:15.745 INFO:teuthology.orchestra.run.smithi029.stderr: 19700K .......... .......... .......... .......... .......... 21% 248M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 19750K .......... .......... .......... .......... .......... 21% 340M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 19800K .......... .......... .......... .......... .......... 21% 279M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 19850K .......... .......... .......... .......... .......... 21% 266M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 19900K .......... .......... .......... .......... .......... 21% 178M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 19950K .......... .......... .......... .......... .......... 21% 333M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20000K .......... .......... .......... .......... .......... 21% 347M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20050K .......... .......... .......... .......... .......... 21% 330M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20100K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20150K .......... .......... .......... .......... .......... 21% 348M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20200K .......... .......... .......... .......... .......... 21% 354M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20250K .......... .......... .......... .......... .......... 21% 366M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20300K .......... .......... .......... .......... .......... 21% 302M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20350K .......... .......... .......... .......... .......... 21% 368M 1s 2024-09-14T11:25:15.746 INFO:teuthology.orchestra.run.smithi029.stderr: 20400K .......... .......... .......... .......... .......... 22% 355M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20450K .......... .......... .......... .......... .......... 22% 317M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20500K .......... .......... .......... .......... .......... 22% 336M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20550K .......... .......... .......... .......... .......... 22% 299M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20600K .......... .......... .......... .......... .......... 22% 359M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20650K .......... .......... .......... .......... .......... 22% 365M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20700K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20750K .......... .......... .......... .......... .......... 22% 346M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20800K .......... .......... .......... .......... .......... 22% 355M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20850K .......... .......... .......... .......... .......... 22% 366M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20900K .......... .......... .......... .......... .......... 22% 319M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 20950K .......... .......... .......... .......... .......... 22% 354M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 21000K .......... .......... .......... .......... .......... 22% 333M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 21050K .......... .......... .......... .......... .......... 22% 287M 1s 2024-09-14T11:25:15.747 INFO:teuthology.orchestra.run.smithi029.stderr: 21100K .......... .......... .......... .......... .......... 22% 204M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21150K .......... .......... .......... .......... .......... 22% 177M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21200K .......... .......... .......... .......... .......... 22% 171M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21250K .......... .......... .......... .......... .......... 22% 170M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21300K .......... .......... .......... .......... .......... 22% 151M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21350K .......... .......... .......... .......... .......... 23% 227M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21400K .......... .......... .......... .......... .......... 23% 267M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21450K .......... .......... .......... .......... .......... 23% 262M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21500K .......... .......... .......... .......... .......... 23% 229M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21550K .......... .......... .......... .......... .......... 23% 325M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21600K .......... .......... .......... .......... .......... 23% 302M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21650K .......... .......... .......... .......... .......... 23% 313M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21700K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21750K .......... .......... .......... .......... .......... 23% 267M 1s 2024-09-14T11:25:15.748 INFO:teuthology.orchestra.run.smithi029.stderr: 21800K .......... .......... .......... .......... .......... 23% 234M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 21850K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 21900K .......... .......... .......... .......... .......... 23% 288M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 21950K .......... .......... .......... .......... .......... 23% 30.1M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22000K .......... .......... .......... .......... .......... 23% 178M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22050K .......... .......... .......... .......... .......... 23% 303M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22100K .......... .......... .......... .......... .......... 23% 293M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22150K .......... .......... .......... .......... .......... 23% 299M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22200K .......... .......... .......... .......... .......... 23% 157M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22250K .......... .......... .......... .......... .......... 24% 290M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22300K .......... .......... .......... .......... .......... 24% 225M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22350K .......... .......... .......... .......... .......... 24% 287M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22400K .......... .......... .......... .......... .......... 24% 294M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22450K .......... .......... .......... .......... .......... 24% 322M 1s 2024-09-14T11:25:15.749 INFO:teuthology.orchestra.run.smithi029.stderr: 22500K .......... .......... .......... .......... .......... 24% 316M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22550K .......... .......... .......... .......... .......... 24% 324M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22600K .......... .......... .......... .......... .......... 24% 345M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22650K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22700K .......... .......... .......... .......... .......... 24% 219M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22750K .......... .......... .......... .......... .......... 24% 329M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22800K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22850K .......... .......... .......... .......... .......... 24% 357M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22900K .......... .......... .......... .......... .......... 24% 318M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 22950K .......... .......... .......... .......... .......... 24% 339M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 23000K .......... .......... .......... .......... .......... 24% 270M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 23050K .......... .......... .......... .......... .......... 24% 326M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 23100K .......... .......... .......... .......... .......... 24% 274M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 23150K .......... .......... .......... .......... .......... 24% 262M 1s 2024-09-14T11:25:15.750 INFO:teuthology.orchestra.run.smithi029.stderr: 23200K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23250K .......... .......... .......... .......... .......... 25% 366M 1s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23300K .......... .......... .......... .......... .......... 25% 372M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23350K .......... .......... .......... .......... .......... 25% 356M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23400K .......... .......... .......... .......... .......... 25% 271M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23450K .......... .......... .......... .......... .......... 25% 356M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23500K .......... .......... .......... .......... .......... 25% 368M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23550K .......... .......... .......... .......... .......... 25% 353M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23600K .......... .......... .......... .......... .......... 25% 329M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23650K .......... .......... .......... .......... .......... 25% 352M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23700K .......... .......... .......... .......... .......... 25% 367M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23750K .......... .......... .......... .......... .......... 25% 347M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23800K .......... .......... .......... .......... .......... 25% 300M 0s 2024-09-14T11:25:15.751 INFO:teuthology.orchestra.run.smithi029.stderr: 23850K .......... .......... .......... .......... .......... 25% 362M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 23900K .......... .......... .......... .......... .......... 25% 365M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 23950K .......... .......... .......... .......... .......... 25% 364M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24000K .......... .......... .......... .......... .......... 25% 325M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24050K .......... .......... .......... .......... .......... 25% 365M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24100K .......... .......... .......... .......... .......... 25% 357M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24150K .......... .......... .......... .......... .......... 26% 368M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24200K .......... .......... .......... .......... .......... 26% 182M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24250K .......... .......... .......... .......... .......... 26% 240M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24300K .......... .......... .......... .......... .......... 26% 355M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24350K .......... .......... .......... .......... .......... 26% 360M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24400K .......... .......... .......... .......... .......... 26% 314M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24450K .......... .......... .......... .......... .......... 26% 324M 0s 2024-09-14T11:25:15.752 INFO:teuthology.orchestra.run.smithi029.stderr: 24500K .......... .......... .......... .......... .......... 26% 291M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24550K .......... .......... .......... .......... .......... 26% 156M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24600K .......... .......... .......... .......... .......... 26% 257M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24650K .......... .......... .......... .......... .......... 26% 55.1M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24700K .......... .......... .......... .......... .......... 26% 19.3M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24750K .......... .......... .......... .......... .......... 26% 298M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24800K .......... .......... .......... .......... .......... 26% 339M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24850K .......... .......... .......... .......... .......... 26% 357M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24900K .......... .......... .......... .......... .......... 26% 327M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 24950K .......... .......... .......... .......... .......... 26% 330M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 25000K .......... .......... .......... .......... .......... 26% 352M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 25050K .......... .......... .......... .......... .......... 27% 347M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 25100K .......... .......... .......... .......... .......... 27% 295M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 25150K .......... .......... .......... .......... .......... 27% 371M 0s 2024-09-14T11:25:15.753 INFO:teuthology.orchestra.run.smithi029.stderr: 25200K .......... .......... .......... .......... .......... 27% 383M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25250K .......... .......... .......... .......... .......... 27% 380M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25300K .......... .......... .......... .......... .......... 27% 317M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25350K .......... .......... .......... .......... .......... 27% 363M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25400K .......... .......... .......... .......... .......... 27% 327M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25450K .......... .......... .......... .......... .......... 27% 345M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25500K .......... .......... .......... .......... .......... 27% 290M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25550K .......... .......... .......... .......... .......... 27% 362M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25600K .......... .......... .......... .......... .......... 27% 358M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25650K .......... .......... .......... .......... .......... 27% 334M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25700K .......... .......... .......... .......... .......... 27% 331M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25750K .......... .......... .......... .......... .......... 27% 381M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25800K .......... .......... .......... .......... .......... 27% 358M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25850K .......... .......... .......... .......... .......... 27% 328M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25900K .......... .......... .......... .......... .......... 27% 256M 0s 2024-09-14T11:25:15.754 INFO:teuthology.orchestra.run.smithi029.stderr: 25950K .......... .......... .......... .......... .......... 27% 377M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26000K .......... .......... .......... .......... .......... 28% 249M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26050K .......... .......... .......... .......... .......... 28% 262M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26100K .......... .......... .......... .......... .......... 28% 326M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26150K .......... .......... .......... .......... .......... 28% 334M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26200K .......... .......... .......... .......... .......... 28% 277M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26250K .......... .......... .......... .......... .......... 28% 352M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26300K .......... .......... .......... .......... .......... 28% 281M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26350K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26400K .......... .......... .......... .......... .......... 28% 357M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26450K .......... .......... .......... .......... .......... 28% 349M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26500K .......... .......... .......... .......... .......... 28% 322M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26550K .......... .......... .......... .......... .......... 28% 311M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26600K .......... .......... .......... .......... .......... 28% 350M 0s 2024-09-14T11:25:15.755 INFO:teuthology.orchestra.run.smithi029.stderr: 26650K .......... .......... .......... .......... .......... 28% 358M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26700K .......... .......... .......... .......... .......... 28% 310M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26750K .......... .......... .......... .......... .......... 28% 384M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26800K .......... .......... .......... .......... .......... 28% 366M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26850K .......... .......... .......... .......... .......... 28% 362M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26900K .......... .......... .......... .......... .......... 29% 331M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 26950K .......... .......... .......... .......... .......... 29% 380M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27000K .......... .......... .......... .......... .......... 29% 372M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27050K .......... .......... .......... .......... .......... 29% 351M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27100K .......... .......... .......... .......... .......... 29% 296M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27150K .......... .......... .......... .......... .......... 29% 371M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27200K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27250K .......... .......... .......... .......... .......... 29% 377M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27300K .......... .......... .......... .......... .......... 29% 325M 0s 2024-09-14T11:25:15.756 INFO:teuthology.orchestra.run.smithi029.stderr: 27350K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27400K .......... .......... .......... .......... .......... 29% 321M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27450K .......... .......... .......... .......... .......... 29% 319M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27500K .......... .......... .......... .......... .......... 29% 310M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27550K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27600K .......... .......... .......... .......... .......... 29% 378M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27650K .......... .......... .......... .......... .......... 29% 355M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27700K .......... .......... .......... .......... .......... 29% 337M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27750K .......... .......... .......... .......... .......... 29% 173M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27800K .......... .......... .......... .......... .......... 29% 18.6M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27850K .......... .......... .......... .......... .......... 30% 93.4M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27900K .......... .......... .......... .......... .......... 30% 285M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 27950K .......... .......... .......... .......... .......... 30% 344M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 28000K .......... .......... .......... .......... .......... 30% 347M 0s 2024-09-14T11:25:15.757 INFO:teuthology.orchestra.run.smithi029.stderr: 28050K .......... .......... .......... .......... .......... 30% 343M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28100K .......... .......... .......... .......... .......... 30% 327M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28150K .......... .......... .......... .......... .......... 30% 375M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28200K .......... .......... .......... .......... .......... 30% 384M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28250K .......... .......... .......... .......... .......... 30% 187M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28300K .......... .......... .......... .......... .......... 30% 274M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28350K .......... .......... .......... .......... .......... 30% 358M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28400K .......... .......... .......... .......... .......... 30% 371M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28450K .......... .......... .......... .......... .......... 30% 359M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28500K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28550K .......... .......... .......... .......... .......... 30% 336M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28600K .......... .......... .......... .......... .......... 30% 286M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28650K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-14T11:25:15.758 INFO:teuthology.orchestra.run.smithi029.stderr: 28700K .......... .......... .......... .......... .......... 30% 249M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 28750K .......... .......... .......... .......... .......... 31% 345M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 28800K .......... .......... .......... .......... .......... 31% 383M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 28850K .......... .......... .......... .......... .......... 31% 358M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 28900K .......... .......... .......... .......... .......... 31% 340M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 28950K .......... .......... .......... .......... .......... 31% 383M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29000K .......... .......... .......... .......... .......... 31% 340M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29050K .......... .......... .......... .......... .......... 31% 377M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29100K .......... .......... .......... .......... .......... 31% 306M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29150K .......... .......... .......... .......... .......... 31% 373M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29200K .......... .......... .......... .......... .......... 31% 364M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29250K .......... .......... .......... .......... .......... 31% 369M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29300K .......... .......... .......... .......... .......... 31% 329M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29350K .......... .......... .......... .......... .......... 31% 343M 0s 2024-09-14T11:25:15.759 INFO:teuthology.orchestra.run.smithi029.stderr: 29400K .......... .......... .......... .......... .......... 31% 379M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29450K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29500K .......... .......... .......... .......... .......... 31% 304M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29550K .......... .......... .......... .......... .......... 31% 248M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29600K .......... .......... .......... .......... .......... 31% 367M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29650K .......... .......... .......... .......... .......... 31% 371M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29700K .......... .......... .......... .......... .......... 32% 330M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29750K .......... .......... .......... .......... .......... 32% 371M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29800K .......... .......... .......... .......... .......... 32% 256M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29850K .......... .......... .......... .......... .......... 32% 357M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29900K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 29950K .......... .......... .......... .......... .......... 32% 288M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 30000K .......... .......... .......... .......... .......... 32% 270M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 30050K .......... .......... .......... .......... .......... 32% 302M 0s 2024-09-14T11:25:15.760 INFO:teuthology.orchestra.run.smithi029.stderr: 30100K .......... .......... .......... .......... .......... 32% 294M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30150K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30200K .......... .......... .......... .......... .......... 32% 366M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30250K .......... .......... .......... .......... .......... 32% 372M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30300K .......... .......... .......... .......... .......... 32% 298M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30350K .......... .......... .......... .......... .......... 32% 377M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30400K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30450K .......... .......... .......... .......... .......... 32% 362M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30500K .......... .......... .......... .......... .......... 32% 347M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30550K .......... .......... .......... .......... .......... 32% 385M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30600K .......... .......... .......... .......... .......... 32% 393M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30650K .......... .......... .......... .......... .......... 33% 367M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30700K .......... .......... .......... .......... .......... 33% 328M 0s 2024-09-14T11:25:15.761 INFO:teuthology.orchestra.run.smithi029.stderr: 30750K .......... .......... .......... .......... .......... 33% 392M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 30800K .......... .......... .......... .......... .......... 33% 332M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 30850K .......... .......... .......... .......... .......... 33% 22.0M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 30900K .......... .......... .......... .......... .......... 33% 60.7M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 30950K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31000K .......... .......... .......... .......... .......... 33% 297M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31050K .......... .......... .......... .......... .......... 33% 355M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31100K .......... .......... .......... .......... .......... 33% 351M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31150K .......... .......... .......... .......... .......... 33% 310M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31200K .......... .......... .......... .......... .......... 33% 389M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31250K .......... .......... .......... .......... .......... 33% 198M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31300K .......... .......... .......... .......... .......... 33% 311M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31350K .......... .......... .......... .......... .......... 33% 175M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31400K .......... .......... .......... .......... .......... 33% 264M 0s 2024-09-14T11:25:15.762 INFO:teuthology.orchestra.run.smithi029.stderr: 31450K .......... .......... .......... .......... .......... 33% 381M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31500K .......... .......... .......... .......... .......... 33% 366M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31550K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31600K .......... .......... .......... .......... .......... 34% 380M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31650K .......... .......... .......... .......... .......... 34% 388M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31700K .......... .......... .......... .......... .......... 34% 401M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31750K .......... .......... .......... .......... .......... 34% 220M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31800K .......... .......... .......... .......... .......... 34% 370M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31850K .......... .......... .......... .......... .......... 34% 357M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31900K .......... .......... .......... .......... .......... 34% 385M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 31950K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 32000K .......... .......... .......... .......... .......... 34% 123M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 32050K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 32100K .......... .......... .......... .......... .......... 34% 371M 0s 2024-09-14T11:25:15.763 INFO:teuthology.orchestra.run.smithi029.stderr: 32150K .......... .......... .......... .......... .......... 34% 335M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32200K .......... .......... .......... .......... .......... 34% 374M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32250K .......... .......... .......... .......... .......... 34% 328M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32300K .......... .......... .......... .......... .......... 34% 381M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32350K .......... .......... .......... .......... .......... 34% 376M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32400K .......... .......... .......... .......... .......... 34% 375M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32450K .......... .......... .......... .......... .......... 34% 309M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32500K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32550K .......... .......... .......... .......... .......... 35% 372M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32600K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32650K .......... .......... .......... .......... .......... 35% 328M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32700K .......... .......... .......... .......... .......... 35% 368M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32750K .......... .......... .......... .......... .......... 35% 375M 0s 2024-09-14T11:25:15.764 INFO:teuthology.orchestra.run.smithi029.stderr: 32800K .......... .......... .......... .......... .......... 35% 380M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 32850K .......... .......... .......... .......... .......... 35% 320M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 32900K .......... .......... .......... .......... .......... 35% 378M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 32950K .......... .......... .......... .......... .......... 35% 259M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33000K .......... .......... .......... .......... .......... 35% 322M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33050K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33100K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33150K .......... .......... .......... .......... .......... 35% 354M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33200K .......... .......... .......... .......... .......... 35% 132M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33250K .......... .......... .......... .......... .......... 35% 344M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33300K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33350K .......... .......... .......... .......... .......... 35% 301M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33400K .......... .......... .......... .......... .......... 36% 363M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33450K .......... .......... .......... .......... .......... 36% 390M 0s 2024-09-14T11:25:15.765 INFO:teuthology.orchestra.run.smithi029.stderr: 33500K .......... .......... .......... .......... .......... 36% 377M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33550K .......... .......... .......... .......... .......... 36% 337M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33600K .......... .......... .......... .......... .......... 36% 213M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33650K .......... .......... .......... .......... .......... 36% 344M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33700K .......... .......... .......... .......... .......... 36% 392M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33750K .......... .......... .......... .......... .......... 36% 330M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33800K .......... .......... .......... .......... .......... 36% 352M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33850K .......... .......... .......... .......... .......... 36% 122M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33900K .......... .......... .......... .......... .......... 36% 38.6M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 33950K .......... .......... .......... .......... .......... 36% 53.8M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 34000K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 34050K .......... .......... .......... .......... .......... 36% 144M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 34100K .......... .......... .......... .......... .......... 36% 283M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 34150K .......... .......... .......... .......... .......... 36% 334M 0s 2024-09-14T11:25:15.766 INFO:teuthology.orchestra.run.smithi029.stderr: 34200K .......... .......... .......... .......... .......... 36% 303M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34250K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34300K .......... .......... .......... .......... .......... 36% 375M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34350K .......... .......... .......... .......... .......... 37% 164M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34400K .......... .......... .......... .......... .......... 37% 374M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34450K .......... .......... .......... .......... .......... 37% 214M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34500K .......... .......... .......... .......... .......... 37% 341M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34550K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34600K .......... .......... .......... .......... .......... 37% 374M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34650K .......... .......... .......... .......... .......... 37% 376M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34700K .......... .......... .......... .......... .......... 37% 390M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34750K .......... .......... .......... .......... .......... 37% 311M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34800K .......... .......... .......... .......... .......... 37% 379M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34850K .......... .......... .......... .......... .......... 37% 365M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34900K .......... .......... .......... .......... .......... 37% 373M 0s 2024-09-14T11:25:15.767 INFO:teuthology.orchestra.run.smithi029.stderr: 34950K .......... .......... .......... .......... .......... 37% 226M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35000K .......... .......... .......... .......... .......... 37% 75.7M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35050K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35100K .......... .......... .......... .......... .......... 37% 383M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35150K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35200K .......... .......... .......... .......... .......... 37% 292M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35250K .......... .......... .......... .......... .......... 37% 336M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35300K .......... .......... .......... .......... .......... 38% 386M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35350K .......... .......... .......... .......... .......... 38% 306M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35400K .......... .......... .......... .......... .......... 38% 363M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35450K .......... .......... .......... .......... .......... 38% 362M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35500K .......... .......... .......... .......... .......... 38% 373M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35550K .......... .......... .......... .......... .......... 38% 309M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35600K .......... .......... .......... .......... .......... 38% 373M 0s 2024-09-14T11:25:15.768 INFO:teuthology.orchestra.run.smithi029.stderr: 35650K .......... .......... .......... .......... .......... 38% 377M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35700K .......... .......... .......... .......... .......... 38% 359M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35750K .......... .......... .......... .......... .......... 38% 337M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35800K .......... .......... .......... .......... .......... 38% 378M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35850K .......... .......... .......... .......... .......... 38% 370M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35900K .......... .......... .......... .......... .......... 38% 372M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 35950K .......... .......... .......... .......... .......... 38% 320M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36000K .......... .......... .......... .......... .......... 38% 386M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36050K .......... .......... .......... .......... .......... 38% 362M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36100K .......... .......... .......... .......... .......... 38% 376M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36150K .......... .......... .......... .......... .......... 38% 330M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36200K .......... .......... .......... .......... .......... 39% 324M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36250K .......... .......... .......... .......... .......... 39% 390M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36300K .......... .......... .......... .......... .......... 39% 400M 0s 2024-09-14T11:25:15.769 INFO:teuthology.orchestra.run.smithi029.stderr: 36350K .......... .......... .......... .......... .......... 39% 155M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36400K .......... .......... .......... .......... .......... 39% 337M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36450K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36500K .......... .......... .......... .......... .......... 39% 332M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36550K .......... .......... .......... .......... .......... 39% 321M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36600K .......... .......... .......... .......... .......... 39% 319M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36650K .......... .......... .......... .......... .......... 39% 332M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36700K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36750K .......... .......... .......... .......... .......... 39% 87.5M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36800K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36850K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36900K .......... .......... .......... .......... .......... 39% 355M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 36950K .......... .......... .......... .......... .......... 39% 64.3M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 37000K .......... .......... .......... .......... .......... 39% 55.3M 0s 2024-09-14T11:25:15.770 INFO:teuthology.orchestra.run.smithi029.stderr: 37050K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37100K .......... .......... .......... .......... .......... 39% 98.1M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37150K .......... .......... .......... .......... .......... 40% 154M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37200K .......... .......... .......... .......... .......... 40% 373M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37250K .......... .......... .......... .......... .......... 40% 375M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37300K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37350K .......... .......... .......... .......... .......... 40% 342M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37400K .......... .......... .......... .......... .......... 40% 85.4M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37450K .......... .......... .......... .......... .......... 40% 372M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37500K .......... .......... .......... .......... .......... 40% 359M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37550K .......... .......... .......... .......... .......... 40% 302M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37600K .......... .......... .......... .......... .......... 40% 380M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37650K .......... .......... .......... .......... .......... 40% 383M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37700K .......... .......... .......... .......... .......... 40% 389M 0s 2024-09-14T11:25:15.771 INFO:teuthology.orchestra.run.smithi029.stderr: 37750K .......... .......... .......... .......... .......... 40% 349M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 37800K .......... .......... .......... .......... .......... 40% 376M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 37850K .......... .......... .......... .......... .......... 40% 374M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 37900K .......... .......... .......... .......... .......... 40% 356M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 37950K .......... .......... .......... .......... .......... 40% 322M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38000K .......... .......... .......... .......... .......... 40% 384M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38050K .......... .......... .......... .......... .......... 41% 84.5M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38100K .......... .......... .......... .......... .......... 41% 278M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38150K .......... .......... .......... .......... .......... 41% 212M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38200K .......... .......... .......... .......... .......... 41% 206M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38250K .......... .......... .......... .......... .......... 41% 368M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38300K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38350K .......... .......... .......... .......... .......... 41% 290M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38400K .......... .......... .......... .......... .......... 41% 391M 0s 2024-09-14T11:25:15.772 INFO:teuthology.orchestra.run.smithi029.stderr: 38450K .......... .......... .......... .......... .......... 41% 374M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38500K .......... .......... .......... .......... .......... 41% 369M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38550K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38600K .......... .......... .......... .......... .......... 41% 138M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38650K .......... .......... .......... .......... .......... 41% 334M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38700K .......... .......... .......... .......... .......... 41% 367M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38750K .......... .......... .......... .......... .......... 41% 303M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38800K .......... .......... .......... .......... .......... 41% 371M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38850K .......... .......... .......... .......... .......... 41% 370M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38900K .......... .......... .......... .......... .......... 41% 376M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 38950K .......... .......... .......... .......... .......... 41% 338M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 39000K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 39050K .......... .......... .......... .......... .......... 42% 369M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 39100K .......... .......... .......... .......... .......... 42% 374M 0s 2024-09-14T11:25:15.773 INFO:teuthology.orchestra.run.smithi029.stderr: 39150K .......... .......... .......... .......... .......... 42% 317M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39200K .......... .......... .......... .......... .......... 42% 386M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39250K .......... .......... .......... .......... .......... 42% 306M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39300K .......... .......... .......... .......... .......... 42% 348M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39350K .......... .......... .......... .......... .......... 42% 324M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39400K .......... .......... .......... .......... .......... 42% 366M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39450K .......... .......... .......... .......... .......... 42% 349M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39500K .......... .......... .......... .......... .......... 42% 370M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39550K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39600K .......... .......... .......... .......... .......... 42% 388M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39650K .......... .......... .......... .......... .......... 42% 391M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39700K .......... .......... .......... .......... .......... 42% 385M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39750K .......... .......... .......... .......... .......... 42% 116M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39800K .......... .......... .......... .......... .......... 42% 235M 0s 2024-09-14T11:25:15.774 INFO:teuthology.orchestra.run.smithi029.stderr: 39850K .......... .......... .......... .......... .......... 42% 316M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 39900K .......... .......... .......... .......... .......... 43% 370M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 39950K .......... .......... .......... .......... .......... 43% 127M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40000K .......... .......... .......... .......... .......... 43% 366M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40050K .......... .......... .......... .......... .......... 43% 64.6M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40100K .......... .......... .......... .......... .......... 43% 330M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40150K .......... .......... .......... .......... .......... 43% 66.8M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40200K .......... .......... .......... .......... .......... 43% 351M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40250K .......... .......... .......... .......... .......... 43% 378M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40300K .......... .......... .......... .......... .......... 43% 391M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40350K .......... .......... .......... .......... .......... 43% 143M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40400K .......... .......... .......... .......... .......... 43% 385M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40450K .......... .......... .......... .......... .......... 43% 126M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40500K .......... .......... .......... .......... .......... 43% 117M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40550K .......... .......... .......... .......... .......... 43% 256M 0s 2024-09-14T11:25:15.775 INFO:teuthology.orchestra.run.smithi029.stderr: 40600K .......... .......... .......... .......... .......... 43% 289M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40650K .......... .......... .......... .......... .......... 43% 377M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40700K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40750K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40800K .......... .......... .......... .......... .......... 43% 375M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40850K .......... .......... .......... .......... .......... 44% 337M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40900K .......... .......... .......... .......... .......... 44% 369M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 40950K .......... .......... .......... .......... .......... 44% 351M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41000K .......... .......... .......... .......... .......... 44% 356M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41050K .......... .......... .......... .......... .......... 44% 391M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41100K .......... .......... .......... .......... .......... 44% 164M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41150K .......... .......... .......... .......... .......... 44% 217M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41200K .......... .......... .......... .......... .......... 44% 222M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41250K .......... .......... .......... .......... .......... 44% 359M 0s 2024-09-14T11:25:15.776 INFO:teuthology.orchestra.run.smithi029.stderr: 41300K .......... .......... .......... .......... .......... 44% 356M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41350K .......... .......... .......... .......... .......... 44% 332M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41400K .......... .......... .......... .......... .......... 44% 373M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41450K .......... .......... .......... .......... .......... 44% 372M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41500K .......... .......... .......... .......... .......... 44% 210M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41550K .......... .......... .......... .......... .......... 44% 169M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41600K .......... .......... .......... .......... .......... 44% 318M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41650K .......... .......... .......... .......... .......... 44% 199M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41700K .......... .......... .......... .......... .......... 44% 378M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41750K .......... .......... .......... .......... .......... 44% 85.7M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41800K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41850K .......... .......... .......... .......... .......... 45% 372M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41900K .......... .......... .......... .......... .......... 45% 368M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 41950K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-14T11:25:15.777 INFO:teuthology.orchestra.run.smithi029.stderr: 42000K .......... .......... .......... .......... .......... 45% 378M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42050K .......... .......... .......... .......... .......... 45% 317M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42100K .......... .......... .......... .......... .......... 45% 391M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42150K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42200K .......... .......... .......... .......... .......... 45% 347M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42250K .......... .......... .......... .......... .......... 45% 368M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42300K .......... .......... .......... .......... .......... 45% 377M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42350K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42400K .......... .......... .......... .......... .......... 45% 360M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42450K .......... .......... .......... .......... .......... 45% 371M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42500K .......... .......... .......... .......... .......... 45% 363M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42550K .......... .......... .......... .......... .......... 45% 340M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42600K .......... .......... .......... .......... .......... 45% 395M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42650K .......... .......... .......... .......... .......... 45% 381M 0s 2024-09-14T11:25:15.778 INFO:teuthology.orchestra.run.smithi029.stderr: 42700K .......... .......... .......... .......... .......... 46% 356M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 42750K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 42800K .......... .......... .......... .......... .......... 46% 364M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 42850K .......... .......... .......... .......... .......... 46% 369M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 42900K .......... .......... .......... .......... .......... 46% 373M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 42950K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43000K .......... .......... .......... .......... .......... 46% 200M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43050K .......... .......... .......... .......... .......... 46% 299M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43100K .......... .......... .......... .......... .......... 46% 391M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43150K .......... .......... .......... .......... .......... 46% 76.9M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43200K .......... .......... .......... .......... .......... 46% 61.9M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43250K .......... .......... .......... .......... .......... 46% 219M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43300K .......... .......... .......... .......... .......... 46% 308M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43350K .......... .......... .......... .......... .......... 46% 318M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43400K .......... .......... .......... .......... .......... 46% 141M 0s 2024-09-14T11:25:15.779 INFO:teuthology.orchestra.run.smithi029.stderr: 43450K .......... .......... .......... .......... .......... 46% 107M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43500K .......... .......... .......... .......... .......... 46% 345M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43550K .......... .......... .......... .......... .......... 46% 230M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43600K .......... .......... .......... .......... .......... 46% 348M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43650K .......... .......... .......... .......... .......... 47% 248M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43700K .......... .......... .......... .......... .......... 47% 220M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43750K .......... .......... .......... .......... .......... 47% 138M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43800K .......... .......... .......... .......... .......... 47% 329M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43850K .......... .......... .......... .......... .......... 47% 366M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43900K .......... .......... .......... .......... .......... 47% 371M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 43950K .......... .......... .......... .......... .......... 47% 173M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 44000K .......... .......... .......... .......... .......... 47% 167M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 44050K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 44100K .......... .......... .......... .......... .......... 47% 350M 0s 2024-09-14T11:25:15.780 INFO:teuthology.orchestra.run.smithi029.stderr: 44150K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44200K .......... .......... .......... .......... .......... 47% 362M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44250K .......... .......... .......... .......... .......... 47% 331M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44300K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44350K .......... .......... .......... .......... .......... 47% 285M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44400K .......... .......... .......... .......... .......... 47% 355M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44450K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44500K .......... .......... .......... .......... .......... 47% 357M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44550K .......... .......... .......... .......... .......... 48% 310M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44600K .......... .......... .......... .......... .......... 48% 291M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44650K .......... .......... .......... .......... .......... 48% 388M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44700K .......... .......... .......... .......... .......... 48% 386M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44750K .......... .......... .......... .......... .......... 48% 60.7M 0s 2024-09-14T11:25:15.781 INFO:teuthology.orchestra.run.smithi029.stderr: 44800K .......... .......... .......... .......... .......... 48% 376M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 44850K .......... .......... .......... .......... .......... 48% 199M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 44900K .......... .......... .......... .......... .......... 48% 343M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 44950K .......... .......... .......... .......... .......... 48% 306M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45000K .......... .......... .......... .......... .......... 48% 361M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45050K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45100K .......... .......... .......... .......... .......... 48% 374M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45150K .......... .......... .......... .......... .......... 48% 290M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45200K .......... .......... .......... .......... .......... 48% 353M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45250K .......... .......... .......... .......... .......... 48% 364M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45300K .......... .......... .......... .......... .......... 48% 367M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45350K .......... .......... .......... .......... .......... 48% 327M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45400K .......... .......... .......... .......... .......... 48% 380M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45450K .......... .......... .......... .......... .......... 48% 375M 0s 2024-09-14T11:25:15.782 INFO:teuthology.orchestra.run.smithi029.stderr: 45500K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45550K .......... .......... .......... .......... .......... 49% 305M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45600K .......... .......... .......... .......... .......... 49% 375M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45650K .......... .......... .......... .......... .......... 49% 310M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45700K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45750K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45800K .......... .......... .......... .......... .......... 49% 350M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45850K .......... .......... .......... .......... .......... 49% 370M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45900K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 45950K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 46000K .......... .......... .......... .......... .......... 49% 381M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 46050K .......... .......... .......... .......... .......... 49% 374M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 46100K .......... .......... .......... .......... .......... 49% 211M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 46150K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-14T11:25:15.783 INFO:teuthology.orchestra.run.smithi029.stderr: 46200K .......... .......... .......... .......... .......... 49% 380M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46250K .......... .......... .......... .......... .......... 49% 75.6M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46300K .......... .......... .......... .......... .......... 49% 185M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46350K .......... .......... .......... .......... .......... 49% 160M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46400K .......... .......... .......... .......... .......... 49% 356M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46450K .......... .......... .......... .......... .......... 50% 215M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46500K .......... .......... .......... .......... .......... 50% 101M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46550K .......... .......... .......... .......... .......... 50% 125M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46600K .......... .......... .......... .......... .......... 50% 344M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46650K .......... .......... .......... .......... .......... 50% 382M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46700K .......... .......... .......... .......... .......... 50% 133M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46750K .......... .......... .......... .......... .......... 50% 170M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46800K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-14T11:25:15.784 INFO:teuthology.orchestra.run.smithi029.stderr: 46850K .......... .......... .......... .......... .......... 50% 337M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 46900K .......... .......... .......... .......... .......... 50% 135M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 46950K .......... .......... .......... .......... .......... 50% 160M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47000K .......... .......... .......... .......... .......... 50% 307M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47050K .......... .......... .......... .......... .......... 50% 360M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47100K .......... .......... .......... .......... .......... 50% 355M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47150K .......... .......... .......... .......... .......... 50% 307M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47200K .......... .......... .......... .......... .......... 50% 358M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47250K .......... .......... .......... .......... .......... 50% 368M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47300K .......... .......... .......... .......... .......... 50% 368M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47350K .......... .......... .......... .......... .......... 51% 319M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47400K .......... .......... .......... .......... .......... 51% 377M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47450K .......... .......... .......... .......... .......... 51% 352M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47500K .......... .......... .......... .......... .......... 51% 360M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47550K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-14T11:25:15.785 INFO:teuthology.orchestra.run.smithi029.stderr: 47600K .......... .......... .......... .......... .......... 51% 384M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47650K .......... .......... .......... .......... .......... 51% 304M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47700K .......... .......... .......... .......... .......... 51% 56.2M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47750K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47800K .......... .......... .......... .......... .......... 51% 360M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47850K .......... .......... .......... .......... .......... 51% 202M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47900K .......... .......... .......... .......... .......... 51% 339M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 47950K .......... .......... .......... .......... .......... 51% 100M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48000K .......... .......... .......... .......... .......... 51% 245M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48050K .......... .......... .......... .......... .......... 51% 317M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48100K .......... .......... .......... .......... .......... 51% 288M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48150K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48200K .......... .......... .......... .......... .......... 51% 366M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48250K .......... .......... .......... .......... .......... 51% 381M 0s 2024-09-14T11:25:15.786 INFO:teuthology.orchestra.run.smithi029.stderr: 48300K .......... .......... .......... .......... .......... 52% 364M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48350K .......... .......... .......... .......... .......... 52% 284M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48400K .......... .......... .......... .......... .......... 52% 366M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48450K .......... .......... .......... .......... .......... 52% 372M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48500K .......... .......... .......... .......... .......... 52% 353M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48550K .......... .......... .......... .......... .......... 52% 337M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48600K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48650K .......... .......... .......... .......... .......... 52% 363M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48700K .......... .......... .......... .......... .......... 52% 364M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48750K .......... .......... .......... .......... .......... 52% 308M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48800K .......... .......... .......... .......... .......... 52% 358M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48850K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48900K .......... .......... .......... .......... .......... 52% 374M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 48950K .......... .......... .......... .......... .......... 52% 342M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 49000K .......... .......... .......... .......... .......... 52% 340M 0s 2024-09-14T11:25:15.787 INFO:teuthology.orchestra.run.smithi029.stderr: 49050K .......... .......... .......... .......... .......... 52% 349M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49100K .......... .......... .......... .......... .......... 52% 378M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49150K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49200K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49250K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49300K .......... .......... .......... .......... .......... 53% 357M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49350K .......... .......... .......... .......... .......... 53% 129M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49400K .......... .......... .......... .......... .......... 53% 353M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49450K .......... .......... .......... .......... .......... 53% 160M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49500K .......... .......... .......... .......... .......... 53% 188M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49550K .......... .......... .......... .......... .......... 53% 170M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49600K .......... .......... .......... .......... .......... 53% 93.6M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49650K .......... .......... .......... .......... .......... 53% 277M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49700K .......... .......... .......... .......... .......... 53% 127M 0s 2024-09-14T11:25:15.788 INFO:teuthology.orchestra.run.smithi029.stderr: 49750K .......... .......... .......... .......... .......... 53% 196M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 49800K .......... .......... .......... .......... .......... 53% 311M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 49850K .......... .......... .......... .......... .......... 53% 321M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 49900K .......... .......... .......... .......... .......... 53% 293M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 49950K .......... .......... .......... .......... .......... 53% 269M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50000K .......... .......... .......... .......... .......... 53% 104M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50050K .......... .......... .......... .......... .......... 53% 242M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50100K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50150K .......... .......... .......... .......... .......... 54% 268M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50200K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50250K .......... .......... .......... .......... .......... 54% 250M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50300K .......... .......... .......... .......... .......... 54% 227M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50350K .......... .......... .......... .......... .......... 54% 207M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50400K .......... .......... .......... .......... .......... 54% 249M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50450K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-14T11:25:15.789 INFO:teuthology.orchestra.run.smithi029.stderr: 50500K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50550K .......... .......... .......... .......... .......... 54% 267M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50600K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50650K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50700K .......... .......... .......... .......... .......... 54% 327M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50750K .......... .......... .......... .......... .......... 54% 262M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50800K .......... .......... .......... .......... .......... 54% 117M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50850K .......... .......... .......... .......... .......... 54% 295M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50900K .......... .......... .......... .......... .......... 54% 284M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 50950K .......... .......... .......... .......... .......... 54% 291M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 51000K .......... .......... .......... .......... .......... 54% 271M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 51050K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 51100K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 51150K .......... .......... .......... .......... .......... 55% 264M 0s 2024-09-14T11:25:15.790 INFO:teuthology.orchestra.run.smithi029.stderr: 51200K .......... .......... .......... .......... .......... 55% 191M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51250K .......... .......... .......... .......... .......... 55% 316M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51300K .......... .......... .......... .......... .......... 55% 248M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51350K .......... .......... .......... .......... .......... 55% 259M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51400K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51450K .......... .......... .......... .......... .......... 55% 228M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51500K .......... .......... .......... .......... .......... 55% 203M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51550K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51600K .......... .......... .......... .......... .......... 55% 301M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51650K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51700K .......... .......... .......... .......... .......... 55% 255M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51750K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51800K .......... .......... .......... .......... .......... 55% 328M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51850K .......... .......... .......... .......... .......... 55% 332M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51900K .......... .......... .......... .......... .......... 55% 246M 0s 2024-09-14T11:25:15.791 INFO:teuthology.orchestra.run.smithi029.stderr: 51950K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52000K .......... .......... .......... .......... .......... 56% 293M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52050K .......... .......... .......... .......... .......... 56% 308M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52100K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52150K .......... .......... .......... .......... .......... 56% 322M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52200K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52250K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52300K .......... .......... .......... .......... .......... 56% 254M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52350K .......... .......... .......... .......... .......... 56% 303M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52400K .......... .......... .......... .......... .......... 56% 312M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52450K .......... .......... .......... .......... .......... 56% 308M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52500K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52550K .......... .......... .......... .......... .......... 56% 308M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52600K .......... .......... .......... .......... .......... 56% 315M 0s 2024-09-14T11:25:15.792 INFO:teuthology.orchestra.run.smithi029.stderr: 52650K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52700K .......... .......... .......... .......... .......... 56% 68.3M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52750K .......... .......... .......... .......... .......... 56% 224M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52800K .......... .......... .......... .......... .......... 56% 295M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52850K .......... .......... .......... .......... .......... 56% 267M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52900K .......... .......... .......... .......... .......... 56% 242M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 52950K .......... .......... .......... .......... .......... 57% 283M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53000K .......... .......... .......... .......... .......... 57% 221M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53050K .......... .......... .......... .......... .......... 57% 191M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53100K .......... .......... .......... .......... .......... 57% 232M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53150K .......... .......... .......... .......... .......... 57% 267M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53200K .......... .......... .......... .......... .......... 57% 139M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53250K .......... .......... .......... .......... .......... 57% 276M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53300K .......... .......... .......... .......... .......... 57% 262M 0s 2024-09-14T11:25:15.793 INFO:teuthology.orchestra.run.smithi029.stderr: 53350K .......... .......... .......... .......... .......... 57% 102M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53400K .......... .......... .......... .......... .......... 57% 273M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53450K .......... .......... .......... .......... .......... 57% 306M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53500K .......... .......... .......... .......... .......... 57% 277M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53550K .......... .......... .......... .......... .......... 57% 227M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53600K .......... .......... .......... .......... .......... 57% 301M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53650K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53700K .......... .......... .......... .......... .......... 57% 243M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53750K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53800K .......... .......... .......... .......... .......... 57% 319M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53850K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53900K .......... .......... .......... .......... .......... 58% 274M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 53950K .......... .......... .......... .......... .......... 58% 307M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 54000K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-14T11:25:15.794 INFO:teuthology.orchestra.run.smithi029.stderr: 54050K .......... .......... .......... .......... .......... 58% 304M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54100K .......... .......... .......... .......... .......... 58% 264M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54150K .......... .......... .......... .......... .......... 58% 308M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54200K .......... .......... .......... .......... .......... 58% 306M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54250K .......... .......... .......... .......... .......... 58% 183M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54300K .......... .......... .......... .......... .......... 58% 277M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54350K .......... .......... .......... .......... .......... 58% 316M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54400K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54450K .......... .......... .......... .......... .......... 58% 299M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54500K .......... .......... .......... .......... .......... 58% 135M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54550K .......... .......... .......... .......... .......... 58% 294M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54600K .......... .......... .......... .......... .......... 58% 242M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54650K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54700K .......... .......... .......... .......... .......... 58% 268M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54750K .......... .......... .......... .......... .......... 58% 290M 0s 2024-09-14T11:25:15.795 INFO:teuthology.orchestra.run.smithi029.stderr: 54800K .......... .......... .......... .......... .......... 59% 282M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 54850K .......... .......... .......... .......... .......... 59% 316M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 54900K .......... .......... .......... .......... .......... 59% 278M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 54950K .......... .......... .......... .......... .......... 59% 196M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55000K .......... .......... .......... .......... .......... 59% 306M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55050K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55100K .......... .......... .......... .......... .......... 59% 284M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55150K .......... .......... .......... .......... .......... 59% 312M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55200K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55250K .......... .......... .......... .......... .......... 59% 320M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55300K .......... .......... .......... .......... .......... 59% 255M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55350K .......... .......... .......... .......... .......... 59% 303M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55400K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55450K .......... .......... .......... .......... .......... 59% 311M 0s 2024-09-14T11:25:15.796 INFO:teuthology.orchestra.run.smithi029.stderr: 55500K .......... .......... .......... .......... .......... 59% 283M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55550K .......... .......... .......... .......... .......... 59% 325M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55600K .......... .......... .......... .......... .......... 59% 329M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55650K .......... .......... .......... .......... .......... 59% 69.0M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55700K .......... .......... .......... .......... .......... 60% 252M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55750K .......... .......... .......... .......... .......... 60% 314M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55800K .......... .......... .......... .......... .......... 60% 286M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55850K .......... .......... .......... .......... .......... 60% 298M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55900K .......... .......... .......... .......... .......... 60% 281M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 55950K .......... .......... .......... .......... .......... 60% 298M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 56000K .......... .......... .......... .......... .......... 60% 273M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 56050K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 56100K .......... .......... .......... .......... .......... 60% 220M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 56150K .......... .......... .......... .......... .......... 60% 315M 0s 2024-09-14T11:25:15.797 INFO:teuthology.orchestra.run.smithi029.stderr: 56200K .......... .......... .......... .......... .......... 60% 310M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56250K .......... .......... .......... .......... .......... 60% 232M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56300K .......... .......... .......... .......... .......... 60% 185M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56350K .......... .......... .......... .......... .......... 60% 246M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56400K .......... .......... .......... .......... .......... 60% 113M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56450K .......... .......... .......... .......... .......... 60% 290M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56500K .......... .......... .......... .......... .......... 60% 231M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56550K .......... .......... .......... .......... .......... 60% 289M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56600K .......... .......... .......... .......... .......... 60% 303M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56650K .......... .......... .......... .......... .......... 61% 328M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56700K .......... .......... .......... .......... .......... 61% 149M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56750K .......... .......... .......... .......... .......... 61% 305M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56800K .......... .......... .......... .......... .......... 61% 287M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56850K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-14T11:25:15.798 INFO:teuthology.orchestra.run.smithi029.stderr: 56900K .......... .......... .......... .......... .......... 61% 274M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 56950K .......... .......... .......... .......... .......... 61% 317M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57000K .......... .......... .......... .......... .......... 61% 318M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57050K .......... .......... .......... .......... .......... 61% 163M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57100K .......... .......... .......... .......... .......... 61% 265M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57150K .......... .......... .......... .......... .......... 61% 313M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57200K .......... .......... .......... .......... .......... 61% 299M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57250K .......... .......... .......... .......... .......... 61% 316M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57300K .......... .......... .......... .......... .......... 61% 269M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57350K .......... .......... .......... .......... .......... 61% 315M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57400K .......... .......... .......... .......... .......... 61% 307M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57450K .......... .......... .......... .......... .......... 61% 282M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57500K .......... .......... .......... .......... .......... 61% 203M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57550K .......... .......... .......... .......... .......... 62% 266M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57600K .......... .......... .......... .......... .......... 62% 308M 0s 2024-09-14T11:25:15.799 INFO:teuthology.orchestra.run.smithi029.stderr: 57650K .......... .......... .......... .......... .......... 62% 223M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57700K .......... .......... .......... .......... .......... 62% 296M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57750K .......... .......... .......... .......... .......... 62% 215M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57800K .......... .......... .......... .......... .......... 62% 188M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57850K .......... .......... .......... .......... .......... 62% 309M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57900K .......... .......... .......... .......... .......... 62% 257M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 57950K .......... .......... .......... .......... .......... 62% 120M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58000K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58050K .......... .......... .......... .......... .......... 62% 325M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58100K .......... .......... .......... .......... .......... 62% 264M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58150K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58200K .......... .......... .......... .......... .......... 62% 315M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58250K .......... .......... .......... .......... .......... 62% 327M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58300K .......... .......... .......... .......... .......... 62% 268M 0s 2024-09-14T11:25:15.800 INFO:teuthology.orchestra.run.smithi029.stderr: 58350K .......... .......... .......... .......... .......... 62% 317M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58400K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58450K .......... .......... .......... .......... .......... 62% 302M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58500K .......... .......... .......... .......... .......... 63% 279M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58550K .......... .......... .......... .......... .......... 63% 287M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58600K .......... .......... .......... .......... .......... 63% 61.5M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58650K .......... .......... .......... .......... .......... 63% 314M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58700K .......... .......... .......... .......... .......... 63% 246M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58750K .......... .......... .......... .......... .......... 63% 319M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58800K .......... .......... .......... .......... .......... 63% 316M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58850K .......... .......... .......... .......... .......... 63% 303M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58900K .......... .......... .......... .......... .......... 63% 292M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 58950K .......... .......... .......... .......... .......... 63% 196M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 59000K .......... .......... .......... .......... .......... 63% 238M 0s 2024-09-14T11:25:15.801 INFO:teuthology.orchestra.run.smithi029.stderr: 59050K .......... .......... .......... .......... .......... 63% 318M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59100K .......... .......... .......... .......... .......... 63% 249M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59150K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59200K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59250K .......... .......... .......... .......... .......... 63% 317M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59300K .......... .......... .......... .......... .......... 63% 256M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59350K .......... .......... .......... .......... .......... 63% 327M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59400K .......... .......... .......... .......... .......... 63% 202M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59450K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59500K .......... .......... .......... .......... .......... 64% 253M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59550K .......... .......... .......... .......... .......... 64% 269M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59600K .......... .......... .......... .......... .......... 64% 294M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59650K .......... .......... .......... .......... .......... 64% 137M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59700K .......... .......... .......... .......... .......... 64% 238M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59750K .......... .......... .......... .......... .......... 64% 306M 0s 2024-09-14T11:25:15.802 INFO:teuthology.orchestra.run.smithi029.stderr: 59800K .......... .......... .......... .......... .......... 64% 256M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 59850K .......... .......... .......... .......... .......... 64% 293M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 59900K .......... .......... .......... .......... .......... 64% 230M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 59950K .......... .......... .......... .......... .......... 64% 323M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60000K .......... .......... .......... .......... .......... 64% 297M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60050K .......... .......... .......... .......... .......... 64% 324M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60100K .......... .......... .......... .......... .......... 64% 281M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60150K .......... .......... .......... .......... .......... 64% 312M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60200K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60250K .......... .......... .......... .......... .......... 64% 313M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60300K .......... .......... .......... .......... .......... 64% 257M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60350K .......... .......... .......... .......... .......... 65% 293M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60400K .......... .......... .......... .......... .......... 65% 326M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60450K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60500K .......... .......... .......... .......... .......... 65% 273M 0s 2024-09-14T11:25:15.803 INFO:teuthology.orchestra.run.smithi029.stderr: 60550K .......... .......... .......... .......... .......... 65% 196M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60600K .......... .......... .......... .......... .......... 65% 313M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60650K .......... .......... .......... .......... .......... 65% 309M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60700K .......... .......... .......... .......... .......... 65% 281M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60750K .......... .......... .......... .......... .......... 65% 179M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60800K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60850K .......... .......... .......... .......... .......... 65% 330M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60900K .......... .......... .......... .......... .......... 65% 199M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 60950K .......... .......... .......... .......... .......... 65% 90.4M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61000K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61050K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61100K .......... .......... .......... .......... .......... 65% 239M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61150K .......... .......... .......... .......... .......... 65% 320M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61200K .......... .......... .......... .......... .......... 65% 243M 0s 2024-09-14T11:25:15.804 INFO:teuthology.orchestra.run.smithi029.stderr: 61250K .......... .......... .......... .......... .......... 65% 205M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61300K .......... .......... .......... .......... .......... 66% 251M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61350K .......... .......... .......... .......... .......... 66% 319M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61400K .......... .......... .......... .......... .......... 66% 284M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61450K .......... .......... .......... .......... .......... 66% 325M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61500K .......... .......... .......... .......... .......... 66% 261M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61550K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61600K .......... .......... .......... .......... .......... 66% 90.3M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61650K .......... .......... .......... .......... .......... 66% 270M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61700K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61750K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61800K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61850K .......... .......... .......... .......... .......... 66% 276M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61900K .......... .......... .......... .......... .......... 66% 93.1M 0s 2024-09-14T11:25:15.805 INFO:teuthology.orchestra.run.smithi029.stderr: 61950K .......... .......... .......... .......... .......... 66% 293M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62000K .......... .......... .......... .......... .......... 66% 290M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62050K .......... .......... .......... .......... .......... 66% 275M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62100K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62150K .......... .......... .......... .......... .......... 66% 256M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62200K .......... .......... .......... .......... .......... 67% 269M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62250K .......... .......... .......... .......... .......... 67% 269M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62300K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62350K .......... .......... .......... .......... .......... 67% 287M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62400K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62450K .......... .......... .......... .......... .......... 67% 244M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62500K .......... .......... .......... .......... .......... 67% 296M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62550K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62600K .......... .......... .......... .......... .......... 67% 330M 0s 2024-09-14T11:25:15.806 INFO:teuthology.orchestra.run.smithi029.stderr: 62650K .......... .......... .......... .......... .......... 67% 249M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62700K .......... .......... .......... .......... .......... 67% 128M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62750K .......... .......... .......... .......... .......... 67% 224M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62800K .......... .......... .......... .......... .......... 67% 312M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62850K .......... .......... .......... .......... .......... 67% 278M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62900K .......... .......... .......... .......... .......... 67% 313M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 62950K .......... .......... .......... .......... .......... 67% 304M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63000K .......... .......... .......... .......... .......... 67% 311M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63050K .......... .......... .......... .......... .......... 67% 267M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63100K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63150K .......... .......... .......... .......... .......... 68% 308M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63200K .......... .......... .......... .......... .......... 68% 317M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63250K .......... .......... .......... .......... .......... 68% 296M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63300K .......... .......... .......... .......... .......... 68% 298M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63350K .......... .......... .......... .......... .......... 68% 311M 0s 2024-09-14T11:25:15.807 INFO:teuthology.orchestra.run.smithi029.stderr: 63400K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63450K .......... .......... .......... .......... .......... 68% 233M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63500K .......... .......... .......... .......... .......... 68% 299M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63550K .......... .......... .......... .......... .......... 68% 250M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63600K .......... .......... .......... .......... .......... 68% 267M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63650K .......... .......... .......... .......... .......... 68% 289M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63700K .......... .......... .......... .......... .......... 68% 287M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63750K .......... .......... .......... .......... .......... 68% 264M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63800K .......... .......... .......... .......... .......... 68% 325M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63850K .......... .......... .......... .......... .......... 68% 247M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63900K .......... .......... .......... .......... .......... 68% 329M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 63950K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 64000K .......... .......... .......... .......... .......... 68% 128M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 64050K .......... .......... .......... .......... .......... 68% 191M 0s 2024-09-14T11:25:15.808 INFO:teuthology.orchestra.run.smithi029.stderr: 64100K .......... .......... .......... .......... .......... 69% 320M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64150K .......... .......... .......... .......... .......... 69% 131M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64200K .......... .......... .......... .......... .......... 69% 187M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64250K .......... .......... .......... .......... .......... 69% 250M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64300K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64350K .......... .......... .......... .......... .......... 69% 286M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64400K .......... .......... .......... .......... .......... 69% 298M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64450K .......... .......... .......... .......... .......... 69% 272M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64500K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64550K .......... .......... .......... .......... .......... 69% 96.0M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64600K .......... .......... .......... .......... .......... 69% 295M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64650K .......... .......... .......... .......... .......... 69% 198M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64700K .......... .......... .......... .......... .......... 69% 257M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64750K .......... .......... .......... .......... .......... 69% 274M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64800K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-14T11:25:15.809 INFO:teuthology.orchestra.run.smithi029.stderr: 64850K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 64900K .......... .......... .......... .......... .......... 69% 142M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 64950K .......... .......... .......... .......... .......... 69% 272M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65000K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65050K .......... .......... .......... .......... .......... 70% 261M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65100K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65150K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65200K .......... .......... .......... .......... .......... 70% 321M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65250K .......... .......... .......... .......... .......... 70% 287M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65300K .......... .......... .......... .......... .......... 70% 322M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65350K .......... .......... .......... .......... .......... 70% 155M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65400K .......... .......... .......... .......... .......... 70% 284M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65450K .......... .......... .......... .......... .......... 70% 259M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65500K .......... .......... .......... .......... .......... 70% 311M 0s 2024-09-14T11:25:15.810 INFO:teuthology.orchestra.run.smithi029.stderr: 65550K .......... .......... .......... .......... .......... 70% 284M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65600K .......... .......... .......... .......... .......... 70% 322M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65650K .......... .......... .......... .......... .......... 70% 271M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65700K .......... .......... .......... .......... .......... 70% 223M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65750K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65800K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65850K .......... .......... .......... .......... .......... 70% 132M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65900K .......... .......... .......... .......... .......... 70% 301M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 65950K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66000K .......... .......... .......... .......... .......... 71% 312M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66050K .......... .......... .......... .......... .......... 71% 244M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66100K .......... .......... .......... .......... .......... 71% 275M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66150K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66200K .......... .......... .......... .......... .......... 71% 256M 0s 2024-09-14T11:25:15.811 INFO:teuthology.orchestra.run.smithi029.stderr: 66250K .......... .......... .......... .......... .......... 71% 218M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66300K .......... .......... .......... .......... .......... 71% 254M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66350K .......... .......... .......... .......... .......... 71% 273M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66400K .......... .......... .......... .......... .......... 71% 328M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66450K .......... .......... .......... .......... .......... 71% 259M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66500K .......... .......... .......... .......... .......... 71% 335M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66550K .......... .......... .......... .......... .......... 71% 306M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66600K .......... .......... .......... .......... .......... 71% 290M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66650K .......... .......... .......... .......... .......... 71% 249M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66700K .......... .......... .......... .......... .......... 71% 310M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66750K .......... .......... .......... .......... .......... 71% 294M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66800K .......... .......... .......... .......... .......... 71% 312M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66850K .......... .......... .......... .......... .......... 72% 290M 0s 2024-09-14T11:25:15.812 INFO:teuthology.orchestra.run.smithi029.stderr: 66900K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 66950K .......... .......... .......... .......... .......... 72% 297M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67000K .......... .......... .......... .......... .......... 72% 188M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67050K .......... .......... .......... .......... .......... 72% 267M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67100K .......... .......... .......... .......... .......... 72% 309M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67150K .......... .......... .......... .......... .......... 72% 169M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67200K .......... .......... .......... .......... .......... 72% 273M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67250K .......... .......... .......... .......... .......... 72% 279M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67300K .......... .......... .......... .......... .......... 72% 159M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67350K .......... .......... .......... .......... .......... 72% 241M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67400K .......... .......... .......... .......... .......... 72% 279M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67450K .......... .......... .......... .......... .......... 72% 259M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67500K .......... .......... .......... .......... .......... 72% 253M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67550K .......... .......... .......... .......... .......... 72% 82.1M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67600K .......... .......... .......... .......... .......... 72% 261M 0s 2024-09-14T11:25:15.813 INFO:teuthology.orchestra.run.smithi029.stderr: 67650K .......... .......... .......... .......... .......... 72% 293M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67700K .......... .......... .......... .......... .......... 72% 303M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67750K .......... .......... .......... .......... .......... 72% 323M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67800K .......... .......... .......... .......... .......... 73% 133M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67850K .......... .......... .......... .......... .......... 73% 245M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67900K .......... .......... .......... .......... .......... 73% 311M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 67950K .......... .......... .......... .......... .......... 73% 311M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68000K .......... .......... .......... .......... .......... 73% 307M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68050K .......... .......... .......... .......... .......... 73% 278M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68100K .......... .......... .......... .......... .......... 73% 305M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68150K .......... .......... .......... .......... .......... 73% 312M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68200K .......... .......... .......... .......... .......... 73% 172M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68250K .......... .......... .......... .......... .......... 73% 268M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68300K .......... .......... .......... .......... .......... 73% 173M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68350K .......... .......... .......... .......... .......... 73% 305M 0s 2024-09-14T11:25:15.814 INFO:teuthology.orchestra.run.smithi029.stderr: 68400K .......... .......... .......... .......... .......... 73% 303M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68450K .......... .......... .......... .......... .......... 73% 285M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68500K .......... .......... .......... .......... .......... 73% 142M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68550K .......... .......... .......... .......... .......... 73% 303M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68600K .......... .......... .......... .......... .......... 73% 292M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68650K .......... .......... .......... .......... .......... 73% 261M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68700K .......... .......... .......... .......... .......... 74% 325M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68750K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68800K .......... .......... .......... .......... .......... 74% 314M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68850K .......... .......... .......... .......... .......... 74% 283M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68900K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 68950K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 69000K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 69050K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 69100K .......... .......... .......... .......... .......... 74% 306M 0s 2024-09-14T11:25:15.815 INFO:teuthology.orchestra.run.smithi029.stderr: 69150K .......... .......... .......... .......... .......... 74% 318M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69200K .......... .......... .......... .......... .......... 74% 303M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69250K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69300K .......... .......... .......... .......... .......... 74% 316M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69350K .......... .......... .......... .......... .......... 74% 306M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69400K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69450K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69500K .......... .......... .......... .......... .......... 74% 296M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69550K .......... .......... .......... .......... .......... 74% 165M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69600K .......... .......... .......... .......... .......... 74% 218M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69650K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69700K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69750K .......... .......... .......... .......... .......... 75% 297M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69800K .......... .......... .......... .......... .......... 75% 317M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69850K .......... .......... .......... .......... .......... 75% 268M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69900K .......... .......... .......... .......... .......... 75% 302M 0s 2024-09-14T11:25:15.816 INFO:teuthology.orchestra.run.smithi029.stderr: 69950K .......... .......... .......... .......... .......... 75% 271M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70000K .......... .......... .......... .......... .......... 75% 227M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70050K .......... .......... .......... .......... .......... 75% 295M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70100K .......... .......... .......... .......... .......... 75% 316M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70150K .......... .......... .......... .......... .......... 75% 284M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70200K .......... .......... .......... .......... .......... 75% 319M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70250K .......... .......... .......... .......... .......... 75% 214M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70300K .......... .......... .......... .......... .......... 75% 188M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70350K .......... .......... .......... .......... .......... 75% 257M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70400K .......... .......... .......... .......... .......... 75% 121M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70450K .......... .......... .......... .......... .......... 75% 306M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70500K .......... .......... .......... .......... .......... 75% 310M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70550K .......... .......... .......... .......... .......... 75% 268M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70600K .......... .......... .......... .......... .......... 76% 111M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70650K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-14T11:25:15.817 INFO:teuthology.orchestra.run.smithi029.stderr: 70700K .......... .......... .......... .......... .......... 76% 302M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 70750K .......... .......... .......... .......... .......... 76% 243M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 70800K .......... .......... .......... .......... .......... 76% 80.9M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 70850K .......... .......... .......... .......... .......... 76% 284M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 70900K .......... .......... .......... .......... .......... 76% 308M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 70950K .......... .......... .......... .......... .......... 76% 244M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71000K .......... .......... .......... .......... .......... 76% 279M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71050K .......... .......... .......... .......... .......... 76% 273M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71100K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71150K .......... .......... .......... .......... .......... 76% 276M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71200K .......... .......... .......... .......... .......... 76% 278M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71250K .......... .......... .......... .......... .......... 76% 277M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71300K .......... .......... .......... .......... .......... 76% 322M 0s 2024-09-14T11:25:15.818 INFO:teuthology.orchestra.run.smithi029.stderr: 71350K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71400K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71450K .......... .......... .......... .......... .......... 76% 302M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71500K .......... .......... .......... .......... .......... 77% 123M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71550K .......... .......... .......... .......... .......... 77% 255M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71600K .......... .......... .......... .......... .......... 77% 305M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71650K .......... .......... .......... .......... .......... 77% 269M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71700K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71750K .......... .......... .......... .......... .......... 77% 262M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71800K .......... .......... .......... .......... .......... 77% 312M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71850K .......... .......... .......... .......... .......... 77% 313M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71900K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 71950K .......... .......... .......... .......... .......... 77% 264M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 72000K .......... .......... .......... .......... .......... 77% 210M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 72050K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-14T11:25:15.819 INFO:teuthology.orchestra.run.smithi029.stderr: 72100K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72150K .......... .......... .......... .......... .......... 77% 277M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72200K .......... .......... .......... .......... .......... 77% 275M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72250K .......... .......... .......... .......... .......... 77% 302M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72300K .......... .......... .......... .......... .......... 77% 326M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72350K .......... .......... .......... .......... .......... 77% 190M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72400K .......... .......... .......... .......... .......... 77% 316M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72450K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72500K .......... .......... .......... .......... .......... 78% 270M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72550K .......... .......... .......... .......... .......... 78% 241M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72600K .......... .......... .......... .......... .......... 78% 317M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72650K .......... .......... .......... .......... .......... 78% 283M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72700K .......... .......... .......... .......... .......... 78% 279M 0s 2024-09-14T11:25:15.820 INFO:teuthology.orchestra.run.smithi029.stderr: 72750K .......... .......... .......... .......... .......... 78% 260M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 72800K .......... .......... .......... .......... .......... 78% 300M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 72850K .......... .......... .......... .......... .......... 78% 313M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 72900K .......... .......... .......... .......... .......... 78% 304M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 72950K .......... .......... .......... .......... .......... 78% 284M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73000K .......... .......... .......... .......... .......... 78% 303M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73050K .......... .......... .......... .......... .......... 78% 313M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73100K .......... .......... .......... .......... .......... 78% 251M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73150K .......... .......... .......... .......... .......... 78% 214M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73200K .......... .......... .......... .......... .......... 78% 249M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73250K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73300K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73350K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73400K .......... .......... .......... .......... .......... 79% 329M 0s 2024-09-14T11:25:15.821 INFO:teuthology.orchestra.run.smithi029.stderr: 73450K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73500K .......... .......... .......... .......... .......... 79% 173M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73550K .......... .......... .......... .......... .......... 79% 132M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73600K .......... .......... .......... .......... .......... 79% 136M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73650K .......... .......... .......... .......... .......... 79% 359M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73700K .......... .......... .......... .......... .......... 79% 359M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73750K .......... .......... .......... .......... .......... 79% 195M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73800K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73850K .......... .......... .......... .......... .......... 79% 93.2M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73900K .......... .......... .......... .......... .......... 79% 249M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 73950K .......... .......... .......... .......... .......... 79% 141M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 74000K .......... .......... .......... .......... .......... 79% 323M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 74050K .......... .......... .......... .......... .......... 79% 357M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 74100K .......... .......... .......... .......... .......... 79% 217M 0s 2024-09-14T11:25:15.822 INFO:teuthology.orchestra.run.smithi029.stderr: 74150K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74200K .......... .......... .......... .......... .......... 79% 318M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74250K .......... .......... .......... .......... .......... 79% 362M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74300K .......... .......... .......... .......... .......... 80% 244M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74350K .......... .......... .......... .......... .......... 80% 135M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74400K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74450K .......... .......... .......... .......... .......... 80% 253M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74500K .......... .......... .......... .......... .......... 80% 363M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74550K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74600K .......... .......... .......... .......... .......... 80% 167M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74650K .......... .......... .......... .......... .......... 80% 271M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74700K .......... .......... .......... .......... .......... 80% 146M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74750K .......... .......... .......... .......... .......... 80% 268M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74800K .......... .......... .......... .......... .......... 80% 312M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74850K .......... .......... .......... .......... .......... 80% 344M 0s 2024-09-14T11:25:15.823 INFO:teuthology.orchestra.run.smithi029.stderr: 74900K .......... .......... .......... .......... .......... 80% 377M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 74950K .......... .......... .......... .......... .......... 80% 209M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75000K .......... .......... .......... .......... .......... 80% 376M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75050K .......... .......... .......... .......... .......... 80% 226M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75100K .......... .......... .......... .......... .......... 80% 307M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75150K .......... .......... .......... .......... .......... 80% 172M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75200K .......... .......... .......... .......... .......... 81% 319M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75250K .......... .......... .......... .......... .......... 81% 273M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75300K .......... .......... .......... .......... .......... 81% 267M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75350K .......... .......... .......... .......... .......... 81% 272M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75400K .......... .......... .......... .......... .......... 81% 318M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75450K .......... .......... .......... .......... .......... 81% 209M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75500K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75550K .......... .......... .......... .......... .......... 81% 271M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75600K .......... .......... .......... .......... .......... 81% 292M 0s 2024-09-14T11:25:15.824 INFO:teuthology.orchestra.run.smithi029.stderr: 75650K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75700K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75750K .......... .......... .......... .......... .......... 81% 275M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75800K .......... .......... .......... .......... .......... 81% 311M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75850K .......... .......... .......... .......... .......... 81% 321M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75900K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 75950K .......... .......... .......... .......... .......... 81% 269M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76000K .......... .......... .......... .......... .......... 81% 304M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76050K .......... .......... .......... .......... .......... 81% 242M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76100K .......... .......... .......... .......... .......... 81% 278M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76150K .......... .......... .......... .......... .......... 82% 253M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76200K .......... .......... .......... .......... .......... 82% 255M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76250K .......... .......... .......... .......... .......... 82% 286M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76300K .......... .......... .......... .......... .......... 82% 285M 0s 2024-09-14T11:25:15.825 INFO:teuthology.orchestra.run.smithi029.stderr: 76350K .......... .......... .......... .......... .......... 82% 267M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76400K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76450K .......... .......... .......... .......... .......... 82% 327M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76500K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76550K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76600K .......... .......... .......... .......... .......... 82% 324M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76650K .......... .......... .......... .......... .......... 82% 86.6M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76700K .......... .......... .......... .......... .......... 82% 315M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76750K .......... .......... .......... .......... .......... 82% 264M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76800K .......... .......... .......... .......... .......... 82% 329M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76850K .......... .......... .......... .......... .......... 82% 201M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76900K .......... .......... .......... .......... .......... 82% 131M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 76950K .......... .......... .......... .......... .......... 82% 274M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 77000K .......... .......... .......... .......... .......... 82% 302M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 77050K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-14T11:25:15.826 INFO:teuthology.orchestra.run.smithi029.stderr: 77100K .......... .......... .......... .......... .......... 83% 243M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77150K .......... .......... .......... .......... .......... 83% 199M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77200K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77250K .......... .......... .......... .......... .......... 83% 279M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77300K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77350K .......... .......... .......... .......... .......... 83% 254M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77400K .......... .......... .......... .......... .......... 83% 96.4M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77450K .......... .......... .......... .......... .......... 83% 261M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77500K .......... .......... .......... .......... .......... 83% 222M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77550K .......... .......... .......... .......... .......... 83% 199M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77600K .......... .......... .......... .......... .......... 83% 298M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77650K .......... .......... .......... .......... .......... 83% 291M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77700K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77750K .......... .......... .......... .......... .......... 83% 286M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77800K .......... .......... .......... .......... .......... 83% 313M 0s 2024-09-14T11:25:15.827 INFO:teuthology.orchestra.run.smithi029.stderr: 77850K .......... .......... .......... .......... .......... 83% 306M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 77900K .......... .......... .......... .......... .......... 83% 309M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 77950K .......... .......... .......... .......... .......... 83% 191M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78000K .......... .......... .......... .......... .......... 84% 312M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78050K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78100K .......... .......... .......... .......... .......... 84% 306M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78150K .......... .......... .......... .......... .......... 84% 283M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78200K .......... .......... .......... .......... .......... 84% 292M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78250K .......... .......... .......... .......... .......... 84% 117M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78300K .......... .......... .......... .......... .......... 84% 337M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78350K .......... .......... .......... .......... .......... 84% 300M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78400K .......... .......... .......... .......... .......... 84% 378M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78450K .......... .......... .......... .......... .......... 84% 113M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78500K .......... .......... .......... .......... .......... 84% 350M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78550K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-14T11:25:15.828 INFO:teuthology.orchestra.run.smithi029.stderr: 78600K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78650K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78700K .......... .......... .......... .......... .......... 84% 352M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78750K .......... .......... .......... .......... .......... 84% 277M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78800K .......... .......... .......... .......... .......... 84% 193M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78850K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78900K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 78950K .......... .......... .......... .......... .......... 85% 305M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79000K .......... .......... .......... .......... .......... 85% 292M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79050K .......... .......... .......... .......... .......... 85% 343M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79100K .......... .......... .......... .......... .......... 85% 311M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79150K .......... .......... .......... .......... .......... 85% 297M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79200K .......... .......... .......... .......... .......... 85% 363M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79250K .......... .......... .......... .......... .......... 85% 361M 0s 2024-09-14T11:25:15.829 INFO:teuthology.orchestra.run.smithi029.stderr: 79300K .......... .......... .......... .......... .......... 85% 342M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79350K .......... .......... .......... .......... .......... 85% 166M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79400K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79450K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79500K .......... .......... .......... .......... .......... 85% 333M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79550K .......... .......... .......... .......... .......... 85% 309M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79600K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79650K .......... .......... .......... .......... .......... 85% 78.8M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79700K .......... .......... .......... .......... .......... 85% 344M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79750K .......... .......... .......... .......... .......... 85% 338M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79800K .......... .......... .......... .......... .......... 85% 180M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79850K .......... .......... .......... .......... .......... 86% 345M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79900K .......... .......... .......... .......... .......... 86% 370M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 79950K .......... .......... .......... .......... .......... 86% 144M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 80000K .......... .......... .......... .......... .......... 86% 265M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 80050K .......... .......... .......... .......... .......... 86% 298M 0s 2024-09-14T11:25:15.830 INFO:teuthology.orchestra.run.smithi029.stderr: 80100K .......... .......... .......... .......... .......... 86% 229M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80150K .......... .......... .......... .......... .......... 86% 311M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80200K .......... .......... .......... .......... .......... 86% 363M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80250K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80300K .......... .......... .......... .......... .......... 86% 217M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80350K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80400K .......... .......... .......... .......... .......... 86% 294M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80450K .......... .......... .......... .......... .......... 86% 109M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80500K .......... .......... .......... .......... .......... 86% 350M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80550K .......... .......... .......... .......... .......... 86% 106M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80600K .......... .......... .......... .......... .......... 86% 300M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80650K .......... .......... .......... .......... .......... 86% 355M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80700K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80750K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-14T11:25:15.831 INFO:teuthology.orchestra.run.smithi029.stderr: 80800K .......... .......... .......... .......... .......... 87% 228M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 80850K .......... .......... .......... .......... .......... 87% 299M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 80900K .......... .......... .......... .......... .......... 87% 172M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 80950K .......... .......... .......... .......... .......... 87% 262M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81000K .......... .......... .......... .......... .......... 87% 293M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81050K .......... .......... .......... .......... .......... 87% 338M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81100K .......... .......... .......... .......... .......... 87% 361M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81150K .......... .......... .......... .......... .......... 87% 209M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81200K .......... .......... .......... .......... .......... 87% 337M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81250K .......... .......... .......... .......... .......... 87% 111M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81300K .......... .......... .......... .......... .......... 87% 291M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81350K .......... .......... .......... .......... .......... 87% 245M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81400K .......... .......... .......... .......... .......... 87% 363M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81450K .......... .......... .......... .......... .......... 87% 87.8M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81500K .......... .......... .......... .......... .......... 87% 302M 0s 2024-09-14T11:25:15.832 INFO:teuthology.orchestra.run.smithi029.stderr: 81550K .......... .......... .......... .......... .......... 87% 275M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81600K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81650K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81700K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81750K .......... .......... .......... .......... .......... 88% 280M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81800K .......... .......... .......... .......... .......... 88% 360M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81850K .......... .......... .......... .......... .......... 88% 370M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81900K .......... .......... .......... .......... .......... 88% 348M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 81950K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82000K .......... .......... .......... .......... .......... 88% 258M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82050K .......... .......... .......... .......... .......... 88% 344M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82100K .......... .......... .......... .......... .......... 88% 371M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82150K .......... .......... .......... .......... .......... 88% 333M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82200K .......... .......... .......... .......... .......... 88% 363M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82250K .......... .......... .......... .......... .......... 88% 358M 0s 2024-09-14T11:25:15.833 INFO:teuthology.orchestra.run.smithi029.stderr: 82300K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82350K .......... .......... .......... .......... .......... 88% 302M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82400K .......... .......... .......... .......... .......... 88% 348M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82450K .......... .......... .......... .......... .......... 88% 152M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82500K .......... .......... .......... .......... .......... 88% 339M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82550K .......... .......... .......... .......... .......... 88% 262M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82600K .......... .......... .......... .......... .......... 88% 378M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82650K .......... .......... .......... .......... .......... 89% 136M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82700K .......... .......... .......... .......... .......... 89% 120M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82750K .......... .......... .......... .......... .......... 89% 301M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82800K .......... .......... .......... .......... .......... 89% 360M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82850K .......... .......... .......... .......... .......... 89% 355M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82900K .......... .......... .......... .......... .......... 89% 374M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 82950K .......... .......... .......... .......... .......... 89% 313M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 83000K .......... .......... .......... .......... .......... 89% 148M 0s 2024-09-14T11:25:15.834 INFO:teuthology.orchestra.run.smithi029.stderr: 83050K .......... .......... .......... .......... .......... 89% 364M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83100K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83150K .......... .......... .......... .......... .......... 89% 299M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83200K .......... .......... .......... .......... .......... 89% 349M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83250K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83300K .......... .......... .......... .......... .......... 89% 362M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83350K .......... .......... .......... .......... .......... 89% 336M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83400K .......... .......... .......... .......... .......... 89% 224M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83450K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83500K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83550K .......... .......... .......... .......... .......... 89% 80.0M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83600K .......... .......... .......... .......... .......... 90% 285M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83650K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83700K .......... .......... .......... .......... .......... 90% 276M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83750K .......... .......... .......... .......... .......... 90% 298M 0s 2024-09-14T11:25:15.835 INFO:teuthology.orchestra.run.smithi029.stderr: 83800K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 83850K .......... .......... .......... .......... .......... 90% 227M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 83900K .......... .......... .......... .......... .......... 90% 134M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 83950K .......... .......... .......... .......... .......... 90% 295M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84000K .......... .......... .......... .......... .......... 90% 300M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84050K .......... .......... .......... .......... .......... 90% 348M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84100K .......... .......... .......... .......... .......... 90% 182M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84150K .......... .......... .......... .......... .......... 90% 269M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84200K .......... .......... .......... .......... .......... 90% 301M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84250K .......... .......... .......... .......... .......... 90% 322M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84300K .......... .......... .......... .......... .......... 90% 211M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84350K .......... .......... .......... .......... .......... 90% 244M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84400K .......... .......... .......... .......... .......... 90% 53.5M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84450K .......... .......... .......... .......... .......... 90% 267M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84500K .......... .......... .......... .......... .......... 91% 280M 0s 2024-09-14T11:25:15.836 INFO:teuthology.orchestra.run.smithi029.stderr: 84550K .......... .......... .......... .......... .......... 91% 273M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84600K .......... .......... .......... .......... .......... 91% 324M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84650K .......... .......... .......... .......... .......... 91% 315M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84700K .......... .......... .......... .......... .......... 91% 319M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84750K .......... .......... .......... .......... .......... 91% 192M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84800K .......... .......... .......... .......... .......... 91% 311M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84850K .......... .......... .......... .......... .......... 91% 325M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84900K .......... .......... .......... .......... .......... 91% 321M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 84950K .......... .......... .......... .......... .......... 91% 284M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85000K .......... .......... .......... .......... .......... 91% 282M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85050K .......... .......... .......... .......... .......... 91% 244M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85100K .......... .......... .......... .......... .......... 91% 279M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85150K .......... .......... .......... .......... .......... 91% 225M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85200K .......... .......... .......... .......... .......... 91% 271M 0s 2024-09-14T11:25:15.837 INFO:teuthology.orchestra.run.smithi029.stderr: 85250K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85300K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85350K .......... .......... .......... .......... .......... 91% 269M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85400K .......... .......... .......... .......... .......... 91% 321M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85450K .......... .......... .......... .......... .......... 92% 311M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85500K .......... .......... .......... .......... .......... 92% 310M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85550K .......... .......... .......... .......... .......... 92% 284M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85600K .......... .......... .......... .......... .......... 92% 334M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85650K .......... .......... .......... .......... .......... 92% 318M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85700K .......... .......... .......... .......... .......... 92% 308M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85750K .......... .......... .......... .......... .......... 92% 154M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85800K .......... .......... .......... .......... .......... 92% 328M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85850K .......... .......... .......... .......... .......... 92% 294M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85900K .......... .......... .......... .......... .......... 92% 312M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 85950K .......... .......... .......... .......... .......... 92% 261M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 86000K .......... .......... .......... .......... .......... 92% 327M 0s 2024-09-14T11:25:15.838 INFO:teuthology.orchestra.run.smithi029.stderr: 86050K .......... .......... .......... .......... .......... 92% 324M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86100K .......... .......... .......... .......... .......... 92% 215M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86150K .......... .......... .......... .......... .......... 92% 283M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86200K .......... .......... .......... .......... .......... 92% 293M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86250K .......... .......... .......... .......... .......... 92% 328M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86300K .......... .......... .......... .......... .......... 92% 320M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86350K .......... .......... .......... .......... .......... 93% 268M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86400K .......... .......... .......... .......... .......... 93% 313M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86450K .......... .......... .......... .......... .......... 93% 324M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86500K .......... .......... .......... .......... .......... 93% 305M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86550K .......... .......... .......... .......... .......... 93% 288M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86600K .......... .......... .......... .......... .......... 93% 194M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86650K .......... .......... .......... .......... .......... 93% 267M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86700K .......... .......... .......... .......... .......... 93% 194M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86750K .......... .......... .......... .......... .......... 93% 203M 0s 2024-09-14T11:25:15.839 INFO:teuthology.orchestra.run.smithi029.stderr: 86800K .......... .......... .......... .......... .......... 93% 299M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 86850K .......... .......... .......... .......... .......... 93% 298M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 86900K .......... .......... .......... .......... .......... 93% 271M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 86950K .......... .......... .......... .......... .......... 93% 135M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87000K .......... .......... .......... .......... .......... 93% 267M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87050K .......... .......... .......... .......... .......... 93% 187M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87100K .......... .......... .......... .......... .......... 93% 246M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87150K .......... .......... .......... .......... .......... 93% 238M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87200K .......... .......... .......... .......... .......... 93% 251M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87250K .......... .......... .......... .......... .......... 93% 334M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87300K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87350K .......... .......... .......... .......... .......... 94% 279M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87400K .......... .......... .......... .......... .......... 94% 323M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87450K .......... .......... .......... .......... .......... 94% 328M 0s 2024-09-14T11:25:15.840 INFO:teuthology.orchestra.run.smithi029.stderr: 87500K .......... .......... .......... .......... .......... 94% 59.5M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87550K .......... .......... .......... .......... .......... 94% 71.7M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87600K .......... .......... .......... .......... .......... 94% 200M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87650K .......... .......... .......... .......... .......... 94% 313M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87700K .......... .......... .......... .......... .......... 94% 304M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87750K .......... .......... .......... .......... .......... 94% 277M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87800K .......... .......... .......... .......... .......... 94% 317M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87850K .......... .......... .......... .......... .......... 94% 287M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87900K .......... .......... .......... .......... .......... 94% 314M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 87950K .......... .......... .......... .......... .......... 94% 251M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 88000K .......... .......... .......... .......... .......... 94% 308M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 88050K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 88100K .......... .......... .......... .......... .......... 94% 312M 0s 2024-09-14T11:25:15.841 INFO:teuthology.orchestra.run.smithi029.stderr: 88150K .......... .......... .......... .......... .......... 94% 282M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88200K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88250K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88300K .......... .......... .......... .......... .......... 95% 312M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88350K .......... .......... .......... .......... .......... 95% 261M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88400K .......... .......... .......... .......... .......... 95% 322M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88450K .......... .......... .......... .......... .......... 95% 324M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88500K .......... .......... .......... .......... .......... 95% 310M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88550K .......... .......... .......... .......... .......... 95% 240M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88600K .......... .......... .......... .......... .......... 95% 276M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88650K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88700K .......... .......... .......... .......... .......... 95% 304M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88750K .......... .......... .......... .......... .......... 95% 227M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88800K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-14T11:25:15.842 INFO:teuthology.orchestra.run.smithi029.stderr: 88850K .......... .......... .......... .......... .......... 95% 325M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 88900K .......... .......... .......... .......... .......... 95% 317M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 88950K .......... .......... .......... .......... .......... 95% 114M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89000K .......... .......... .......... .......... .......... 95% 299M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89050K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89100K .......... .......... .......... .......... .......... 95% 322M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89150K .......... .......... .......... .......... .......... 96% 259M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89200K .......... .......... .......... .......... .......... 96% 296M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89250K .......... .......... .......... .......... .......... 96% 308M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89300K .......... .......... .......... .......... .......... 96% 319M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89350K .......... .......... .......... .......... .......... 96% 265M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89400K .......... .......... .......... .......... .......... 96% 323M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89450K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89500K .......... .......... .......... .......... .......... 96% 311M 0s 2024-09-14T11:25:15.843 INFO:teuthology.orchestra.run.smithi029.stderr: 89550K .......... .......... .......... .......... .......... 96% 273M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89600K .......... .......... .......... .......... .......... 96% 316M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89650K .......... .......... .......... .......... .......... 96% 328M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89700K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89750K .......... .......... .......... .......... .......... 96% 248M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89800K .......... .......... .......... .......... .......... 96% 279M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89850K .......... .......... .......... .......... .......... 96% 310M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89900K .......... .......... .......... .......... .......... 96% 335M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 89950K .......... .......... .......... .......... .......... 96% 203M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90000K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90050K .......... .......... .......... .......... .......... 96% 216M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90100K .......... .......... .......... .......... .......... 97% 315M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90150K .......... .......... .......... .......... .......... 97% 271M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90200K .......... .......... .......... .......... .......... 97% 307M 0s 2024-09-14T11:25:15.844 INFO:teuthology.orchestra.run.smithi029.stderr: 90250K .......... .......... .......... .......... .......... 97% 337M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90300K .......... .......... .......... .......... .......... 97% 236M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90350K .......... .......... .......... .......... .......... 97% 127M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90400K .......... .......... .......... .......... .......... 97% 307M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90450K .......... .......... .......... .......... .......... 97% 74.1M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90500K .......... .......... .......... .......... .......... 97% 297M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90550K .......... .......... .......... .......... .......... 97% 291M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90600K .......... .......... .......... .......... .......... 97% 148M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90650K .......... .......... .......... .......... .......... 97% 299M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90700K .......... .......... .......... .......... .......... 97% 147M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90750K .......... .......... .......... .......... .......... 97% 158M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90800K .......... .......... .......... .......... .......... 97% 320M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90850K .......... .......... .......... .......... .......... 97% 107M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90900K .......... .......... .......... .......... .......... 97% 142M 0s 2024-09-14T11:25:15.845 INFO:teuthology.orchestra.run.smithi029.stderr: 90950K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91000K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91050K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91100K .......... .......... .......... .......... .......... 98% 297M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91150K .......... .......... .......... .......... .......... 98% 285M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91200K .......... .......... .......... .......... .......... 98% 395M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91250K .......... .......... .......... .......... .......... 98% 389M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91300K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91350K .......... .......... .......... .......... .......... 98% 321M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91400K .......... .......... .......... .......... .......... 98% 370M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91450K .......... .......... .......... .......... .......... 98% 295M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91500K .......... .......... .......... .......... .......... 98% 313M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91550K .......... .......... .......... .......... .......... 98% 260M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91600K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91650K .......... .......... .......... .......... .......... 98% 282M 0s 2024-09-14T11:25:15.846 INFO:teuthology.orchestra.run.smithi029.stderr: 91700K .......... .......... .......... .......... .......... 98% 234M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 91750K .......... .......... .......... .......... .......... 98% 288M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 91800K .......... .......... .......... .......... .......... 98% 332M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 91850K .......... .......... .......... .......... .......... 98% 182M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 91900K .......... .......... .......... .......... .......... 98% 312M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 91950K .......... .......... .......... .......... .......... 99% 93.4M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92000K .......... .......... .......... .......... .......... 99% 251M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92050K .......... .......... .......... .......... .......... 99% 281M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92100K .......... .......... .......... .......... .......... 99% 316M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92150K .......... .......... .......... .......... .......... 99% 280M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92200K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92250K .......... .......... .......... .......... .......... 99% 306M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92300K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-14T11:25:15.847 INFO:teuthology.orchestra.run.smithi029.stderr: 92350K .......... .......... .......... .......... .......... 99% 253M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92400K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92450K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92500K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92550K .......... .......... .......... .......... .......... 99% 283M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92600K .......... .......... .......... .......... .......... 99% 328M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92650K .......... .......... .......... .......... .......... 99% 315M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92700K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92750K .......... .......... .......... .......... .......... 99% 269M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92800K .......... .......... .......... .......... .......... 99% 310M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92850K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 92900K 100% 134G=0.4s 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14 11:25:14 (206 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:25:15.848 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T11:25:15.888 INFO:teuthology.orchestra.run.smithi029.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:25:15.888 INFO:teuthology.orchestra.run.smithi029.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:25:15.888 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:25:15.888 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:25:15.889 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:25:15.890 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:25:15.891 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:25:15.892 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:25:15.893 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:25:15.894 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:25:15.895 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:25:15.896 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:25:15.897 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:25:15.898 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:25:15.899 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:25:15.900 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:25:15.901 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:25:15.902 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:25:15.903 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.904 INFO:teuthology.orchestra.run.smithi029.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout:Here are the highlights of this release: 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Advanced control of transitive versions 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Support for optional features and dependencies 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Rules to tweak published metadata 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Support for Java 13 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - New Zinc compiler for Scala 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - VS2019 support 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.905 INFO:teuthology.orchestra.run.smithi029.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:------------------------------------------------------------ 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Gradle 6.0.1 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:------------------------------------------------------------ 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Kotlin: 1.3.50 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Groovy: 2.5.8 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:25:15.906 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:15.907 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:25:15.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:25:15.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T11:25:15.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:25:15.907 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T11:25:15.907 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:25:16.182 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:25:16.182 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:25:16.182 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ZQUXJQZVYWEFBETKFEMN', 'access_secret': 'wAh5vz4G6HfC7q5zSaWdyzLSGU0+EFsE0+tlcpuFpxHlDax4I5h0qg==', 'region': 'mexico', 'endpoint': 'smithi029.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi029.front.sepia.ceph.com'} 2024-09-14T11:25:16.183 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:25:16.183 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ZQUXJQZVYWEFBETKFEMN', '--secret', 'wAh5vz4G6HfC7q5zSaWdyzLSGU0+EFsE0+tlcpuFpxHlDax4I5h0qg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:25:16.183 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ZQUXJQZVYWEFBETKFEMN --secret wAh5vz4G6HfC7q5zSaWdyzLSGU0+EFsE0+tlcpuFpxHlDax4I5h0qg== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:25:16.249 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:16.250 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:16.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.288+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.289+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.289+0000 7fa114b2e800 20 realm 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.289+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.290+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.290+0000 7fa114b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.290+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.290+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.290+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.291+0000 7fa114b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.291+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.291+0000 7fa114b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:16.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.291+0000 7fa114b2e800 20 searching for the correct realm 2024-09-14T11:25:16.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.293+0000 7fa1080dc640 0 -- 172.21.15.29:0/148822310 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fa100019030 msgr2=0x7fa100060250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.297+0000 7fa1110de640 0 -- 172.21.15.29:0/148822310 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55e67b553fc0 msgr2=0x55e67b5563b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.304+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 zone default found 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 4 Realm: () 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 zonegroup default 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.305+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.306+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.306+0000 7fa114b2e800 20 started sync module instance, tier type = 2024-09-14T11:25:16.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.306+0000 7fa114b2e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:25:16.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.315+0000 7fa114b2e800 20 add_watcher() i=0 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=1 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=2 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=3 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=4 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=5 2024-09-14T11:25:16.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=6 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 20 add_watcher() i=7 2024-09-14T11:25:16.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.513+0000 7fa114b2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.514+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.514+0000 7fa114b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.514+0000 7fa114b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7fa114b2e800 5 note: GC not initialized 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7f9fc67e4640 20 reqs_thread_entry: start 2024-09-14T11:25:16.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7fa114b2e800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:16.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7fa114b2e800 20 Filter name: none 2024-09-14T11:25:16.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7f9fbffff640 20 reqs_thread_entry: start 2024-09-14T11:25:16.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7fa114b2e800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:25:16.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.515+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache get: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN : miss 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN info.flags=0x0 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 adding default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN to cache LRU end 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache get: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN : hit (negative entry) 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.516+0000 7fa114b2e800 10 cache get: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN : hit (negative entry) 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7fa114b2e800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7fa114b2e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7f9fe7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497103 cookie 94448400067568 notifier 8727 bl.length()=670 2024-09-14T11:25:16.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7f9fe7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:25:16.517 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.518+0000 7f9fe7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7fa114b2e800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7fa114b2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7f9fe77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497010 cookie 94448400062576 notifier 8727 bl.length()=200 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7f9fe77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:25:16.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.521+0000 7f9fe77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7fa114b2e800 10 cache put: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN info.flags=0x7 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7fa114b2e800 10 moving default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN to cache LRU end 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7fa114b2e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:ZQUXJQZVYWEFBETKFEMN, ofs0, ns] 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7f9fe77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497031 cookie 94448400028016 notifier 8727 bl.length()=189 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7f9fe77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN info.flags=0x7 2024-09-14T11:25:16.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.524+0000 7f9fe77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZQUXJQZVYWEFBETKFEMN to cache LRU end 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "tester.client.0", 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "tester.client.0", 2024-09-14T11:25:16.525 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "ZQUXJQZVYWEFBETKFEMN", 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "wAh5vz4G6HfC7q5zSaWdyzLSGU0+EFsE0+tlcpuFpxHlDax4I5h0qg==", 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:25:16.517587Z" 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:25:16.526 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:25:16.527 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:25:16.517575Z", 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:16.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.528+0000 7f9fc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.531+0000 7fa114b2e800 20 remove_watcher() i=0 2024-09-14T11:25:16.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.531+0000 7fa114b2e800 2 removed watcher, disabling cache 2024-09-14T11:25:16.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.532+0000 7fa114b2e800 20 remove_watcher() i=1 2024-09-14T11:25:16.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.533+0000 7fa114b2e800 20 remove_watcher() i=2 2024-09-14T11:25:16.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.534+0000 7fa114b2e800 20 remove_watcher() i=3 2024-09-14T11:25:16.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.535+0000 7fa114b2e800 20 remove_watcher() i=4 2024-09-14T11:25:16.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.536+0000 7fa114b2e800 20 remove_watcher() i=5 2024-09-14T11:25:16.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.537+0000 7fa114b2e800 20 remove_watcher() i=6 2024-09-14T11:25:16.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.538+0000 7fa114b2e800 20 remove_watcher() i=7 2024-09-14T11:25:16.548 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:25:16.548 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:25:16.580 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:25:16.580 DEBUG:teuthology.orchestra.run.smithi029:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:25:16.647 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:25:16.739 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:16.739 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:16.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.781+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 realm 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.783+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.784+0000 7f0eb132f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:16.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.784+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.785+0000 7f0eb132f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:16.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.785+0000 7f0eb132f800 20 searching for the correct realm 2024-09-14T11:25:16.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.786+0000 7f0ead076640 0 -- 172.21.15.29:0/467606575 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55987edf40b0 msgr2=0x55987edf6570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:16.790+0000 7f0ead076640 0 -- 172.21.15.29:0/467606575 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x55987eb70c50 msgr2=0x7f0ea8081400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:16.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:16.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.000+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:17.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:17.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 zone default found 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 4 Realm: () 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 zonegroup default 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.001+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.002+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.002+0000 7f0eb132f800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.002+0000 7f0eb132f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.002+0000 7f0eb132f800 20 started sync module instance, tier type = 2024-09-14T11:25:17.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.002+0000 7f0eb132f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:25:17.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=0 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=1 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=2 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=3 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=4 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=5 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.011+0000 7f0eb132f800 20 add_watcher() i=6 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.012+0000 7f0eb132f800 20 add_watcher() i=7 2024-09-14T11:25:17.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.012+0000 7f0eb132f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:17.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.014+0000 7f0d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:17.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.014+0000 7f0eb132f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:17.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.014+0000 7f0eb132f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.052+0000 7f0d627e4640 20 reqs_thread_entry: start 2024-09-14T11:25:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.052+0000 7f0eb132f800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.052+0000 7f0eb132f800 20 Filter name: none 2024-09-14T11:25:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.052+0000 7f0cd3fff640 20 reqs_thread_entry: start 2024-09-14T11:25:17.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.052+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:25:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.053+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.054+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7918321075621213498', time=2024-09-14T13:15:49.319774+0000, chain.objs.size()=2 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_0 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_1 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5495945802242454997', time=2024-09-14T13:17:16.341516+0000, chain.objs.size()=1 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.5AKmlrdvONYP-v6cE3XL2jmUtYc0na1_0 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16970214069560831273', time=2024-09-14T13:17:16.439512+0000, chain.objs.size()=1 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.rYxqqMst6ZL1fLoUVI9i-JJi-pebwwL_0 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10070998484472632298', time=2024-09-14T13:17:50.894445+0000, chain.objs.size()=1 2024-09-14T11:25:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.JdVdwGU36qik994QhkYHtuX5_tMIDyP_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7321348271679978551', time=2024-09-14T13:17:50.930255+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.URFQQh6ayF6MpOHfFm0cKxO7nDstQsA_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15951672547006832216', time=2024-09-14T13:17:56.604120+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.ktocdsJ20q2hyo1dGZ-45_FRufSuBDU_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2006243035915634484', time=2024-09-14T13:17:59.305459+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.yDsb04wIXwsCE22u8HnTVCkWOO8NRnS_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.57790693199083200', time=2024-09-14T13:18:31.023035+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.br0H7XuD4Lr0X5YcR4ue2I2JTt_TbTB_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5738182283532863552', time=2024-09-14T13:18:36.747675+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.UnalJhzAtBExX4dRm1gs5AsBNBqmuFE_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11501268159150475888', time=2024-09-14T13:19:10.563738+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.W9GkZDQd2TBW_LHBKiVrC3vJToeW44L_0 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4682793507966445626', time=2024-09-14T13:19:17.124265+0000, chain.objs.size()=1 2024-09-14T11:25:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.055+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.o2zzxxBjNXbrjHtnSPRByouftwJgao7_0 2024-09-14T11:25:17.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.057+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11994948551399089626', time=2024-09-14T13:19:48.228133+0000, chain.objs.size()=1 2024-09-14T11:25:17.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.057+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.C2-fDDNDVuOodHKPmIC--vMlUTU96b2_0 2024-09-14T11:25:17.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7763443310728868119', time=2024-09-14T13:19:52.187380+0000, chain.objs.size()=1 2024-09-14T11:25:17.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.CESbY6TH1bxJ9umfbSDfqh8gCK9htYl_0 2024-09-14T11:25:17.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2840948136516883266', time=2024-09-14T13:20:28.400429+0000, chain.objs.size()=1 2024-09-14T11:25:17.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.UhRDeEl-oCiCuIDKdFlIj6fJQio0sRL_0 2024-09-14T11:25:17.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5287034973871407059', time=2024-09-14T13:20:28.449780+0000, chain.objs.size()=1 2024-09-14T11:25:17.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.058+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.NPe8qoWNFWEUrPEdWQ7d32XIcSqkTCU_0 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14844461241848142635', time=2024-09-14T13:21:06.280669+0000, chain.objs.size()=1 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.IMUSDw_uEUviIXx6PAe_6UWZR73-G5j_0 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17610905206686827708', time=2024-09-14T13:21:06.281539+0000, chain.objs.size()=1 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.d7Z_BZ_EZyO-gQSivfUgdjzJshz19o__0 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12040365999827368268', time=2024-09-14T13:21:10.546475+0000, chain.objs.size()=1 2024-09-14T11:25:17.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.FkzEz12GWDTNAi3splfD9C9aesdT72m_0 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9239420563293724717', time=2024-09-14T13:21:44.350798+0000, chain.objs.size()=1 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.061+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.QyAask3gB6ADNCCeXHAiyZeOIhaXrON_0 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17602700717713144729', time=2024-09-14T13:21:44.440944+0000, chain.objs.size()=1 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.LDcJNJNJ1lStMo2JRIGYDU4bTO7aAee_0 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2530628028863048390', time=2024-09-14T13:21:48.044139+0000, chain.objs.size()=1 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.V2vh6hYo7LM3ADgDsA2BQNoktgZ0T_F_0 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2619950683818008127', time=2024-09-14T13:21:50.774757+0000, chain.objs.size()=1 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.JVsgWxNZhUzzZNRsaSWkrhWk2WPT5Xh_0 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15552761281034908858', time=2024-09-14T13:22:25.178560+0000, chain.objs.size()=1 2024-09-14T11:25:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.062+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.MlKxvfsI07XMN_L63aDNK1ENFSGPmGP_0 2024-09-14T11:25:17.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.067+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.070+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:25:17.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.071+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_85UOsX_ANaL_FJEXg-japepLBNAMO91', time=2024-09-14T13:15:49.392202+0000, chain.objs.size()=3 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_0 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_1 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.feMCyRArjN9ng2Gsgt-VpL4TZJTpe_T_2 2024-09-14T11:25:17.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.804531901037094335', time=2024-09-14T13:15:49.425527+0000, chain.objs.size()=5 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1_1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2_1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.3 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7035326053608090197', time=2024-09-14T13:17:13.719827+0000, chain.objs.size()=1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.yQ4erLGMOvY2ev9Ks5O7hQFWvzpy6cu_0 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10154730721150479996', time=2024-09-14T13:17:13.745122+0000, chain.objs.size()=1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.SqvHqOBu-8xPHVPU_tqdpNA_RwPEaDd_0 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4742745486424054275', time=2024-09-14T13:17:16.401084+0000, chain.objs.size()=1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.qy8miyH1-x5h2hTznh759-gOGB3E6aU_0 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15545875058836872136', time=2024-09-14T13:17:50.946975+0000, chain.objs.size()=1 2024-09-14T11:25:17.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.072+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.0C_uKj1h89MZHnGyLEBJriwup6exVQb_0 2024-09-14T11:25:17.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.295251951679406646', time=2024-09-14T13:18:31.020635+0000, chain.objs.size()=1 2024-09-14T11:25:17.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.BX-Vk_YeEgSzjgAZYApURaYapl7ELoU_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3625838652662056636', time=2024-09-14T13:18:31.022263+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.tzyTvTFW5tfYZ0wiIQV4zmbUTtZq7RX_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16105034844451916448', time=2024-09-14T13:18:34.238880+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.075+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.-ayZhNyY-LRCPQfeSxDbrxUE2WnObkR_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13261977239714921363', time=2024-09-14T13:18:34.288484+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.iVemZBy8Sf646H3UnbmVYjpY8DwQ00M_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16750611542961289938', time=2024-09-14T13:18:36.796345+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.gDAtlBPfZJe-MIMHQqYQIQRn9-snFaU_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2448454256886548611', time=2024-09-14T13:19:10.563814+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.LS4pcVK3eNdG1hGgtX2OaFiBRBVN9Lk_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7013429509770341794', time=2024-09-14T13:21:06.279013+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.kPbd6LvAwVcdt2A0ocNjmJOInGlrm3r_0 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14059070205624871296', time=2024-09-14T13:21:10.585202+0000, chain.objs.size()=1 2024-09-14T11:25:17.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.6azG0oIjcHzc2Rrp2Bqp-Acdf7cAxe5_0 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2108565679353639535', time=2024-09-14T13:21:48.086067+0000, chain.objs.size()=1 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.59yYCSBHAekwHUG4my6MgSvkPoJZuTs_0 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15266369007832443191', time=2024-09-14T13:21:50.723791+0000, chain.objs.size()=1 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.rDtidQH5PgHwfdOn7R-T8pwS_8GvzT4_0 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7561712091772744857', time=2024-09-14T13:21:50.724261+0000, chain.objs.size()=1 2024-09-14T11:25:17.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.076+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.gphac8E1Hb7K9peJmwzHq9m91stZ5XY_0 2024-09-14T11:25:17.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.081+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16604171831339396271', time=2024-09-14T13:22:25.210112+0000, chain.objs.size()=1 2024-09-14T11:25:17.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.081+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.rP38ObpALbWInCHiEr1JZ1-VjGEIILT_0 2024-09-14T11:25:17.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.083+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.086+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:25:17.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.087+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.087+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3763186178080446661', time=2024-09-14T13:15:49.215585+0000, chain.objs.size()=4 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.1 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.2 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.3 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.12__multipart_foo.2~7FLO_BGIPXSeaJPT6-8XsC9axlbW7DF.4 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4231189482941097845', time=2024-09-14T13:15:49.581744+0000, chain.objs.size()=1 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.5LDEHGqBKUMkC20_FlBCwA7tPbDJhbS_0 2024-09-14T11:25:17.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9878507661463759667', time=2024-09-14T13:18:31.026851+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.r91Tj4SceDbnDAK2K0m76vtj4cie7oM_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16015078545865760466', time=2024-09-14T13:18:36.752575+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.PpAXIu-IrQLsGVFr-ATzFS8LmJF9kom_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14819785750819010152', time=2024-09-14T13:19:13.285301+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.igAfLe6g3Qvig-E1vtwgBZKZX6uWNn7_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5574072135017440879', time=2024-09-14T13:20:27.242015+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.KszuUaJZPivKnKvHRzGUK0x_lBuEI28_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5527430132438283994', time=2024-09-14T13:20:32.148122+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.dSY_0hRYlaImMXGhCe-g1Q-phZ3aDT4_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6348564786831103030', time=2024-09-14T13:20:32.148936+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.y67exCnhC0d2j_aPKzlEKiTdxzT-l6O_0 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14485310643968370468', time=2024-09-14T13:21:10.585507+0000, chain.objs.size()=1 2024-09-14T11:25:17.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.088+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.tVoBzep2k_227RRij6nzc_D3a2KQMe1_0 2024-09-14T11:25:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.091+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1461950773897696424', time=2024-09-14T13:21:44.398311+0000, chain.objs.size()=1 2024-09-14T11:25:17.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.091+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.47-wY8RuPtF_4CRmUfh6HEQU4PVtsBu_0 2024-09-14T11:25:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.093+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4863695059162420850', time=2024-09-14T13:24:36.850057+0000, chain.objs.size()=1 2024-09-14T11:25:17.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.093+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.g7J7_8Q461Qg2Zq0Ujh4tumG38dasSc_0 2024-09-14T11:25:17.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.095+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.098+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:25:17.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.099+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:25:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.105814988132408890', time=2024-09-14T13:15:49.590284+0000, chain.objs.size()=1 2024-09-14T11:25:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.NKA1BnfKa9CzB7NnvBJQFOR4_9JXb2X_0 2024-09-14T11:25:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18293834157972679800', time=2024-09-14T13:17:50.945899+0000, chain.objs.size()=1 2024-09-14T11:25:17.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.nk9JwLHz3ePn9ynhJXLieE37txG8Ovh_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11787139343515487946', time=2024-09-14T13:18:31.063707+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_._dbf1DailZVpfzugCTo1OdpAcYMeUgC_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16965020496482464528', time=2024-09-14T13:18:34.288914+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.KvzbsIPOrrGpyN_aQg4ijqo_zhGG02y_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5415954221441407428', time=2024-09-14T13:19:14.668136+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.6Y0ebNkQdzSiT89P0DSODBoFWsNxuWY_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12500834921755724205', time=2024-09-14T13:19:52.096842+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.tEJph_HrbwTJ4hxjc28laRjZNUGcwGI_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11476227358966767222', time=2024-09-14T13:19:52.098011+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.eeSGdrxkgw5-FV6945B5xPqXIXXZEIQ_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4219197898393318612', time=2024-09-14T13:19:52.136373+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.U3V6SvUDf-oXQs0Tni5dp7g0uTeHUY-_0 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.744445607163635995', time=2024-09-14T13:19:52.136907+0000, chain.objs.size()=1 2024-09-14T11:25:17.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.100+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.WULdcP6MPXNKsIk6Q1eEiZ3ooUieUqe_0 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7839040583760198713', time=2024-09-14T13:20:28.399565+0000, chain.objs.size()=1 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.1TyENtkmPAipz6cqhVLomhpUVZaTQxC_0 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14301163306900018047', time=2024-09-14T13:21:48.037856+0000, chain.objs.size()=1 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.OIUOQ_1iITkYTo0B6VMPt6Y9lmJIGWI_0 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7258964571084247292', time=2024-09-14T13:22:25.205162+0000, chain.objs.size()=1 2024-09-14T11:25:17.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.101+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.BNxCK5ueNln3D4QNxOPp96iSj6Q1Wgr_0 2024-09-14T11:25:17.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.107+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.109+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:25:17.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.110+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6046111185939639375', time=2024-09-14T13:15:49.556099+0000, chain.objs.size()=1 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.phtYHUKEtK8D9jt2EWVGBtsnXuRnnV5_0 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18015193903988435018', time=2024-09-14T13:17:50.886320+0000, chain.objs.size()=1 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.Wj8wBQigMKcn49sUL-qYKCVq1ESgz5k_0 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8632445058726852339', time=2024-09-14T13:17:56.609412+0000, chain.objs.size()=1 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.KwiRS6VyXNaRQmiIaImYtQW4KLufjMd_0 2024-09-14T11:25:17.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3060463246962984783', time=2024-09-14T13:18:34.264903+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.OmyZxPPy-DWC5xCRO8Sky0KXyAHqY-o_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.826583286100022203', time=2024-09-14T13:19:10.617271+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.m2cXAtdX1T7V3eK0821QNYJhhAPHR_H_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14194081529725321763', time=2024-09-14T13:19:14.616169+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.0Ts2DK2oxsifwWQSLE44NzmTwAkzbe7_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5515112933134301830', time=2024-09-14T13:19:14.690696+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.tdFNBVNiDVtxNgv4gtfz-iS5CFzdxJi_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3295111739414790305', time=2024-09-14T13:19:48.216226+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.SwyXOuOcDt8r7g2RAr4g1yzU4ETlhEo_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6088764483454671913', time=2024-09-14T13:19:48.229490+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.R5fGwn2NTeRL-w8SJ2xSYin4e-UMr9v_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11624837794111677273', time=2024-09-14T13:20:28.454308+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.Js6CmJ8tl8vqQPaYcvxcit8mlgQpqoX_0 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13947093583422339638', time=2024-09-14T13:21:06.269337+0000, chain.objs.size()=1 2024-09-14T11:25:17.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.19KnOqFTWQpfVUWVzbxw0dIYdLpYttr_0 2024-09-14T11:25:17.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12143890060246370940', time=2024-09-14T13:21:10.566889+0000, chain.objs.size()=1 2024-09-14T11:25:17.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.111+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.SCbkC5XYGDzMm9mT6wJFikD6IUv8Vy__0 2024-09-14T11:25:17.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.116+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12787551617851641388', time=2024-09-14T13:21:44.398412+0000, chain.objs.size()=1 2024-09-14T11:25:17.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.116+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.juXfvCatYXVNfyGfbIqlKFkfSSZsT9L_0 2024-09-14T11:25:17.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.118+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.121+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:25:17.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.123+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.123+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6542947418151656858', time=2024-09-14T13:15:49.417537+0000, chain.objs.size()=5 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1_1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2_1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.3 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14349561374287221999', time=2024-09-14T13:17:50.915361+0000, chain.objs.size()=1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.n52lpgnjOLmgPquFkX38H-P6C90SKdq_0 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13708397183613887852', time=2024-09-14T13:17:54.119167+0000, chain.objs.size()=1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.hnlbftMPuZ-FrtkHFzKwIQhuN5W14Y4_0 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17932199531286268108', time=2024-09-14T13:17:56.613192+0000, chain.objs.size()=1 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.fBZVlfqSAWgI3SAvmMYdlTvsAWVm_k3_0 2024-09-14T11:25:17.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13837268801771357941', time=2024-09-14T13:18:36.729791+0000, chain.objs.size()=1 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.f5Lf5lOaSpx4B73l_bRn8piPgU1EIpD_0 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16892531670227023616', time=2024-09-14T13:19:14.619331+0000, chain.objs.size()=1 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.8OcuzU-hJZUyePYXgLbwpfv3ymeqzBZ_0 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.652301613358366764', time=2024-09-14T13:19:48.253343+0000, chain.objs.size()=1 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.MEh8c_96N_cSu41ziSr3zW0pTSHCeUS_0 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16201469479737534985', time=2024-09-14T13:20:28.449497+0000, chain.objs.size()=1 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.124+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.Syffkgb6wMS3OX-sZwnwFhOBe1wwwkO_0 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.126+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17002579667370107845', time=2024-09-14T13:21:50.721062+0000, chain.objs.size()=1 2024-09-14T11:25:17.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.126+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.FodYejh3miRlFfUKxrgWyOoNGNpJYjU_0 2024-09-14T11:25:17.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.129+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.131+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:25:17.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9122147305171069131', time=2024-09-14T13:15:49.169354+0000, chain.objs.size()=1 2024-09-14T11:25:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.ElJs2nfmjdtUTdZ7qQ_AzC0JZmCjwko_0 2024-09-14T11:25:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_qApoOVPhwqV2JWcuSFDjm3JbCEvXGy7', time=2024-09-14T13:15:49.384047+0000, chain.objs.size()=3 2024-09-14T11:25:17.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.tIxpSmeW0Hjis-D7KuUO5MeBDaPCMZ7_2 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12796860407393335969', time=2024-09-14T13:15:49.577720+0000, chain.objs.size()=1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.T3FNVeFEfXGTK6-Z4w6I-g0bNUTyWGz_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.125382099573645591', time=2024-09-14T13:17:16.358586+0000, chain.objs.size()=1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.5ig2_14dciyBjdKmUFJ1SQo5VSLTtvb_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15871844455415271537', time=2024-09-14T13:17:54.122264+0000, chain.objs.size()=1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.BWjVHoVwYjPILBpP1IqNCnd2c0ohet8_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1126651759170725601', time=2024-09-14T13:18:31.026838+0000, chain.objs.size()=1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.133+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.t0ebByGgboOhyCo8loyGx4uBsKXtXI5_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6375733089943727808', time=2024-09-14T13:18:34.239407+0000, chain.objs.size()=1 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.WcRqsFtGxyk7RZ1boKX6Ub_cnkl690B_0 2024-09-14T11:25:17.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8673520460956438214', time=2024-09-14T13:18:34.264941+0000, chain.objs.size()=1 2024-09-14T11:25:17.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.lKEN0y4Xpm4IPXwgo37Qh84uZ-brKyB_0 2024-09-14T11:25:17.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.804608500230752392', time=2024-09-14T13:18:36.752049+0000, chain.objs.size()=1 2024-09-14T11:25:17.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.t8xjtMi4TbLMfW1In8EYjXTw2fp_TpI_0 2024-09-14T11:25:17.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5345121506732895539', time=2024-09-14T13:19:10.575954+0000, chain.objs.size()=1 2024-09-14T11:25:17.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.134+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.9rLJk49ERAw9bwXsYNXioQm7C8t8a-s_0 2024-09-14T11:25:17.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5507073348572921074', time=2024-09-14T13:19:14.657554+0000, chain.objs.size()=1 2024-09-14T11:25:17.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.cT-7zrGfNCY3mcvLd8U2DXA_QFVKFgD_0 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7021147656463900704', time=2024-09-14T13:19:48.192869+0000, chain.objs.size()=1 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.TcFJnRzCSSN7P2zBKyAi03kR4bjGY0i_0 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1780027474945717075', time=2024-09-14T13:20:28.372720+0000, chain.objs.size()=1 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.HQsWTzWkKJtwNmryyTgLZU5I1D8yLid_0 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15785496339845471473', time=2024-09-14T13:21:06.269359+0000, chain.objs.size()=1 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.e07GNxhTkQefSP8P_qBxw0kTr8ZLVJ6_0 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.936541468331660613', time=2024-09-14T13:21:50.729265+0000, chain.objs.size()=1 2024-09-14T11:25:17.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.138+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.ukok44fYqC2S3SVpPi7bH3M8PKFIc-l_0 2024-09-14T11:25:17.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.142+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.144+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:25:17.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.146+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.146+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:25:17.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2352665798044786833', time=2024-09-14T13:18:31.020545+0000, chain.objs.size()=1 2024-09-14T11:25:17.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.9RltVa72hxYBLXvfBpLJvpX7CxFd7yp_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16123388396944594266', time=2024-09-14T13:18:34.290468+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.RLNKVRogczLR5o3xug9wv2vf-h6-V9G_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14333658293759105128', time=2024-09-14T13:19:10.625112+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.94sXwG8q88tVl3ZsydjGDETvWrwgQE9_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7167266849348149603', time=2024-09-14T13:19:14.656962+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.OvuFeprkXeCzvkiU0NvIUKIXUIg2pnv_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2299250954849027073', time=2024-09-14T13:20:28.412525+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.MUHIyjb8zo7v46kktj41yMVrSyAn5h3_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4846102963085417284', time=2024-09-14T13:21:48.059414+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.BNri5CDpUPJY3ooO8Vv4caqtYVYHFt0_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18282127847385110699', time=2024-09-14T13:21:50.719119+0000, chain.objs.size()=1 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.X6HTw90YYMyaMdi8H4ow8PgjE-gPCOJ_0 2024-09-14T11:25:17.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15250157032986650447', time=2024-09-14T13:21:50.723233+0000, chain.objs.size()=1 2024-09-14T11:25:17.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.FNnMYxh10Hy8z89n9BlSuFRL4U42jHK_0 2024-09-14T11:25:17.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16379492985186238797', time=2024-09-14T13:21:50.775068+0000, chain.objs.size()=1 2024-09-14T11:25:17.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.147+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.WwHEWcDu71Mgn-0HghZdOqxZN0Q3V2o_0 2024-09-14T11:25:17.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.151+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.153+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:25:17.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17953305889447298831', time=2024-09-14T13:17:13.673271+0000, chain.objs.size()=1 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.qXVdRXgthyJQgDUfMSUrK7meUzWry_y_0 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6914230107238847142', time=2024-09-14T13:17:13.687098+0000, chain.objs.size()=1 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.YSckfuv5LENVqmwZlqqlwEMFSXgNZrJ_0 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8842416359329166602', time=2024-09-14T13:17:13.722213+0000, chain.objs.size()=1 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.j3Tlr8VAdY5MI1fDVnKQDb8aucvfMde_0 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.288383469982612157', time=2024-09-14T13:17:16.351565+0000, chain.objs.size()=1 2024-09-14T11:25:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.5OHOpKPu7H0qVY7saSpzQMLKG00iDaK_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10618962570682834125', time=2024-09-14T13:17:16.380795+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.155+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.YSUcdX7j2X_FuzurouKhfGi48-gfIO3_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2795507720571276595', time=2024-09-14T13:17:16.404731+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.koGWNvBv25N5f4K5sVdgKno_dln9xpJ_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8163299726010231249', time=2024-09-14T13:17:56.583298+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.kan3dFmJcFFyrKgUr8B-ES8hdTnDAkK_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2281794877155715621', time=2024-09-14T13:17:56.584011+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.H4YuFbuJzwZ3xjDG5dbdsGqtlr7kcZ0_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8240306809466552196', time=2024-09-14T13:18:36.767640+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.90xDohYkzcS1KxrZ6HTDP0JuWgRsiWo_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8323883723879118957', time=2024-09-14T13:18:36.768354+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.TGF9YHYi7oCpqrHty3ynkbSyiLrh_v8_0 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4741401189795400399', time=2024-09-14T13:18:36.777958+0000, chain.objs.size()=1 2024-09-14T11:25:17.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.tmWYM71lYB1lMkQSEdrQ4hfUOYKYFhF_0 2024-09-14T11:25:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.953232986471126422', time=2024-09-14T13:19:10.587465+0000, chain.objs.size()=1 2024-09-14T11:25:17.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.156+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.lCed-HQqCV_kM45LXhel_ZjNeJytd9m_0 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1578333757790004552', time=2024-09-14T13:19:54.374594+0000, chain.objs.size()=1 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.hcihqvZaC7jaGRq5214hMqaAjB9m6Vx_0 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3554990067925197077', time=2024-09-14T13:20:32.101140+0000, chain.objs.size()=1 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.6qtLKNypooKP-OsKZHYvI6i0T84UFYy_0 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13418602404250985954', time=2024-09-14T13:21:06.316423+0000, chain.objs.size()=1 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.m0REyfFVon-P4ZMIcohSJU3g4ZIGOcq_0 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10142686580824114494', time=2024-09-14T13:21:06.338050+0000, chain.objs.size()=1 2024-09-14T11:25:17.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.160+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.7DAC68mhlRNLM_dpturFU4ulN5TckeH_0 2024-09-14T11:25:17.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8496241818187408323', time=2024-09-14T13:21:44.407416+0000, chain.objs.size()=1 2024-09-14T11:25:17.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.Fe1XeoPPGeTvcyy42Z_rLXvceiJH-VB_0 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3162218086986182116', time=2024-09-14T13:21:50.728906+0000, chain.objs.size()=1 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.YV2Vrn3soh0VB1GIL7pE5BbUY_UEyY4_0 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4524341960867484129', time=2024-09-14T13:21:50.729609+0000, chain.objs.size()=1 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.uHkHel2G71rYC-UooqrcM9OzUjJINgi_0 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16200910590597107670', time=2024-09-14T13:22:25.192775+0000, chain.objs.size()=1 2024-09-14T11:25:17.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.161+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.PHbW_4-VBv1KHcflxmeBoCyhkCLm2LE_0 2024-09-14T11:25:17.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.165+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.167+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:25:17.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.610457940694169268', time=2024-09-14T13:15:49.290343+0000, chain.objs.size()=7 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.1 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.169+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.1_1 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.2 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.2_1 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.3 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__shadow_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.3_1 2024-09-14T11:25:17.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.10__multipart_foo.2~Jd58QnrR0U68BKOW2WLlq2nvJXN2SmP.4 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_Z0qWsooWJC07HsrVbvbs-oJxPK67GEn', time=2024-09-14T13:15:49.405219+0000, chain.objs.size()=3 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_0 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_1 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.ckeBQWEE3sbGGGs4NWCo-CqGrNf-rtt_2 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1223196277759506436', time=2024-09-14T13:15:49.457158+0000, chain.objs.size()=5 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.1 2024-09-14T11:25:17.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.170+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.1_1 2024-09-14T11:25:17.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.173+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.2 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.2_1 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-LUKEWARM.2~_OM72WEfKC6HrOfwLmKt5cHTHrHD-z_.3 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15703266037067030116', time=2024-09-14T13:17:56.590748+0000, chain.objs.size()=1 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.YnEw3Rm3OZEA-1EnfAG8jKkJo_gwQqS_0 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1381584407022573583', time=2024-09-14T13:17:56.593441+0000, chain.objs.size()=1 2024-09-14T11:25:17.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.0_8DldDtvXyFWupH-JvmKfXifVhxJyQ_0 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13397178209580393066', time=2024-09-14T13:19:54.348063+0000, chain.objs.size()=1 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.ZXNN5MQfJAb3QbvzADqNTWspsqvL-Rd_0 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1269327074298294418', time=2024-09-14T13:19:54.463146+0000, chain.objs.size()=1 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.tbfFSr_sF1PaWqqV4ejsEL7D6kbNz_h_0 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10226026870751766997', time=2024-09-14T13:20:32.066783+0000, chain.objs.size()=1 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.8rOeCdqTQ0d-9SUy2lRmKTXlL2b8f6I_0 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2718457487388353519', time=2024-09-14T13:20:32.155161+0000, chain.objs.size()=1 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.175+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.RxkVOTfjbPB3dk5AKL6EZsJpyKLqxbQ_0 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2711544483712184240', time=2024-09-14T13:21:06.238517+0000, chain.objs.size()=1 2024-09-14T11:25:17.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.p0VG-JdZDe2fkcWlRjzMUnM5FFyeUKy_0 2024-09-14T11:25:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8748721311846629561', time=2024-09-14T13:21:06.332326+0000, chain.objs.size()=1 2024-09-14T11:25:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.iEEh4KvTFuTwMFce-n4hB5MTuXsGaro_0 2024-09-14T11:25:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9313592602551828318', time=2024-09-14T13:21:10.590206+0000, chain.objs.size()=1 2024-09-14T11:25:17.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.176+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.c5KQzqCtFkTJuoSOLw51btKSXwTKtek_0 2024-09-14T11:25:17.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.178+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8511961323934284589', time=2024-09-14T13:21:50.722564+0000, chain.objs.size()=1 2024-09-14T11:25:17.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.178+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.Cz4S7uo6z22fCWvZk4K8Zlm2l-aiwKQ_0 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2065129746773482065', time=2024-09-14T13:21:50.781565+0000, chain.objs.size()=1 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.V-OJZzxraj7A2Zx6am3-JyOvB7imqPb_0 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13540399103640598310', time=2024-09-14T13:24:36.851032+0000, chain.objs.size()=1 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.D5d-sTGwuL9Bd9awGmgWcjbg9HNq5fz_0 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2149210862079940043', time=2024-09-14T13:24:36.854622+0000, chain.objs.size()=1 2024-09-14T11:25:17.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.180+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.qIrFI1BPqcMc5sJCICFh90l2EME2UyW_0 2024-09-14T11:25:17.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.183+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.186+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:25:17.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.187+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.187+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1376136108177957437', time=2024-09-14T13:15:49.447762+0000, chain.objs.size()=5 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.1_1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.2 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__shadow_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.2_1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-FROZEN.2~VSCmT6_sIjunDeb6p7aoMWgKmUygdYv.3 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8932147717980356293', time=2024-09-14T13:17:13.721905+0000, chain.objs.size()=1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.jytuM8OPdVbX21fmRmNv3ETGvT4xZkr_0 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8732717416909729799', time=2024-09-14T13:17:16.454869+0000, chain.objs.size()=1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.rR-87Iw9wYMEG8urM4QnwppFCfvF--F_0 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5977727072722810676', time=2024-09-14T13:17:50.915405+0000, chain.objs.size()=1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.pzFsR4xu8JQGEI4A9MaFzFRmfbfyZ03_0 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4267115857694213554', time=2024-09-14T13:17:50.963951+0000, chain.objs.size()=1 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.TZh5Afcf_haST6TujtrUoCuwMMxGQBn_0 2024-09-14T11:25:17.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17390202025975043965', time=2024-09-14T13:17:54.185692+0000, chain.objs.size()=1 2024-09-14T11:25:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.9XX8NJTBE3aLys136A_k9Ot_5OGzm6J_0 2024-09-14T11:25:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4503271090151439231', time=2024-09-14T13:19:10.539384+0000, chain.objs.size()=1 2024-09-14T11:25:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.ozfFNqsybglBJ8Z-qXOqyvY888UT8Zo_0 2024-09-14T11:25:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10093275277625625211', time=2024-09-14T13:19:14.699420+0000, chain.objs.size()=1 2024-09-14T11:25:17.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.188+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.1A9-o5HEpx29-Efb8AfWTHDqFWTB73h_0 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10742944349635991170', time=2024-09-14T13:19:48.218215+0000, chain.objs.size()=1 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.u19YvdU2C5RL5iKuR87msZBgwO6GdnD_0 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4400691513316735901', time=2024-09-14T13:19:54.450630+0000, chain.objs.size()=1 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.hEhC8yNTggvMljLIE5QEjtwmDxfSTyA_0 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9791271535129072802', time=2024-09-14T13:20:28.376960+0000, chain.objs.size()=1 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.x6eoTzyVzpZssy0HDSZAKnKgWK7e4_A_0 2024-09-14T11:25:17.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17032596260463744073', time=2024-09-14T13:20:28.413240+0000, chain.objs.size()=1 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.By_UBIaea3R7Q_bF8givzwQSUE_qgPE_0 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1251450780158824479', time=2024-09-14T13:21:10.548992+0000, chain.objs.size()=1 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.192+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.JTZvBMge6mlF6XcPo1H6d3qI4sebNHD_0 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.193+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8999439535156705660', time=2024-09-14T13:21:10.549715+0000, chain.objs.size()=1 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.193+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.HY06nImXojHys0ZvUlWKtJ2plPKrcuI_0 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.193+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5241151846412379920', time=2024-09-14T13:21:44.359676+0000, chain.objs.size()=1 2024-09-14T11:25:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.193+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.rgcP9KbZepM0DYYVeJb6lcn4OmAZUdJ_0 2024-09-14T11:25:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.196+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.199+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:25:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.200+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:25:17.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4979055716873992486', time=2024-09-14T13:15:49.173705+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.6Ye0FLjDduB9tBwG7JuJ_5erCcGgr7a_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_wBpoFW4fHGx49gD7cim6nkaqzSYJvsr', time=2024-09-14T13:15:49.328456+0000, chain.objs.size()=2 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.4jyomfC44GbfrD3eQ5O4xr48ktj6vwp_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.4jyomfC44GbfrD3eQ5O4xr48ktj6vwp_1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4727119235884349534', time=2024-09-14T13:17:13.684651+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.dvJUGSyLTi3zcs9LgR3VVnOh4LJgMaJ_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1337739317623573770', time=2024-09-14T13:17:50.882194+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.YEt6sAyOtKhw2q-zAXTdmXM-2ruOdNL_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.905814387598118441', time=2024-09-14T13:17:56.619184+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.dPqYGLEd8UjldvfSL2v5fRjzs9A8LqG_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2574695309396434654', time=2024-09-14T13:18:34.312342+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.ILAFXF3F46upe_CchVgjNEapxN1jf4R_0 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17314934381378262959', time=2024-09-14T13:19:10.553680+0000, chain.objs.size()=1 2024-09-14T11:25:17.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.0-OX0-3KWIXKd84Jc0r1F36sI1fDQmi_0 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12638591159460362802', time=2024-09-14T13:19:14.648534+0000, chain.objs.size()=1 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.rY0Zyr12luyzQ13gdxg_XM1XOlKOsYL_0 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8542547369723059633', time=2024-09-14T13:19:14.697455+0000, chain.objs.size()=1 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.g9si6whPN0cd8kUfYe8N14NLOsW80ID_0 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6742691396023468056', time=2024-09-14T13:19:48.242437+0000, chain.objs.size()=1 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.8t8LGLSD7QD-8V7FXrAgeDzc_OT0sRc_0 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18073314201999562823', time=2024-09-14T13:19:48.248806+0000, chain.objs.size()=1 2024-09-14T11:25:17.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.201+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.N1zXm_kiX1Gc156I3DxelG64GeSNite_0 2024-09-14T11:25:17.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15021363303232718546', time=2024-09-14T13:20:28.371830+0000, chain.objs.size()=1 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.qN1OsWUDorAeJ2-1I3nh2tIluW2F_ii_0 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3539978434162691807', time=2024-09-14T13:20:28.390488+0000, chain.objs.size()=1 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.4YkNvR9FaR7vy148K6yfAigLB3D3eem_0 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8488790990202738400', time=2024-09-14T13:21:10.512929+0000, chain.objs.size()=1 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.bZPheAzNaattaQot9vERSgXfkkwRjpt_0 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3492059744711642845', time=2024-09-14T13:21:44.407153+0000, chain.objs.size()=1 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.y3z59qATX-9KpbbldW5PtM65puI4lTR_0 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12930729703637816530', time=2024-09-14T13:21:44.431418+0000, chain.objs.size()=1 2024-09-14T11:25:17.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.204+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.jKzHti6VB9aID224j9c9kl59T7-u97Z_0 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7650996293584576370', time=2024-09-14T13:21:48.035381+0000, chain.objs.size()=1 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.Uvg7_M7AEa6OXQT6DjZSqf8viPMo6ch_0 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13566747327870182842', time=2024-09-14T13:21:48.112611+0000, chain.objs.size()=1 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.XuVemB3pKoMFAMdRak9iTXV1VCNfCGL_0 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14164495723075090494', time=2024-09-14T13:21:50.679241+0000, chain.objs.size()=1 2024-09-14T11:25:17.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.205+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_._mLWDb3qhfbyTIGBpuoHePN54YuUrF2_0 2024-09-14T11:25:17.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.210+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.212+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:25:17.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:25:17.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_tUsi6U8_O0ajGVkQ_ARgmV0iXYnVD0n', time=2024-09-14T13:15:49.311575+0000, chain.objs.size()=1 2024-09-14T11:25:17.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.X7blNr_KZU4XscCn__bmYo8_P10d1lE_0 2024-09-14T11:25:17.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_riVzlm3zMyNJN7o1jMP3FOaZ1qy1lIG', time=2024-09-14T13:15:49.379996+0000, chain.objs.size()=3 2024-09-14T11:25:17.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_0 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.Y7LlX_B1RZ8Nf8kSAKENp9HLeCnKxFT_2 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_W6rIGnlAROIPexHZ_o8KEu7GiUJlo38', time=2024-09-14T13:15:49.396627+0000, chain.objs.size()=3 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_0 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.j_zdL1CP1oI5tGJxg1zlOJBoRG3wGT6_2 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2254976161346867419', time=2024-09-14T13:17:54.122741+0000, chain.objs.size()=1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.214+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.vue0mezmgbxLpd87YrNoabjO_cjUGE3_0 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15315941957685030690', time=2024-09-14T13:18:34.237950+0000, chain.objs.size()=1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.K0zra5tNFoR1-zix8-CcwICXp4agod3_0 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14876788109486749352', time=2024-09-14T13:18:34.288470+0000, chain.objs.size()=1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.J8nBWk4p_0dyhKByvOyT7jQkwjCa4zj_0 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3498800574686493302', time=2024-09-14T13:18:36.824858+0000, chain.objs.size()=1 2024-09-14T11:25:17.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.mD1yjq3iXx0roIUaW9Hn4J-hUyyC_Kt_0 2024-09-14T11:25:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7649828564443184960', time=2024-09-14T13:19:50.965235+0000, chain.objs.size()=1 2024-09-14T11:25:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.215+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.tF0F1XJMaJfBfFURqLil8slnEbPVxJe_0 2024-09-14T11:25:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.216+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.63647358582358179', time=2024-09-14T13:20:32.046188+0000, chain.objs.size()=1 2024-09-14T11:25:17.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.217+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.Dn8oXZb3hBF0tEkqfWHi_S-3Mdxz5FO_0 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.217+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1400701127488769888', time=2024-09-14T13:20:32.112913+0000, chain.objs.size()=1 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.217+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.5x1aCkZg05lDTm-mKVowdunnNkLHl1h_0 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.217+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.348810892155562706', time=2024-09-14T13:21:10.610982+0000, chain.objs.size()=1 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.217+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.W-uTX06ykkCG8LXJ0jpdVhgZl_jT4Pi_0 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.218+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15808202972394169572', time=2024-09-14T13:22:25.202916+0000, chain.objs.size()=1 2024-09-14T11:25:17.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.218+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.G4gjFdFlgguBDehe5uSykhz13GuZ88h_0 2024-09-14T11:25:17.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.221+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.223+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:25:17.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.224+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1250295081314970775', time=2024-09-14T13:15:49.341049+0000, chain.objs.size()=2 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_0 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_1 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11916139927665145690', time=2024-09-14T13:15:49.409830+0000, chain.objs.size()=5 2024-09-14T11:25:17.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.1_1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.2_1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-LUKEWARM.2~TLm32pxplEfis5C9qEuqlfqdoJf08WJ.3 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12240125388162430194', time=2024-09-14T13:17:13.773101+0000, chain.objs.size()=1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.OFZH4yFGx8AUGgncSMwIrV_WpR_5r5w_0 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.660485282315157908', time=2024-09-14T13:17:54.162123+0000, chain.objs.size()=1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.zlylHn_bCQnxkh4143GU7HFZQ1Wp-QW_0 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15745398576459678807', time=2024-09-14T13:17:54.162878+0000, chain.objs.size()=1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.OCygkpdDtXTEcLGA5vjqCToBz-VH5kz_0 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14486877256286437069', time=2024-09-14T13:17:56.613166+0000, chain.objs.size()=1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.qPC1A0w8D1mzStmUSAqVfNVx1NyRwme_0 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17437806772334835245', time=2024-09-14T13:18:31.035130+0000, chain.objs.size()=1 2024-09-14T11:25:17.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.225+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.c7LyNePZpca5TwO7N_E-DsSGvYFcjP9_0 2024-09-14T11:25:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.227+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2431592980983739993', time=2024-09-14T13:18:32.919358+0000, chain.objs.size()=1 2024-09-14T11:25:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.227+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.OeG4hIf4L8UFoXw1NX_NvV-nLBt_gLp_0 2024-09-14T11:25:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.227+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17623883007195209432', time=2024-09-14T13:19:54.407869+0000, chain.objs.size()=1 2024-09-14T11:25:17.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.227+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.oCqagucA79yLPosY6DkPKr1Vbp3l_ud_0 2024-09-14T11:25:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11295660753416463214', time=2024-09-14T13:20:32.079353+0000, chain.objs.size()=1 2024-09-14T11:25:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.h2C2C9IJudeuqdF-264_34tedS3M4XN_0 2024-09-14T11:25:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.21429320754191005', time=2024-09-14T13:21:44.359783+0000, chain.objs.size()=1 2024-09-14T11:25:17.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.Oiv4Ab4esVAv463Y6UtF5ETE7_zMkc__0 2024-09-14T11:25:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18011807781108937918', time=2024-09-14T13:21:50.775997+0000, chain.objs.size()=1 2024-09-14T11:25:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.zMbcsD_xzBoVNihz6mrhwjv1IzMBxuo_0 2024-09-14T11:25:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3458736971590406507', time=2024-09-14T13:22:25.136396+0000, chain.objs.size()=1 2024-09-14T11:25:17.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.229+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.JB5KS0MNIHZZJ37jjH0_UbMAOnV87zP_0 2024-09-14T11:25:17.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.232+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.235+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:25:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.236+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7914084046489690143', time=2024-09-14T13:17:50.885590+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.VyKhwgn_t9g52ZFZ3Efe3vAWsf6AUmg_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5380632969365971671', time=2024-09-14T13:19:14.616100+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.ug2cXv0-piF-Hu2iet5iJ492kVeBb2N_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14341671360984892240', time=2024-09-14T13:19:54.399546+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.xOC_n30ekzvCcVQi8WvFdb6fY1TKVwE_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13817016373542991296', time=2024-09-14T13:19:54.400372+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.Az_eTQanGGB2WvrswHJhxKwivOi3pQe_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1199413418916235610', time=2024-09-14T13:19:54.445617+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.EvgbT4uJvggsQQP2PfKfhSvjZKX4Lmf_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10414147766563548756', time=2024-09-14T13:20:28.387940+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.qDTlaFTHiQ69irtD5edWTyb8-Gu7xoG_0 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2832141559283660424', time=2024-09-14T13:20:30.745097+0000, chain.objs.size()=1 2024-09-14T11:25:17.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.AaBXZ8mzB0vO9VQ9cQ57Z6e9csmwPgy_0 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11120652656434023312', time=2024-09-14T13:20:32.089436+0000, chain.objs.size()=1 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.KVS_HxXD2kZv80vw_nmxBcK7qFVTGW9_0 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8158585170087943390', time=2024-09-14T13:21:44.352326+0000, chain.objs.size()=1 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.VBOonCMo59O8kbwIZ1vk_DCkpmnyKGZ_0 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11484050761100029021', time=2024-09-14T13:21:50.689622+0000, chain.objs.size()=1 2024-09-14T11:25:17.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.237+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.K7yX6MoButMPHzZ-EY1Wopb8eGCpNVu_0 2024-09-14T11:25:17.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.241+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.244+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:25:17.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.245+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.245+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11750277953507586978', time=2024-09-14T13:15:49.356923+0000, chain.objs.size()=2 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_0 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.VOQqtBv15VmThto8BrHSxRASlKCAHxp_1 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14624120322987792268', time=2024-09-14T13:15:49.413612+0000, chain.objs.size()=5 2024-09-14T11:25:17.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1_1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2_1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.3 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4110092565901633228', time=2024-09-14T13:17:16.353789+0000, chain.objs.size()=1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.Tp1HTNlxx5L0Gc4O8W5tb8-MkMQSqXg_0 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14645750843059424843', time=2024-09-14T13:17:16.380838+0000, chain.objs.size()=1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.Sfu59z6LHlKdRKe50bj45NQkSLjYnXg_0 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6374816706402872777', time=2024-09-14T13:17:50.971462+0000, chain.objs.size()=1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.nIbKmZZnpR1ar8Eb18tkibKyl8Urxdm_0 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.222314579151814465', time=2024-09-14T13:17:53.214516+0000, chain.objs.size()=1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.ViSDJ41Zc2dghYmzmLN7bI6mC5D2gBE_0 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4697835966950453258', time=2024-09-14T13:18:31.013374+0000, chain.objs.size()=1 2024-09-14T11:25:17.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.246+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.RflVuN35BafPfcmX1vleWL6GcBCv_OG_0 2024-09-14T11:25:17.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8910980100221403292', time=2024-09-14T13:18:36.767649+0000, chain.objs.size()=1 2024-09-14T11:25:17.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.JkZdlmmHvMlaHozv9XfdnsP6QH3YJCt_0 2024-09-14T11:25:17.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7428916719702368213', time=2024-09-14T13:18:36.783399+0000, chain.objs.size()=1 2024-09-14T11:25:17.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.J6d2EktBt55pXYwZg8Vk5kK_nYjdus__0 2024-09-14T11:25:17.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17310680573825683509', time=2024-09-14T13:19:14.648928+0000, chain.objs.size()=1 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_._dWDa7ZKV16P0GCE4GnUyATX_GYNsVp_0 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4232298746382656330', time=2024-09-14T13:19:52.110012+0000, chain.objs.size()=1 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.CKXbxl4t-K-S3NVDc67zHnSU4RJFVyi_0 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13948227669821634350', time=2024-09-14T13:19:52.149930+0000, chain.objs.size()=1 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.C9SCVgT-wwfYAUtypCGKr1qA_r2xfzJ_0 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11081312080233004334', time=2024-09-14T13:21:10.570250+0000, chain.objs.size()=1 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.JFcbU9Rhzd2iumUCa9SWNvecVKbFuGy_0 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6271177668809599679', time=2024-09-14T13:24:36.862937+0000, chain.objs.size()=1 2024-09-14T11:25:17.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.250+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.EZp0pcMsxlpPnoh5uyggasmYfnZFmg4_0 2024-09-14T11:25:17.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.255+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.257+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:25:17.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.258+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.258+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:25:17.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14262609321459975233', time=2024-09-14T13:15:49.163698+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.RvakpKX2RE_Zm1JzyuiUEsSwM3uMnqK_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12504341435658116938', time=2024-09-14T13:17:13.679235+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.MZLr15jlHbEssfUulyBbRwdWg6B4obl_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17552294475407229675', time=2024-09-14T13:17:16.358159+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.1YTQsfZFsBzvX4e4M-6hRUHz_syTFd1_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6736267092582903434', time=2024-09-14T13:17:54.165706+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.1KYJBwIqPYSOiEo1Gl_NZ6G06Uqv7r3_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8662527492036877094', time=2024-09-14T13:19:14.601382+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.xUaRzi3aqtwP8p1zgE6Dej9FhLNDu80_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.76922884258559723', time=2024-09-14T13:19:48.248834+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.RybyXFn0IY08_VC9I02wcdesFKYkJt4_0 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15204101066101147250', time=2024-09-14T13:19:52.160059+0000, chain.objs.size()=1 2024-09-14T11:25:17.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.B8fJ26yRRvT6qKuZxSPVo0u_1dA_4MQ_0 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11691841253517199612', time=2024-09-14T13:20:28.399554+0000, chain.objs.size()=1 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.YFxpwBQbdZVzgaaLCGY1KNFnoJn9ozK_0 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1669760185793857945', time=2024-09-14T13:21:44.353887+0000, chain.objs.size()=1 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.3V1PQfnNhNM-yBk9MOJLQAuExn2pZvc_0 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9710183792786730501', time=2024-09-14T13:22:25.171560+0000, chain.objs.size()=1 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.rvLrpuX2QTHRB69eemwRG1U-cZy0dyg_0 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14336304231214898135', time=2024-09-14T13:22:25.205133+0000, chain.objs.size()=1 2024-09-14T11:25:17.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.259+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.ZGnnuQyChByTvF7VHIIJU5g3AWPovYS_0 2024-09-14T11:25:17.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.264+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.267+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:25:17.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.268+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.268+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-14T11:25:17.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3737533619442658273', time=2024-09-14T13:15:49.344975+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.3SKiKWvzNKdV-ixUckEYu53OP-Mulzr_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2778509371862053440', time=2024-09-14T13:15:49.543536+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.W_mH-lfu32z51t-eWHkBwm3GbYLGWtT_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18170742344009804980', time=2024-09-14T13:15:49.547777+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.M9SuERThJ4aGpIyvh4VQW8dlF_6Lien_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7656113647576865239', time=2024-09-14T13:17:13.764467+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.FtnyUfFyG0AR60F1k0drys_rg69ewOm_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15697727818083445954', time=2024-09-14T13:17:50.916103+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.-BpjiTj91prA7vwxwkMQAALsutzU2DN_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15280289142277153998', time=2024-09-14T13:17:54.202171+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.N8sUHfddiIehQ4yigZuuCe-1sTBSOPu_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14858812680283867574', time=2024-09-14T13:18:31.035121+0000, chain.objs.size()=1 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.TZ17u75brmj_R_-yTjGT7fWqCozZvU4_0 2024-09-14T11:25:17.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.522444614618004014', time=2024-09-14T13:18:34.244170+0000, chain.objs.size()=1 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.be_zko-cBa8lSw_6aRHSxWgfypUel7e_0 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17242103885653215682', time=2024-09-14T13:19:10.561606+0000, chain.objs.size()=1 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.-eVs1hEloU1kFR-HT--Ol1DCBCKczZU_0 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16767732788826437377', time=2024-09-14T13:20:32.094596+0000, chain.objs.size()=1 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_._DHTJDUVf9MNuFkG_Ru3ha7ZEYiYII3_0 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2349236463161174467', time=2024-09-14T13:20:32.095320+0000, chain.objs.size()=1 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.8SJYOXbOvIPGKaufAo-PO-kXOMcFoib_0 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12219966324663774984', time=2024-09-14T13:21:06.289420+0000, chain.objs.size()=1 2024-09-14T11:25:17.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.269+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.diiKj_o8WfAriaX0FM5VxPJi1uJw0Sd_0 2024-09-14T11:25:17.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.272+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3446467161178920694', time=2024-09-14T13:21:10.548992+0000, chain.objs.size()=1 2024-09-14T11:25:17.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.-gjpGuTrSpACYWCG2ohtvA44-S9PF2Q_0 2024-09-14T11:25:17.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14066342840464419026', time=2024-09-14T13:21:44.359765+0000, chain.objs.size()=1 2024-09-14T11:25:17.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.0_xORf_gvYBbi1wFLfH-_aD81JLnaPp_0 2024-09-14T11:25:17.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3814409804156350252', time=2024-09-14T13:21:44.376675+0000, chain.objs.size()=1 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.O08KAujwAtFLkEiiNtZ9120PPis78nx_0 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10014964517511718883', time=2024-09-14T13:21:48.083885+0000, chain.objs.size()=1 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.9UvLRwf-MJ8dHtsqyrXidNfPptvaeUy_0 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12820350585547351072', time=2024-09-14T13:21:48.106009+0000, chain.objs.size()=1 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.5fitvO-maWcBwM2pLVxZqS_PyGB9Y_A_0 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2359070718146245871', time=2024-09-14T13:21:50.690309+0000, chain.objs.size()=1 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.rhuDVoglaUjliMELGsup04VW0Yjf3dL_0 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15701456624052729623', time=2024-09-14T13:22:25.116775+0000, chain.objs.size()=1 2024-09-14T11:25:17.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.273+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.2N8W1xhhFZJaoDJdOAzaEI2-nwiMOhd_0 2024-09-14T11:25:17.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.274+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5634187055071937709', time=2024-09-14T13:24:36.861040+0000, chain.objs.size()=1 2024-09-14T11:25:17.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.274+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.lxuRvGk0q0RD3Wpw9yaIroDSTGKkY-b_0 2024-09-14T11:25:17.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.278+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.280+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:25:17.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.282+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.282+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2357010794909085216', time=2024-09-14T13:15:49.186964+0000, chain.objs.size()=1 2024-09-14T11:25:17.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.WbJgeBh-5-8qUseux9AuaoFldVkWou4_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_aK4LYu2fRcdHjZMylG7cxm8bjx7VNdd', time=2024-09-14T13:15:49.324236+0000, chain.objs.size()=2 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.QKkCdUHo9lDqg44IvrEEoB_RTFKPQaQ_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.QKkCdUHo9lDqg44IvrEEoB_RTFKPQaQ_1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3296864698937182334', time=2024-09-14T13:17:13.772240+0000, chain.objs.size()=1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.b39WjOAy3VpAJ41D2WhS8WhYs3UcDdS_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.422341863873404041', time=2024-09-14T13:17:19.194656+0000, chain.objs.size()=1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.mNF26Pv4dj9OyTjJIZ4-1qT34yXs3c3_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17797643410709373210', time=2024-09-14T13:17:50.964356+0000, chain.objs.size()=1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.CRmgMxCK5shl-PP64nmwlPRNmfcK_RC_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12963731071103737817', time=2024-09-14T13:17:54.182099+0000, chain.objs.size()=1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.meNHIMdEDMDFYRDwV-dFAJ1Drq6aCjo_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15162735244500282661', time=2024-09-14T13:17:54.209518+0000, chain.objs.size()=1 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.-rfC5ZqP1jCQvzCYQ8Hp_6n8m702W4T_0 2024-09-14T11:25:17.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17623870266075021783', time=2024-09-14T13:18:31.015029+0000, chain.objs.size()=1 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.Fo_87AuQ3SFHpbsNgUc2ejh_Dw1qQnW_0 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14974347442299682085', time=2024-09-14T13:19:14.617944+0000, chain.objs.size()=1 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.yn4TPMYgLId8pV7lqtaLcZOAt5sPulw_0 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10882820840308016551', time=2024-09-14T13:19:52.173318+0000, chain.objs.size()=1 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.LOdW0xMmo4v3vlkhdb9BQNfE0CuBS2C_0 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.166822832432812179', time=2024-09-14T13:19:54.401524+0000, chain.objs.size()=1 2024-09-14T11:25:17.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.283+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.vfJviHbVOApYhf93w1lB5IKEhF4KSEe_0 2024-09-14T11:25:17.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.286+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16082660380830820642', time=2024-09-14T13:20:32.103868+0000, chain.objs.size()=1 2024-09-14T11:25:17.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.286+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.rHxcn1-MNpAnLRtOFB8br7-eEALAZYs_0 2024-09-14T11:25:17.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.286+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10067599457262913121', time=2024-09-14T13:21:06.269166+0000, chain.objs.size()=1 2024-09-14T11:25:17.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.286+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.PA3SQQRjnZDa0cBoXWlOSd6Y2SLv4E7_0 2024-09-14T11:25:17.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.287+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6594857338127362895', time=2024-09-14T13:21:48.100086+0000, chain.objs.size()=1 2024-09-14T11:25:17.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.287+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.WmVc9H9C_frYYJG-FQCkYKIiObbqYH8_0 2024-09-14T11:25:17.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.287+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.522343413659139583', time=2024-09-14T13:24:52.468216+0000, chain.objs.size()=1 2024-09-14T11:25:17.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.287+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:5ezGEsXKZmgXboloHH9EEwulNwo5-yR_.ywAvx5F4Kml44lg6-VrP2YpF3yptM-5_0 2024-09-14T11:25:17.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.290+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.293+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:25:17.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.295+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.295+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_EHNdYN-MiOVzbtBvErkzOw2JH9DDsiw', time=2024-09-14T13:15:49.337104+0000, chain.objs.size()=2 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.Z5Qjd8CqD2argOnqnIMJPH5Z8wXc7W4_0 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.Z5Qjd8CqD2argOnqnIMJPH5Z8wXc7W4_1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5048049889872059390', time=2024-09-14T13:17:16.403993+0000, chain.objs.size()=1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.HbpyIKlbED2SmKZCjFirp0f-MWNwodA_0 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5810900456394200311', time=2024-09-14T13:17:16.453781+0000, chain.objs.size()=1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.g4cqka64HtK2P1Tbzp8BdEar5PsfOA-_0 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14553928768162078930', time=2024-09-14T13:17:50.897858+0000, chain.objs.size()=1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.T9t54pclfuLlKMOx-J8svYGj_CKAqPE_0 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13668209581694127578', time=2024-09-14T13:17:54.160731+0000, chain.objs.size()=1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.t_CuIEFQeAsB7Fw0Tg5d3d1vi_eaDF__0 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3311671139031403454', time=2024-09-14T13:19:10.586803+0000, chain.objs.size()=1 2024-09-14T11:25:17.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.FXhDpJdoLTWsrNLwdG2RM26IP1NgZn9_0 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17614921562966801689', time=2024-09-14T13:19:14.620216+0000, chain.objs.size()=1 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.zZYEnjO0HVrAwQ4AmA7iZwYby81o7o0_0 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7823960307293196945', time=2024-09-14T13:19:14.648913+0000, chain.objs.size()=1 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.lyaT8yz4TJTwaeeUqSYf5dCskdvGGZx_0 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8157772865156543004', time=2024-09-14T13:19:52.088960+0000, chain.objs.size()=1 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.J-t6YA5eawWE0hJqezBRM6ts29FBl3k_0 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4874157153084964040', time=2024-09-14T13:19:52.090039+0000, chain.objs.size()=1 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.izoiRZE5g2zx2rfgtpm-RcJ3fGmRVnm_0 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6905165793443739793', time=2024-09-14T13:19:52.149005+0000, chain.objs.size()=1 2024-09-14T11:25:17.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.296+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.nzyRlgbDnXhwzQkZFUbBdL9ZteeqUPp_0 2024-09-14T11:25:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.299+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13856670386025161049', time=2024-09-14T13:19:52.149556+0000, chain.objs.size()=1 2024-09-14T11:25:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.299+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.r9ryE5h2DpXws6bzDCIa1DG6Ft_fiNi_0 2024-09-14T11:25:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.299+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4116209931397434660', time=2024-09-14T13:20:32.101917+0000, chain.objs.size()=1 2024-09-14T11:25:17.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.299+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.2ltN72v1XbNly6wnRktcyZnryuK8HfH_0 2024-09-14T11:25:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16439266390391161878', time=2024-09-14T13:21:06.275172+0000, chain.objs.size()=1 2024-09-14T11:25:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.jK6f7UcZzGSIaOuG1Ok-Sb2FQfZ7iHX_0 2024-09-14T11:25:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17396332229228536625', time=2024-09-14T13:21:10.584108+0000, chain.objs.size()=1 2024-09-14T11:25:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.KvqJ2L9zeAYRPgKnqIzFMhuppGkkVmk_0 2024-09-14T11:25:17.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1480980943653152276', time=2024-09-14T13:21:47.126327+0000, chain.objs.size()=1 2024-09-14T11:25:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.8kK9CIC4UbhX2u2R6j57Zi78REgVTI4_0 2024-09-14T11:25:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5088933067188579976', time=2024-09-14T13:24:36.863105+0000, chain.objs.size()=1 2024-09-14T11:25:17.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.301+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.Z_sVJ3ZDKFzYoUte_UOOhsYeOif9Kmj_0 2024-09-14T11:25:17.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.304+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.307+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:25:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.308+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.308+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3471375875052266689', time=2024-09-14T13:15:49.401109+0000, chain.objs.size()=5 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.1_1 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2 2024-09-14T11:25:17.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.2_1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-STANDARD.2~LwkPwMeFC0XQWGbNrcYFthyE7oDOQ-5.3 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8969558653354213573', time=2024-09-14T13:15:49.488053+0000, chain.objs.size()=3 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_0 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.-xB2xJFlCN5mTkBtRA8RE5jh6hm3ik4_2 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11131361951281228591', time=2024-09-14T13:17:50.909954+0000, chain.objs.size()=1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.Xh-QZcvZxRmYT5uoxcZ__-Rnhbm51Ri_0 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17723623330730824342', time=2024-09-14T13:17:54.111815+0000, chain.objs.size()=1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.5rLDJKRjIkuGNQlAh22nqvaY1xw9e49_0 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6114189937477037386', time=2024-09-14T13:18:31.026863+0000, chain.objs.size()=1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.O9rYd-O08M3w__1qk_NQdLaDR1NUYDF_0 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14100254155412354509', time=2024-09-14T13:18:34.256211+0000, chain.objs.size()=1 2024-09-14T11:25:17.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.309+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_._Gp1MPFufWBOo5Y4pjYDzoKoUHiofhj_0 2024-09-14T11:25:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14284177849636014251', time=2024-09-14T13:18:34.313064+0000, chain.objs.size()=1 2024-09-14T11:25:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.Tym7_rBqA_i2MU4uU1rGDSXwEmEckP5_0 2024-09-14T11:25:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3723062350481655934', time=2024-09-14T13:18:36.803696+0000, chain.objs.size()=1 2024-09-14T11:25:17.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.4gMSLNYOh3Eleovk8d2WFgefpdl6OeT_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12024990491440572613', time=2024-09-14T13:19:10.623579+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.X9HMD7vwc4VnclY3rzNROuX7NyIzAzb_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.716277816537609186', time=2024-09-14T13:20:28.372597+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_._4gh451VoZxMfII2tf2JhUKiwlcJQMD_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12081498995871603150', time=2024-09-14T13:20:28.374984+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.hStLPIUkiZP1jEf9kokbjCqGzKtt6OP_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15411612804369483017', time=2024-09-14T13:21:48.085204+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.W2GGnDNP9HX4Af4HiwaKxW6Gfnt3goc_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2719480079859112571', time=2024-09-14T13:21:50.726286+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.FpygUXlMeULvySa2vm70lDAGa8NGMxs_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.784094811392274674', time=2024-09-14T13:22:25.218564+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.uvy4LIP8SqV8nmNsNTBupTWxY301G0J_0 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12896848442958720782', time=2024-09-14T13:24:36.884031+0000, chain.objs.size()=1 2024-09-14T11:25:17.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.8q9MJET_kJgYfshkAGUiZX3bfrAv1Cr_0 2024-09-14T11:25:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14407346473247608328', time=2024-09-14T13:24:36.884642+0000, chain.objs.size()=1 2024-09-14T11:25:17.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.313+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.MB9ycKMOSqTxozAFoEWSuy_Sbi1k9YL_0 2024-09-14T11:25:17.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.319+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.322+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:25:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.323+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.323+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:25:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_ItoVNEOzKaEkUVBfPl3mRWWviozqR3K', time=2024-09-14T13:15:49.315778+0000, chain.objs.size()=2 2024-09-14T11:25:17.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.v64F4hzX64awD7jEt5ZzBTdiEmgLOou_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.v64F4hzX64awD7jEt5ZzBTdiEmgLOou_1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_mISLgFodAABk5sQiP9hK2NVi85DVyhz', time=2024-09-14T13:15:49.421591+0000, chain.objs.size()=3 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_.89HwANl6ZXj6W8npj8tzJ-DTgH8J93p_2 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16195003098173094281', time=2024-09-14T13:17:16.339062+0000, chain.objs.size()=1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.kWccaJhiq1MLJpAq6gLnOXJoMGvfm5U_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3651342649366006937', time=2024-09-14T13:17:50.910844+0000, chain.objs.size()=1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.TXNZepRjX90HDOvGdqcvqPQADvcVDA2_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3334902970733405398', time=2024-09-14T13:17:54.147223+0000, chain.objs.size()=1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.zqk8epHmTwVEu6oObKNkFzYzGmp3EyO_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14916017589046833281', time=2024-09-14T13:18:31.081295+0000, chain.objs.size()=1 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.SJHkJIhohI7JCgVqgDtpmoYQ2cOuKuX_0 2024-09-14T11:25:17.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16822911326899353713', time=2024-09-14T13:18:34.254855+0000, chain.objs.size()=1 2024-09-14T11:25:17.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.hutS4-fevoTuvH683mYVqeCF35k2ldr_0 2024-09-14T11:25:17.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4260260690500244471', time=2024-09-14T13:18:34.262723+0000, chain.objs.size()=1 2024-09-14T11:25:17.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.WSWFXzSpaUPPFVpfBed5gl-YQbSGYF5_0 2024-09-14T11:25:17.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.812380905670756800', time=2024-09-14T13:19:10.560628+0000, chain.objs.size()=1 2024-09-14T11:25:17.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.324+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.UmU0P9ANDh7-C_gXQKyeOxCtnzMQEsx_0 2024-09-14T11:25:17.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9869798018105984339', time=2024-09-14T13:19:48.268362+0000, chain.objs.size()=1 2024-09-14T11:25:17.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.ZZ8ictCBQhdAQQub3qORBC8LaAt4WDB_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6078561904224371508', time=2024-09-14T13:19:48.272384+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.ea2X4DfOrFkN0rPOw-FKkH_RLkqMu_j_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9510062344465260975', time=2024-09-14T13:19:54.357853+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.UMoGDJxh4ikSoLm00nD2e5-fq-B9oOK_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9466669112784110957', time=2024-09-14T13:20:28.411897+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.6rOe3qDhCWNzPe8f7p4KBnBHFbBE-0X_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7578617049982251142', time=2024-09-14T13:21:06.299498+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.PyBOsBPGWwFWELjcOmsL_67WvCO0UrJ_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5456060755219050146', time=2024-09-14T13:21:10.575024+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.hDODQWpWjc8Ma_mEjNDxJfLa4XobWyG_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10425020806172811638', time=2024-09-14T13:21:53.216895+0000, chain.objs.size()=1 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.4DZyhMD9WrZSr5azyRuvCO1riG8n5FC_0 2024-09-14T11:25:17.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1438842681171796340', time=2024-09-14T13:22:25.137662+0000, chain.objs.size()=1 2024-09-14T11:25:17.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.Ora9rnJjwBS1G5Qj2y7G2qVTBzpq8ht_0 2024-09-14T11:25:17.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12021140422563192587', time=2024-09-14T13:24:36.858327+0000, chain.objs.size()=1 2024-09-14T11:25:17.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.328+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.JXRcztKkwRKbwMPknNp1uW7f7_vMH_K_0 2024-09-14T11:25:17.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.334+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.336+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:25:17.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.337+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.337+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16240050270278232145', time=2024-09-14T13:15:49.452411+0000, chain.objs.size()=3 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.1 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.2 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.15__multipart_foo-STANDARD.2~4VbxvIYyVBAZwC3eI-OgglBjH5Snnd1.3 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4180392404142704991', time=2024-09-14T13:15:49.483728+0000, chain.objs.size()=1 2024-09-14T11:25:17.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.cbkKuDyXEJdz5EGhLD5eqEbwcJSnpe7_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14588827707830914072', time=2024-09-14T13:17:13.741296+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.evv7nQYTqv5aU6aMiZxhvvgI83SAEiX_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11681240008007786575', time=2024-09-14T13:17:16.397310+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.GMQ6PbHaxCS4Glk9DTh-FUWEfkk5HCT_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1820540605721645354', time=2024-09-14T13:17:56.610584+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.CJFuxlUrKiluING3R0KGWH-y2G9o0UD_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11632321148138208334', time=2024-09-14T13:18:36.727576+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.zZrqOYecLfIopWib8nIOwWehb5cygIy_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15235036991253760478', time=2024-09-14T13:19:10.529331+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.2kJyIjYpnpzr3EAUyZ1EHgLcxD8iU1k_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2642520477637824260', time=2024-09-14T13:19:10.580844+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.YEag5-yc5vDN9POB__BkoNLmaCNKpKM_0 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6303024484196909164', time=2024-09-14T13:19:14.618324+0000, chain.objs.size()=1 2024-09-14T11:25:17.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.cMycbDrpcUYap2vJHRNmZhHKU9tUqwd_0 2024-09-14T11:25:17.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16311953919840200569', time=2024-09-14T13:19:48.203168+0000, chain.objs.size()=1 2024-09-14T11:25:17.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.338+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.gYrfQov7k-HNIskN_VTiCDm0_8ziv6W_0 2024-09-14T11:25:17.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.342+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17897220973038154797', time=2024-09-14T13:19:48.290249+0000, chain.objs.size()=1 2024-09-14T11:25:17.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.342+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.wCP8Q0W_8RF9YqKobIK-hJurmrWC9-l_0 2024-09-14T11:25:17.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.342+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12485307668839402311', time=2024-09-14T13:21:10.575853+0000, chain.objs.size()=1 2024-09-14T11:25:17.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.342+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.9tZqIe0xnvFLMcHhSnEDdV4i7KWgA9b_0 2024-09-14T11:25:17.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.343+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13370098967606555104', time=2024-09-14T13:21:44.376655+0000, chain.objs.size()=1 2024-09-14T11:25:17.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.343+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.TibUqb9nNDdhk7Lns_BdFOsvwva1U78_0 2024-09-14T11:25:17.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.346+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.348+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:25:17.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.349+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11021977134490571169', time=2024-09-14T13:15:49.238896+0000, chain.objs.size()=4 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.1 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.2 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.3 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.13__multipart_foo.2~QPkUAxxlkKvwDTJtc5RUJWmI-UlJzPt.4 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13096635357954589262', time=2024-09-14T13:15:49.479635+0000, chain.objs.size()=3 2024-09-14T11:25:17.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_0 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.14__shadow_.orog6aMEcMqXDxTH9d--pmgrR2OQdv7_2 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10368970148838394313', time=2024-09-14T13:17:13.726274+0000, chain.objs.size()=1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.QKGBdiMJHvJ9WbAs0YwQvl3xzR14Cis_0 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8544907485606060605', time=2024-09-14T13:17:50.929499+0000, chain.objs.size()=1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.pXmCorDDpTunVvvZLhuHuxFMSeoLAio_0 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5470697111129876407', time=2024-09-14T13:17:54.130018+0000, chain.objs.size()=1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.gmofhVt1r7eA-zqdgr8f8OQ6wHBzocC_0 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11194579178407819976', time=2024-09-14T13:18:31.088939+0000, chain.objs.size()=1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.niJOkvEnDQuAm57VyeGlo1j0ubzF2UH_0 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9636150054705300553', time=2024-09-14T13:18:34.239404+0000, chain.objs.size()=1 2024-09-14T11:25:17.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.350+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.LwVdUuA4SGp3y74yvN4JOlrsqw7Eq1Y_0 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.353+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6588967360717060980', time=2024-09-14T13:18:36.802654+0000, chain.objs.size()=1 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.353+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.zPnVBgzOv3Erl9CZlRenuYsaksEH09K_0 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.353+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17004846427113416001', time=2024-09-14T13:19:48.216144+0000, chain.objs.size()=1 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.353+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.9Mgv5QQEhS0fXW5rFnEUa4Tq4TjFB_y_0 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.353+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10295701264518355263', time=2024-09-14T13:19:54.458150+0000, chain.objs.size()=1 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.354+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.vH_mtQyg7qkybzVagRfWvXuXoyZIeGz_0 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.354+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18392649016188023942', time=2024-09-14T13:21:06.300056+0000, chain.objs.size()=1 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.354+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.rxSW1rvJdILq76adWKZtd3-gzayOPFb_0 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.354+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1676666525776121565', time=2024-09-14T13:21:10.544186+0000, chain.objs.size()=1 2024-09-14T11:25:17.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.354+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.YA5VVoNOhd4uUjLiZ5ZzEPq-5i74lai_0 2024-09-14T11:25:17.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.355+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2469088935900548349', time=2024-09-14T13:21:10.624808+0000, chain.objs.size()=1 2024-09-14T11:25:17.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.355+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.Ll4UtnnYux6sl8rRXKN73tKp613qX0r_0 2024-09-14T11:25:17.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.355+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2086691342818058799', time=2024-09-14T13:21:50.690651+0000, chain.objs.size()=1 2024-09-14T11:25:17.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.355+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.p7kxCKu2BsOIdw9ByIHD_Yw-oIDfrQe_0 2024-09-14T11:25:17.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.359+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.361+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:25:17.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.362+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4718463275742915106', time=2024-09-14T13:17:13.742517+0000, chain.objs.size()=1 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.qa68qIyXPcUTxPgjRR1JeSf6HEAkuJS_0 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10923791790263068959', time=2024-09-14T13:17:16.358199+0000, chain.objs.size()=1 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.bx_Zak8hZ4ppbNAH9ZYX-MBn06H7oNZ_0 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8272759552844211508', time=2024-09-14T13:17:16.382737+0000, chain.objs.size()=1 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.QDz5Ee1Aq4zYM0YAOiid8DDuCbUBNjn_0 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8088840278176484040', time=2024-09-14T13:17:56.608660+0000, chain.objs.size()=1 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.TSJK3xGCURV1cJwpiVmq-rkmV9qibr7_0 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18067031998663990017', time=2024-09-14T13:18:31.027313+0000, chain.objs.size()=1 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.7g5MIvkfgyvSQL7xx3zYuT9D-WyuUFG_0 2024-09-14T11:25:17.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.504267612432568232', time=2024-09-14T13:18:34.262699+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.QZ-f2xevY2gOCpcMItrWI75DprcdLWQ_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8270576676616114791', time=2024-09-14T13:19:10.560656+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.GnCozRmZqNuxWrx9bHZUoxcH8Xhn7P7_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7717347106127377061', time=2024-09-14T13:19:14.668155+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.zKjsBpP1CK3r9QYUlUkfUf6GvrZO4ea_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11628768767921140427', time=2024-09-14T13:19:52.110201+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.vLIkt6S2cKnxde7xGbds9xo89GTvMOp_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1583225607054691185', time=2024-09-14T13:19:52.136619+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.0GBL3Us9BufttJ1ignSSvJXgS6dEc59_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5072132529041100363', time=2024-09-14T13:19:52.173593+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.c6doKI4oFrGUm7-e4veCRStmU8d194j_0 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12643805522490615040', time=2024-09-14T13:19:54.403725+0000, chain.objs.size()=1 2024-09-14T11:25:17.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.363+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.IpJwgfH9b7dmdTgWDTMYZr8ZONG2yd4_0 2024-09-14T11:25:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.366+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8462908835849001617', time=2024-09-14T13:21:09.012613+0000, chain.objs.size()=1 2024-09-14T11:25:17.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.366+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.LYqOP4tjhm6-8LpRoyxC0ObKOUKzHDA_0 2024-09-14T11:25:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.367+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8145258920451041986', time=2024-09-14T13:21:48.085229+0000, chain.objs.size()=1 2024-09-14T11:25:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.367+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.wtY_16sWKEVgDeTKX8CylcmAco7CGVT_0 2024-09-14T11:25:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.367+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12185504167259626383', time=2024-09-14T13:21:50.690984+0000, chain.objs.size()=1 2024-09-14T11:25:17.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.367+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.PuI9JWGGtq6pv7lpXEdbPqjg6kKHc8g_0 2024-09-14T11:25:17.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.371+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.373+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:25:17.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.374+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15205123856141964784', time=2024-09-14T13:15:49.182772+0000, chain.objs.size()=1 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.ZhKd6VFOxlTc7Nkvx2a1KZLhnRgJ1BX_0 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2643203964754534635', time=2024-09-14T13:15:49.192330+0000, chain.objs.size()=1 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.fqI2b2a7OnrCSKWmKMGItZekoJTpl9L_0 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3160922869332881102', time=2024-09-14T13:15:49.264602+0000, chain.objs.size()=4 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.1 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.2 2024-09-14T11:25:17.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.3 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.11__multipart_foo.2~IAR4AoSFu5DoEl5q6MyEHLiwWTRCwvx.4 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3988697292329232415', time=2024-09-14T13:15:49.332893+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.3SKiKWvzNKdV-ixUckEYu53OP-Mulzr_0 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10207823860188344932', time=2024-09-14T13:17:56.613121+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.FjGZjSmdBY3z90bCeep6s3cuWYfz3LQ_0 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8652119500093246333', time=2024-09-14T13:19:48.293534+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.otdMnavV6OGNcroSZH6_dsK7R3Dr_aN_0 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14945968874504176520', time=2024-09-14T13:19:54.407865+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.wpkIXUOBzBbLOmOUEdkaBdIoZrm4hOY_0 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15939201182940330088', time=2024-09-14T13:20:28.414104+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.rufSgJLXe_fpkvnRV6zqHXfjzsKZD3p_0 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13234772096232025370', time=2024-09-14T13:20:32.094624+0000, chain.objs.size()=1 2024-09-14T11:25:17.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.375+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.VmfpYoJ5Ivy_ge3fOwBO2f5UDQjWZ3T_0 2024-09-14T11:25:17.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.378+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12390549430390025447', time=2024-09-14T13:20:32.098209+0000, chain.objs.size()=1 2024-09-14T11:25:17.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.378+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.REcAA76gBMTQxD4LR8dT5YYUMIsyFG5_0 2024-09-14T11:25:17.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6328284894219476581', time=2024-09-14T13:21:06.289330+0000, chain.objs.size()=1 2024-09-14T11:25:17.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.M-vdS9Y9-4qWLhS2xAAjnRFXmi6yv7M_0 2024-09-14T11:25:17.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6716511849364464862', time=2024-09-14T13:21:10.590622+0000, chain.objs.size()=1 2024-09-14T11:25:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.-ID6cCsaCqpIr494pV5p7nq4TfvW37r_0 2024-09-14T11:25:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4244297093409362060', time=2024-09-14T13:21:10.621938+0000, chain.objs.size()=1 2024-09-14T11:25:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.379+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.f0JtBOn6agSaBbMBpypo9ZmBUBkVauB_0 2024-09-14T11:25:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.380+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16736521977173338790', time=2024-09-14T13:21:48.062476+0000, chain.objs.size()=1 2024-09-14T11:25:17.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.380+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.a93mL7NiRQlpQR43ZTLRFOUAbgFqpn2_0 2024-09-14T11:25:17.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7249510711444451202', time=2024-09-14T13:21:48.063299+0000, chain.objs.size()=1 2024-09-14T11:25:17.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.y3GN57JoUxPS7OvpGqMv0gSpAj7NyWl_0 2024-09-14T11:25:17.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18270024676566276327', time=2024-09-14T13:24:36.873824+0000, chain.objs.size()=1 2024-09-14T11:25:17.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.A-EzZLzBUhMnpCkgbgLKcKxFkC-0T5Y_0 2024-09-14T11:25:17.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6205070698500752585', time=2024-09-14T13:24:46.526546+0000, chain.objs.size()=1 2024-09-14T11:25:17.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.381+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:OAHDnG-shQNYBwrhCG2dq9o.jXO8ll1_.rgYSxdcTpbxQcfHgpluZwuoi2gl2yPT_0 2024-09-14T11:25:17.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.385+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.387+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:25:17.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.388+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7920648558087330682', time=2024-09-14T13:17:54.133050+0000, chain.objs.size()=1 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.cmS765abJeno1_akS6H8-ZZOEXuZOxv_0 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2943777779041869793', time=2024-09-14T13:17:54.160740+0000, chain.objs.size()=1 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.h29CoOYKeZtZDO8IGnPfg97CmMynu0J_0 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6404415791048404945', time=2024-09-14T13:17:56.609168+0000, chain.objs.size()=1 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.06tPNeAk01i89efA3EmIJTTFM7IYTW__0 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2512578508747020853', time=2024-09-14T13:18:36.814889+0000, chain.objs.size()=1 2024-09-14T11:25:17.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.TzodhbfsljlamcCrDHqrc0NQF_sMY7V_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2032281665742395465', time=2024-09-14T13:18:36.824347+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.iFES9TIwCngFHeL8BeH446-AvfQnAkg_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3250809773589398842', time=2024-09-14T13:18:39.043351+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.mxJi8kl8uhaDMTya3iof4MrvfFc2Ocv_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6996262081907935784', time=2024-09-14T13:19:10.586838+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.2ftmzH0qNTzgYn-Lwls_SIjij7iCs9Y_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14042648132219742944', time=2024-09-14T13:19:52.149005+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.SyW2hfsiqmBAT0ykELw5TsV9TLebK8l_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1874127459408706314', time=2024-09-14T13:19:54.383588+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.GJ1-_ieHdeFSlKzeW2VSIPlKIX8lbjz_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7291338758895335864', time=2024-09-14T13:20:32.131667+0000, chain.objs.size()=1 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.XxI9rOGI21_ciMXT3x4S5y2KXOxL-MC_0 2024-09-14T11:25:17.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6194777054513759521', time=2024-09-14T13:20:34.373406+0000, chain.objs.size()=1 2024-09-14T11:25:17.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.sntk9eI4mfcV9x1W6TxTgk5t8Nycht3_0 2024-09-14T11:25:17.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3616185088365100652', time=2024-09-14T13:21:06.275213+0000, chain.objs.size()=1 2024-09-14T11:25:17.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.389+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.ifGC890KWvEpZ9eWujy1kh8AAWyMNXR_0 2024-09-14T11:25:17.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.392+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6433580453532265225', time=2024-09-14T13:21:10.584142+0000, chain.objs.size()=1 2024-09-14T11:25:17.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.392+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.36__shadow_.dGtA7efn9r4Ss1lnLYGCVW5M4Nt7BDv_0 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13728941622511352077', time=2024-09-14T13:21:12.446816+0000, chain.objs.size()=1 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.eFe8eDnm9qosnqpO_h0bAA3TK5cfQo4_0 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18180559867818830255', time=2024-09-14T13:22:25.106074+0000, chain.objs.size()=1 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.RBqTAZjsGu5QGdYO9yMuS_RQi2DR_zM_0 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4968315616132788922', time=2024-09-14T13:22:25.149623+0000, chain.objs.size()=1 2024-09-14T11:25:17.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.394+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.sRwSH-0DqhBtBXuOtP4_QCalG7kKO5L_0 2024-09-14T11:25:17.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.397+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.400+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:25:17.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.401+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.401+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15342372364609467885', time=2024-09-14T13:15:49.154333+0000, chain.objs.size()=1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.opz-nUpLSp3exuIO1wole_gMTgpL9PV_0 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.441545903855536585', time=2024-09-14T13:15:49.178524+0000, chain.objs.size()=1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.AIYUsB-xK6BmxsnfHyfZZI21WVoLy5E_0 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1006836564891715346', time=2024-09-14T13:15:49.388038+0000, chain.objs.size()=5 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.1_1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__shadow_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.2_1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.17__multipart_foo-FROZEN.2~qCWCSLdcdwfRIxXCDGE3INKQ2V0DJdg.3 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10094721052240685149', time=2024-09-14T13:15:49.551958+0000, chain.objs.size()=1 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.8__shadow_.6QJASlxgwg7mVQDtGvFpm8UkRpmneAR_0 2024-09-14T11:25:17.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1172855426842385232', time=2024-09-14T13:17:13.710895+0000, chain.objs.size()=1 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.2aQIENMTJcbgK-Xo7LEB4XeCFeKg8uV_0 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4269697750243996742', time=2024-09-14T13:17:13.719808+0000, chain.objs.size()=1 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.WBFs966cyMHbzX3cn1GcZE9aVFF7uJh_0 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5709821952311221669', time=2024-09-14T13:17:54.202730+0000, chain.objs.size()=1 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.96IG3sX6sxIVVwupwig28RzojAkyTOK_0 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.709814009826211629', time=2024-09-14T13:18:31.022232+0000, chain.objs.size()=1 2024-09-14T11:25:17.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.402+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.EwNbr2T3hqbNUteMRgnn0fY-p9YuF5M_0 2024-09-14T11:25:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.405+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16519442703476211025', time=2024-09-14T13:18:36.746904+0000, chain.objs.size()=1 2024-09-14T11:25:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.405+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.9_tUlvcpESfivBNoYKSetDvk527u_JL_0 2024-09-14T11:25:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.405+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8913303964149240365', time=2024-09-14T13:18:36.795109+0000, chain.objs.size()=1 2024-09-14T11:25:17.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.405+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.M9vb743dvBmCCi48WHv00NbNXNMRHaO_0 2024-09-14T11:25:17.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.406+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14203378787189583734', time=2024-09-14T13:19:14.669646+0000, chain.objs.size()=1 2024-09-14T11:25:17.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.406+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.TUZ3r5uUWYhtmIZalp7czzp4o0Hd4sM_0 2024-09-14T11:25:17.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13121895770124640326', time=2024-09-14T13:19:48.219293+0000, chain.objs.size()=1 2024-09-14T11:25:17.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.L-Q8ixsgAvOeOAR88he4qCNOzS_fc73_0 2024-09-14T11:25:17.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4325724102168287013', time=2024-09-14T13:19:48.222512+0000, chain.objs.size()=1 2024-09-14T11:25:17.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.9_V5fNfGqMps-qKE8Rd5dl6hXiRvUHc_0 2024-09-14T11:25:17.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3234841763385085516', time=2024-09-14T13:19:54.349667+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.78r39WnQO1tqxzrdBu7gUrMumdGcGHl_0 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9164498135837264819', time=2024-09-14T13:19:54.369325+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.qS63pOCungWSlsTPn_HsApLTY9g5ArE_0 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.42532962327148683', time=2024-09-14T13:19:54.405498+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.CTNY0hsfrMt15CboGmNprTkfItiw0Ep_0 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8903810332801054715', time=2024-09-14T13:19:54.406181+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.5F8nHtEGJojQ8PaLmCxaWFL7qXDFwl1_0 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17870857593897873444', time=2024-09-14T13:20:28.401270+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.o3KrwohfQ_AJ2hJlY2X9BT-4h1pSm41_0 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12530999290798032722', time=2024-09-14T13:20:32.079601+0000, chain.objs.size()=1 2024-09-14T11:25:17.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.407+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.Kn2PgGOrt7zZLOEhO26YvtUergsSzRD_0 2024-09-14T11:25:17.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.408+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6965753296742958321', time=2024-09-14T13:21:06.299741+0000, chain.objs.size()=1 2024-09-14T11:25:17.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.408+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.b9in8r0BIZR6c7_f7a_EdKr7E_Brlhw_0 2024-09-14T11:25:17.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.408+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4860327336066821860', time=2024-09-14T13:21:44.374713+0000, chain.objs.size()=1 2024-09-14T11:25:17.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.408+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.l057WKUV_bKTKUaKtv-xPRqcSlhKHOX_0 2024-09-14T11:25:17.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.410+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8772020993825460846', time=2024-09-14T13:21:44.396206+0000, chain.objs.size()=1 2024-09-14T11:25:17.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.410+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.D1YDo5BBJi_VW_gYwOsz6VCXWbdC8G2_0 2024-09-14T11:25:17.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.411+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17825011351906627033', time=2024-09-14T13:21:48.015693+0000, chain.objs.size()=1 2024-09-14T11:25:17.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.411+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.B8BoZ_daYcb5QnVjiWDuxk-0KZdgI4l_0 2024-09-14T11:25:17.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.411+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.44154451871774440', time=2024-09-14T13:21:48.037956+0000, chain.objs.size()=1 2024-09-14T11:25:17.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.411+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.qg5NxhTFBXKnfuV_PyLScM0GiOIZIK4_0 2024-09-14T11:25:17.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.413+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14502304255291594305', time=2024-09-14T13:22:25.179185+0000, chain.objs.size()=1 2024-09-14T11:25:17.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.413+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.P_qofsz386nahIc6QzT6lXA3Qs46PkW_0 2024-09-14T11:25:17.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.413+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12116105175393649002', time=2024-09-14T13:22:25.203497+0000, chain.objs.size()=1 2024-09-14T11:25:17.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.413+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.7hzCFgQMUCZ4Q9-2iiQwzB6Ro0jbrRZ_0 2024-09-14T11:25:17.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.414+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3086743180678163915', time=2024-09-14T13:24:36.855219+0000, chain.objs.size()=1 2024-09-14T11:25:17.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.414+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.K6EdaZvNg8lcDUy-0TViJGAFEwj281k_0 2024-09-14T11:25:17.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.414+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.761996754702001757', time=2024-09-14T13:24:52.472503+0000, chain.objs.size()=1 2024-09-14T11:25:17.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.414+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:39rvaagvCBTWOGFX3UYyUTtVO1vg4d1_.t21pWAk49U8Q8LVUJDTHeaHptelocn__0 2024-09-14T11:25:17.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.416+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.419+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:25:17.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.420+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8294200721358384908', time=2024-09-14T13:17:13.742565+0000, chain.objs.size()=1 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.qya5JffgRl5Bd8NapIUYkdcPnCfQmhs_0 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17341826503047612413', time=2024-09-14T13:17:16.382758+0000, chain.objs.size()=1 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.YZFtgajm4ZM6KT5mnk2pAeOVf36FU-2_0 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4494858203438796226', time=2024-09-14T13:17:54.135612+0000, chain.objs.size()=1 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.FlAKtjyLRVAmWwNvlOcOewpH3etdmhK_0 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12057765976218828742', time=2024-09-14T13:17:56.609953+0000, chain.objs.size()=1 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.AZN_VyMZ3ioNRWipvX14FqdjwK-mDTE_0 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12808872880678021533', time=2024-09-14T13:17:56.680983+0000, chain.objs.size()=1 2024-09-14T11:25:17.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.MlV3oQk2CSMyvhYHYWFIx1H75h93V4A_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2552124836966475373', time=2024-09-14T13:18:31.025809+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.M66rBS3rTraqPE205F_ikXXO3KpW1jD_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5137013718976293745', time=2024-09-14T13:18:36.815401+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.qZBVToE5xQYxMQgRV9WgKBOps_LFj2p_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18309247161717384835', time=2024-09-14T13:19:10.541534+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.Yqjq1C2jfaaQOkmcbpFvbM57w1HTXRV_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1321119470164209577', time=2024-09-14T13:19:10.581438+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.o1YyW_BLB1U77y2JugkMtdeORX-FeHK_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4749788897065248785', time=2024-09-14T13:19:48.269532+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.L6dpOR4bJcsMJXpTTd4lUfEdOpmEB8i_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16478279081928015910', time=2024-09-14T13:19:48.283325+0000, chain.objs.size()=1 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.30__shadow_.Dt1tnAEyLQ77Q4vj0vQG94yRj86WI0W_0 2024-09-14T11:25:17.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2710433631120290535', time=2024-09-14T13:19:52.110293+0000, chain.objs.size()=1 2024-09-14T11:25:17.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.421+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.fK0oY6mPcKVzWV0hHpVgvDby1QAFRH4_0 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10193046606772780535', time=2024-09-14T13:19:54.403729+0000, chain.objs.size()=1 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.V4G7Q8adoz_WcqFGKJwmnNstuwQrlxL_0 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3150926301968571052', time=2024-09-14T13:20:28.372630+0000, chain.objs.size()=1 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.33__shadow_.9PjQf2H0zCdvhg9vRmhcCvakWtVrjPG_0 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13653800566623774062', time=2024-09-14T13:21:48.008150+0000, chain.objs.size()=1 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.i1fM55HwPc8PugyysWx_YCN1EPNiiSJ_0 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.449759766668696909', time=2024-09-14T13:22:25.170763+0000, chain.objs.size()=1 2024-09-14T11:25:17.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.426+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.dJTWbS_MGRCCty763nnZrXNejFics3H_0 2024-09-14T11:25:17.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.429+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.431+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:25:17.430 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.432+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3327281599000277286', time=2024-09-14T13:17:13.687726+0000, chain.objs.size()=1 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.CvUtiUn4xleQsuvayPMEfqUPXfcPAlu_0 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2629965633786195857', time=2024-09-14T13:17:13.721964+0000, chain.objs.size()=1 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.zikXmRq4cm55fuOfszkXZLZmkqBsWMJ_0 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1235417453728233158', time=2024-09-14T13:17:16.415141+0000, chain.objs.size()=1 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_.51jbsOd0iQlt4mYWgmwRetXT7EtDjcT_0 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7136394301228922117', time=2024-09-14T13:17:16.444743+0000, chain.objs.size()=1 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.21__shadow_._HVg8tJjBLNEX2mXI7yyjIZlelT-_9i_0 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16355283860387999771', time=2024-09-14T13:17:54.118989+0000, chain.objs.size()=1 2024-09-14T11:25:17.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.23__shadow_.B0s-kkhl74xNK-Heiq1CoPNnLd5X5lS_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5816130247067706901', time=2024-09-14T13:17:56.668733+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.NmNrFkvXkBkKo8u2qgz1tgc54nRc-Iv_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6372761806169288495', time=2024-09-14T13:17:56.669407+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.cLCLCoDNxyQ-P0asSvhiar7B6V7JvRO_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6237912126575435791', time=2024-09-14T13:17:56.674703+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.dkwaNx_ytv1dpLHzmJkixhwzznrK7HG_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8343573045276151788', time=2024-09-14T13:18:31.062583+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.AGwtm7RYuBvwq9RUsHKqWOnG-ZVcBKw_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.523552675459308819', time=2024-09-14T13:19:14.619270+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.29__shadow_.OeZZ-PsnjukTEodTWbFJMYQzLwqhFDn_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11631828567369268300', time=2024-09-14T13:20:32.056392+0000, chain.objs.size()=1 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.ZcaZyJmUhoRoSk8U0-1pRTH2euEewv7_0 2024-09-14T11:25:17.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4609310296658662204', time=2024-09-14T13:20:32.132499+0000, chain.objs.size()=1 2024-09-14T11:25:17.434 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.433+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.34__shadow_.djt6QcLR9NoH4J9kE3nhx3-SlReUGT1_0 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16016986580690864531', time=2024-09-14T13:21:48.033840+0000, chain.objs.size()=1 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.rNnhqM_0Cm4GlJH72BcgDKym7V1FOV1_0 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17950050897240479623', time=2024-09-14T13:21:48.083857+0000, chain.objs.size()=1 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.PzhWS4uy2IBG2MnjyytIt4FAAmJqVJ-_0 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12152699167235127416', time=2024-09-14T13:21:50.690113+0000, chain.objs.size()=1 2024-09-14T11:25:17.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.437+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.39__shadow_.Gv5uoqMHohz_bIPG1RtBF4DjwouyJ1P_0 2024-09-14T11:25:17.438 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.440+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.443+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:25:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.444+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.444+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:25:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12886648011228890183', time=2024-09-14T13:15:49.349104+0000, chain.objs.size()=2 2024-09-14T11:25:17.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.XaMw4SQ-na5xE4Ly27XNWoeKEAhyMZY_1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6516732014677589923', time=2024-09-14T13:15:49.585957+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.9__shadow_.Ay9vytFv-VMKAw8smg33FE-wrTvyOGq_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14230189215794200615', time=2024-09-14T13:17:12.355415+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.20__shadow_.dre6lDONlnr8pYM7s9oEu75seDbXnMY_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16460035316100996811', time=2024-09-14T13:17:50.901229+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.Ged22mrh_TzQY_g4MCQnLMhQ4M58OKW_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15520676365829857098', time=2024-09-14T13:17:56.587316+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.jUTEMlrdhXO_6UJhRLCD30YHktdE7zR_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8476618828784367756', time=2024-09-14T13:18:31.084708+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.25__shadow_.n6cG9P2LIwjVFhYhjvYJZPelCwhg55H_0 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3739917544663164850', time=2024-09-14T13:18:34.320457+0000, chain.objs.size()=1 2024-09-14T11:25:17.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.d_sI70TFsy6g-4J9-p6YKmT3j4jaNd1_0 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11793858176643181518', time=2024-09-14T13:19:52.116984+0000, chain.objs.size()=1 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.31__shadow_.w4eba-EilLQak-Yhv5UhAsKoQ28KjT-_0 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10092741709663039219', time=2024-09-14T13:19:54.367853+0000, chain.objs.size()=1 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.32__shadow_.QWYj3b6MEYJDrpfCnVIQDyigi75GQUw_0 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6333793290864269932', time=2024-09-14T13:21:06.280605+0000, chain.objs.size()=1 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.OU3_DAOzeqLS46sMrNuHE56RuU6fk9M_0 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9102540778506501262', time=2024-09-14T13:21:44.396298+0000, chain.objs.size()=1 2024-09-14T11:25:17.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.445+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.OxlHsCTE7LKZ3mB_gGUXBLX--RHK78h_0 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11822064366724808420', time=2024-09-14T13:21:44.442744+0000, chain.objs.size()=1 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.IeusJ-7T_8SOAe-hEL9uKqjL6vDk5Yd_0 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6905087224992166335', time=2024-09-14T13:22:25.147181+0000, chain.objs.size()=1 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.3rMCP2FDdk0Cf_G_SzZ-r6YPuriOZ9S_0 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11176029232703714402', time=2024-09-14T13:22:25.178488+0000, chain.objs.size()=1 2024-09-14T11:25:17.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.448+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.ViQMNEIG2C17RqjcYNVSgXAKn7J7NeP_0 2024-09-14T11:25:17.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.449+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5457779943149301491', time=2024-09-14T13:24:52.464185+0000, chain.objs.size()=1 2024-09-14T11:25:17.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.449+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.19__shadow:-VF.E46Csf-nDSF-3QfJ.usA6iImw5n_.EktgKWX2ipKGfuj1zdg5KMj8UmvWBUK_0 2024-09-14T11:25:17.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.452+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.454+0000 7f0eb132f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:25:17.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.456+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:17.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.456+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2793629875307540804', time=2024-09-14T13:15:49.159076+0000, chain.objs.size()=1 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.5__shadow_.W1fDKuBxXHSRQqyurtlZHF2hqfk-FFm_0 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='_KposS2-atjOXw1DkHBfnWLRsOT2sV1K', time=2024-09-14T13:15:49.352949+0000, chain.objs.size()=1 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.16__shadow_.s3fkMVHer3AdSi5Gg3brblRy0OlZaqc_0 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.420061083099638248', time=2024-09-14T13:17:50.897818+0000, chain.objs.size()=1 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.22__shadow_.H_p7ScpERmMiRIjbRypicPaMjRCXGwD_0 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2459279405088192334', time=2024-09-14T13:17:56.583266+0000, chain.objs.size()=1 2024-09-14T11:25:17.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.24__shadow_.V_2hSMJuBp3hP-vmfYzA_w-YASJXsPT_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3418704580265903614', time=2024-09-14T13:18:34.244397+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.26__shadow_.L8Exu3j5oNsHe2efOMftoBVEAtgPBBz_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9701394706944697344', time=2024-09-14T13:18:36.712252+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.27__shadow_.ktdgrWneTo46-IvmkA5lF7QpvqfVPEu_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13174789649037972751', time=2024-09-14T13:19:10.553883+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.28__shadow_.i84uIFwU8TSX7AFaitTYwRhciMmtcb8_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5931315527007283839', time=2024-09-14T13:21:06.341144+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.35__shadow_.arFc-8LaKEdQxpJm5YttlVtoX4ovi1h_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.873543649178851785', time=2024-09-14T13:21:44.408203+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.37__shadow_.c2KuY3bp9NUaBdfrQNxoZvNRjUzCvwh_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10311298680569460767', time=2024-09-14T13:21:48.040703+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.38__shadow_.qQJkqNsajd8YOD3T-HHnZB18hVWMLK3_0 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8367618949302443743', time=2024-09-14T13:22:25.168138+0000, chain.objs.size()=1 2024-09-14T11:25:17.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.40__shadow_.ZxRnKgRpuGqhRU60ODtum83qEWg4F0O_0 2024-09-14T11:25:17.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16269861596688552015', time=2024-09-14T13:24:36.863620+0000, chain.objs.size()=1 2024-09-14T11:25:17.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.457+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.18__shadow_.CyLAxtO4Pmoh9Jxsm86AE7nwSWMCW4l_0 2024-09-14T11:25:17.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.462+0000 7f0eb132f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:25:17.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.465+0000 7f0d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:17.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.467+0000 7f0eb132f800 20 remove_watcher() i=0 2024-09-14T11:25:17.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.467+0000 7f0eb132f800 2 removed watcher, disabling cache 2024-09-14T11:25:17.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.468+0000 7f0eb132f800 20 remove_watcher() i=1 2024-09-14T11:25:17.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.469+0000 7f0eb132f800 20 remove_watcher() i=2 2024-09-14T11:25:17.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.470+0000 7f0eb132f800 20 remove_watcher() i=3 2024-09-14T11:25:17.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.471+0000 7f0eb132f800 20 remove_watcher() i=4 2024-09-14T11:25:17.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.472+0000 7f0eb132f800 20 remove_watcher() i=5 2024-09-14T11:25:17.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.473+0000 7f0eb132f800 20 remove_watcher() i=6 2024-09-14T11:25:17.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.474+0000 7f0eb132f800 20 remove_watcher() i=7 2024-09-14T11:25:17.483 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:25:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:25:17.576 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:25:17.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.817+0000 7f6d5053e640 0 --2- 172.21.15.29:0/3049401518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a151619b80 0x55a151607a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:25:17.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.820+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.821+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.821+0000 7f6d5492c800 20 realm 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.821+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:17.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.822+0000 7f6d5492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:17.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.823+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:17.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.823+0000 7f6d5492c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:25:17.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.823+0000 7f6d5492c800 20 searching for the correct realm 2024-09-14T11:25:17.822 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:17.825+0000 7f6d4fd3d640 0 -- 172.21.15.29:0/3049401518 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f6d4007d420 msgr2=0x7f6d4007d840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.031+0000 7f6d50d3f640 0 -- 172.21.15.29:0/3049401518 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55a151634860 msgr2=0x55a151636c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:25:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:25:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:25:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:25:18.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:25:18.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:25:18.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:25:18.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.037+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:25:18.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 zone default found 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 4 Realm: () 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 zonegroup default 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.038+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.039+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.039+0000 7f6d5492c800 20 rados->read ofs=0 len=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.039+0000 7f6d5492c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.039+0000 7f6d5492c800 20 started sync module instance, tier type = 2024-09-14T11:25:18.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.039+0000 7f6d5492c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=0 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=1 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=2 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=3 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=4 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=5 2024-09-14T11:25:18.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.048+0000 7f6d5492c800 20 add_watcher() i=6 2024-09-14T11:25:18.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.049+0000 7f6d5492c800 20 add_watcher() i=7 2024-09-14T11:25:18.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.049+0000 7f6d5492c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:25:18.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.050+0000 7f6c067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.051+0000 7f6d5492c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:25:18.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.051+0000 7f6d5492c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:25:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.087+0000 7f6c057e2640 20 reqs_thread_entry: start 2024-09-14T11:25:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.088+0000 7f6d5492c800 20 init_complete bucket index max shards: 11 2024-09-14T11:25:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.088+0000 7f6d5492c800 20 Filter name: none 2024-09-14T11:25:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.088+0000 7f6b76ffd640 20 reqs_thread_entry: start 2024-09-14T11:25:18.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.088+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:25:18.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.090+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.091+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.091+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.092+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:25:18.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.093+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.094+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.094+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.095+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:25:18.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.096+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.097+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.097+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.099+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:25:18.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.100+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.101+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.101+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.102+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:25:18.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.103+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.104+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.104+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.105+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:25:18.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.107+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.107+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.107+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.108+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:25:18.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.110+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.110+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.111+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.112+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:25:18.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.113+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.113+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.114+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.115+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:25:18.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.116+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.117+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.117+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.118+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:25:18.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.119+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.120+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.120+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.119 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.121+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:25:18.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.122+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.123+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.123+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.124+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:25:18.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.125+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.126+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.126+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.127+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:25:18.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.128+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.129+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.129+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.130+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:25:18.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.131+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.132+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.132+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.133+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:25:18.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.134+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.132 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.135+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.135+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.136+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:25:18.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.137+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.137+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.138+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.139+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:25:18.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.140+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.140+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.140+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.141+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:25:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.143+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.143+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.144+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.144+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:25:18.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.146+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.147+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.147+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.148+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:25:18.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.149+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.150+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.150+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.151+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:25:18.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.152+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.153+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.153+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.155+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:25:18.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.156+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.156+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.156+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.157+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:25:18.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.159+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.159+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.159+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.160+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:25:18.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.162+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.162+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.162+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.163+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:25:18.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.164+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.165+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.165+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.166+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:25:18.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.167+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.167+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.168+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.169+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:25:18.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.170+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.170+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.170+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.171+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:25:18.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.173+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.174+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.174+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.175+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:25:18.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.177+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.177+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.177+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.178+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:25:18.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.180+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.180+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.180+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.181+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:25:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.183+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.183+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.183+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.184+0000 7f6d5492c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:25:18.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.185+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.186+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:25:18.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.186+0000 7f6d5492c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:25:18.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.188+0000 7f6c067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:25:18.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.190+0000 7f6d5492c800 20 remove_watcher() i=0 2024-09-14T11:25:18.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.190+0000 7f6d5492c800 2 removed watcher, disabling cache 2024-09-14T11:25:18.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.191+0000 7f6d5492c800 20 remove_watcher() i=1 2024-09-14T11:25:18.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.192+0000 7f6d5492c800 20 remove_watcher() i=2 2024-09-14T11:25:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.193+0000 7f6d5492c800 20 remove_watcher() i=3 2024-09-14T11:25:18.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.194+0000 7f6d5492c800 20 remove_watcher() i=4 2024-09-14T11:25:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.195+0000 7f6d5492c800 20 remove_watcher() i=5 2024-09-14T11:25:18.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.195+0000 7f6d5492c800 20 remove_watcher() i=6 2024-09-14T11:25:18.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:25:18.196+0000 7f6d5492c800 20 remove_watcher() i=7 2024-09-14T11:25:18.206 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:25:18.747 INFO:teuthology.orchestra.run.smithi029.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:25:22.348 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:25:42.247 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileJava 2024-09-14T11:25:42.248 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processResources 2024-09-14T11:25:42.347 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :classes 2024-09-14T11:25:43.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:43.047 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileTestJava 2024-09-14T11:25:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:25:43.048 INFO:teuthology.orchestra.run.smithi029.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:25:43.049 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:43.049 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:25:43.049 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :testClasses 2024-09-14T11:25:49.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:49.047 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :test 2024-09-14T11:25:49.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:49.048 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:25:53.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:53.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:25:53.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:53.447 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:25:53.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:53.547 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:25:53.946 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:53.947 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:25:59.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:59.447 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:25:59.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:59.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:25:59.848 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:25:59.848 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:26:00.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:00.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:26:00.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:00.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:26:00.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:00.547 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:26:05.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:05.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:26:05.846 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:05.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:26:06.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:06.147 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:26:06.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14 11:26:06,067 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:26:58.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:58.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:26:58.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:58.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:26:58.947 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:58.947 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:26:59.347 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:59.347 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:26:59.447 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:26:59.447 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:27:00.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:00.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:27:04.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:04.147 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:27:04.546 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:04.547 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:27:04.646 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:04.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:27:04.746 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:04.746 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:27:10.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:10.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:27:11.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:11.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:27:19.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:19.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:27:19.947 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:19.947 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:27:26.347 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:26.347 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:27:26.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:27:26.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:28:18.647 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:18.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:28:19.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:19.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:28:23.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:23.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:28:24.347 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:24.347 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:28:37.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:37.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:28:37.646 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:37.646 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:28:40.246 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:40.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:28:55.547 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:55.547 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:28:55.646 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:55.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:28:56.047 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:56.047 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:28:56.146 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:56.147 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:28:56.647 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:56.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:28:56.647 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:56.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:28:57.147 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:57.147 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:28:57.246 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:57.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:28:57.647 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:57.647 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:28:57.746 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:57.747 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:28:58.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:58.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:28:58.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:58.247 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:28:58.746 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:58.747 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:28:58.847 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:58.847 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:28:59.246 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:28:59.246 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:29:07.747 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:07.747 INFO:teuthology.orchestra.run.smithi029.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:29:08.247 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:08.247 INFO:teuthology.orchestra.run.smithi029.stdout:---------------------------------------------------------------------- 2024-09-14T11:29:08.247 INFO:teuthology.orchestra.run.smithi029.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:29:08.247 INFO:teuthology.orchestra.run.smithi029.stdout:---------------------------------------------------------------------- 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout:BUILD SUCCESSFUL in 3m 49s 2024-09-14T11:29:08.288 INFO:teuthology.orchestra.run.smithi029.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:29:08.606 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:08.659 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:08.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.701+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 realm 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.703+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.704+0000 7f531ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:08.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.704+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:08.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.705+0000 7f531ab42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:08.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.705+0000 7f531ab42800 20 searching for the correct realm 2024-09-14T11:29:08.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.705+0000 7f5316886640 0 -- 172.21.15.29:0/2910925434 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x55e4da558a70 msgr2=0x55e4da55af30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:08.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:08.910+0000 7f5316886640 0 -- 172.21.15.29:0/2910925434 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x7f53100b82f0 msgr2=0x7f53100563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.120+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 zone default found 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 4 Realm: () 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 zonegroup default 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.121+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.122+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.122+0000 7f531ab42800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.122+0000 7f531ab42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.122+0000 7f531ab42800 20 started sync module instance, tier type = 2024-09-14T11:29:09.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.122+0000 7f531ab42800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:09.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=0 2024-09-14T11:29:09.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=1 2024-09-14T11:29:09.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=2 2024-09-14T11:29:09.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=3 2024-09-14T11:29:09.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=4 2024-09-14T11:29:09.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=5 2024-09-14T11:29:09.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.132+0000 7f531ab42800 20 add_watcher() i=6 2024-09-14T11:29:09.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.133+0000 7f531ab42800 20 add_watcher() i=7 2024-09-14T11:29:09.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.133+0000 7f531ab42800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:09.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.135+0000 7f51cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.136+0000 7f531ab42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:09.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.136+0000 7f531ab42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:09.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.174+0000 7f5147fff640 20 reqs_thread_entry: start 2024-09-14T11:29:09.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.175+0000 7f531ab42800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:09.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.175+0000 7f531ab42800 20 Filter name: none 2024-09-14T11:29:09.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.175+0000 7f5145ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:09.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.175+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:09.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.177+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.177+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10189513062282202697', time=2024-09-14T13:26:54.817267+0000, chain.objs.size()=7 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.1 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.1_1 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.1_2 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.2 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.2_1 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.2_2 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~iuExRJ5y3nXTs7-Yrf97uiaBdeopVWn.3 2024-09-14T11:29:09.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.481641167550801959', time=2024-09-14T13:28:01.851344+0000, chain.objs.size()=19 2024-09-14T11:29:09.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.1 2024-09-14T11:29:09.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.1_1 2024-09-14T11:29:09.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.2 2024-09-14T11:29:09.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.2_1 2024-09-14T11:29:09.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.178+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.3 2024-09-14T11:29:09.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.181+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.3_1 2024-09-14T11:29:09.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.182+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.4 2024-09-14T11:29:09.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.183+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.4_1 2024-09-14T11:29:09.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.184+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.5 2024-09-14T11:29:09.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.184+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.5_1 2024-09-14T11:29:09.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.184+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.6 2024-09-14T11:29:09.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.184+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.6_1 2024-09-14T11:29:09.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.185+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.7 2024-09-14T11:29:09.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.185+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.7_1 2024-09-14T11:29:09.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.185+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.8 2024-09-14T11:29:09.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.185+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.8_1 2024-09-14T11:29:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.189+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.9 2024-09-14T11:29:09.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.189+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.9_1 2024-09-14T11:29:09.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.189+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~btoThnozrwc5DcYUZpLUVjC6bEscgco.10 2024-09-14T11:29:09.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.194+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.197+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:09.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.198+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.198+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1148158886013812443', time=2024-09-14T13:25:59.543962+0000, chain.objs.size()=9 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__multipart_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.1 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__shadow_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.1_1 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__multipart_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.2 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__shadow_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.2_1 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__multipart_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.3 2024-09-14T11:29:09.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__shadow_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.3_1 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__multipart_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.4 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__shadow_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.4_1 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.43__multipart_key1.2~jJlT6f2ro5f_PeLKFtJViN37f5UKhn5.5 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2689435008761985916', time=2024-09-14T13:28:10.212037+0000, chain.objs.size()=16 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.1 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.1_1 2024-09-14T11:29:09.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.199+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.1_2 2024-09-14T11:29:09.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.203+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.2 2024-09-14T11:29:09.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.2_1 2024-09-14T11:29:09.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.2_2 2024-09-14T11:29:09.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.3 2024-09-14T11:29:09.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.3_1 2024-09-14T11:29:09.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.3_2 2024-09-14T11:29:09.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.4 2024-09-14T11:29:09.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.4_1 2024-09-14T11:29:09.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.4_2 2024-09-14T11:29:09.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.5 2024-09-14T11:29:09.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.205+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.5_1 2024-09-14T11:29:09.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.208+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.5_2 2024-09-14T11:29:09.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.209+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~UHIMIiHFhWTvl_vrtdm1lJ9w_vMTFpT.6 2024-09-14T11:29:09.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.212+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8432545913209792820', time=2024-09-14T13:28:22.889200+0000, chain.objs.size()=1 2024-09-14T11:29:09.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.212+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__shadow_.QTYN2J8UODazWpL-4v3n6ohi7CauEbv_0 2024-09-14T11:29:09.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.215+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.217+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:09.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.218+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6658659851469966677', time=2024-09-14T13:26:51.219293+0000, chain.objs.size()=9 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.1 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.1_1 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.2 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.2_1 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.3 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.3_1 2024-09-14T11:29:09.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.4 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.4_1 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~uQY2kD5nzAtW1E1lPHV70HLP2axc9OK.5 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1416963830590280204', time=2024-09-14T13:26:58.207526+0000, chain.objs.size()=6 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_0 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_1 2024-09-14T11:29:09.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.219+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_2 2024-09-14T11:29:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.223+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_3 2024-09-14T11:29:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.223+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_4 2024-09-14T11:29:09.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.223+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.47__shadow_.pD_G7DksM0eexbMxRUWTek6vbSa6lla_5 2024-09-14T11:29:09.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.228+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.230+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.232+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6531902273561089650', time=2024-09-14T13:28:23.976114+0000, chain.objs.size()=9 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__multipart_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.1 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__shadow_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.1_1 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__multipart_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.2 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__shadow_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.2_1 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__multipart_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.3 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__shadow_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.3_1 2024-09-14T11:29:09.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__multipart_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.4 2024-09-14T11:29:09.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__shadow_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.4_1 2024-09-14T11:29:09.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.233+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.57__multipart_key1.2~Wo9Ki-ikDaGE1XLLJC7_oLO45ogp0sk.5 2024-09-14T11:29:09.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.239+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.241+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:09.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.242+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4235847024873859007', time=2024-09-14T13:27:10.936864+0000, chain.objs.size()=9 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__multipart_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.1 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__shadow_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.1_1 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__multipart_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.2 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__shadow_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.2_1 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__multipart_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.3 2024-09-14T11:29:09.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__shadow_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.3_1 2024-09-14T11:29:09.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__multipart_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.4 2024-09-14T11:29:09.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__shadow_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.4_1 2024-09-14T11:29:09.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.243+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.53__multipart_key1.2~imfWw1uDnNAzfEReTQzAxwrrrnRl8Wq.5 2024-09-14T11:29:09.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.250+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.252+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.253+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.254+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.254+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.254+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15289222033339521847', time=2024-09-14T13:27:45.235353+0000, chain.objs.size()=21 2024-09-14T11:29:09.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.254+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.1_1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.2 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.2_1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.3 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.3_1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.4 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.4_1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.5 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.5_1 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.6 2024-09-14T11:29:09.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.255+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.6_1 2024-09-14T11:29:09.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.257+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.7 2024-09-14T11:29:09.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.258+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.7_1 2024-09-14T11:29:09.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.8 2024-09-14T11:29:09.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.8_1 2024-09-14T11:29:09.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.9 2024-09-14T11:29:09.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.9_1 2024-09-14T11:29:09.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.10 2024-09-14T11:29:09.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.10_1 2024-09-14T11:29:09.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.261+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Ox2R1klrldg8aFCCD8USrk5lwXjGHg1.11 2024-09-14T11:29:09.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.265+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.268+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:09.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.269+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14699956578459568126', time=2024-09-14T13:26:26.283625+0000, chain.objs.size()=9 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.1 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.1_1 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.2 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.2_1 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.3 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.3_1 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.4 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.4_1 2024-09-14T11:29:09.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.270+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~gXoqjN2lzeFYGNHXOJ9hUsnF0x52Kha.5 2024-09-14T11:29:09.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.275+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.277+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:09.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.279+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.279+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.279+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.280+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:09.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.281+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18063704015064273792', time=2024-09-14T13:26:38.989426+0000, chain.objs.size()=9 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.1 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.1_1 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.2 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.2_1 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.3 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.3_1 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.4 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.4_1 2024-09-14T11:29:09.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.282+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~DYnkgAB8moa3DKtqu0JaM2PWfFT_Ezh.5 2024-09-14T11:29:09.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.287+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.289+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.291+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.291+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.291+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.291+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16459547178510494034', time=2024-09-14T13:28:56.813321+0000, chain.objs.size()=1 2024-09-14T11:29:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.291+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.62__shadow_.bfPqTENnTtsHSW1Cf0MIG4gX1cvbF5X_0 2024-09-14T11:29:09.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.292+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.295+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.298+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.298+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16645494378658632457', time=2024-09-14T13:28:18.509258+0000, chain.objs.size()=16 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.1 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.1_1 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.1_2 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.2 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.2_1 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.2_2 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.3 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.3_1 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.3_2 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.4 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.4_1 2024-09-14T11:29:09.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.299+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.4_2 2024-09-14T11:29:09.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.305+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.5 2024-09-14T11:29:09.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.305+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.5_1 2024-09-14T11:29:09.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.305+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.5_2 2024-09-14T11:29:09.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.305+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~SbsIIZ3uEdqOsTpp0-ME_rD32uXVFKO.6 2024-09-14T11:29:09.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.308+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.310+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:09.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.311+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16636527791166639779', time=2024-09-14T13:27:19.517030+0000, chain.objs.size()=1 2024-09-14T11:29:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_.UFK3R1ZFJjGM3TAS_xwMTBWccDeVO43_0 2024-09-14T11:29:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11598769191621093771', time=2024-09-14T13:28:57.880706+0000, chain.objs.size()=1 2024-09-14T11:29:09.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.312+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.64__shadow_.H9nqi4jYYM3R-Sqj9H7gxzMpms-Vjfy_0 2024-09-14T11:29:09.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.314+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.316+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:09.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.317+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:29:09.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq', time=2024-09-14T13:27:26.622550+0000, chain.objs.size()=5 2024-09-14T11:29:09.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.55__multipart_key1.2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq.7 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.55__shadow_key1.2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq.7_1 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.55__multipart_key1.2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq.10 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.55__shadow_key1.2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq.10_1 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.55__multipart_key1.2~WY6W04VgH7hfDNaef1wJuXopgQRnDxq.13 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2828652461609941521', time=2024-09-14T13:28:18.738867+0000, chain.objs.size()=16 2024-09-14T11:29:09.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.1 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.1_1 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.1_2 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.318+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.2 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.319+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.2_1 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.319+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.2_2 2024-09-14T11:29:09.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.319+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.3 2024-09-14T11:29:09.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.3_1 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.3_2 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.4 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.4_1 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.4_2 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.5 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.5_1 2024-09-14T11:29:09.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.322+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.5_2 2024-09-14T11:29:09.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.324+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~jTob2gWHAdIetHbyE91Gpy1ybEXJwUi.6 2024-09-14T11:29:09.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.324+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:50.968458+0000, chain.objs.size()=1 2024-09-14T11:29:09.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.324+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.17 2024-09-14T11:29:09.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.324+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:51.136117+0000, chain.objs.size()=1 2024-09-14T11:29:09.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.324+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.20 2024-09-14T11:29:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.327+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:51.213206+0000, chain.objs.size()=62 2024-09-14T11:29:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.327+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.1 2024-09-14T11:29:09.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.327+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.2 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.328+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.3 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.328+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.4 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.329+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.5 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.329+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.6 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.329+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.7 2024-09-14T11:29:09.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.329+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.8 2024-09-14T11:29:09.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.330+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.9 2024-09-14T11:29:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.330+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.10 2024-09-14T11:29:09.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.330+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.11 2024-09-14T11:29:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.333+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.12 2024-09-14T11:29:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.333+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.13 2024-09-14T11:29:09.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.333+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.14 2024-09-14T11:29:09.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.15 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.16 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.vcBhpc3pTQRXiONQpsUyPBgWmPoeADyi.17 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.18 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.19 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.pqMzIOw4gjwlPulVP99dlea6rr98ArnD.20 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.21 2024-09-14T11:29:09.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.334+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.22 2024-09-14T11:29:09.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.337+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.23 2024-09-14T11:29:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.337+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.24 2024-09-14T11:29:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.338+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.25 2024-09-14T11:29:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.338+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.26 2024-09-14T11:29:09.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.338+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.27 2024-09-14T11:29:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.339+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.28 2024-09-14T11:29:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.339+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.29 2024-09-14T11:29:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.339+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.30 2024-09-14T11:29:09.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.339+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.31 2024-09-14T11:29:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.340+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.32 2024-09-14T11:29:09.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.340+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.33 2024-09-14T11:29:09.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.341+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.34 2024-09-14T11:29:09.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.342+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.35 2024-09-14T11:29:09.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.344+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.36 2024-09-14T11:29:09.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.344+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.37 2024-09-14T11:29:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.344+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.38 2024-09-14T11:29:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.345+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.39 2024-09-14T11:29:09.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.345+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.40 2024-09-14T11:29:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.41 2024-09-14T11:29:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.42 2024-09-14T11:29:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.43 2024-09-14T11:29:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.44 2024-09-14T11:29:09.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.45 2024-09-14T11:29:09.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.346+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.46 2024-09-14T11:29:09.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.348+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.47 2024-09-14T11:29:09.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.348+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.48 2024-09-14T11:29:09.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.348+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.49 2024-09-14T11:29:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.349+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.50 2024-09-14T11:29:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.349+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.51 2024-09-14T11:29:09.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.350+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.52 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.53 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.54 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.55 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.56 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.57 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.58 2024-09-14T11:29:09.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.59 2024-09-14T11:29:09.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.352+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.60 2024-09-14T11:29:09.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.354+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.61 2024-09-14T11:29:09.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.354+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.62 2024-09-14T11:29:09.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.355+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:52.372778+0000, chain.objs.size()=9 2024-09-14T11:29:09.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.355+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.63 2024-09-14T11:29:09.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.357+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.64 2024-09-14T11:29:09.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.357+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.65 2024-09-14T11:29:09.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.357+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.66 2024-09-14T11:29:09.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.357+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.67 2024-09-14T11:29:09.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.357+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.68 2024-09-14T11:29:09.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.358+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.69 2024-09-14T11:29:09.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.358+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.70 2024-09-14T11:29:09.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.358+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.71 2024-09-14T11:29:09.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.358+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:53.647348+0000, chain.objs.size()=7 2024-09-14T11:29:09.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.358+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.72 2024-09-14T11:29:09.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.360+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.73 2024-09-14T11:29:09.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.360+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.74 2024-09-14T11:29:09.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.361+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.75 2024-09-14T11:29:09.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.361+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.76 2024-09-14T11:29:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.363+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.77 2024-09-14T11:29:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.363+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.80 2024-09-14T11:29:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.363+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:54.603052+0000, chain.objs.size()=5 2024-09-14T11:29:09.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.363+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.78 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.79 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.81 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.82 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.83 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:55.246125+0000, chain.objs.size()=8 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.84 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.85 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.86 2024-09-14T11:29:09.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.365+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.87 2024-09-14T11:29:09.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.366+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.88 2024-09-14T11:29:09.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.366+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.89 2024-09-14T11:29:09.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.368+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.91 2024-09-14T11:29:09.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.368+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.92 2024-09-14T11:29:09.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.368+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV', time=2024-09-14T13:28:55.321310+0000, chain.objs.size()=1 2024-09-14T11:29:09.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.368+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.59__multipart_key1.2~jNKSKk2E6dOlWr2_vRGlDaqROhBlCIV.90 2024-09-14T11:29:09.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.373+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.375+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.377+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.377+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7889167071182101457', time=2024-09-14T13:27:53.898453+0000, chain.objs.size()=21 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.1 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.1_1 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.2 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.2_1 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.3 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.3_1 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.4 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.4_1 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.5 2024-09-14T11:29:09.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.5_1 2024-09-14T11:29:09.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.6 2024-09-14T11:29:09.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.378+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.6_1 2024-09-14T11:29:09.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.381+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.7 2024-09-14T11:29:09.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.381+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.7_1 2024-09-14T11:29:09.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.383+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.8 2024-09-14T11:29:09.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.8_1 2024-09-14T11:29:09.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.9 2024-09-14T11:29:09.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.9_1 2024-09-14T11:29:09.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.10 2024-09-14T11:29:09.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__shadow_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.10_1 2024-09-14T11:29:09.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.384+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.56__multipart_key1.2~Sc_sVIaAF3PSiLrEgzKFXdkU0FO5NYK.11 2024-09-14T11:29:09.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.389+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.392+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:09.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.393+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.394+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.395+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.396+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:09.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.397+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.396 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd', time=2024-09-14T13:25:52.938948+0000, chain.objs.size()=9 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__multipart_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.1 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__shadow_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.1_1 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__multipart_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.2 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__shadow_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.2_1 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__multipart_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.3 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__shadow_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.3_1 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__multipart_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.4 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__shadow_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.4_1 2024-09-14T11:29:09.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.398+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.41__multipart_key1.2~Uy_b6-akSEfoeRjTm-PVzQyAhVbhidd.5 2024-09-14T11:29:09.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.403+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.405+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:09.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.406+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13489889688970402971', time=2024-09-14T13:28:55.741647+0000, chain.objs.size()=1 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.60__shadow_.bSPFnsa0PNoFs_cnJT0DgIIvATAlW_6_0 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7526317919171927032', time=2024-09-14T13:29:07.904097+0000, chain.objs.size()=21 2024-09-14T11:29:09.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.1_1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.2 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.2_1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.3 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.3_1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.4 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.4_1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.5 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.5_1 2024-09-14T11:29:09.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.407+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.6 2024-09-14T11:29:09.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.411+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.6_1 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.7 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.7_1 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.8 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.8_1 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.9 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.9_1 2024-09-14T11:29:09.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.10 2024-09-14T11:29:09.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__shadow_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.10_1 2024-09-14T11:29:09.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.412+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.67__multipart_key1.2~mFhzjaQhhaBEOV2xsI2jcAw1JhOsy_G.11 2024-09-14T11:29:09.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.419+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.421+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:09.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.422+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:29:09.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4057393355756881606', time=2024-09-14T13:27:19.479008+0000, chain.objs.size()=9 2024-09-14T11:29:09.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.1 2024-09-14T11:29:09.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.1_1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.2 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.2_1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.3 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.3_1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.4 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.4_1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file2.mpg.2~NtKhWu3Utfdi31jgBmk1H_AvyIg1WKQ.5 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10613885218181483287', time=2024-09-14T13:28:37.364360+0000, chain.objs.size()=9 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__multipart_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__shadow_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.1_1 2024-09-14T11:29:09.423 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.423+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__multipart_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.2 2024-09-14T11:29:09.424 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.426+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__shadow_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.2_1 2024-09-14T11:29:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.427+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__multipart_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.3 2024-09-14T11:29:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.427+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__shadow_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.3_1 2024-09-14T11:29:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.427+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__multipart_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.4 2024-09-14T11:29:09.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.427+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__shadow_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.4_1 2024-09-14T11:29:09.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.428+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.58__multipart_key1.2~UveuNHfwH2afW9Q5C3THFObf5iTVorz.5 2024-09-14T11:29:09.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.428+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15401392538325468510', time=2024-09-14T13:28:57.346323+0000, chain.objs.size()=1 2024-09-14T11:29:09.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.428+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.63__shadow_.ELbRyPHwmRX8uvox7w03qgcfgU4jmBn_0 2024-09-14T11:29:09.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.433+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.435+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:09.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.437+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.437+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6408743966541671785', time=2024-09-14T13:26:58.522321+0000, chain.objs.size()=7 2024-09-14T11:29:09.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.1 2024-09-14T11:29:09.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.1_1 2024-09-14T11:29:09.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.1_2 2024-09-14T11:29:09.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.2 2024-09-14T11:29:09.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.2_1 2024-09-14T11:29:09.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.2_2 2024-09-14T11:29:09.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.438+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~3_wZOUNJLXkwYTCb1Hj8Oe4FdCgpPvA.3 2024-09-14T11:29:09.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.441+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.444+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.445+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.446+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.446+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.446+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3429200323373044861', time=2024-09-14T13:27:19.433598+0000, chain.objs.size()=1 2024-09-14T11:29:09.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.446+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_.W_1BtzuX9DkcxLSI2pDKE-dyDX8vMkP_0 2024-09-14T11:29:09.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.447+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.449+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:09.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.451+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.451+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.451+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.452+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.454+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.454+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.454+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.455+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:09.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.457+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.455 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.457+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4778968950684855716', time=2024-09-14T13:26:57.983833+0000, chain.objs.size()=7 2024-09-14T11:29:09.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.1 2024-09-14T11:29:09.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.1_1 2024-09-14T11:29:09.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.1_2 2024-09-14T11:29:09.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.2 2024-09-14T11:29:09.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.2_1 2024-09-14T11:29:09.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__shadow_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.2_2 2024-09-14T11:29:09.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.458+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.48__multipart_key1.2~GpmmSJsA7D77986ndFT5ujbopkIKRk_.3 2024-09-14T11:29:09.459 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.461+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.464+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:09.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.465+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.466+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.466+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.467+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:09.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.468+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16024464961106346444', time=2024-09-14T13:26:05.530439+0000, chain.objs.size()=9 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.1 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.1_1 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.2 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.2_1 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.3 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.3_1 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.4 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.4_1 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.5 2024-09-14T11:29:09.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1013112078763377057', time=2024-09-14T13:27:19.556506+0000, chain.objs.size()=1 2024-09-14T11:29:09.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.469+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_.3CsBxEpDTK0hr6O5KDV8sc5EIUJwfp4_0 2024-09-14T11:29:09.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.474+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.477+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:09.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.478+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14669724694150500936', time=2024-09-14T13:27:19.394744+0000, chain.objs.size()=9 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.1_1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.2 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.2_1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.3 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.3_1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.4 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__shadow_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.4_1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.54__multipart_file.mpg.2~t_PvJKdK6w0wajGdWpfKne6C3cNP0AJ.5 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5431035477168615764', time=2024-09-14T13:28:56.281007+0000, chain.objs.size()=1 2024-09-14T11:29:09.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.479+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.61__shadow_.L1q8JbU4LaIwWhI4PUfvJMm4zaBccZb_0 2024-09-14T11:29:09.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.484+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.487+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:09.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.488+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.489+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.489+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.489+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10754158468152219036', time=2024-09-14T13:28:58.414708+0000, chain.objs.size()=1 2024-09-14T11:29:09.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.489+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.65__shadow_.ofJGUrKjcG3h4zmQrQNmX5ezqp0-k8E_0 2024-09-14T11:29:09.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.490+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.493+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.494+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.494+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.494+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.495+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.497+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.497+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.497+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.498+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:09.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.499+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.500+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.500+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.501+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:09.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.503+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.503+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.503+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.502 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.504+0000 7f531ab42800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:09.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.506+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.504 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.506+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:29:09.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16884490490072806281', time=2024-09-14T13:26:05.213927+0000, chain.objs.size()=9 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.1_1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.2 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.2_1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.3 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.3_1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.4 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__shadow_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.4_1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.45__multipart_key1.2~TcfpfKlaq8_Z1qDdXL-BMVga_VkUU-F.5 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3112726387813233872', time=2024-09-14T13:27:04.229049+0000, chain.objs.size()=9 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__multipart_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__shadow_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.1_1 2024-09-14T11:29:09.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.507+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__multipart_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.2 2024-09-14T11:29:09.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.511+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__shadow_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.2_1 2024-09-14T11:29:09.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.511+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__multipart_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.3 2024-09-14T11:29:09.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.511+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__shadow_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.3_1 2024-09-14T11:29:09.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.511+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__multipart_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.4 2024-09-14T11:29:09.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.511+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__shadow_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.4_1 2024-09-14T11:29:09.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.512+0000 7f531ab42800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.52__multipart_key1.2~QKEc66q2vo1jG_MBbpgwDJhMXIVEIx4.5 2024-09-14T11:29:09.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.516+0000 7f531ab42800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:09.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.520+0000 7f51cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.522+0000 7f531ab42800 20 remove_watcher() i=0 2024-09-14T11:29:09.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.522+0000 7f531ab42800 2 removed watcher, disabling cache 2024-09-14T11:29:09.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.523+0000 7f531ab42800 20 remove_watcher() i=1 2024-09-14T11:29:09.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.524+0000 7f531ab42800 20 remove_watcher() i=2 2024-09-14T11:29:09.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.525+0000 7f531ab42800 20 remove_watcher() i=3 2024-09-14T11:29:09.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.526+0000 7f531ab42800 20 remove_watcher() i=4 2024-09-14T11:29:09.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.527+0000 7f531ab42800 20 remove_watcher() i=5 2024-09-14T11:29:09.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.528+0000 7f531ab42800 20 remove_watcher() i=6 2024-09-14T11:29:09.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.529+0000 7f531ab42800 20 remove_watcher() i=7 2024-09-14T11:29:09.539 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:09.592 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:09.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.634+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 realm 2024-09-14T11:29:09.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.636+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.637+0000 7f1471120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.637+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.638+0000 7f1471120800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:09.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.638+0000 7f1471120800 20 searching for the correct realm 2024-09-14T11:29:09.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.640+0000 7f146d503640 0 -- 172.21.15.29:0/1727330459 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1464072bd0 msgr2=0x7f1464080430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.644+0000 7f146c501640 0 -- 172.21.15.29:0/1727330459 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1464093040 msgr2=0x7f14640a3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:09.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.850+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.851+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.851+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.851+0000 7f1471120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.851+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 zone default found 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 4 Realm: () 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 zonegroup default 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.852+0000 7f1471120800 20 rados->read ofs=0 len=0 2024-09-14T11:29:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.853+0000 7f1471120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.853+0000 7f1471120800 20 started sync module instance, tier type = 2024-09-14T11:29:09.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.853+0000 7f1471120800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=0 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=1 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=2 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=3 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=4 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=5 2024-09-14T11:29:09.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.862+0000 7f1471120800 20 add_watcher() i=6 2024-09-14T11:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.863+0000 7f1471120800 20 add_watcher() i=7 2024-09-14T11:29:09.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.863+0000 7f1471120800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:09.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.864+0000 7f13237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.865+0000 7f1471120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:09.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.865+0000 7f1471120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:09.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.899+0000 7f13227e4640 20 reqs_thread_entry: start 2024-09-14T11:29:09.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.899+0000 7f1471120800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:09.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.899+0000 7f1471120800 20 Filter name: none 2024-09-14T11:29:09.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.900+0000 7f131bfff640 20 reqs_thread_entry: start 2024-09-14T11:29:09.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.900+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.901+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.901+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.902+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.902+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:09.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.904+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.904+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.904+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.905+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.906+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.907+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.907+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.908+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:09.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.909+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.910+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.910+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.911+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.912+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.913+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.913+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.914+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:09.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.915+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.916+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.916+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.917+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.918+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.918+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.919+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.920+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:09.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.921+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.921+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.922+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.923+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:09.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.924+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.924+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.925+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.925+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:09.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.927+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.928+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.928+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.929+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:09.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.930+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.931+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.931+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.932+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:09.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.933+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.934+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.934+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.935+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:09.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.936+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.937+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.937+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.938+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:09.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.939+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.940+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.940+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.941+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:09.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.942+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.942+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.943+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.944+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:09.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.945+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.946+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.946+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.947+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:09.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.948+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.949+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.949+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.951+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:09.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.952+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.953+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.953+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.954+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:09.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.955+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.956+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.956+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.957+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:09.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.958+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.959+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.959+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.960+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:09.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.961+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.961+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.962+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.963+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:09.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.964+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.965+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.965+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.966+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:09.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.967+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.967+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.967+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.968+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:09.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.969+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.970+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.970+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.971+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:09.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.972+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.973+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.973+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.974+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:09.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.975+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.976+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.976+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.977+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:09.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.978+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.979+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.979+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.980+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:09.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.981+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.981+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.982+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.983+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.984+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.984+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.985+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.986+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.987+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.987+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.988+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.988+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:09.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.990+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.990+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.991+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.992+0000 7f1471120800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.993+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.994+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:09.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.994+0000 7f1471120800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:09.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.996+0000 7f13237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:09.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.998+0000 7f1471120800 20 remove_watcher() i=0 2024-09-14T11:29:09.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.998+0000 7f1471120800 2 removed watcher, disabling cache 2024-09-14T11:29:09.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:09.999+0000 7f1471120800 20 remove_watcher() i=1 2024-09-14T11:29:09.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.000+0000 7f1471120800 20 remove_watcher() i=2 2024-09-14T11:29:09.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.001+0000 7f1471120800 20 remove_watcher() i=3 2024-09-14T11:29:10.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.002+0000 7f1471120800 20 remove_watcher() i=4 2024-09-14T11:29:10.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.003+0000 7f1471120800 20 remove_watcher() i=5 2024-09-14T11:29:10.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.004+0000 7f1471120800 20 remove_watcher() i=6 2024-09-14T11:29:10.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.005+0000 7f1471120800 20 remove_watcher() i=7 2024-09-14T11:29:10.015 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:10.067 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:10.067 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:10.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.109+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 realm 2024-09-14T11:29:10.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:10.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.111+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.112+0000 7fcb0a526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:10.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.112+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.113+0000 7fcb0a526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:10.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.113+0000 7fcb0a526800 20 searching for the correct realm 2024-09-14T11:29:10.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.115+0000 7fcb069da640 0 -- 172.21.15.29:0/3344503422 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fcb00018040 msgr2=0x7fcb00049430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:10.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.321+0000 7fcb059d8640 0 -- 172.21.15.29:0/3344503422 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fcb00022930 msgr2=0x7fcb0002f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:10.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:10.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:10.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.529+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 zone default found 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 4 Realm: () 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 zonegroup default 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.530+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.531+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.531+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.531+0000 7fcb0a526800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.532+0000 7fcb0a526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.532+0000 7fcb0a526800 20 started sync module instance, tier type = 2024-09-14T11:29:10.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.532+0000 7fcb0a526800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=0 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=1 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=2 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=3 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=4 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=5 2024-09-14T11:29:10.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.541+0000 7fcb0a526800 20 add_watcher() i=6 2024-09-14T11:29:10.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.542+0000 7fcb0a526800 20 add_watcher() i=7 2024-09-14T11:29:10.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.542+0000 7fcb0a526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:10.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.544+0000 7fc9bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.544+0000 7fcb0a526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:10.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.544+0000 7fcb0a526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:10.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.580+0000 7fc9377fe640 20 reqs_thread_entry: start 2024-09-14T11:29:10.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.581+0000 7fcb0a526800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:10.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.581+0000 7fcb0a526800 20 Filter name: none 2024-09-14T11:29:10.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.581+0000 7fc9357fa640 20 reqs_thread_entry: start 2024-09-14T11:29:10.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.581+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:10.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.582+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.583+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.583+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.584+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:10.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.585+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.586+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.584 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.586+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.587+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:10.586 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.588+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.589+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.587 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.589+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.590+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:10.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.591+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.592+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.592+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.593+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:10.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.594+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.595+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.595+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.596+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:10.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.598+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.598+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.596 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.598+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.599+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.601+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.601+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.602+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.601 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.603+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:10.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.604+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.602 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.605+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.603 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.605+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.606+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:10.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.607+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.608+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.608+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.607 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.609+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:10.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.611+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.611+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.609 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.611+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.613+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:10.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.614+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.615+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.615+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.616+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:10.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.617+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.617+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.616 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.618+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.617 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.619+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:10.618 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.620+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.621+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.621+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.622+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:10.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.624+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.624+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.625+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.626+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:10.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.627+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.627+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.628+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.629+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:10.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.630+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.631+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.631+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.632+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:10.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.634+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.634+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.635+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.633 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.636+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:10.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.637+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.638+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.638+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.639+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:10.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.641+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.641+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.641+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.642+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:10.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.644+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.644+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.644+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.645+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:10.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.646+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.647+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.647+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.648+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:10.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.649+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.650+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.650+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.651+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.653+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.653+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.653+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.654+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:10.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.655+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.656+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.656+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.657+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:10.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.658+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.659+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.659+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.660+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:10.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.661+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.662+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.662+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.661 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.663+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:10.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.664+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.662 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.664+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.665+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.664 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.666+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:10.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.667+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.667+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.668+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.668+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:10.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.670+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.670+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.671+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.672+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:10.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.673+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.674+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.674+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.675+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:10.674 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.676+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.677+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.677+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.675 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.678+0000 7fcb0a526800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:10.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.679+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.679+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:10.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.680+0000 7fcb0a526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:10.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.682+0000 7fc9bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:10.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.684+0000 7fcb0a526800 20 remove_watcher() i=0 2024-09-14T11:29:10.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.684+0000 7fcb0a526800 2 removed watcher, disabling cache 2024-09-14T11:29:10.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.685+0000 7fcb0a526800 20 remove_watcher() i=1 2024-09-14T11:29:10.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.686+0000 7fcb0a526800 20 remove_watcher() i=2 2024-09-14T11:29:10.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.686+0000 7fcb0a526800 20 remove_watcher() i=3 2024-09-14T11:29:10.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.687+0000 7fcb0a526800 20 remove_watcher() i=4 2024-09-14T11:29:10.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.688+0000 7fcb0a526800 20 remove_watcher() i=5 2024-09-14T11:29:10.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.689+0000 7fcb0a526800 20 remove_watcher() i=6 2024-09-14T11:29:10.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.690+0000 7fcb0a526800 20 remove_watcher() i=7 2024-09-14T11:29:10.700 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:10.753 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:10.754 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:10.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.795+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 20 realm 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.797+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.798+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:10.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.798+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.798+0000 7f6ffa72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.798+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.799+0000 7f6ffa72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:10.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.799+0000 7f6ffa72a800 20 searching for the correct realm 2024-09-14T11:29:10.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:10.801+0000 7f6ff6c50640 0 -- 172.21.15.29:0/1248125822 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f6ff006e460 msgr2=0x7f6ff0074dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:11.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.006+0000 7f6ff5c4e640 0 -- 172.21.15.29:0/1248125822 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f6ff0090220 msgr2=0x7f6ff0041620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:11.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:11.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:11.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:11.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:11.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:11.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:11.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.213+0000 7f6ffa72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:11.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:11.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 zone default found 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 4 Realm: () 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 zonegroup default 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.214+0000 7f6ffa72a800 20 rados->read ofs=0 len=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.215+0000 7f6ffa72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.215+0000 7f6ffa72a800 20 started sync module instance, tier type = 2024-09-14T11:29:11.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.215+0000 7f6ffa72a800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=0 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=1 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=2 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=3 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=4 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=5 2024-09-14T11:29:11.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.224+0000 7f6ffa72a800 20 add_watcher() i=6 2024-09-14T11:29:11.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.225+0000 7f6ffa72a800 20 add_watcher() i=7 2024-09-14T11:29:11.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.225+0000 7f6ffa72a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.227+0000 7f6eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.227+0000 7f6ffa72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:11.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.227+0000 7f6ffa72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:11.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.262+0000 7f6e277fe640 20 reqs_thread_entry: start 2024-09-14T11:29:11.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.262+0000 7f6ffa72a800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:11.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.262+0000 7f6ffa72a800 20 Filter name: none 2024-09-14T11:29:11.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.263+0000 7f6e257fa640 20 reqs_thread_entry: start 2024-09-14T11:29:11.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.263+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.264+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.265+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.265+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.266+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:11.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.267+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.268+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.268+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.269+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.270+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.271+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.271+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.272+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:11.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.274+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.274+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.275+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.276+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:11.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.277+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.278+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.278+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.279+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:11.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.280+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.281+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.281+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.282+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:11.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.284+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.284+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.285+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.286+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:11.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.287+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.287+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.288+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.289+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:11.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.290+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.290+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.291+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.292+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:11.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.293+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.293+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.294+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.295+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:11.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.296+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.297+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.297+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.298+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:11.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.299+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.300+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.300+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.301+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:11.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.303+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.303+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.304+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.305+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:11.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.306+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.307+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.307+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.308+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.310+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.310+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.311+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.312+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.313+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.313+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.314+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.315+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.316+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.316+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.317+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.317+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:11.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.319+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.319+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.319+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.320+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.322+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.322+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.323+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.323+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:11.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.325+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.326+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.326+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.327+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:11.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.328+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.329+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.329+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.330+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:11.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.331+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.332+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.332+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.333+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:11.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.334+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.335+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.335+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.337+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:11.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.339+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.339+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.340+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.341+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:11.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.342+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.342+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.343+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.344+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:11.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.345+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.346+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.346+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.347+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:11.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.348+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.349+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.349+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.351+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:11.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.352+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.352+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.353+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.354+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:11.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.355+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.356+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.356+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.357+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:11.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.358+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.359+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.359+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.360+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:11.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.361+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.362+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.362+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.363+0000 7f6ffa72a800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:11.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.364+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.365+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:11.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.365+0000 7f6ffa72a800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:11.365 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.367+0000 7f6eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:11.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.369+0000 7f6ffa72a800 20 remove_watcher() i=0 2024-09-14T11:29:11.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.369+0000 7f6ffa72a800 2 removed watcher, disabling cache 2024-09-14T11:29:11.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.370+0000 7f6ffa72a800 20 remove_watcher() i=1 2024-09-14T11:29:11.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.371+0000 7f6ffa72a800 20 remove_watcher() i=2 2024-09-14T11:29:11.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.372+0000 7f6ffa72a800 20 remove_watcher() i=3 2024-09-14T11:29:11.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.373+0000 7f6ffa72a800 20 remove_watcher() i=4 2024-09-14T11:29:11.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.374+0000 7f6ffa72a800 20 remove_watcher() i=5 2024-09-14T11:29:11.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.375+0000 7f6ffa72a800 20 remove_watcher() i=6 2024-09-14T11:29:11.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:11.376+0000 7f6ffa72a800 20 remove_watcher() i=7 2024-09-14T11:29:11.386 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:29:12.006 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :clean 2024-09-14T11:29:12.704 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileJava 2024-09-14T11:29:12.704 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processResources 2024-09-14T11:29:12.705 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :classes 2024-09-14T11:29:13.304 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:13.305 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileTestJava 2024-09-14T11:29:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:29:13.305 INFO:teuthology.orchestra.run.smithi029.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:29:13.306 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:13.306 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:29:13.306 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :testClasses 2024-09-14T11:29:15.306 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.306 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :test 2024-09-14T11:29:15.306 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.306 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:29:15.306 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14 11:29:14,534 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.307 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:29:15.504 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.504 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:29:15.604 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:29:15.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:15.904 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:29:16.104 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:16.104 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:29:16.204 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:16.204 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:29:16.404 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:16.404 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:29:16.804 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:16.805 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:29:16.805 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:16.805 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:29:17.004 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:17.004 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:29:17.104 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:17.104 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:29:17.804 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:17.804 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:29:17.904 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:17.904 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:29:18.204 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:18.204 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:29:18.304 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:18.304 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:29:18.383 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------- 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------- 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:BUILD SUCCESSFUL in 6s 2024-09-14T11:29:18.384 INFO:teuthology.orchestra.run.smithi029.stdout:5 actionable tasks: 5 executed 2024-09-14T11:29:18.400 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:18.456 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:18.457 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:18.503 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.505+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 realm 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.507+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.508+0000 7f66bef32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:18.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.508+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.509+0000 7f66bef32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:18.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.509+0000 7f66bef32800 20 searching for the correct realm 2024-09-14T11:29:18.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.511+0000 7f66bb3bd640 0 -- 172.21.15.29:0/2910512114 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f66b4017020 msgr2=0x7f66b4070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:18.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.717+0000 7f66b3fff640 0 -- 172.21.15.29:0/2910512114 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f66b4089130 msgr2=0x7f66b408b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.924+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:18.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 zone default found 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 4 Realm: () 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 zonegroup default 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.925+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.926+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.926+0000 7f66bef32800 20 rados->read ofs=0 len=0 2024-09-14T11:29:18.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.926+0000 7f66bef32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:18.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.926+0000 7f66bef32800 20 started sync module instance, tier type = 2024-09-14T11:29:18.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.926+0000 7f66bef32800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=0 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=1 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=2 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=3 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=4 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=5 2024-09-14T11:29:18.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.936+0000 7f66bef32800 20 add_watcher() i=6 2024-09-14T11:29:18.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.937+0000 7f66bef32800 20 add_watcher() i=7 2024-09-14T11:29:18.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.937+0000 7f66bef32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.939+0000 7f65717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.939+0000 7f66bef32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:18.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.939+0000 7f66bef32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.977+0000 7f64ebfff640 20 reqs_thread_entry: start 2024-09-14T11:29:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.977+0000 7f66bef32800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:18.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.977+0000 7f66bef32800 20 Filter name: none 2024-09-14T11:29:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.977+0000 7f64e9ffb640 20 reqs_thread_entry: start 2024-09-14T11:29:18.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.977+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:18.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.979+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.979+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.980+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.981+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:18.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.982+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.982+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.983+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.984+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:18.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.985+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.985+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.986+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.987+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:18.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.988+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.988+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.986 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.989+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.990+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:18.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.991+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.991+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.992+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.993+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:18.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.994+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.995+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.995+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.995+0000 7f66bef32800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1987644232428705901', time=2024-09-14T13:29:16.497388+0000, chain.objs.size()=1 2024-09-14T11:29:18.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.995+0000 7f66bef32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.72__shadow_.wYBjJGcIFJSsH_JEvuotz8137427NcF_0 2024-09-14T11:29:18.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.996+0000 7f66bef32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:18.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:18.999+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:18.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.000+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.001+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:18.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.001+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.002+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:19.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.003+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.004+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.004+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.005+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:19.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.006+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.007+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.007+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:29:19.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.007+0000 7f66bef32800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13597740503237372597', time=2024-09-14T13:29:17.479627+0000, chain.objs.size()=1 2024-09-14T11:29:19.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.007+0000 7f66bef32800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.73__shadow_.LSl-an0S054dR2lvG9MSeKiQChmmLst_0 2024-09-14T11:29:19.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.009+0000 7f66bef32800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:29:19.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.011+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:19.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.012+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.013+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.013+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.015+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:19.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.016+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.016+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.017+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.018+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:19.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.019+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.020+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.020+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.021+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:19.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.022+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.023+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.023+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.024+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:19.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.026+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.026+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.026+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.027+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:19.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.029+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.029+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.029+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.030+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:19.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.032+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.032+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.033+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.034+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:19.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.035+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.036+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.036+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.037+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:19.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.038+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.039+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.039+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.040+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:19.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.041+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.042+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.042+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.043+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:19.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.044+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.045+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.045+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.046+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.048+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.048+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.049+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.049+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:19.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.051+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.052+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.053+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.054+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.055+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.055+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.056+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.057+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:19.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.058+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.059+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.059+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.060+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:19.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.061+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.061+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.062+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.063+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:19.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.064+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.064+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.065+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.066+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.067+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.067+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.068+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.068+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.070+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.070+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.071+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.073+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:19.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.074+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.074+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.075+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.076+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:19.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.077+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.078+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.078+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.079+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:19.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.081+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.081+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.082+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.083+0000 7f66bef32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:19.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.084+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.084+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.085+0000 7f66bef32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.086+0000 7f65717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:19.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.089+0000 7f66bef32800 20 remove_watcher() i=0 2024-09-14T11:29:19.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.089+0000 7f66bef32800 2 removed watcher, disabling cache 2024-09-14T11:29:19.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.090+0000 7f66bef32800 20 remove_watcher() i=1 2024-09-14T11:29:19.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.090+0000 7f66bef32800 20 remove_watcher() i=2 2024-09-14T11:29:19.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.091+0000 7f66bef32800 20 remove_watcher() i=3 2024-09-14T11:29:19.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.092+0000 7f66bef32800 20 remove_watcher() i=4 2024-09-14T11:29:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.093+0000 7f66bef32800 20 remove_watcher() i=5 2024-09-14T11:29:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.094+0000 7f66bef32800 20 remove_watcher() i=6 2024-09-14T11:29:19.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.095+0000 7f66bef32800 20 remove_watcher() i=7 2024-09-14T11:29:19.105 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:19.158 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:19.158 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:19.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.199+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 realm 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.201+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.202+0000 7f2fd592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:19.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.202+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.203+0000 7f2fd592c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:19.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.203+0000 7f2fd592c800 20 searching for the correct realm 2024-09-14T11:29:19.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.205+0000 7f2fd0e4e640 0 -- 172.21.15.29:0/2399274218 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f2fc4039040 msgr2=0x7f2fc4039420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:19.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.208+0000 7f2fd0e4e640 0 -- 172.21.15.29:0/2399274218 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f2e9c087860 msgr2=0x7f2e9c089c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:19.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.213+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:19.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 zone default found 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 4 Realm: () 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 zonegroup default 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.214+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 started sync module instance, tier type = 2024-09-14T11:29:19.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.215+0000 7f2fd592c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=0 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=1 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=2 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=3 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=4 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=5 2024-09-14T11:29:19.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.224+0000 7f2fd592c800 20 add_watcher() i=6 2024-09-14T11:29:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.225+0000 7f2fd592c800 20 add_watcher() i=7 2024-09-14T11:29:19.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.225+0000 7f2fd592c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:19.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.226+0000 7f2e877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:19.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.227+0000 7f2fd592c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:19.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.227+0000 7f2fd592c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:19.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.261+0000 7f2e867e4640 20 reqs_thread_entry: start 2024-09-14T11:29:19.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.261+0000 7f2fd592c800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:19.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.261+0000 7f2fd592c800 20 Filter name: none 2024-09-14T11:29:19.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.261+0000 7f2df7fff640 20 reqs_thread_entry: start 2024-09-14T11:29:19.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.261+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:19.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.262+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.263+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.263+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.264+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:19.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.265+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.266+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.266+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.267+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:19.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.268+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.268+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.269+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.270+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:19.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.271+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.271+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.269 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.271+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.272+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:19.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.273+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.274+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.274+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.275+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:19.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.276+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.277+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.277+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.278+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:19.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.279+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.280+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.280+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.281+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:19.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.282+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.283+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.283+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.284+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:19.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.286+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.286+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.286+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.287+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:19.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.289+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.289+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.289+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.291+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:19.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.292+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.292+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.293+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.294+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:19.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.295+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.295+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.296+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.297+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.298+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.298+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.298+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.299+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:19.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.301+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.301+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.302+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.302+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.304+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.304+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.305+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.305+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:19.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.307+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.307+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.308+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.309+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:19.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.311+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.311+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.312+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.313+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:19.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.314+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.315+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.315+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.316+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:19.518 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.520+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.521+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.521+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.522+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:19.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.523+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.524+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.524+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.525+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:19.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.527+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.527+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.528+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.529+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:19.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.530+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.531+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.531+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.532+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:19.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.534+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.534+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.535+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.536+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:19.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.537+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.537+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.538+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.539+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:19.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.541+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.541+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.542+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.543+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:19.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.544+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.545+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.545+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.546+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.547+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.547+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.548+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.549+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:19.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.551+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.551+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.552+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.553+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:19.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.554+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.554+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.555+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.556+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:19.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.557+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.557+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.557+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.556 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.558+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:19.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.560+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.560+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.561+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.560 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.562+0000 7f2fd592c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.563+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.563+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:19.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.564+0000 7f2fd592c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:19.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.565+0000 7f2e877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.567+0000 7f2fd592c800 20 remove_watcher() i=0 2024-09-14T11:29:19.565 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.567+0000 7f2fd592c800 2 removed watcher, disabling cache 2024-09-14T11:29:19.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.568+0000 7f2fd592c800 20 remove_watcher() i=1 2024-09-14T11:29:19.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.569+0000 7f2fd592c800 20 remove_watcher() i=2 2024-09-14T11:29:19.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.570+0000 7f2fd592c800 20 remove_watcher() i=3 2024-09-14T11:29:19.569 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.571+0000 7f2fd592c800 20 remove_watcher() i=4 2024-09-14T11:29:19.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.572+0000 7f2fd592c800 20 remove_watcher() i=5 2024-09-14T11:29:19.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.573+0000 7f2fd592c800 20 remove_watcher() i=6 2024-09-14T11:29:19.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.574+0000 7f2fd592c800 20 remove_watcher() i=7 2024-09-14T11:29:19.584 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:19.637 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:19.638 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:19.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.679+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.680+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.680+0000 7f31e5a11800 20 realm 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.680+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.681+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.681+0000 7f31e5a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.681+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.681+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.681+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.682+0000 7f31e5a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:19.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.682+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:19.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.682+0000 7f31e5a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:19.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.682+0000 7f31e5a11800 20 searching for the correct realm 2024-09-14T11:29:19.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.684+0000 7f31e1949640 0 -- 172.21.15.29:0/1419329811 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f31dc0881a0 msgr2=0x7f31dc06aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:19.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:19.889+0000 7f31e0947640 0 -- 172.21.15.29:0/1419329811 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f31dc05f040 msgr2=0x7f31dc068510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:20.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.095+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 zone default found 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 4 Realm: () 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 zonegroup default 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.096+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.097+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.097+0000 7f31e5a11800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.097+0000 7f31e5a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.097+0000 7f31e5a11800 20 started sync module instance, tier type = 2024-09-14T11:29:20.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.097+0000 7f31e5a11800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:20.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=0 2024-09-14T11:29:20.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=1 2024-09-14T11:29:20.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=2 2024-09-14T11:29:20.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=3 2024-09-14T11:29:20.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=4 2024-09-14T11:29:20.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=5 2024-09-14T11:29:20.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.107+0000 7f31e5a11800 20 add_watcher() i=6 2024-09-14T11:29:20.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.108+0000 7f31e5a11800 20 add_watcher() i=7 2024-09-14T11:29:20.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.108+0000 7f31e5a11800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:20.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.110+0000 7f30977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:20.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.110+0000 7f31e5a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:20.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.110+0000 7f31e5a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:20.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.146+0000 7f30967e4640 20 reqs_thread_entry: start 2024-09-14T11:29:20.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.146+0000 7f31e5a11800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:20.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.146+0000 7f31e5a11800 20 Filter name: none 2024-09-14T11:29:20.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.146+0000 7f3007fff640 20 reqs_thread_entry: start 2024-09-14T11:29:20.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.146+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:20.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.148+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.148+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.148+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.149+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:20.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.151+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.152+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.152+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.153+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:20.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.154+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.154+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.155+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.154 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.156+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:20.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.157+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.157+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.158+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.159+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:20.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.161+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.161+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.161+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.162+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:20.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.164+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.164+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.164+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.165+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:20.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.167+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.167+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.167+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.168+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.170+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.170+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.170+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.171+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:20.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.172+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.173+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.173+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.174+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:20.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.176+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.176+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.177+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.178+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:20.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.179+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.180+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.180+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.179 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.181+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:20.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.182+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.183+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.183+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.184+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:20.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.185+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.185+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.186+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.187+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.188+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.189+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.189+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.190+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:20.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.191+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.191+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.192+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.194+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.195+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.196+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.196+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.197+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:20.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.198+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.199+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.199+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.200+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:20.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.201+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.202+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.202+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.203+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:20.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.204+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.205+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.205+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.206+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.207+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.208+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.208+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.209+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:20.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.210+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.211+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.211+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.212+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.214+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.214+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.214+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.215+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.217+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.217+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.217+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.219+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:20.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.220+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.220+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.221+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.222+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:20.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.223+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.223+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.224+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.224+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:20.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.226+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.226+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.226+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.227+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:20.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.229+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.229+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.229+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.231+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:20.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.232+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.232+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.233+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.234+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:20.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.235+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.236+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.236+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.237+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:20.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.238+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.239+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.239+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.240+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:20.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.242+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.242+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.242+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.243+0000 7f31e5a11800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:20.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.244+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.245+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.245+0000 7f31e5a11800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.247+0000 7f30977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.249+0000 7f31e5a11800 20 remove_watcher() i=0 2024-09-14T11:29:20.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.249+0000 7f31e5a11800 2 removed watcher, disabling cache 2024-09-14T11:29:20.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.250+0000 7f31e5a11800 20 remove_watcher() i=1 2024-09-14T11:29:20.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.251+0000 7f31e5a11800 20 remove_watcher() i=2 2024-09-14T11:29:20.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.252+0000 7f31e5a11800 20 remove_watcher() i=3 2024-09-14T11:29:20.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.253+0000 7f31e5a11800 20 remove_watcher() i=4 2024-09-14T11:29:20.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.254+0000 7f31e5a11800 20 remove_watcher() i=5 2024-09-14T11:29:20.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.255+0000 7f31e5a11800 20 remove_watcher() i=6 2024-09-14T11:29:20.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.256+0000 7f31e5a11800 20 remove_watcher() i=7 2024-09-14T11:29:20.265 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:29:20.318 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:20.319 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:20.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.361+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 20 realm 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.362+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.363+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.363+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.363+0000 7f1d0e50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.363+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.364+0000 7f1d0e50c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:20.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.364+0000 7f1d0e50c800 20 searching for the correct realm 2024-09-14T11:29:20.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.366+0000 7f1d0c7f7640 0 -- 172.21.15.29:0/765789995 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1d04061040 msgr2=0x7f1d0408a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:20.570 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.571+0000 7f1d0b7f5640 0 -- 172.21.15.29:0/765789995 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1d040603b0 msgr2=0x7f1d04060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.778+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:20.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:20.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 zone default found 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 4 Realm: () 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 zonegroup default 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.779+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.780+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.780+0000 7f1d0e50c800 20 rados->read ofs=0 len=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.780+0000 7f1d0e50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.780+0000 7f1d0e50c800 20 started sync module instance, tier type = 2024-09-14T11:29:20.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.780+0000 7f1d0e50c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:29:20.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=0 2024-09-14T11:29:20.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=1 2024-09-14T11:29:20.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=2 2024-09-14T11:29:20.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=3 2024-09-14T11:29:20.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=4 2024-09-14T11:29:20.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=5 2024-09-14T11:29:20.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.790+0000 7f1d0e50c800 20 add_watcher() i=6 2024-09-14T11:29:20.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.791+0000 7f1d0e50c800 20 add_watcher() i=7 2024-09-14T11:29:20.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.791+0000 7f1d0e50c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:20.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.793+0000 7f1bc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:20.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.793+0000 7f1d0e50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:20.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.793+0000 7f1d0e50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.830+0000 7f1bc0fe1640 20 reqs_thread_entry: start 2024-09-14T11:29:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.830+0000 7f1d0e50c800 20 init_complete bucket index max shards: 11 2024-09-14T11:29:20.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.830+0000 7f1d0e50c800 20 Filter name: none 2024-09-14T11:29:20.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.830+0000 7f1b3a7fc640 20 reqs_thread_entry: start 2024-09-14T11:29:20.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.830+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:29:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.832+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.832+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.832+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.833+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:29:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.835+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.835+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.836+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.836+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:29:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.838+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.838+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.839+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.840+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:29:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.841+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.841+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.842+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.843+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:29:20.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.844+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.844+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.843 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.845+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.846+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:29:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.847+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.847+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.848+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.849+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:29:20.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.850+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.850+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.851+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.851+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:29:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.853+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.853+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.854+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.854+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:29:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.856+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.856+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.856+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.858+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:29:20.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.859+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.859+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.860+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.860+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:29:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.862+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.862+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.863+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.864+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:29:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.865+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.865+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.865+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.866+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:29:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.868+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.868+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.868+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.869+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:29:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.871+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.871+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.871+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.872+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:29:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.874+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.874+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.874+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.875+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:29:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.877+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.877+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.877+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.879+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.880+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.880+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.881+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.881+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.883+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.883+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.883+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.884+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:29:20.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.886+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.886+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.886+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.887+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:29:20.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.888+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.889+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.889+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.890+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:29:20.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.891+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.892+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.892+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.893+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:29:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.894+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.894+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.895+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.896+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:29:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.897+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.897+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.897+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.898+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:29:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.900+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.900+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.901+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.902+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:29:20.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.903+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.904+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.904+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.906+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:29:20.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.907+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.908+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.908+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.909+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:29:20.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.910+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.911+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.911+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.912+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:29:20.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.914+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.914+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.914+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.915+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:29:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.917+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.917+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.917+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.918+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:29:20.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.920+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.921+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.921+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.922+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:29:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.923+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.924+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.924+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.925+0000 7f1d0e50c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:29:20.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.926+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.927+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:29:20.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.927+0000 7f1d0e50c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:29:20.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.929+0000 7f1bc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:20.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.931+0000 7f1d0e50c800 20 remove_watcher() i=0 2024-09-14T11:29:20.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.931+0000 7f1d0e50c800 2 removed watcher, disabling cache 2024-09-14T11:29:20.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.932+0000 7f1d0e50c800 20 remove_watcher() i=1 2024-09-14T11:29:20.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.932+0000 7f1d0e50c800 20 remove_watcher() i=2 2024-09-14T11:29:20.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.934+0000 7f1d0e50c800 20 remove_watcher() i=3 2024-09-14T11:29:20.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.935+0000 7f1d0e50c800 20 remove_watcher() i=4 2024-09-14T11:29:20.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.936+0000 7f1d0e50c800 20 remove_watcher() i=5 2024-09-14T11:29:20.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.936+0000 7f1d0e50c800 20 remove_watcher() i=6 2024-09-14T11:29:20.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:29:20.937+0000 7f1d0e50c800 20 remove_watcher() i=7 2024-09-14T11:29:20.947 DEBUG:teuthology.orchestra.run.smithi029:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:29:21.562 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :clean 2024-09-14T11:29:22.360 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileJava 2024-09-14T11:29:22.360 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processResources 2024-09-14T11:29:22.360 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :classes 2024-09-14T11:29:22.760 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:22.761 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :compileTestJava 2024-09-14T11:29:22.761 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:22.761 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:29:22.761 INFO:teuthology.orchestra.run.smithi029.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:29:22.761 INFO:teuthology.orchestra.run.smithi029.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:29:22.859 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :testClasses 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout:> Task :test 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14 11:29:24,122 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:24.762 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:29:25.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:25.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:29:25.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:25.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:29:25.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:25.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:29:25.660 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:25.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:29:25.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:25.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:29:28.060 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:28.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:29:28.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:28.360 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:29:28.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:28.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:29:28.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:28.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:29:29.060 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:29:29.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:29:29.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:29:29.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:29:29.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:29:29.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:29.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:29:31.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:31.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:29:32.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:32.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:29:32.160 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:32.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:29:32.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:32.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:29:32.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:32.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:29:32.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:32.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:29:33.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:33.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:29:33.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:33.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:29:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:33.559 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:29:33.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:33.860 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:29:33.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:33.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:29:34.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:34.360 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:29:34.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:34.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:29:34.860 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:34.860 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:29:34.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:34.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:29:35.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:35.360 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:29:37.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:37.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:29:38.260 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:29:38.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:30:29.060 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:29.061 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:30:29.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:29.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:30:29.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:29.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:30:30.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:30.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:30:30.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:30.159 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:30:30.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:30.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:30:33.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:33.159 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:30:33.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:33.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:30:33.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:33.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:30:33.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:33.659 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:30:37.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:37.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:30:37.660 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:37.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:30:41.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:41.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:30:42.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:42.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:30:44.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:44.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:30:44.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:30:44.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:31:16.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:16.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:31:16.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:16.459 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:31:20.160 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:20.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:31:20.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:20.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:31:22.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:22.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:31:22.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:22.959 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:31:24.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:24.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:31:34.660 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:34.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:31:34.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:34.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:31:34.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:34.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:31:34.860 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:34.860 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:31:35.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:35.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:31:35.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:35.359 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:31:35.760 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:35.760 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:31:35.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:35.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:31:36.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:36.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:31:36.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:36.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:31:36.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:36.659 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:31:36.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:36.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:31:37.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:37.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:31:37.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:37.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:31:37.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:37.559 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:31:37.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:37.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:31:38.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:38.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:31:38.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:38.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:31:39.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:39.059 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:31:39.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:39.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:31:39.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:39.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:31:39.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:39.959 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:31:40.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:40.459 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:31:40.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:40.659 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:31:41.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:41.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:31:41.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:41.359 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:31:41.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:41.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:31:42.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:42.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:31:42.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:42.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:31:42.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:42.760 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:31:43.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:43.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:31:43.460 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:43.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:31:43.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:43.959 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:31:44.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:44.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:31:44.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:44.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:31:44.860 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:44.860 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:31:45.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:45.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:31:45.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:45.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:31:45.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:45.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:31:46.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:46.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:31:46.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:46.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:31:46.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:46.860 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:31:47.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:47.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:31:47.560 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:47.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:31:47.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:47.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:31:48.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:48.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:31:48.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:48.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:31:48.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:48.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:31:49.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:49.359 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:31:49.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:49.660 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:31:50.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:50.060 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:31:50.260 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:50.260 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:31:50.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:50.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:31:50.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:50.959 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:31:51.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:51.360 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:31:51.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:51.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:31:52.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:52.059 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:31:52.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:52.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:31:52.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:52.659 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:31:52.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:52.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:31:53.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:53.059 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:31:53.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:53.159 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:31:53.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:53.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:31:53.659 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:53.659 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:31:54.059 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:54.059 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:31:54.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:54.159 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:31:54.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:54.460 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:31:54.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:54.760 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:31:55.159 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:31:55.160 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.160 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:31:55.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:31:55.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.459 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:31:55.759 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.759 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:31:55.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:55.959 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:31:56.359 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:56.359 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:31:56.459 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:56.459 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:31:56.859 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:56.859 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:31:56.959 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:56.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:31:57.259 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:57.259 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:31:59.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:31:59.960 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:32:00.360 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:00.360 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:32:02.559 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:02.560 INFO:teuthology.orchestra.run.smithi029.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:32:02.960 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:02.960 INFO:teuthology.orchestra.run.smithi029.stdout:---------------------------------------------------------------------- 2024-09-14T11:32:02.960 INFO:teuthology.orchestra.run.smithi029.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:32:02.960 INFO:teuthology.orchestra.run.smithi029.stdout:---------------------------------------------------------------------- 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout:BUILD SUCCESSFUL in 2m 41s 2024-09-14T11:32:02.961 INFO:teuthology.orchestra.run.smithi029.stdout:5 actionable tasks: 5 executed 2024-09-14T11:32:02.968 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:32:03.022 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:03.023 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:03.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.064+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 realm 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.066+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.067+0000 7fe677146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.067+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.068+0000 7fe677146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:03.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.068+0000 7fe677146800 20 searching for the correct realm 2024-09-14T11:32:03.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.070+0000 7fe675438640 0 -- 172.21.15.29:0/1594955134 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe66c022040 msgr2=0x7fe66c03a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:03.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.277+0000 7fe674436640 0 -- 172.21.15.29:0/1594955134 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe66c0543f0 msgr2=0x7fe66c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:03.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:03.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.486+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 zone default found 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 4 Realm: () 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 zonegroup default 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.487+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.488+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.488+0000 7fe677146800 20 rados->read ofs=0 len=0 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.488+0000 7fe677146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.488+0000 7fe677146800 20 started sync module instance, tier type = 2024-09-14T11:32:03.488 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.488+0000 7fe677146800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=0 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=1 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=2 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=3 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=4 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=5 2024-09-14T11:32:03.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.498+0000 7fe677146800 20 add_watcher() i=6 2024-09-14T11:32:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.499+0000 7fe677146800 20 add_watcher() i=7 2024-09-14T11:32:03.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.499+0000 7fe677146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:03.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.501+0000 7fe52b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.502+0000 7fe677146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:03.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.502+0000 7fe677146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.541+0000 7fe52a7e4640 20 reqs_thread_entry: start 2024-09-14T11:32:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.541+0000 7fe677146800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.541+0000 7fe677146800 20 Filter name: none 2024-09-14T11:32:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.542+0000 7fe5237fe640 20 reqs_thread_entry: start 2024-09-14T11:32:03.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.542+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:03.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.543+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:03.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17290002571137544949', time=2024-09-14T13:29:32.214060+0000, chain.objs.size()=1 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.85__shadow_.mjQ3Cmqn_wD9I41iP-ucVyq8l5v2vE1_0 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7378045668103354515', time=2024-09-14T13:30:42.052325+0000, chain.objs.size()=1 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_.IYKGQKQL5vMIvJqXDf0T3CseOpsye_8_0 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17508439891908727149', time=2024-09-14T13:31:38.709777+0000, chain.objs.size()=1 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.114__shadow_.PTDvJ7hI8OdnuUM01WaVHSTbxJsNolX_0 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11365608429500715254', time=2024-09-14T13:31:40.742133+0000, chain.objs.size()=1 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.117__shadow_.TmSmJKJt9fzZ-O4Mpgvn52X9EOnEXK7_0 2024-09-14T11:32:03.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12905100462559930010', time=2024-09-14T13:31:49.095027+0000, chain.objs.size()=1 2024-09-14T11:32:03.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.544+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.129__shadow_.Ffi-tdbcygGT1NY7YraWoHP6WRhWrjY_0 2024-09-14T11:32:03.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.548+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:03.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.550+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.551+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:03.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:03.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:32:03.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1990253668819316073', time=2024-09-14T13:29:37.985140+0000, chain.objs.size()=9 2024-09-14T11:32:03.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.1 2024-09-14T11:32:03.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.1_1 2024-09-14T11:32:03.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.2 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.2_1 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.3 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.3_1 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.552+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.4 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.4_1 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.5 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18329076976889070638', time=2024-09-14T13:30:29.396682+0000, chain.objs.size()=7 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.1 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.1_1 2024-09-14T11:32:03.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.553+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.1_2 2024-09-14T11:32:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.2 2024-09-14T11:32:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.2_1 2024-09-14T11:32:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.2_2 2024-09-14T11:32:03.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~MbzOqFuKmdajnbLLzbjC9IwCGW5Thra.3 2024-09-14T11:32:03.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11035119835116237404', time=2024-09-14T13:30:42.111592+0000, chain.objs.size()=1 2024-09-14T11:32:03.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_.eaPWLtm0ugke7XFL4kMYrSD0PP9vjwq_0 2024-09-14T11:32:03.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.538562769463989288', time=2024-09-14T13:31:04.973248+0000, chain.objs.size()=7 2024-09-14T11:32:03.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:03.558+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.1 2024-09-14T11:32:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.713+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.1_1 2024-09-14T11:32:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.713+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.1_2 2024-09-14T11:32:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.713+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.2 2024-09-14T11:32:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.713+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.2_1 2024-09-14T11:32:07.712 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.2_2 2024-09-14T11:32:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~9C5x2uqaNttopD0-0WfuQkVF4sEkYAS.3 2024-09-14T11:32:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8394996869934302657', time=2024-09-14T13:31:48.360211+0000, chain.objs.size()=1 2024-09-14T11:32:07.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.128__shadow_.8AaXUSjWHLgZJquL8H_asXwmoD62v8W_0 2024-09-14T11:32:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8810388638503679591', time=2024-09-14T13:31:48.399915+0000, chain.objs.size()=1 2024-09-14T11:32:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.128__shadow_.T_ZHifwpTG2QITTet1ZDmmLTGb38shq_0 2024-09-14T11:32:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13083715565728460780', time=2024-09-14T13:31:51.687886+0000, chain.objs.size()=1 2024-09-14T11:32:07.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.714+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.133__shadow_.V1aIbNMRh-6ybsIWHntDsU3kbI6kj1o_0 2024-09-14T11:32:07.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.722+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.725+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:07.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.727+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10750050875315499350', time=2024-09-14T13:31:19.084669+0000, chain.objs.size()=1 2024-09-14T11:32:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__shadow_.rnEEcbXtQ4SpcAOv2T3oZ8DU5Wior3l_0 2024-09-14T11:32:07.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8190858545637766330', time=2024-09-14T13:31:42.893147+0000, chain.objs.size()=1 2024-09-14T11:32:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.120__shadow_.tzMuuVpwIxU4WbebHq_vwYrriWDY7Km_0 2024-09-14T11:32:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17682035814068194751', time=2024-09-14T13:31:45.619462+0000, chain.objs.size()=1 2024-09-14T11:32:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.124__shadow_.6HTCVJGXSr_b2V27d8JpteDCyGg76vs_0 2024-09-14T11:32:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14279708860390543748', time=2024-09-14T13:31:54.166351+0000, chain.objs.size()=1 2024-09-14T11:32:07.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.728+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.138__shadow_.ZfMPIuFlrmFQlpQkAn_AX1fE8HaZiNx_0 2024-09-14T11:32:07.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.731+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.734+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:07.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.736+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.736+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9708319736623403423', time=2024-09-14T13:29:25.228979+0000, chain.objs.size()=1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.78__shadow_.uwSLmLxqx5-YE7K8aX9z9ePZ9mMVnwV_0 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW', time=2024-09-14T13:29:27.949227+0000, chain.objs.size()=9 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__multipart_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__shadow_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.1_1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__multipart_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.2 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__shadow_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.2_1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__multipart_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.3 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__shadow_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.3_1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__multipart_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.4 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__shadow_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.4_1 2024-09-14T11:32:07.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.80__multipart_key1.2~dHpoCRCk0rXRcN6lQbki7EWR1CQuNmW.5 2024-09-14T11:32:07.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14124602257858649', time=2024-09-14T13:31:45.647283+0000, chain.objs.size()=1 2024-09-14T11:32:07.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.124__shadow_.5Rr50CXVcO1aIw4b1PyLVHEV43ltcXy_0 2024-09-14T11:32:07.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18280697734490837684', time=2024-09-14T13:31:46.940293+0000, chain.objs.size()=1 2024-09-14T11:32:07.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.737+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.126__shadow_.08TfKpg0rAdIlNIUAeKxPlEgOOstg9T_0 2024-09-14T11:32:07.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.741+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8994247888386245256', time=2024-09-14T13:31:50.382868+0000, chain.objs.size()=1 2024-09-14T11:32:07.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.741+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.131__shadow_.N8D8CdS6fqXzqVBQ8xOGuZwgBP12D1s_0 2024-09-14T11:32:07.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.744+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15188891722709402923', time=2024-09-14T13:31:51.078029+0000, chain.objs.size()=1 2024-09-14T11:32:07.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.744+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.132__shadow_.HJRqmJH0uSLhp_w7pcuofQey4u6DmCV_0 2024-09-14T11:32:07.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.746+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.749+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:07.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.751+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.751+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17670579910623447262', time=2024-09-14T13:31:38.682314+0000, chain.objs.size()=1 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.114__shadow_.tUVU0tKavZMFKYGCrPt8AyNEsAT0JwR_0 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10019310377671216178', time=2024-09-14T13:31:49.714352+0000, chain.objs.size()=1 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.130__shadow_.n3YYOMJD-wMGtfE1wDGYD7XUoxnj11N_0 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10093144496995521158', time=2024-09-14T13:31:53.721670+0000, chain.objs.size()=1 2024-09-14T11:32:07.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.752+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.137__shadow_.7o57L98w9RoK_2MXRlrneSICoONzEFL_0 2024-09-14T11:32:07.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.754+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.756+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:07.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.758+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8686938301487660068', time=2024-09-14T13:31:48.331073+0000, chain.objs.size()=1 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.128__shadow_.AB1aHYt-5e6_S1YE0ro8ycVK1xGb9uN_0 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17650181688589326448', time=2024-09-14T13:31:49.740939+0000, chain.objs.size()=1 2024-09-14T11:32:07.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.130__shadow_.GV6pdckreJlUqjf2zV8Es6Hu_9MXk9p_0 2024-09-14T11:32:07.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14311898227870128975', time=2024-09-14T13:31:54.580149+0000, chain.objs.size()=1 2024-09-14T11:32:07.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.759+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.139__shadow_.nI3Iwa0Jv7ZNqMuHj5ApY0DGGdp-Ozc_0 2024-09-14T11:32:07.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.761+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.762 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.764+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:07.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.765+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:07.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6312068027367635097', time=2024-09-14T13:31:38.628276+0000, chain.objs.size()=1 2024-09-14T11:32:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.114__shadow_.csOMiOm9jeC7-Byw-SxHrhbmgdqV8uf_0 2024-09-14T11:32:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11652906730996851586', time=2024-09-14T13:31:41.433452+0000, chain.objs.size()=1 2024-09-14T11:32:07.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.766+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.118__shadow_.RMGTjVUhCwtAqPxnK9qzvIaANCXPBFS_0 2024-09-14T11:32:07.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.768+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.770+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.772+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.772+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5792672216995473208', time=2024-09-14T13:31:22.671475+0000, chain.objs.size()=9 2024-09-14T11:32:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__multipart_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.1 2024-09-14T11:32:07.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__shadow_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.1_1 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__multipart_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.2 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__shadow_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.2_1 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__multipart_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.3 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__shadow_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.3_1 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__multipart_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.4 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__shadow_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.4_1 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.105__multipart_key1.2~2aA7ShKn6hQ4J1MhmEjeNMf5_jY_ewp.5 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14937706201153219959', time=2024-09-14T13:31:46.263196+0000, chain.objs.size()=1 2024-09-14T11:32:07.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.773+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.125__shadow_.2aHQvo8ng9mcuMWguEPOfGYl4Z-Cnqb_0 2024-09-14T11:32:07.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.778+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.782+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:07.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.783+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15488615068834787432', time=2024-09-14T13:31:16.194049+0000, chain.objs.size()=7 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.1 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.1_1 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.1_2 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.2 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.2_1 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.2_2 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~74J_XnyyeNIUcTIyABKOQwon0Sv185g.3 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14515149168471927583', time=2024-09-14T13:31:39.416995+0000, chain.objs.size()=1 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.115__shadow_.3EFyTXS81qBweeRKdy_YWJWSMPntw3t_0 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17047034636160291005', time=2024-09-14T13:31:44.281795+0000, chain.objs.size()=1 2024-09-14T11:32:07.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.784+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.122__shadow_.apDoIWjXU5jw_hYM3U5VSrDxQaq7xfp_0 2024-09-14T11:32:07.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.789+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.792+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:07.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.793+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18003723245068074966', time=2024-09-14T13:30:09.745203+0000, chain.objs.size()=9 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.1 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.1_1 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.2 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.2_1 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.3 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.3_1 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.4 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.4_1 2024-09-14T11:32:07.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.794+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~8VBCmajwi1TD3PuR6o1zZUO5FxEM88f.5 2024-09-14T11:32:07.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.800+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.803+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:07.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.804+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.804+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15602643662080285480', time=2024-09-14T13:31:40.041070+0000, chain.objs.size()=1 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.116__shadow_.zB4t8VGBv3WJYVduWCmkcsFacZ5VNqt_0 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10743003554075996733', time=2024-09-14T13:31:40.796396+0000, chain.objs.size()=1 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.117__shadow_.xfSRKgofVJ0y3_hTySLTxSgp0D88vo4_0 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.307119717793550452', time=2024-09-14T13:31:42.838254+0000, chain.objs.size()=1 2024-09-14T11:32:07.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.120__shadow_.uUxIU1HZw-yJMhE4rSvn2v0SfGpvr-X_0 2024-09-14T11:32:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7656906036589064503', time=2024-09-14T13:31:47.634154+0000, chain.objs.size()=1 2024-09-14T11:32:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.127__shadow_.dODDDn4p_Ubw8-pBNb6JtYx1HfArh7T_0 2024-09-14T11:32:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14486144069566726109', time=2024-09-14T13:31:50.410961+0000, chain.objs.size()=1 2024-09-14T11:32:07.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.805+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.131__shadow_.P1Gdx7rKGAhx_z3IZAHmSjciwyobAzu_0 2024-09-14T11:32:07.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.808+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.811+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:07.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.812+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.812+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2855389134311500117', time=2024-09-14T13:31:47.688617+0000, chain.objs.size()=1 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.127__shadow_.oDyGEAr_dK7f93G5H4kKFVbSRvREbpV_0 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16197067827516268750', time=2024-09-14T13:31:49.774899+0000, chain.objs.size()=1 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.130__shadow_.7xQPOgcncLNOXsRW09kCwdiviJLV1e7_0 2024-09-14T11:32:07.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4308874107085374810', time=2024-09-14T13:31:49.802174+0000, chain.objs.size()=1 2024-09-14T11:32:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.130__shadow_.Z1vovOF2JycTsIFStW-3jFz_Zz5rvB4_0 2024-09-14T11:32:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17981696614242868829', time=2024-09-14T13:31:50.437556+0000, chain.objs.size()=1 2024-09-14T11:32:07.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.813+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.131__shadow_.rBBfsTeMODl7tADYJibcDbp_mKkDldW_0 2024-09-14T11:32:07.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.815+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.818+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:07.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.819+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16480245857333010884', time=2024-09-14T13:29:34.864896+0000, chain.objs.size()=1 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.91__shadow_.FdcQgMxLPMcPfttcLOXPUtZB-rjuafF_0 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3032709973316931005', time=2024-09-14T13:30:42.139706+0000, chain.objs.size()=1 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_.1xh3wgSZK4ZteE0bZ0tCzDJT2p7rjHD_0 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8005185089519889076', time=2024-09-14T13:31:42.865342+0000, chain.objs.size()=1 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.120__shadow_.C6ZfpE5mn0_lIF9TXPtZwzGsS9eOXIq_0 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15806798891500387823', time=2024-09-14T13:31:47.607439+0000, chain.objs.size()=1 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.127__shadow_.XoByWdYbUCk2gxam99cqrJ6Bwyl8Grw_0 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15966188934952352085', time=2024-09-14T13:32:02.658860+0000, chain.objs.size()=1 2024-09-14T11:32:07.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.820+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__shadow_.Q4e-wpC1IgXdf67JwnktCfR4NP6Dp5__0 2024-09-14T11:32:07.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.823+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.825+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:07.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.826+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.827+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:32:07.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13877937959192715741', time=2024-09-14T13:31:00.647626+0000, chain.objs.size()=9 2024-09-14T11:32:07.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.1 2024-09-14T11:32:07.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.1_1 2024-09-14T11:32:07.826 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.2 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.2_1 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.3 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.3_1 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.4 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.4_1 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~OLp-AEsjfOr6XmA6xL_xdeZkyrqbUqc.5 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:27.881022+0000, chain.objs.size()=72 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.1 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.2 2024-09-14T11:32:07.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.828+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.3 2024-09-14T11:32:07.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.833+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.4 2024-09-14T11:32:07.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.833+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.5 2024-09-14T11:32:07.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.833+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.6 2024-09-14T11:32:07.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.834+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.7 2024-09-14T11:32:07.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.834+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.8 2024-09-14T11:32:07.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.834+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.9 2024-09-14T11:32:07.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.834+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.10 2024-09-14T11:32:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.835+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.11 2024-09-14T11:32:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.835+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.12 2024-09-14T11:32:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.835+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.13 2024-09-14T11:32:07.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.835+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.14 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.15 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.16 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.17 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.18 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.19 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.20 2024-09-14T11:32:07.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.840+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.21 2024-09-14T11:32:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.841+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.22 2024-09-14T11:32:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.841+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.23 2024-09-14T11:32:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.841+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.24 2024-09-14T11:32:07.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.841+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.25 2024-09-14T11:32:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.843+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.26 2024-09-14T11:32:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.844+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.27 2024-09-14T11:32:07.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.844+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.28 2024-09-14T11:32:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.29 2024-09-14T11:32:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.30 2024-09-14T11:32:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.31 2024-09-14T11:32:07.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.32 2024-09-14T11:32:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.33 2024-09-14T11:32:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.847+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.34 2024-09-14T11:32:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.848+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.35 2024-09-14T11:32:07.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.848+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.36 2024-09-14T11:32:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.849+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.37 2024-09-14T11:32:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.849+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.38 2024-09-14T11:32:07.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.849+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.39 2024-09-14T11:32:07.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.852+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.40 2024-09-14T11:32:07.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.852+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.41 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.42 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.43 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.44 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.45 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.46 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.47 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.48 2024-09-14T11:32:07.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.49 2024-09-14T11:32:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.50 2024-09-14T11:32:07.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.854+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.51 2024-09-14T11:32:07.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.857+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.52 2024-09-14T11:32:07.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.859+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.53 2024-09-14T11:32:07.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.859+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.54 2024-09-14T11:32:07.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.55 2024-09-14T11:32:07.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.56 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.57 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.58 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.59 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.60 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.61 2024-09-14T11:32:07.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.860+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.62 2024-09-14T11:32:07.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.865+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.63 2024-09-14T11:32:07.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.866+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.64 2024-09-14T11:32:07.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.866+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.65 2024-09-14T11:32:07.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.866+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.66 2024-09-14T11:32:07.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.866+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.67 2024-09-14T11:32:07.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.866+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.68 2024-09-14T11:32:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.69 2024-09-14T11:32:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.70 2024-09-14T11:32:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.71 2024-09-14T11:32:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.72 2024-09-14T11:32:07.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:28.255238+0000, chain.objs.size()=8 2024-09-14T11:32:07.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.867+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.73 2024-09-14T11:32:07.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.869+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.74 2024-09-14T11:32:07.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.870+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.75 2024-09-14T11:32:07.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.76 2024-09-14T11:32:07.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.77 2024-09-14T11:32:07.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.78 2024-09-14T11:32:07.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.79 2024-09-14T11:32:07.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.80 2024-09-14T11:32:07.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:28.740134+0000, chain.objs.size()=8 2024-09-14T11:32:07.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.871+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.81 2024-09-14T11:32:07.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.872+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.82 2024-09-14T11:32:07.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.873+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.83 2024-09-14T11:32:07.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.873+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.84 2024-09-14T11:32:07.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.873+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.85 2024-09-14T11:32:07.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.875+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.86 2024-09-14T11:32:07.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.875+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.87 2024-09-14T11:32:07.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.877+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.88 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.877+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:29.050562+0000, chain.objs.size()=5 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.877+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.89 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.877+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.90 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.877+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.91 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.878+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.92 2024-09-14T11:32:07.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.878+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.93 2024-09-14T11:32:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:29.488908+0000, chain.objs.size()=6 2024-09-14T11:32:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.94 2024-09-14T11:32:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.95 2024-09-14T11:32:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.96 2024-09-14T11:32:07.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.97 2024-09-14T11:32:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.98 2024-09-14T11:32:07.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.880+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.99 2024-09-14T11:32:07.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.882+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:29.867475+0000, chain.objs.size()=6 2024-09-14T11:32:07.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.882+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.100 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.883+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.101 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.883+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.102 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.883+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.103 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.883+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.106 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.883+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.107 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.884+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:30.312495+0000, chain.objs.size()=8 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.884+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.104 2024-09-14T11:32:07.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.884+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.105 2024-09-14T11:32:07.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.885+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.108 2024-09-14T11:32:07.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.886+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.109 2024-09-14T11:32:07.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.886+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.110 2024-09-14T11:32:07.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.886+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.111 2024-09-14T11:32:07.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.888+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.112 2024-09-14T11:32:07.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.888+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.113 2024-09-14T11:32:07.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.888+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:30.809786+0000, chain.objs.size()=9 2024-09-14T11:32:07.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.888+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.114 2024-09-14T11:32:07.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.888+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.115 2024-09-14T11:32:07.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.889+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.116 2024-09-14T11:32:07.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.889+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.117 2024-09-14T11:32:07.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.890+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.118 2024-09-14T11:32:07.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.890+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.119 2024-09-14T11:32:07.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.890+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.120 2024-09-14T11:32:07.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.892+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.121 2024-09-14T11:32:07.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.894+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.122 2024-09-14T11:32:07.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.894+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:31.145143+0000, chain.objs.size()=6 2024-09-14T11:32:07.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.894+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.123 2024-09-14T11:32:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.894+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.124 2024-09-14T11:32:07.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.125 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.126 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.127 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.128 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:31.528804+0000, chain.objs.size()=7 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.129 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.130 2024-09-14T11:32:07.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.895+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.131 2024-09-14T11:32:07.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.132 2024-09-14T11:32:07.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.133 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.134 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.135 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:32.069096+0000, chain.objs.size()=6 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.136 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.899+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.137 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.138 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.139 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.140 2024-09-14T11:32:07.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.141 2024-09-14T11:32:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:32.383172+0000, chain.objs.size()=7 2024-09-14T11:32:07.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.900+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.142 2024-09-14T11:32:07.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.902+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.143 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.144 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.145 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.146 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.147 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.148 2024-09-14T11:32:07.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:32.715490+0000, chain.objs.size()=10 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.149 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.150 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.151 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.152 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.153 2024-09-14T11:32:07.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.906+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.154 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.910+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.155 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.910+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.156 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.910+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.157 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.910+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.158 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.910+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E', time=2024-09-14T13:31:33.398091+0000, chain.objs.size()=10 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.159 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.160 2024-09-14T11:32:07.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.161 2024-09-14T11:32:07.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.162 2024-09-14T11:32:07.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.163 2024-09-14T11:32:07.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.164 2024-09-14T11:32:07.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.911+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.165 2024-09-14T11:32:07.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.915+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.166 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.915+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.167 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.915+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.106__multipart_key1.2~baBbMNwWZPQ7ILN-L9lIeGqPHxPig9E.168 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4545521540203960340', time=2024-09-14T13:31:37.955413+0000, chain.objs.size()=1 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.113__shadow_.lPV1TmG71wsJB_b6-8vOeVfuH09it9c_0 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11941135920251902511', time=2024-09-14T13:31:40.122820+0000, chain.objs.size()=1 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.116__shadow_.PzOyfINYeVr-JnVar671JosOgfs5xYr_0 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12908086342894965170', time=2024-09-14T13:31:42.139602+0000, chain.objs.size()=1 2024-09-14T11:32:07.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.119__shadow_.LqfT1FNaN-dtFvmCwrg_aIXIN9ZPnFr_0 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11206281664297099090', time=2024-09-14T13:31:44.309019+0000, chain.objs.size()=1 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.122__shadow_._Gmxd9VDB72bJVeUUbv18QoeQC-uaeQ_0 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17799812746947113762', time=2024-09-14T13:31:46.290811+0000, chain.objs.size()=1 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.125__shadow_.zQAQqDxYR2_7n9FyBgzPPqH3fyyGBdS_0 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16983107904948984344', time=2024-09-14T13:31:51.022191+0000, chain.objs.size()=1 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.132__shadow_.-87_bhggnkB9T3P9LXCZzBc5C8L8xzS_0 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5446605980744044272', time=2024-09-14T13:31:51.659117+0000, chain.objs.size()=1 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.133__shadow_.clU93IuImoCvIy4FtjRS7OhqWtu5kJI_0 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4181016130616809282', time=2024-09-14T13:31:56.024221+0000, chain.objs.size()=1 2024-09-14T11:32:07.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.916+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.141__shadow_.Ynod0OiD1Ar_6aLGVnoSUykNSRTdWx7_0 2024-09-14T11:32:07.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.922+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.925+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.926+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1458589652218489956', time=2024-09-14T13:30:06.186686+0000, chain.objs.size()=9 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.1_1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.2 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.2_1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.3 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.3_1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.4 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.4_1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~dE8J0XYXwtyaUhvcEYAWV3AaOQ409WM.5 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14246979398694495862', time=2024-09-14T13:31:34.982607+0000, chain.objs.size()=1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.107__shadow_._UKZTnXCq-W55EtRRbZMzcztPn58kk8_0 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11462561469248204344', time=2024-09-14T13:31:51.049897+0000, chain.objs.size()=1 2024-09-14T11:32:07.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.132__shadow_._yAjZYTlwCh2sBtpXvafRFmlzjDNXI5_0 2024-09-14T11:32:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10897301764431055578', time=2024-09-14T13:31:51.717574+0000, chain.objs.size()=1 2024-09-14T11:32:07.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.927+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.133__shadow_.s-qEN0kOlapWbpx9VLKEeehLJy5pkGT_0 2024-09-14T11:32:07.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.931+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4072183388947641806', time=2024-09-14T13:31:52.360907+0000, chain.objs.size()=1 2024-09-14T11:32:07.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.931+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.134__shadow_._ueZgwBrYMaGaA31iW4UrsTXp9WkToX_0 2024-09-14T11:32:07.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.934+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.936+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:07.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.937+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10557077736589868831', time=2024-09-14T13:29:37.700416+0000, chain.objs.size()=9 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.1 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.1_1 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.2 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.2_1 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.3 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.3_1 2024-09-14T11:32:07.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.4 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__shadow_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.4_1 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.92__multipart_key1.2~cbPzMVsw8P-Y-SxWbuBnROY9Cg55JwR.5 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4936448902006281939', time=2024-09-14T13:30:33.249689+0000, chain.objs.size()=9 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__multipart_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.1 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__shadow_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.1_1 2024-09-14T11:32:07.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.938+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__multipart_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.2 2024-09-14T11:32:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__shadow_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.2_1 2024-09-14T11:32:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__multipart_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.3 2024-09-14T11:32:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__shadow_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.3_1 2024-09-14T11:32:07.941 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__multipart_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.4 2024-09-14T11:32:07.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__shadow_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.4_1 2024-09-14T11:32:07.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.943+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.99__multipart_key1.2~E8hUt7l7ypXWb3b9Vt7ZoDyZm2XLxU7.5 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12907477135671423612', time=2024-09-14T13:31:46.231913+0000, chain.objs.size()=1 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.125__shadow_.1oBBYIrH9fbxdPaCcKfK3257Y3B2j1t_0 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18423157530767961133', time=2024-09-14T13:32:00.053044+0000, chain.objs.size()=9 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__multipart_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.1 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__shadow_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.1_1 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__multipart_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.2 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__shadow_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.2_1 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.946+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__multipart_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.3 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.947+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__shadow_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.3_1 2024-09-14T11:32:07.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.947+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__multipart_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.4 2024-09-14T11:32:07.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.949+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__shadow_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.4_1 2024-09-14T11:32:07.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.949+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.144__multipart_key1.2~B3e8QFJY13kOU4O4TVvlGEZ531QENPr.5 2024-09-14T11:32:07.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.953+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.956+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:07.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.957+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.957+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13079581560783669647', time=2024-09-14T13:29:29.111146+0000, chain.objs.size()=1 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.82__shadow_.6zKZGprq2Hmz5gcZJCuZxqdYjP95nkE_0 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8807815447625731959', time=2024-09-14T13:31:42.221659+0000, chain.objs.size()=1 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.119__shadow_.yji5z5QClnooyiDQhxAcNC6jJp895c0_0 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14069031850336814660', time=2024-09-14T13:31:49.039935+0000, chain.objs.size()=1 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.129__shadow_.Q8cBjhZNdBaUGURtyts0GI0DsEH4YUF_0 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3994346756131299689', time=2024-09-14T13:31:52.306775+0000, chain.objs.size()=1 2024-09-14T11:32:07.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.958+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.134__shadow_.CP5SFqeq_rIHyhepOLfuqyr6crRIUVX_0 2024-09-14T11:32:07.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.960+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.962+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:07.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.963+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.963+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10821047019103485445', time=2024-09-14T13:31:37.981555+0000, chain.objs.size()=1 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.113__shadow_.d-u6-FFvY7qr5H71-uMbvQJTnrThYFN_0 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11984610643132759326', time=2024-09-14T13:31:44.254522+0000, chain.objs.size()=1 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.122__shadow_.Y7oACsd3c9Rkmbaz9NZhnUIlR8WoVRM_0 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12581393038946329028', time=2024-09-14T13:31:55.506917+0000, chain.objs.size()=1 2024-09-14T11:32:07.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.964+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.140__shadow_.X2HaqU7FquidlQG2MVVJ5H8lSeHteDQ_0 2024-09-14T11:32:07.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.966+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.968+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:07.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.969+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:07.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8442370405657804886', time=2024-09-14T13:31:39.333911+0000, chain.objs.size()=1 2024-09-14T11:32:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.115__shadow_.PUP3PrpMHz62ycYodStGm6ydeIFy27Y_0 2024-09-14T11:32:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14351553009157460901', time=2024-09-14T13:31:44.958747+0000, chain.objs.size()=1 2024-09-14T11:32:07.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.970+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.123__shadow_.hqfKvhsXapqClpQk58nq_w5MZjEBa1x_0 2024-09-14T11:32:07.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.972+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.974+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:07.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.975+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.975+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.976+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.976+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2771632448340995014', time=2024-09-14T13:31:39.360807+0000, chain.objs.size()=1 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.976+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.115__shadow_.OoJXTozYsYITK8_Uko5vLOu1KSHGgOD_0 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.976+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10071626785122701479', time=2024-09-14T13:31:46.968347+0000, chain.objs.size()=1 2024-09-14T11:32:07.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.976+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.126__shadow_.9GloPQffCiHiQceM_iWn3qyMHUO-oV4_0 2024-09-14T11:32:07.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.977+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.979+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.981+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.981+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:07.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10354539205640898408', time=2024-09-14T13:30:37.407337+0000, chain.objs.size()=9 2024-09-14T11:32:07.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__multipart_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__shadow_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.1_1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__multipart_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.2 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__shadow_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.2_1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__multipart_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.3 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__shadow_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.3_1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__multipart_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.4 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__shadow_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.4_1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.100__multipart_key1.2~O_cJgw_0zRl92yPxIp6rURPU1qYRVcC.5 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16123429689083304550', time=2024-09-14T13:31:40.096079+0000, chain.objs.size()=1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.116__shadow_.hKnSMg-i1QsMVPU2wf4N1sgynM_XDzT_0 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6270694616500186412', time=2024-09-14T13:31:41.515083+0000, chain.objs.size()=1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.118__shadow_.LED4Wtwf6mIV8g0EeWM54v8aYTgbAVs_0 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5385223812082163106', time=2024-09-14T13:31:52.333771+0000, chain.objs.size()=1 2024-09-14T11:32:07.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.982+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.134__shadow_.4GYYhrmQWxRquZVY82MDq_EozGi3Y7Q_0 2024-09-14T11:32:07.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.989+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:07.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.991+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:07.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.992+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:07.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8884046001360699047', time=2024-09-14T13:30:42.083858+0000, chain.objs.size()=9 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.1_1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.2 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.2_1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.3 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.3_1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.4 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.4_1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file2.mpg.2~7Z4xY9-uthENcU88iao-UDvVUX4KKq3.5 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4053340661621759218', time=2024-09-14T13:31:38.655669+0000, chain.objs.size()=1 2024-09-14T11:32:07.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.114__shadow_.NrKQTWisg_8aTbIClubtwvSOC2zaUrT_0 2024-09-14T11:32:07.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7043309839665200654', time=2024-09-14T13:31:41.461105+0000, chain.objs.size()=1 2024-09-14T11:32:07.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.118__shadow_.UGHDjbbDhbmDGnpM4PokTqRCKmjUrLF_0 2024-09-14T11:32:07.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15793424185663281733', time=2024-09-14T13:31:43.530177+0000, chain.objs.size()=1 2024-09-14T11:32:07.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.993+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.121__shadow_.QhR5YuJxaNoErMCpspkxnVu8zM992bH_0 2024-09-14T11:32:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.998+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8323542799592186589', time=2024-09-14T13:31:46.996060+0000, chain.objs.size()=1 2024-09-14T11:32:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.998+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.126__shadow_.Rkhe9G07wUwHJ8dAh1ovSAKkOgtb6vf_0 2024-09-14T11:32:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.998+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2549430428277940897', time=2024-09-14T13:31:49.012788+0000, chain.objs.size()=1 2024-09-14T11:32:07.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:07.998+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.129__shadow_.Mq9sZYTQSycJtdPikhBqz0f5JOUf1Vx_0 2024-09-14T11:32:07.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.001+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.003+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:08.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.004+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.005+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.005+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:08.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.005+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13304921115516249331', time=2024-09-14T13:31:44.227487+0000, chain.objs.size()=1 2024-09-14T11:32:08.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.005+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.122__shadow_.AmlsDlY8dVCYTsY29u6Vuf_cwA5NPXJ_0 2024-09-14T11:32:08.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.006+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.008+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:08.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.010+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.010+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:32:08.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17259133652294066227', time=2024-09-14T13:30:13.392268+0000, chain.objs.size()=9 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.1_1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.2 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.2_1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.3 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.3_1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.4 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.4_1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~RdxPyTFaRlC5963aLiC40DMWdPzD9ET.5 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9400267451725584132', time=2024-09-14T13:30:29.110721+0000, chain.objs.size()=6 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_0 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_1 2024-09-14T11:32:08.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.011+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_2 2024-09-14T11:32:08.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.014+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_3 2024-09-14T11:32:08.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.014+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_4 2024-09-14T11:32:08.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.014+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.94__shadow_.W5ntlL077-_THXrZH6D0U9i9Oeil9rF_5 2024-09-14T11:32:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15092967052208908261', time=2024-09-14T13:31:02.534595+0000, chain.objs.size()=9 2024-09-14T11:32:08.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.1 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.1_1 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.2 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.2_1 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.3 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.016+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.3_1 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.017+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.4 2024-09-14T11:32:08.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.017+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.4_1 2024-09-14T11:32:08.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.018+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~PTRZeS8mFnmIyLXa-Y52TCP23ohKXXw.5 2024-09-14T11:32:08.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.018+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9458537001018212243', time=2024-09-14T13:31:40.068785+0000, chain.objs.size()=1 2024-09-14T11:32:08.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.018+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.116__shadow_.Wwy_p7SISKiJKOnK7dW6M3aiYSErMcG_0 2024-09-14T11:32:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.020+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3603441719743704285', time=2024-09-14T13:31:42.167198+0000, chain.objs.size()=1 2024-09-14T11:32:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.020+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.119__shadow_.k-NF50a4P49VWsqU8Zg3X3TWKGgokMf_0 2024-09-14T11:32:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.020+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8585532346535574374', time=2024-09-14T13:31:42.920283+0000, chain.objs.size()=1 2024-09-14T11:32:08.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.020+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.120__shadow_.BFlEABP1j5veHpqoQiAs_E_j6BJCkDG_0 2024-09-14T11:32:08.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.021+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13280656009676218307', time=2024-09-14T13:31:43.583728+0000, chain.objs.size()=1 2024-09-14T11:32:08.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.021+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.121__shadow_.kcdN2vOsKFVY4440lQuM-ppaqHyVIHt_0 2024-09-14T11:32:08.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.022+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2006516019730735291', time=2024-09-14T13:31:44.931583+0000, chain.objs.size()=1 2024-09-14T11:32:08.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.022+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.123__shadow_.gGO2naANMPp7MIBfJ9sCqlS34I0DNKz_0 2024-09-14T11:32:08.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.022+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14021539940093325359', time=2024-09-14T13:31:47.661939+0000, chain.objs.size()=1 2024-09-14T11:32:08.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.022+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.127__shadow_.zLGS3DGPPYuxlv736YfbsoaS5jr4S73_0 2024-09-14T11:32:08.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.026+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.029+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.030+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.030+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:32:08.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14826769093725033799', time=2024-09-14T13:29:31.735655+0000, chain.objs.size()=3 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.84__shadow_.zR802jV6nKt3eW87wGSg44z67EBTff4_0 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.84__shadow_.zR802jV6nKt3eW87wGSg44z67EBTff4_1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.84__shadow_.zR802jV6nKt3eW87wGSg44z67EBTff4_2 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9337966633909853214', time=2024-09-14T13:31:41.488401+0000, chain.objs.size()=1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.118__shadow_.nJXgDkolXIiL6nHtepWOIKvPwQIR7MT_0 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10561982728557344630', time=2024-09-14T13:31:42.194461+0000, chain.objs.size()=1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.119__shadow_.54gnBkqjr9UZWwHXx7cI2z2N1cyUQun_0 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16132471598006185750', time=2024-09-14T13:31:43.557167+0000, chain.objs.size()=1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.121__shadow_.chPPEOkfBhACVopK3fAqVRPV_qIV3HV_0 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5336353251645273288', time=2024-09-14T13:31:44.985858+0000, chain.objs.size()=1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.123__shadow_.ye9ub46wQsCq3ECpIF6-0QDkIOwZl_X_0 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17782018725697498706', time=2024-09-14T13:31:54.667495+0000, chain.objs.size()=1 2024-09-14T11:32:08.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.031+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.139__shadow_.02q980AT45AVdt2lVRvhXEksjFOM8qh_0 2024-09-14T11:32:08.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.035+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.038+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:08.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.039+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:32:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4940032663647469535', time=2024-09-14T13:31:39.389546+0000, chain.objs.size()=1 2024-09-14T11:32:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.115__shadow_.MuU6mMbEIZrYAYSYdQGovdP3j8BYrXp_0 2024-09-14T11:32:08.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14766748528397940430', time=2024-09-14T13:31:48.303086+0000, chain.objs.size()=1 2024-09-14T11:32:08.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.040+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.128__shadow_.ECOoP3Bqr9JHOwyStfGHRkojAKqRsb9_0 2024-09-14T11:32:08.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.042+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.044+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.045+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:32:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3672695830491603215', time=2024-09-14T13:30:28.913801+0000, chain.objs.size()=7 2024-09-14T11:32:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.1 2024-09-14T11:32:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.1_1 2024-09-14T11:32:08.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.1_2 2024-09-14T11:32:08.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.2 2024-09-14T11:32:08.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.2_1 2024-09-14T11:32:08.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.2_2 2024-09-14T11:32:08.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.046+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~S7qWH5ohpPyMzuRBMxMXcafCoPSFtB3.3 2024-09-14T11:32:08.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.050+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.052+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:08.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.053+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6850123385424555933', time=2024-09-14T13:30:16.668113+0000, chain.objs.size()=7 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.1 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.1_1 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.1_2 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.2 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.2_1 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__shadow_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.2_2 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.95__multipart_key1.2~YoGG7GrgJctzPLJ4vKS_EC5G45Y9hC6.3 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11953621893764003204', time=2024-09-14T13:31:40.769357+0000, chain.objs.size()=1 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.117__shadow_.8MBRdlAW8mSzqEOkr9JkTvRwKk57Mes_0 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12793836320877741486', time=2024-09-14T13:31:49.067179+0000, chain.objs.size()=1 2024-09-14T11:32:08.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.054+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.129__shadow_.-DPNd5iLX7cExN4_M-5-Xe0cmgnghpT_0 2024-09-14T11:32:08.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.059+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.061+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:08.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.062+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14375443230138395815', time=2024-09-14T13:30:58.105028+0000, chain.objs.size()=9 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.1 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.1_1 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.2 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.2_1 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.3 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.3_1 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.4 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.4_1 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~oWU4lvhC-WUiBg01tyTt9-Fy9uMfd_X.5 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16839116431891197310', time=2024-09-14T13:31:15.997188+0000, chain.objs.size()=7 2024-09-14T11:32:08.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.1 2024-09-14T11:32:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.1_1 2024-09-14T11:32:08.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.063+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.1_2 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.2 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.2_1 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__shadow_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.2_2 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.103__multipart_key1.2~e7wuCuCNckqrHaPuTuwUNOmNxKvKvdz.3 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1364480418471049646', time=2024-09-14T13:31:45.013757+0000, chain.objs.size()=1 2024-09-14T11:32:08.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.068+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.123__shadow_.gb-LHCjonoBP2FMJSkEH-MbSxFoXabf_0 2024-09-14T11:32:08.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.072+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.075+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.076+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6805775196799414098', time=2024-09-14T13:30:42.024744+0000, chain.objs.size()=9 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.1 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.1_1 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.2 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.2_1 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.3 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.3_1 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.4 2024-09-14T11:32:08.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__shadow_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.4_1 2024-09-14T11:32:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.101__multipart_file.mpg.2~KEWftkpEO6NUdYf1JaESalxEPgl3sL9.5 2024-09-14T11:32:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP', time=2024-09-14T13:30:44.631463+0000, chain.objs.size()=9 2024-09-14T11:32:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__multipart_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.7 2024-09-14T11:32:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__shadow_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.7_1 2024-09-14T11:32:08.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.077+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__multipart_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.8 2024-09-14T11:32:08.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.080+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__shadow_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.8_1 2024-09-14T11:32:08.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.080+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__multipart_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.9 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__shadow_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.9_1 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__multipart_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.10 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__shadow_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.10_1 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.102__multipart_key1.2~XByAj4hNS1SV0JY0-X4ZAIileM6VfzP.11 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10190639941669977141', time=2024-09-14T13:31:20.195235+0000, chain.objs.size()=9 2024-09-14T11:32:08.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.081+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__multipart_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.1 2024-09-14T11:32:08.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.083+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__shadow_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.1_1 2024-09-14T11:32:08.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.083+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__multipart_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.2 2024-09-14T11:32:08.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.083+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__shadow_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.2_1 2024-09-14T11:32:08.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.083+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__multipart_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.3 2024-09-14T11:32:08.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__shadow_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.3_1 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__multipart_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.4 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__shadow_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.4_1 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.104__multipart_key1.2~SWWTa9ENdkuh5jHzgF2FA3rcbvu__2U.5 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6927550552182024087', time=2024-09-14T13:31:38.009185+0000, chain.objs.size()=1 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.113__shadow_.21vb6OWaznpeH2JfvYmlIXRgIhGo-zp_0 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17401712080791214302', time=2024-09-14T13:31:43.611055+0000, chain.objs.size()=1 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.121__shadow_.Hnd6R65g2hSqtV3ZiQvmSl7S_crFa6r_0 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2048852363358875041', time=2024-09-14T13:31:45.591808+0000, chain.objs.size()=1 2024-09-14T11:32:08.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.086+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.124__shadow_.VGDkKEx6SthED3ACqyMGekN22FXA1DT_0 2024-09-14T11:32:08.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.089+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5931843421273673005', time=2024-09-14T13:31:46.913387+0000, chain.objs.size()=1 2024-09-14T11:32:08.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.089+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.126__shadow_.fKoIbBSyENFKuKCipFZg7BANjDkF4x3_0 2024-09-14T11:32:08.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.094+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.096+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:08.095 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.097+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10650377046983911132', time=2024-09-14T13:29:32.681117+0000, chain.objs.size()=1 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.86__shadow_.CKJDAJGTKOftSLtqnITYHU0bpCrMFCW_0 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8331245492872485711', time=2024-09-14T13:31:37.927479+0000, chain.objs.size()=1 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.113__shadow_.ErPOaZdAHxxZsJplqS729RSPHYwGc8b_0 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13658803789556970987', time=2024-09-14T13:31:40.823237+0000, chain.objs.size()=1 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.117__shadow_.EAdXW77wzbd7LlHWZUuHQzMcxzk2P5Q_0 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3688014644866439670', time=2024-09-14T13:32:02.630298+0000, chain.objs.size()=9 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__multipart_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.1 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__shadow_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.1_1 2024-09-14T11:32:08.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__multipart_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.2 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__shadow_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.2_1 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__multipart_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.3 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__shadow_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.3_1 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__multipart_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.4 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__shadow_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.4_1 2024-09-14T11:32:08.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.098+0000 7fe677146800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.145__multipart_key1/data/file.mpg.2~-jMLKM24zZOiQU-d035SBjaqIjuW6Rr.5 2024-09-14T11:32:08.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.105+0000 7fe677146800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:32:08.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.107+0000 7fe677146800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:08.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.108+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.109+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.109+0000 7fe677146800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.111+0000 7fe52b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.113+0000 7fe677146800 20 remove_watcher() i=0 2024-09-14T11:32:08.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.113+0000 7fe677146800 2 removed watcher, disabling cache 2024-09-14T11:32:08.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.114+0000 7fe677146800 20 remove_watcher() i=1 2024-09-14T11:32:08.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.115+0000 7fe677146800 20 remove_watcher() i=2 2024-09-14T11:32:08.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.116+0000 7fe677146800 20 remove_watcher() i=3 2024-09-14T11:32:08.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.117+0000 7fe677146800 20 remove_watcher() i=4 2024-09-14T11:32:08.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.118+0000 7fe677146800 20 remove_watcher() i=5 2024-09-14T11:32:08.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.119+0000 7fe677146800 20 remove_watcher() i=6 2024-09-14T11:32:08.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.120+0000 7fe677146800 20 remove_watcher() i=7 2024-09-14T11:32:08.130 DEBUG:teuthology.orchestra.run.smithi029:> radosgw-admin gc process --include-all 2024-09-14T11:32:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:08.183 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:08.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.225+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.226+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.226+0000 7ff16ad32800 20 realm 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.226+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.227+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.227+0000 7ff16ad32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.227+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.227+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.227+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.228+0000 7ff16ad32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.228+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.228+0000 7ff16ad32800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:08.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.228+0000 7ff16ad32800 20 searching for the correct realm 2024-09-14T11:32:08.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.230+0000 7ff1671bd640 0 -- 172.21.15.29:0/4207849581 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55dd33fb2ce0 msgr2=0x55dd33fb50d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.234+0000 7ff1671bd640 0 -- 172.21.15.29:0/4207849581 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7ff030087890 msgr2=0x7ff030089cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 zone default found 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 4 Realm: () 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 zonegroup default 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.239+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 rados->read ofs=0 len=0 2024-09-14T11:32:08.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:08.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 started sync module instance, tier type = 2024-09-14T11:32:08.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.240+0000 7ff16ad32800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=0 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=1 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=2 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=3 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=4 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=5 2024-09-14T11:32:08.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.249+0000 7ff16ad32800 20 add_watcher() i=6 2024-09-14T11:32:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.250+0000 7ff16ad32800 20 add_watcher() i=7 2024-09-14T11:32:08.248 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.250+0000 7ff16ad32800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:08.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.251+0000 7ff01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.252+0000 7ff16ad32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:08.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.252+0000 7ff16ad32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.284+0000 7ff01cfe1640 20 reqs_thread_entry: start 2024-09-14T11:32:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.284+0000 7ff16ad32800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.285+0000 7ff16ad32800 20 Filter name: none 2024-09-14T11:32:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.285+0000 7ff015ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:08.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.285+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:32:08.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.286+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.286+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.287+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.288+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:32:08.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.289+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.290+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.290+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.291+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:32:08.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.293+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.293+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.291 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.293+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.294+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:32:08.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.296+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.296+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.296+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.297+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:32:08.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.299+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.299+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.299+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.300+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:32:08.299 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.301+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.302+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.302+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.301 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.303+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:32:08.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.304+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.305+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.305+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.306+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:32:08.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.307+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.308+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.308+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.309+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:32:08.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.310+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.311+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.311+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.312+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:32:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.314+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.314+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.314+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.315+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:32:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.316+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.317+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.317+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.318+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:32:08.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.319+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.320+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.320+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.321+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:32:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.323+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.323+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.324+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.325+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:32:08.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.326+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.327+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.327+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.328+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:32:08.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.329+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.330+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.330+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.332+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:32:08.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.333+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.333+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.334+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.335+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:32:08.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.336+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.336+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.337+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.338+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:32:08.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.339+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.339+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.339+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.340+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:32:08.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.342+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.343+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.343+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.345+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:32:08.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.346+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.346+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.347+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.348+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:32:08.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.349+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.349+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.350+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.351+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:32:08.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.352+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.352+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.353+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.354+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:32:08.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.355+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.355+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.356+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.357+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:32:08.356 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.358+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.359+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.359+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.360+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:32:08.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.362+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.360 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.362+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.362+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.364+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:32:08.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.365+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.365+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.365+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.366+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:32:08.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.368+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.368+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.369+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.370+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:32:08.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.371+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.372+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.372+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.373+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:32:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.375+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.375+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.375+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.376+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:32:08.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.378+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.379+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.379+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.380+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:32:08.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.382+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.383+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.383+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.384+0000 7ff16ad32800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:32:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.386+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.386+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:32:08.384 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.386+0000 7ff16ad32800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:32:08.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.389+0000 7ff01dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:08.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.391+0000 7ff16ad32800 20 remove_watcher() i=0 2024-09-14T11:32:08.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.391+0000 7ff16ad32800 2 removed watcher, disabling cache 2024-09-14T11:32:08.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.391+0000 7ff16ad32800 20 remove_watcher() i=1 2024-09-14T11:32:08.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.393+0000 7ff16ad32800 20 remove_watcher() i=2 2024-09-14T11:32:08.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.394+0000 7ff16ad32800 20 remove_watcher() i=3 2024-09-14T11:32:08.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.395+0000 7ff16ad32800 20 remove_watcher() i=4 2024-09-14T11:32:08.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.395+0000 7ff16ad32800 20 remove_watcher() i=5 2024-09-14T11:32:08.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.396+0000 7ff16ad32800 20 remove_watcher() i=6 2024-09-14T11:32:08.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:08.397+0000 7ff16ad32800 20 remove_watcher() i=7 2024-09-14T11:32:08.408 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:32:08.428 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:32:08.428 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:32:08.428 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:32:08.429 DEBUG:teuthology.orchestra.run.smithi029:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:32:08.458 INFO:teuthology.orchestra.run.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:32:09.394 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:32:09.395 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T11:32:09.395 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key SKRPDCUJWBNMGRBEQJXV --secret H856H/Vru9339a1lOv7N7xUUwfXeNuYTHvGtxUYUiO/Wu9NjUONz/w== --cluster ceph 2024-09-14T11:32:09.501 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:09.501 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:09.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.539+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.541+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.541+0000 7fc9b072c800 20 realm 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.541+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.542+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.542+0000 7fc9b072c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.542+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.542+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.542+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.543+0000 7fc9b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.543+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.543+0000 7fc9b072c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:09.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.543+0000 7fc9b072c800 20 searching for the correct realm 2024-09-14T11:32:09.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.544+0000 7fc9ac44f640 0 -- 172.21.15.29:0/1602648829 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x563db938d090 msgr2=0x563db938f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:09.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.548+0000 7fc9ac44f640 0 -- 172.21.15.29:0/1602648829 >> [v2:172.21.15.73:6808/1291450503,v1:172.21.15.73:6809/1291450503] conn(0x563db9239da0 msgr2=0x7fc9a40a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:09.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.758+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.759+0000 7fc9b072c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.759+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 zone default found 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 4 Realm: () 2024-09-14T11:32:09.758 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 zonegroup default 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 started sync module instance, tier type = 2024-09-14T11:32:09.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.760+0000 7fc9b072c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=0 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=1 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=2 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=3 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=4 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=5 2024-09-14T11:32:09.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.770+0000 7fc9b072c800 20 add_watcher() i=6 2024-09-14T11:32:09.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.771+0000 7fc9b072c800 20 add_watcher() i=7 2024-09-14T11:32:09.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.771+0000 7fc9b072c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.772+0000 7fc862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.772+0000 7fc9b072c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.772+0000 7fc9b072c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.772+0000 7fc9b072c800 5 note: GC not initialized 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc861fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:09.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:09.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 20 Filter name: none 2024-09-14T11:32:09.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc7d37fe640 20 reqs_thread_entry: start 2024-09-14T11:32:09.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:32:09.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.773+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 cache get: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV : miss 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV info.flags=0x0 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 adding default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV to cache LRU end 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 cache get: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV : hit (negative entry) 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.774+0000 7fc9b072c800 10 cache get: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV : hit (negative entry) 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc9b072c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:09.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc9b072c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:32:09.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497151 cookie 94823100510656 notifier 8964 bl.length()=645 2024-09-14T11:32:09.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:32:09.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.775+0000 7fc8837fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:09.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.778+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:32:09.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.778+0000 7fc9b072c800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:32:09.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.778+0000 7fc9b072c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:32:09.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.779+0000 7fc8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497152 cookie 94823100524336 notifier 8964 bl.length()=185 2024-09-14T11:32:09.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.779+0000 7fc8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:32:09.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.779+0000 7fc8837fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.781+0000 7fc9b072c800 10 cache put: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV info.flags=0x7 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.781+0000 7fc9b072c800 10 moving default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV to cache LRU end 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.781+0000 7fc9b072c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:SKRPDCUJWBNMGRBEQJXV, ofs0, ns] 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.782+0000 7fc8837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1116691497153 cookie 94823100524336 notifier 8964 bl.length()=186 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.782+0000 7fc8837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV info.flags=0x7 2024-09-14T11:32:09.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.782+0000 7fc8837fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+SKRPDCUJWBNMGRBEQJXV to cache LRU end 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "foo.client.0", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "foo+test@test.test", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "foo.client.0", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "SKRPDCUJWBNMGRBEQJXV", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "H856H/Vru9339a1lOv7N7xUUwfXeNuYTHvGtxUYUiO/Wu9NjUONz/w==", 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:09.782 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:09.775190Z" 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:09.783 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:09.775180Z", 2024-09-14T11:32:09.784 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.784+0000 7fc862fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.787+0000 7fc9b072c800 20 remove_watcher() i=0 2024-09-14T11:32:09.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.787+0000 7fc9b072c800 2 removed watcher, disabling cache 2024-09-14T11:32:09.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.788+0000 7fc9b072c800 20 remove_watcher() i=1 2024-09-14T11:32:09.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.789+0000 7fc9b072c800 20 remove_watcher() i=2 2024-09-14T11:32:09.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.790+0000 7fc9b072c800 20 remove_watcher() i=3 2024-09-14T11:32:09.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.791+0000 7fc9b072c800 20 remove_watcher() i=4 2024-09-14T11:32:09.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.792+0000 7fc9b072c800 20 remove_watcher() i=5 2024-09-14T11:32:09.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.793+0000 7fc9b072c800 20 remove_watcher() i=6 2024-09-14T11:32:09.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.794+0000 7fc9b072c800 20 remove_watcher() i=7 2024-09-14T11:32:09.803 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 4627904946 --totp-seed 3SZQM6RYSIIBYKEQJ4ESQNFHBQ3UJKUFAD3HTCOGKQGZPMOIU5HGKNVO4KKFG752 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:09.871 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:09.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.910+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 realm 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:09.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.912+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.913+0000 7fd05af2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:09.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.913+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.914+0000 7fd05af2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:09.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.914+0000 7fd05af2c800 20 searching for the correct realm 2024-09-14T11:32:09.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:09.916+0000 7fd0574ae640 0 -- 172.21.15.29:0/1943290981 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd05003fbf0 msgr2=0x7fd05000f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.122+0000 7fd0564ac640 0 -- 172.21.15.29:0/1943290981 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd050036900 msgr2=0x7fd050059380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:10.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:10.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.330+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 zone default found 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 4 Realm: () 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:10.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 zonegroup default 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.331+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.332+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.332+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.332+0000 7fd05af2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.332+0000 7fd05af2c800 20 started sync module instance, tier type = 2024-09-14T11:32:10.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.332+0000 7fd05af2c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=0 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=1 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=2 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=3 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=4 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.342+0000 7fd05af2c800 20 add_watcher() i=5 2024-09-14T11:32:10.341 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.343+0000 7fd05af2c800 20 add_watcher() i=6 2024-09-14T11:32:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.343+0000 7fd05af2c800 20 add_watcher() i=7 2024-09-14T11:32:10.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.343+0000 7fd05af2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.345+0000 7fcf0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:10.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.345+0000 7fd05af2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.345+0000 7fd05af2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.345+0000 7fd05af2c800 5 note: GC not initialized 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fce87fff640 20 reqs_thread_entry: start 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 20 Filter name: none 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fce85ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:10.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:10.346+0000 7fd05af2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fd05af2c800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:32:11.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fd05af2c800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fd05af2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:32:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fcf39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431746 cookie 94667513215568 notifier 8985 bl.length()=659 2024-09-14T11:32:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fcf39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:32:11.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.441+0000 7fcf39ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:32:11.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.445+0000 7fcf0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:11.445 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.447+0000 7fd05af2c800 20 remove_watcher() i=0 2024-09-14T11:32:11.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.447+0000 7fd05af2c800 2 removed watcher, disabling cache 2024-09-14T11:32:11.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.449+0000 7fd05af2c800 20 remove_watcher() i=1 2024-09-14T11:32:11.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.450+0000 7fd05af2c800 20 remove_watcher() i=2 2024-09-14T11:32:11.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.451+0000 7fd05af2c800 20 remove_watcher() i=3 2024-09-14T11:32:11.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.452+0000 7fd05af2c800 20 remove_watcher() i=4 2024-09-14T11:32:11.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.454+0000 7fd05af2c800 20 remove_watcher() i=5 2024-09-14T11:32:11.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.455+0000 7fd05af2c800 20 remove_watcher() i=6 2024-09-14T11:32:11.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.456+0000 7fd05af2c800 20 remove_watcher() i=7 2024-09-14T11:32:11.467 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:32:11.468 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key WYIOTYVMZSYSFUZLYUBO --secret k+Bt/6Bu6qHOiMEL3SY5721HFM5uJ9h3z02nMkHStLHqdtKAV/D9wQ== --cluster ceph 2024-09-14T11:32:11.538 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:11.538 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:11.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.577+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 realm 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.579+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.580+0000 7f26efd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.580+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.581+0000 7f26efd36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:11.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.581+0000 7f26efd36800 20 searching for the correct realm 2024-09-14T11:32:11.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.583+0000 7f26ec2b8640 0 -- 172.21.15.29:0/2377359764 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f26e4031030 msgr2=0x7f26e4077530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.789+0000 7f26eb2b6640 0 -- 172.21.15.29:0/2377359764 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f26e406e970 msgr2=0x7f26e40880b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:11.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:11.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.996+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 zone default found 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 4 Realm: () 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 zonegroup default 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 started sync module instance, tier type = 2024-09-14T11:32:11.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:11.997+0000 7f26efd36800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=0 2024-09-14T11:32:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=1 2024-09-14T11:32:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=2 2024-09-14T11:32:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=3 2024-09-14T11:32:12.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=4 2024-09-14T11:32:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=5 2024-09-14T11:32:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.007+0000 7f26efd36800 20 add_watcher() i=6 2024-09-14T11:32:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.008+0000 7f26efd36800 20 add_watcher() i=7 2024-09-14T11:32:12.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.008+0000 7f26efd36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.009+0000 7f25a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 5 note: GC not initialized 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f25a17e2640 20 reqs_thread_entry: start 2024-09-14T11:32:12.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 20 Filter name: none 2024-09-14T11:32:12.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f259a7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:12.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:32:12.009 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.010+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache get: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO : miss 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO info.flags=0x0 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 adding default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO to cache LRU end 2024-09-14T11:32:12.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache get: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO : hit (negative entry) 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.011+0000 7f26efd36800 10 cache get: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO : hit (negative entry) 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f26efd36800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f26efd36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f25caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431682 cookie 94482098682528 notifier 9006 bl.length()=645 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f25caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:32:12.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.013+0000 7f25caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f26efd36800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f26efd36800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f25caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431817 cookie 94482098699296 notifier 9006 bl.length()=185 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f25caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:32:12.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.016+0000 7f25caffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.019+0000 7f26efd36800 10 cache put: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO info.flags=0x7 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.019+0000 7f26efd36800 10 moving default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO to cache LRU end 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.019+0000 7f26efd36800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:WYIOTYVMZSYSFUZLYUBO, ofs0, ns] 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.020+0000 7f25ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431818 cookie 94482098704096 notifier 9006 bl.length()=186 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.020+0000 7f25ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO info.flags=0x7 2024-09-14T11:32:12.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.020+0000 7f25ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WYIOTYVMZSYSFUZLYUBO to cache LRU end 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "bar.client.0", 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "bar+test@test.test", 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:12.019 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "bar.client.0", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "WYIOTYVMZSYSFUZLYUBO", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "k+Bt/6Bu6qHOiMEL3SY5721HFM5uJ9h3z02nMkHStLHqdtKAV/D9wQ==", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:12.012384Z" 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:12.020 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:32:12.021 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:12.012371Z", 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.022+0000 7f25a27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.024+0000 7f26efd36800 20 remove_watcher() i=0 2024-09-14T11:32:12.022 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.024+0000 7f26efd36800 2 removed watcher, disabling cache 2024-09-14T11:32:12.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.025+0000 7f26efd36800 20 remove_watcher() i=1 2024-09-14T11:32:12.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.026+0000 7f26efd36800 20 remove_watcher() i=2 2024-09-14T11:32:12.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.028+0000 7f26efd36800 20 remove_watcher() i=3 2024-09-14T11:32:12.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.029+0000 7f26efd36800 20 remove_watcher() i=4 2024-09-14T11:32:12.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.030+0000 7f26efd36800 20 remove_watcher() i=5 2024-09-14T11:32:12.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.031+0000 7f26efd36800 20 remove_watcher() i=6 2024-09-14T11:32:12.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.032+0000 7f26efd36800 20 remove_watcher() i=7 2024-09-14T11:32:12.041 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4040552645 --totp-seed 3IFL3HDVR2Z37DGNAQJV5XPY37ECO6RUJAR2ICTHJMXAE57P7XH3SDQJ3X4RPB7J --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.109 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.148+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 realm 2024-09-14T11:32:12.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.149+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.150+0000 7fb6f190c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.150+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.151+0000 7fb6f190c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.151+0000 7fb6f190c800 20 searching for the correct realm 2024-09-14T11:32:12.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.153+0000 7fb6efbf7640 0 -- 172.21.15.29:0/1192005892 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55e644e785d0 msgr2=0x55e644e7a9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.156+0000 7fb6efbf7640 0 -- 172.21.15.29:0/1192005892 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7fb5b80885c0 msgr2=0x7fb5b808a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.162+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 zone default found 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 4 Realm: () 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 zonegroup default 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.163+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.164+0000 7fb6f190c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.164+0000 7fb6f190c800 20 started sync module instance, tier type = 2024-09-14T11:32:12.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.164+0000 7fb6f190c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:12.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=0 2024-09-14T11:32:12.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=1 2024-09-14T11:32:12.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=2 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=3 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=4 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=5 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.172+0000 7fb6f190c800 20 add_watcher() i=6 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.173+0000 7fb6f190c800 20 add_watcher() i=7 2024-09-14T11:32:12.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.173+0000 7fb6f190c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb5a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 5 note: GC not initialized 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb5a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 20 Filter name: none 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb51e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.175+0000 7fb6f190c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.176+0000 7fb6f190c800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:32:12.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.176+0000 7fb6f190c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:32:12.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.176+0000 7fb6f190c800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.176+0000 7fb6f190c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb6f190c800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb6f190c800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb6f190c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb5d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 94447486897280 notifier 8522 bl.length()=659 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb5d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:32:12.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.179+0000 7fb5d2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:32:12.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.182+0000 7fb5a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.184+0000 7fb6f190c800 20 remove_watcher() i=0 2024-09-14T11:32:12.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.184+0000 7fb6f190c800 2 removed watcher, disabling cache 2024-09-14T11:32:12.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.185+0000 7fb6f190c800 20 remove_watcher() i=1 2024-09-14T11:32:12.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.186+0000 7fb6f190c800 20 remove_watcher() i=2 2024-09-14T11:32:12.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.187+0000 7fb6f190c800 20 remove_watcher() i=3 2024-09-14T11:32:12.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.188+0000 7fb6f190c800 20 remove_watcher() i=4 2024-09-14T11:32:12.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.189+0000 7fb6f190c800 20 remove_watcher() i=5 2024-09-14T11:32:12.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.190+0000 7fb6f190c800 20 remove_watcher() i=6 2024-09-14T11:32:12.189 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.191+0000 7fb6f190c800 20 remove_watcher() i=7 2024-09-14T11:32:12.201 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:32:12.264 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.264 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.302+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 realm 2024-09-14T11:32:12.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.304+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.305+0000 7ffbc900e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.305+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.306+0000 7ffbc900e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.306+0000 7ffbc900e800 20 searching for the correct realm 2024-09-14T11:32:12.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.308+0000 7ffbc4fbd640 0 -- 172.21.15.29:0/2346804556 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ffbbc02d060 msgr2=0x7ffbbc09c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.532+0000 7ffbc3fbb640 0 -- 172.21.15.29:0/2346804556 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ffbbc00e070 msgr2=0x7ffbbc07d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:12.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:12.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:12.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:12.738 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.740+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:12.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 zone default found 2024-09-14T11:32:12.740 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 4 Realm: () 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 zonegroup default 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.741+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.742+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.742+0000 7ffbc900e800 20 started sync module instance, tier type = 2024-09-14T11:32:12.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.742+0000 7ffbc900e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=0 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=1 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=2 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=3 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=4 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=5 2024-09-14T11:32:12.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.752+0000 7ffbc900e800 20 add_watcher() i=6 2024-09-14T11:32:12.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.753+0000 7ffbc900e800 20 add_watcher() i=7 2024-09-14T11:32:12.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.753+0000 7ffbc900e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffa7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffbc900e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffbc900e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffbc900e800 5 note: GC not initialized 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffa79fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffbc900e800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.755+0000 7ffbc900e800 20 Filter name: none 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ff9eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:32:12.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:32:12.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:12.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:32:12.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:32:12.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:32:12.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:32:12.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.756+0000 7ffbc900e800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffbc900e800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffbc900e800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffbc900e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffa9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398980 cookie 93908776799072 notifier 9042 bl.length()=389 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffa9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:32:12.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.758+0000 7ffa9b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:12.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.761+0000 7ffbc900e800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:32:12.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.761+0000 7ffbc900e800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:12.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.761+0000 7ffbc900e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:32:12.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.762+0000 7ffa9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399043 cookie 93908776807856 notifier 9042 bl.length()=230 2024-09-14T11:32:12.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.762+0000 7ffa9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:32:12.760 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.762+0000 7ffa9b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffbc900e800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffbc900e800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffbc900e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffa9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 93908776802544 notifier 9042 bl.length()=234 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffa9b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:32:12.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.765+0000 7ffa9b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:32:12.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.767+0000 7ffa7afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.770+0000 7ffbc900e800 20 remove_watcher() i=0 2024-09-14T11:32:12.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.770+0000 7ffbc900e800 2 removed watcher, disabling cache 2024-09-14T11:32:12.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.771+0000 7ffbc900e800 20 remove_watcher() i=1 2024-09-14T11:32:12.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.772+0000 7ffbc900e800 20 remove_watcher() i=2 2024-09-14T11:32:12.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.773+0000 7ffbc900e800 20 remove_watcher() i=3 2024-09-14T11:32:12.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.774+0000 7ffbc900e800 20 remove_watcher() i=4 2024-09-14T11:32:12.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.775+0000 7ffbc900e800 20 remove_watcher() i=5 2024-09-14T11:32:12.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.776+0000 7ffbc900e800 20 remove_watcher() i=6 2024-09-14T11:32:12.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.777+0000 7ffbc900e800 20 remove_watcher() i=7 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "RGW33333333333333333", 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "tenant": "testx", 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "quota": { 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:12.785 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_users": 1000, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_roles": 1000, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_groups": 1000, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout: "max_access_keys": 4 2024-09-14T11:32:12.786 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:12.787 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:32:12.788 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key DUMEIPPGQKOSUFGFYDOG --secret 0yte5RQJnVMdEmk3x3zjSXhDvi2TjHqItLpe9TvOcd8LXARu/ZKxdQ== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:32:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:12.857 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:12.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.895+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.896+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.896+0000 7fe3f6939800 20 realm 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.896+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.897+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.897+0000 7fe3f6939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.897+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.897+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:12.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.897+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.898+0000 7fe3f6939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.898+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.898+0000 7fe3f6939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:12.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.898+0000 7fe3f6939800 20 searching for the correct realm 2024-09-14T11:32:12.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:12.901+0000 7fe3f2e26640 0 -- 172.21.15.29:0/39590936 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe3ec0881b0 msgr2=0x7fe3ec060ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.107+0000 7fe3f1e24640 0 -- 172.21.15.29:0/39590936 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe3ec0847a0 msgr2=0x7fe3ec0605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.315+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 zone default found 2024-09-14T11:32:13.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 4 Realm: () 2024-09-14T11:32:13.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:13.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 zonegroup default 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.316+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 started sync module instance, tier type = 2024-09-14T11:32:13.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.317+0000 7fe3f6939800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=0 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=1 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=2 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=3 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=4 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=5 2024-09-14T11:32:13.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.327+0000 7fe3f6939800 20 add_watcher() i=6 2024-09-14T11:32:13.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.329+0000 7fe3f6939800 20 add_watcher() i=7 2024-09-14T11:32:13.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.329+0000 7fe3f6939800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 5 note: GC not initialized 2024-09-14T11:32:13.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe2237fe640 20 reqs_thread_entry: start 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 20 Filter name: none 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe2217fa640 20 reqs_thread_entry: start 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.331+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:32:13.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:32:13.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG : miss 2024-09-14T11:32:13.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG info.flags=0x0 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 adding default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG to cache LRU end 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.332+0000 7fe3f6939800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG : hit (negative entry) 2024-09-14T11:32:13.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.333+0000 7fe3f6939800 10 cache get: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG : hit (negative entry) 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe3f6939800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe3f6939800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe2d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399115 cookie 94029689770560 notifier 9057 bl.length()=732 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe2d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:32:13.334 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.335+0000 7fe2d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe3f6939800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe3f6939800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe2d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398940 cookie 94029689772688 notifier 9057 bl.length()=215 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe2d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:32:13.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.338+0000 7fe2d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.341+0000 7fe3f6939800 10 cache put: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG info.flags=0x7 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.341+0000 7fe3f6939800 10 moving default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG to cache LRU end 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.341+0000 7fe3f6939800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:DUMEIPPGQKOSUFGFYDOG, ofs0, ns] 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.342+0000 7fe2d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94029689760736 notifier 9057 bl.length()=201 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.342+0000 7fe2d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG info.flags=0x7 2024-09-14T11:32:13.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.342+0000 7fe2d57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+DUMEIPPGQKOSUFGFYDOG to cache LRU end 2024-09-14T11:32:13.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.344+0000 7fe3f6939800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:32:13.342 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:13.342 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "DUMEIPPGQKOSUFGFYDOG", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "0yte5RQJnVMdEmk3x3zjSXhDvi2TjHqItLpe9TvOcd8LXARu/ZKxdQ==", 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:13.334516Z" 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:13.343 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:13.344 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "root", 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:13.334503Z", 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:13.345 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:13.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.345+0000 7fe2a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.347+0000 7fe3f6939800 20 remove_watcher() i=0 2024-09-14T11:32:13.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.347+0000 7fe3f6939800 2 removed watcher, disabling cache 2024-09-14T11:32:13.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.349+0000 7fe3f6939800 20 remove_watcher() i=1 2024-09-14T11:32:13.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.350+0000 7fe3f6939800 20 remove_watcher() i=2 2024-09-14T11:32:13.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.351+0000 7fe3f6939800 20 remove_watcher() i=3 2024-09-14T11:32:13.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.352+0000 7fe3f6939800 20 remove_watcher() i=4 2024-09-14T11:32:13.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.353+0000 7fe3f6939800 20 remove_watcher() i=5 2024-09-14T11:32:13.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.354+0000 7fe3f6939800 20 remove_watcher() i=6 2024-09-14T11:32:13.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.355+0000 7fe3f6939800 20 remove_watcher() i=7 2024-09-14T11:32:13.366 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 8707791146 --totp-seed I45I3VDV3Z3IKB5DEYF4VIVUOQWVW4FVCVJFOQ3ZDSLILFOVQ7BKGGLWFQBFI6TK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:13.438 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:13.438 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:13.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.476+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 realm 2024-09-14T11:32:13.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.478+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.479+0000 7fc091946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.479+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.480+0000 7fc091946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:13.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.480+0000 7fc091946800 20 searching for the correct realm 2024-09-14T11:32:13.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.482+0000 7fc08fc38640 0 -- 172.21.15.29:0/1041561820 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc088050070 msgr2=0x7fc08803d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:13.686 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.688+0000 7fc087fff640 0 -- 172.21.15.29:0/1041561820 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc08803d040 msgr2=0x7fc088075430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.894+0000 7fc091946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:13.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.895+0000 7fc091946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 zone default found 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 4 Realm: () 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:13.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 zonegroup default 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 started sync module instance, tier type = 2024-09-14T11:32:13.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.896+0000 7fc091946800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:13.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=0 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=1 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=2 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=3 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=4 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=5 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.906+0000 7fc091946800 20 add_watcher() i=6 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.907+0000 7fc091946800 20 add_watcher() i=7 2024-09-14T11:32:13.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.907+0000 7fc091946800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fbf45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fc091946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fc091946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fc091946800 5 note: GC not initialized 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fbf44fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fc091946800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fc091946800 20 Filter name: none 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.909+0000 7fbebe7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:32:13.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 20 rados->read ofs=0 len=0 2024-09-14T11:32:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:32:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:32:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.910+0000 7fc091946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.912+0000 7fc091946800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.912+0000 7fc091946800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.912+0000 7fc091946800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.913+0000 7fbf72ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399116 cookie 94605066290992 notifier 8573 bl.length()=746 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.913+0000 7fbf72ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:32:13.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.913+0000 7fbf72ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:32:13.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.915+0000 7fbf45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:13.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.918+0000 7fc091946800 20 remove_watcher() i=0 2024-09-14T11:32:13.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.918+0000 7fc091946800 2 removed watcher, disabling cache 2024-09-14T11:32:13.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.919+0000 7fc091946800 20 remove_watcher() i=1 2024-09-14T11:32:13.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.920+0000 7fc091946800 20 remove_watcher() i=2 2024-09-14T11:32:13.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.922+0000 7fc091946800 20 remove_watcher() i=3 2024-09-14T11:32:13.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.923+0000 7fc091946800 20 remove_watcher() i=4 2024-09-14T11:32:13.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.924+0000 7fc091946800 20 remove_watcher() i=5 2024-09-14T11:32:13.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.925+0000 7fc091946800 20 remove_watcher() i=6 2024-09-14T11:32:13.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:13.926+0000 7fc091946800 20 remove_watcher() i=7 2024-09-14T11:32:13.935 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:32:13.935 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key GCFPXZJKSDAWBIJSXANB --secret tlwpaqg6Bm38tvxYND0uIYfiwgCcud25z82HOMXyTsWD+vPGEA5DDA== --cluster ceph 2024-09-14T11:32:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.001 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.039+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 realm 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.041+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.042+0000 7f4f8ff0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.042+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.043+0000 7f4f8ff0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.043+0000 7f4f8ff0c800 20 searching for the correct realm 2024-09-14T11:32:14.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.045+0000 7f4f8e1fe640 0 -- 172.21.15.29:0/4252205778 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55864c37ab50 msgr2=0x55864c37cf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.048+0000 7f4f8e1fe640 0 -- 172.21.15.29:0/4252205778 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7f4e580885c0 msgr2=0x7f4e5808a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:14.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.054+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 zone default found 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 4 Realm: () 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 zonegroup default 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.055+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.056+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.056+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.056+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.056+0000 7f4f8ff0c800 20 started sync module instance, tier type = 2024-09-14T11:32:14.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.056+0000 7f4f8ff0c800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=0 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=1 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=2 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=3 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=4 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=5 2024-09-14T11:32:14.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.066+0000 7f4f8ff0c800 20 add_watcher() i=6 2024-09-14T11:32:14.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.067+0000 7f4f8ff0c800 20 add_watcher() i=7 2024-09-14T11:32:14.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.067+0000 7f4f8ff0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.068+0000 7f4e3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.068+0000 7f4f8ff0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.068+0000 7f4f8ff0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.068+0000 7f4f8ff0c800 5 note: GC not initialized 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.068+0000 7f4e3e7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 Filter name: none 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4daffff640 20 reqs_thread_entry: start 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:32:14.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 10 cache get: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB : miss 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.069+0000 7f4f8ff0c800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.070+0000 7f4f8ff0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.070+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB info.flags=0x0 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.070+0000 7f4f8ff0c800 10 adding default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB to cache LRU end 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.070+0000 7f4f8ff0c800 10 cache get: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB : hit (negative entry) 2024-09-14T11:32:14.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.070+0000 7f4f8ff0c800 10 cache get: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB : hit (negative entry) 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4f8ff0c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4f8ff0c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398941 cookie 94035292746800 notifier 8591 bl.length()=660 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.071+0000 7f4e717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:32:14.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4f8ff0c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:32:14.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4f8ff0c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:32:14.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4e717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94035292727696 notifier 8591 bl.length()=191 2024-09-14T11:32:14.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4e717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:32:14.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.074+0000 7f4e717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.077+0000 7f4f8ff0c800 10 cache put: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB info.flags=0x7 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.077+0000 7f4f8ff0c800 10 moving default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB to cache LRU end 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.077+0000 7f4f8ff0c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:GCFPXZJKSDAWBIJSXANB, ofs0, ns] 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.078+0000 7f4e70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399044 cookie 94035292736976 notifier 8591 bl.length()=189 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.078+0000 7f4e70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB info.flags=0x7 2024-09-14T11:32:14.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.078+0000 7f4e70ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+GCFPXZJKSDAWBIJSXANB to cache LRU end 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "foobar.client.0", 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "foobar+test@test.test", 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:14.077 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "foobar.client.0", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "GCFPXZJKSDAWBIJSXANB", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "tlwpaqg6Bm38tvxYND0uIYfiwgCcud25z82HOMXyTsWD+vPGEA5DDA==", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:14.070929Z" 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:14.078 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:14.079 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:14.070915Z", 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:14.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.080+0000 7f4e3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.082+0000 7f4f8ff0c800 20 remove_watcher() i=0 2024-09-14T11:32:14.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.082+0000 7f4f8ff0c800 2 removed watcher, disabling cache 2024-09-14T11:32:14.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.084+0000 7f4f8ff0c800 20 remove_watcher() i=1 2024-09-14T11:32:14.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.085+0000 7f4f8ff0c800 20 remove_watcher() i=2 2024-09-14T11:32:14.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.086+0000 7f4f8ff0c800 20 remove_watcher() i=3 2024-09-14T11:32:14.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.087+0000 7f4f8ff0c800 20 remove_watcher() i=4 2024-09-14T11:32:14.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.088+0000 7f4f8ff0c800 20 remove_watcher() i=5 2024-09-14T11:32:14.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.089+0000 7f4f8ff0c800 20 remove_watcher() i=6 2024-09-14T11:32:14.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.090+0000 7f4f8ff0c800 20 remove_watcher() i=7 2024-09-14T11:32:14.100 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0282874484 --totp-seed FNYIWVD2VXMFDNLSJTMBM3KJ3VJ3N3YXPHXITVEH2YCLUP44MCO3IM2XGPPRLKWJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:14.168 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.168 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.206+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 20 realm 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.208+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.209+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.209+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.210+0000 7ff7a752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.210+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.210+0000 7ff7a752e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.210+0000 7ff7a752e800 20 searching for the correct realm 2024-09-14T11:32:14.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.212+0000 7ff7a3ade640 0 -- 172.21.15.29:0/1297654633 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7ff79c091060 msgr2=0x7ff79c092450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.418+0000 7ff7a2adc640 0 -- 172.21.15.29:0/1297654633 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7ff79c0b9e50 msgr2=0x7ff79c0ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.625+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 zone default found 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 4 Realm: () 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 zonegroup default 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.626+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 started sync module instance, tier type = 2024-09-14T11:32:14.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.627+0000 7ff7a752e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=0 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=1 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=2 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=3 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=4 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=5 2024-09-14T11:32:14.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.637+0000 7ff7a752e800 20 add_watcher() i=6 2024-09-14T11:32:14.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.638+0000 7ff7a752e800 20 add_watcher() i=7 2024-09-14T11:32:14.636 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.638+0000 7ff7a752e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff659fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 5 note: GC not initialized 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff658fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 20 Filter name: none 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff5d27fc640 20 reqs_thread_entry: start 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.640+0000 7ff7a752e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.641+0000 7ff7a752e800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.641+0000 7ff7a752e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:32:14.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.641+0000 7ff7a752e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.641+0000 7ff7a752e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.643+0000 7ff7a752e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.643+0000 7ff7a752e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.643+0000 7ff7a752e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.644+0000 7ff686ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398942 cookie 94425736573760 notifier 8606 bl.length()=674 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.644+0000 7ff686ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.644+0000 7ff686ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.646+0000 7ff659fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.649+0000 7ff7a752e800 20 remove_watcher() i=0 2024-09-14T11:32:14.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.649+0000 7ff7a752e800 2 removed watcher, disabling cache 2024-09-14T11:32:14.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.650+0000 7ff7a752e800 20 remove_watcher() i=1 2024-09-14T11:32:14.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.651+0000 7ff7a752e800 20 remove_watcher() i=2 2024-09-14T11:32:14.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.653+0000 7ff7a752e800 20 remove_watcher() i=3 2024-09-14T11:32:14.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.654+0000 7ff7a752e800 20 remove_watcher() i=4 2024-09-14T11:32:14.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.655+0000 7ff7a752e800 20 remove_watcher() i=5 2024-09-14T11:32:14.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.656+0000 7ff7a752e800 20 remove_watcher() i=6 2024-09-14T11:32:14.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.657+0000 7ff7a752e800 20 remove_watcher() i=7 2024-09-14T11:32:14.667 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:32:14.725 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.725 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.765+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 realm 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.766+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.767+0000 7f4eaf532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.767+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.768+0000 7f4eaf532800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.768+0000 7f4eaf532800 20 searching for the correct realm 2024-09-14T11:32:14.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.770+0000 7f4eab9bd640 0 -- 172.21.15.29:0/1596980954 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x5570825c8630 msgr2=0x5570825caa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:14.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.775+0000 7f4eaa9bb640 0 -- 172.21.15.29:0/1596980954 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7f4e9c01a040 msgr2=0x7f4e9c039410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.781+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 zone default found 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 4 Realm: () 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 zonegroup default 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 started sync module instance, tier type = 2024-09-14T11:32:14.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.782+0000 7f4eaf532800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:14.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=0 2024-09-14T11:32:14.789 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=1 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=2 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=3 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=4 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=5 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.791+0000 7f4eaf532800 20 add_watcher() i=6 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.792+0000 7f4eaf532800 20 add_watcher() i=7 2024-09-14T11:32:14.790 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.792+0000 7f4eaf532800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4eaf532800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4eaf532800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4eaf532800 5 note: GC not initialized 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4d60fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4eaf532800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.794+0000 7f4eaf532800 20 Filter name: none 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4cda7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:32:14.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:32:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:32:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.794 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.795+0000 7f4eaf532800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4eaf532800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4eaf532800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4eaf532800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4d8effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 93941711854864 notifier 9132 bl.length()=727 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4d8effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:32:14.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.796+0000 7f4d8effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "foobar.client.0", 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "foobar+test@test.test", 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:14.796 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "foobar.client.0", 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "GCFPXZJKSDAWBIJSXANB", 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "tlwpaqg6Bm38tvxYND0uIYfiwgCcud25z82HOMXyTsWD+vPGEA5DDA==", 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:14.070929Z" 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [ 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "oidc-provider", 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: "perm": "*" 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.797 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "roles", 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "perm": "*" 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "user-policy", 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "perm": "*" 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:14.798 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "rgw", 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [ 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: "0282874484" 2024-09-14T11:32:14.799 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "", 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:14.070915Z", 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:14.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.799+0000 7f4d61fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.801+0000 7f4eaf532800 20 remove_watcher() i=0 2024-09-14T11:32:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.801+0000 7f4eaf532800 2 removed watcher, disabling cache 2024-09-14T11:32:14.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.803+0000 7f4eaf532800 20 remove_watcher() i=1 2024-09-14T11:32:14.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.804+0000 7f4eaf532800 20 remove_watcher() i=2 2024-09-14T11:32:14.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.805+0000 7f4eaf532800 20 remove_watcher() i=3 2024-09-14T11:32:14.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.806+0000 7f4eaf532800 20 remove_watcher() i=4 2024-09-14T11:32:14.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.807+0000 7f4eaf532800 20 remove_watcher() i=5 2024-09-14T11:32:14.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.808+0000 7f4eaf532800 20 remove_watcher() i=6 2024-09-14T11:32:14.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.809+0000 7f4eaf532800 20 remove_watcher() i=7 2024-09-14T11:32:14.819 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:32:14.880 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:14.880 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:14.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.918+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 realm 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.920+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.921+0000 7f1c7232e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:14.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.921+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:14.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.922+0000 7f1c7232e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:14.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.922+0000 7f1c7232e800 20 searching for the correct realm 2024-09-14T11:32:14.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:14.924+0000 7f1c6e8de640 0 -- 172.21.15.29:0/1552878223 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1c6800fc20 msgr2=0x7f1c68068e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.130+0000 7f1c6d8dc640 0 -- 172.21.15.29:0/1552878223 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1c68073670 msgr2=0x7f1c68021740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.337+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.338+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.338+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.338+0000 7f1c7232e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.338+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 zone default found 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 4 Realm: () 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 zonegroup default 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.339+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.340+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.340+0000 7f1c7232e800 20 started sync module instance, tier type = 2024-09-14T11:32:15.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.340+0000 7f1c7232e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:15.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=0 2024-09-14T11:32:15.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=1 2024-09-14T11:32:15.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=2 2024-09-14T11:32:15.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=3 2024-09-14T11:32:15.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=4 2024-09-14T11:32:15.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=5 2024-09-14T11:32:15.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.350+0000 7f1c7232e800 20 add_watcher() i=6 2024-09-14T11:32:15.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.351+0000 7f1c7232e800 20 add_watcher() i=7 2024-09-14T11:32:15.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.351+0000 7f1c7232e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1c7232e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1c7232e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1c7232e800 5 note: GC not initialized 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1a9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:15.352 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.353+0000 7f1c7232e800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 Filter name: none 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1a9d7fa640 20 reqs_thread_entry: start 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:32:15.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.354+0000 7f1c7232e800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:32:15.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1c7232e800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1c7232e800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1c7232e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94646254344736 notifier 9153 bl.length()=384 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:32:15.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.356+0000 7f1b51ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1c7232e800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:32:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1c7232e800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1c7232e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:32:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399045 cookie 94646254361136 notifier 9153 bl.length()=225 2024-09-14T11:32:15.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:32:15.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.360+0000 7f1b51ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.363+0000 7f1c7232e800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.363+0000 7f1c7232e800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:32:15.361 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.363+0000 7f1c7232e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:32:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.364+0000 7f1b51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398953 cookie 94646254354480 notifier 9153 bl.length()=234 2024-09-14T11:32:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.364+0000 7f1b51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:32:15.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.364+0000 7f1b51ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:32:15.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.366+0000 7f1b24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.369+0000 7f1c7232e800 20 remove_watcher() i=0 2024-09-14T11:32:15.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.369+0000 7f1c7232e800 2 removed watcher, disabling cache 2024-09-14T11:32:15.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.370+0000 7f1c7232e800 20 remove_watcher() i=1 2024-09-14T11:32:15.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.371+0000 7f1c7232e800 20 remove_watcher() i=2 2024-09-14T11:32:15.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.372+0000 7f1c7232e800 20 remove_watcher() i=3 2024-09-14T11:32:15.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.373+0000 7f1c7232e800 20 remove_watcher() i=4 2024-09-14T11:32:15.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.375+0000 7f1c7232e800 20 remove_watcher() i=5 2024-09-14T11:32:15.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.376+0000 7f1c7232e800 20 remove_watcher() i=6 2024-09-14T11:32:15.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.377+0000 7f1c7232e800 20 remove_watcher() i=7 2024-09-14T11:32:15.385 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:15.385 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "RGW88888888888888888", 2024-09-14T11:32:15.385 INFO:teuthology.orchestra.run.smithi029.stdout: "tenant": "", 2024-09-14T11:32:15.385 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "quota": { 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:15.386 INFO:teuthology.orchestra.run.smithi029.stdout: "max_users": 1000, 2024-09-14T11:32:15.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max_roles": 1000, 2024-09-14T11:32:15.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max_groups": 1000, 2024-09-14T11:32:15.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:15.387 INFO:teuthology.orchestra.run.smithi029.stdout: "max_access_keys": 4 2024-09-14T11:32:15.387 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:15.388 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:32:15.388 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key IPEKVGUEYGEPOORTSKZO --secret X673Nf5Tdmct6X0+tU+q1NplSNebdVEK8px8+4dQvGpaesgXI4X/Gw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:32:15.459 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:15.459 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:15.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.498+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 realm 2024-09-14T11:32:15.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.499+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.500+0000 7fd6f6b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.498 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.500+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.501+0000 7fd6f6b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:15.499 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.501+0000 7fd6f6b25800 20 searching for the correct realm 2024-09-14T11:32:15.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.503+0000 7fd6f30a3640 0 -- 172.21.15.29:0/4230838646 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x56443f41e4b0 msgr2=0x56443f4208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.507+0000 7fd6f30a3640 0 -- 172.21.15.29:0/4230838646 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x7fd5bc0885f0 msgr2=0x7fd5bc08aa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.512+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 zone default found 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 4 Realm: () 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 zonegroup default 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.513+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 started sync module instance, tier type = 2024-09-14T11:32:15.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.514+0000 7fd6f6b25800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=0 2024-09-14T11:32:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=1 2024-09-14T11:32:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=2 2024-09-14T11:32:15.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=3 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=4 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=5 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.524+0000 7fd6f6b25800 20 add_watcher() i=6 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.525+0000 7fd6f6b25800 20 add_watcher() i=7 2024-09-14T11:32:15.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.525+0000 7fd6f6b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:15.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd5a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd6f6b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd6f6b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd6f6b25800 5 note: GC not initialized 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd523fff640 20 reqs_thread_entry: start 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd6f6b25800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd6f6b25800 20 Filter name: none 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.527+0000 7fd521ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:32:15.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:15.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO : miss 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO info.flags=0x0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 adding default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO to cache LRU end 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.528+0000 7fd6f6b25800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:32:15.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO : hit (negative entry) 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.529+0000 7fd6f6b25800 10 cache get: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO : hit (negative entry) 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd6f6b25800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:15.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd6f6b25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:32:15.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd5d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398983 cookie 94851119052416 notifier 9174 bl.length()=681 2024-09-14T11:32:15.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd5d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:32:15.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.531+0000 7fd5d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd6f6b25800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd6f6b25800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:32:15.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd5d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399117 cookie 94851119093392 notifier 9174 bl.length()=189 2024-09-14T11:32:15.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd5d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:32:15.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.534+0000 7fd5d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd6f6b25800 10 cache put: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO info.flags=0x7 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd6f6b25800 10 moving default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO to cache LRU end 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd6f6b25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:IPEKVGUEYGEPOORTSKZO, ofs0, ns] 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd5d5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399046 cookie 94851119092144 notifier 9174 bl.length()=188 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd5d5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO info.flags=0x7 2024-09-14T11:32:15.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.537+0000 7fd5d5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IPEKVGUEYGEPOORTSKZO to cache LRU end 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.540+0000 7fd6f6b25800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "root1.client.0", 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "root1+test@test.test", 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:15.538 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "root1.client.0", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "IPEKVGUEYGEPOORTSKZO", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "X673Nf5Tdmct6X0+tU+q1NplSNebdVEK8px8+4dQvGpaesgXI4X/Gw==", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:15.530455Z" 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:15.539 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:15.540 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "root", 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:15.530442Z", 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:15.541 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:15.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.541+0000 7fd5a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:15.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.543+0000 7fd6f6b25800 20 remove_watcher() i=0 2024-09-14T11:32:15.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.543+0000 7fd6f6b25800 2 removed watcher, disabling cache 2024-09-14T11:32:15.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.544+0000 7fd6f6b25800 20 remove_watcher() i=1 2024-09-14T11:32:15.543 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.545+0000 7fd6f6b25800 20 remove_watcher() i=2 2024-09-14T11:32:15.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.546+0000 7fd6f6b25800 20 remove_watcher() i=3 2024-09-14T11:32:15.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.547+0000 7fd6f6b25800 20 remove_watcher() i=4 2024-09-14T11:32:15.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.548+0000 7fd6f6b25800 20 remove_watcher() i=5 2024-09-14T11:32:15.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.549+0000 7fd6f6b25800 20 remove_watcher() i=6 2024-09-14T11:32:15.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.550+0000 7fd6f6b25800 20 remove_watcher() i=7 2024-09-14T11:32:15.560 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 5290680284 --totp-seed 5YQAPXD2Y3JMRF7NISLKOGBAYFYWGVBFGRMBYUO6SSVARFEQIHFBUSKAZNVBMSGH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:15.628 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:15.628 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:15.663 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.665+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 realm 2024-09-14T11:32:15.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.667+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.668+0000 7fc2c8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:15.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.668+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:15.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.669+0000 7fc2c8726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:15.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.669+0000 7fc2c8726800 20 searching for the correct realm 2024-09-14T11:32:15.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.671+0000 7fc2c4b0a640 0 -- 172.21.15.29:0/3294394095 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fc2bc00e040 msgr2=0x7fc2bc067760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:15.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:15.878+0000 7fc2c3b08640 0 -- 172.21.15.29:0/3294394095 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fc2bc073850 msgr2=0x7fc2bc01e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:16.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:16.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.085+0000 7fc2c8726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.086+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.086+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.086+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.086+0000 7fc2c8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.086+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 zone default found 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 4 Realm: () 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 zonegroup default 2024-09-14T11:32:16.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.087+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.088+0000 7fc2c8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.088+0000 7fc2c8726800 20 started sync module instance, tier type = 2024-09-14T11:32:16.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.088+0000 7fc2c8726800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:16.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=0 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=1 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=2 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=3 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=4 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=5 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.098+0000 7fc2c8726800 20 add_watcher() i=6 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.099+0000 7fc2c8726800 20 add_watcher() i=7 2024-09-14T11:32:16.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.099+0000 7fc2c8726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.101+0000 7fc17afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.101+0000 7fc2c8726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.101+0000 7fc2c8726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.101+0000 7fc2c8726800 5 note: GC not initialized 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc179fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc2c8726800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:16.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc2c8726800 20 Filter name: none 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc0eb7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc2c8726800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.102+0000 7fc2c8726800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.103+0000 7fc2c8726800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.103+0000 7fc2c8726800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.103+0000 7fc2c8726800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:16.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.103+0000 7fc2c8726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:16.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.105+0000 7fc2c8726800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.105+0000 7fc2c8726800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.105+0000 7fc2c8726800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.106+0000 7fc19b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398984 cookie 94755125308544 notifier 8675 bl.length()=695 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.106+0000 7fc19b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:32:16.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.106+0000 7fc19b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:32:16.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.109+0000 7fc17afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.112+0000 7fc2c8726800 20 remove_watcher() i=0 2024-09-14T11:32:16.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.112+0000 7fc2c8726800 2 removed watcher, disabling cache 2024-09-14T11:32:16.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.113+0000 7fc2c8726800 20 remove_watcher() i=1 2024-09-14T11:32:16.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.114+0000 7fc2c8726800 20 remove_watcher() i=2 2024-09-14T11:32:16.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.115+0000 7fc2c8726800 20 remove_watcher() i=3 2024-09-14T11:32:16.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.116+0000 7fc2c8726800 20 remove_watcher() i=4 2024-09-14T11:32:16.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.117+0000 7fc2c8726800 20 remove_watcher() i=5 2024-09-14T11:32:16.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.118+0000 7fc2c8726800 20 remove_watcher() i=6 2024-09-14T11:32:16.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.119+0000 7fc2c8726800 20 remove_watcher() i=7 2024-09-14T11:32:16.130 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:32:16.193 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:16.193 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:16.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.233+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 realm 2024-09-14T11:32:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.235+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.236+0000 7fd8ae020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.236+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.237+0000 7fd8ae020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:16.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.237+0000 7fd8ae020800 20 searching for the correct realm 2024-09-14T11:32:16.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.238+0000 7fd8ab309640 0 -- 172.21.15.29:0/3887488296 >> [v2:172.21.15.73:6800/3037189412,v1:172.21.15.73:6801/3037189412] conn(0x7fd89c088410 msgr2=0x7fd89c088830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.445+0000 7fd8ac30b640 0 -- 172.21.15.29:0/3887488296 >> [v2:172.21.15.29:6824/2902667139,v1:172.21.15.29:6825/2902667139] conn(0x55fea54b0f30 msgr2=0x55fea54b3340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:16.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:16.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.452+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:16.452 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 zone default found 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 4 Realm: () 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 zonegroup default 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.453+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.454+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.454+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.454+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.454+0000 7fd8ae020800 20 started sync module instance, tier type = 2024-09-14T11:32:16.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.454+0000 7fd8ae020800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:16.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=0 2024-09-14T11:32:16.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=1 2024-09-14T11:32:16.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=2 2024-09-14T11:32:16.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=3 2024-09-14T11:32:16.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=4 2024-09-14T11:32:16.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=5 2024-09-14T11:32:16.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.465+0000 7fd8ae020800 20 add_watcher() i=6 2024-09-14T11:32:16.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.466+0000 7fd8ae020800 20 add_watcher() i=7 2024-09-14T11:32:16.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.466+0000 7fd8ae020800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.467+0000 7fd761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 5 note: GC not initialized 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd760fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 20 Filter name: none 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd6da7fc640 20 reqs_thread_entry: start 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.468+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:32:16.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:16.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:32:16.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:32:16.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.469+0000 7fd8ae020800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.470+0000 7fd8ae020800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.470+0000 7fd8ae020800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.470+0000 7fd8ae020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:32:16.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.471+0000 7fd78affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398985 cookie 94552183219632 notifier 8687 bl.length()=384 2024-09-14T11:32:16.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.471+0000 7fd78affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:32:16.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.471+0000 7fd78affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:16.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd8ae020800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:32:16.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd8ae020800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:16.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd8ae020800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:32:16.472 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd78affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399047 cookie 94552183258464 notifier 8687 bl.length()=225 2024-09-14T11:32:16.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd78affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:32:16.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.474+0000 7fd78affd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:16.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.477+0000 7fd8ae020800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:32:16.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.477+0000 7fd8ae020800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:32:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.477+0000 7fd8ae020800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:32:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.478+0000 7fd78affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398954 cookie 94552183252272 notifier 8687 bl.length()=234 2024-09-14T11:32:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.478+0000 7fd78affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:32:16.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.478+0000 7fd78affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:32:16.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.480+0000 7fd761fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:16.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.483+0000 7fd8ae020800 20 remove_watcher() i=0 2024-09-14T11:32:16.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.483+0000 7fd8ae020800 2 removed watcher, disabling cache 2024-09-14T11:32:16.482 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.484+0000 7fd8ae020800 20 remove_watcher() i=1 2024-09-14T11:32:16.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.485+0000 7fd8ae020800 20 remove_watcher() i=2 2024-09-14T11:32:16.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.486+0000 7fd8ae020800 20 remove_watcher() i=3 2024-09-14T11:32:16.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.487+0000 7fd8ae020800 20 remove_watcher() i=4 2024-09-14T11:32:16.486 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.488+0000 7fd8ae020800 20 remove_watcher() i=5 2024-09-14T11:32:16.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.490+0000 7fd8ae020800 20 remove_watcher() i=6 2024-09-14T11:32:16.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.491+0000 7fd8ae020800 20 remove_watcher() i=7 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "id": "RGW99999999999999999", 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "tenant": "", 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "quota": { 2024-09-14T11:32:16.499 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_users": 1000, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_roles": 1000, 2024-09-14T11:32:16.500 INFO:teuthology.orchestra.run.smithi029.stdout: "max_groups": 1000, 2024-09-14T11:32:16.501 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:16.501 INFO:teuthology.orchestra.run.smithi029.stdout: "max_access_keys": 4 2024-09-14T11:32:16.501 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:16.502 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:32:16.502 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key INWLPXRBYKHGOVEJDOHI --secret sncQOZlquw1ITwqUQxczn4h5bDc6UafJb6iw81GILz6mgGlzpz7oGw== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:32:16.571 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:16.572 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:16.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.610+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 20 realm 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.611+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.612+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:16.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.612+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.612+0000 7f1b0cb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:16.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.612+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:16.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.613+0000 7f1b0cb2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:16.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.613+0000 7f1b0cb2f800 20 searching for the correct realm 2024-09-14T11:32:16.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.615+0000 7f1b09077640 0 -- 172.21.15.29:0/2080303061 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f1b04063040 msgr2=0x7f1b0406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:16.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:16.821+0000 7f1b00075640 0 -- 172.21.15.29:0/2080303061 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f1b04083560 msgr2=0x7f1b040629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:17.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.028+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 zone default found 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 4 Realm: () 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:17.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 zonegroup default 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.029+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.030+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.030+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.030+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.030+0000 7f1b0cb2f800 20 started sync module instance, tier type = 2024-09-14T11:32:17.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.030+0000 7f1b0cb2f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=0 2024-09-14T11:32:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=1 2024-09-14T11:32:17.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=2 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=3 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=4 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=5 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.041+0000 7f1b0cb2f800 20 add_watcher() i=6 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.042+0000 7f1b0cb2f800 20 add_watcher() i=7 2024-09-14T11:32:17.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.042+0000 7f1b0cb2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f19befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 5 note: GC not initialized 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f19bdfe3640 20 reqs_thread_entry: start 2024-09-14T11:32:17.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:17.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 20 Filter name: none 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f192f7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.045+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:32:17.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI : miss 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.046+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI info.flags=0x0 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 adding default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI to cache LRU end 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:17.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI : hit (negative entry) 2024-09-14T11:32:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.047+0000 7f1b0cb2f800 10 cache get: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI : hit (negative entry) 2024-09-14T11:32:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:32:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f1b0cb2f800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f1b0cb2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:32:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f19dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398986 cookie 94027586670928 notifier 8705 bl.length()=681 2024-09-14T11:32:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f19dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:32:17.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.049+0000 7f19dffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f1b0cb2f800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f1b0cb2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f19dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399118 cookie 94027586690816 notifier 8705 bl.length()=189 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f19dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:32:17.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.053+0000 7f19dffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:32:17.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f1b0cb2f800 10 cache put: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI info.flags=0x7 2024-09-14T11:32:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f1b0cb2f800 10 moving default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI to cache LRU end 2024-09-14T11:32:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f1b0cb2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:INWLPXRBYKHGOVEJDOHI, ofs0, ns] 2024-09-14T11:32:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f19df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94027586691872 notifier 8705 bl.length()=188 2024-09-14T11:32:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f19df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI info.flags=0x7 2024-09-14T11:32:17.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.057+0000 7f19df7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+INWLPXRBYKHGOVEJDOHI to cache LRU end 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.060+0000 7f1b0cb2f800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "user_id": "root2.client.0", 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "email": "root2+test@test.test", 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "suspended": 0, 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "max_buckets": 1000, 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "subusers": [], 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "keys": [ 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: { 2024-09-14T11:32:17.058 INFO:teuthology.orchestra.run.smithi029.stdout: "user": "root2.client.0", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "access_key": "INWLPXRBYKHGOVEJDOHI", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "secret_key": "sncQOZlquw1ITwqUQxczn4h5bDc6UafJb6iw81GILz6mgGlzpz7oGw==", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "active": true, 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:17.048506Z" 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: } 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: ], 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "swift_keys": [], 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "caps": [], 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "op_mask": "read, write, delete", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "default_placement": "", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "default_storage_class": "", 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "placement_tags": [], 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "bucket_quota": { 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:17.059 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "user_quota": { 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "enabled": false, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "check_on_raw": false, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size": -1, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_size_kb": 0, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "max_objects": -1 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: }, 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "temp_url_keys": [], 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "type": "root", 2024-09-14T11:32:17.060 INFO:teuthology.orchestra.run.smithi029.stdout: "mfa_ids": [], 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: "path": "/", 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: "create_date": "2024-09-14T11:32:17.048491Z", 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: "tags": [], 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: "group_ids": [] 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:32:17.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.061+0000 7f19befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:17.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.063+0000 7f1b0cb2f800 20 remove_watcher() i=0 2024-09-14T11:32:17.062 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.063+0000 7f1b0cb2f800 2 removed watcher, disabling cache 2024-09-14T11:32:17.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.064+0000 7f1b0cb2f800 20 remove_watcher() i=1 2024-09-14T11:32:17.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.066+0000 7f1b0cb2f800 20 remove_watcher() i=2 2024-09-14T11:32:17.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.067+0000 7f1b0cb2f800 20 remove_watcher() i=3 2024-09-14T11:32:17.066 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.068+0000 7f1b0cb2f800 20 remove_watcher() i=4 2024-09-14T11:32:17.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.070+0000 7f1b0cb2f800 20 remove_watcher() i=5 2024-09-14T11:32:17.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.071+0000 7f1b0cb2f800 20 remove_watcher() i=6 2024-09-14T11:32:17.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.072+0000 7f1b0cb2f800 20 remove_watcher() i=7 2024-09-14T11:32:17.083 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 8569758664 --totp-seed A322ETYAVCLLPJDN767ECLAKWCCRA5J4NETNCNMDVFNXOEIXE4OBIWHADUWYCM4L --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:32:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:17.154 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:17.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.194+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 realm 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.196+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.197+0000 7f9a75533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.197+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.197+0000 7f9a75533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:17.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.198+0000 7f9a75533800 20 searching for the correct realm 2024-09-14T11:32:17.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.200+0000 7f9a7199a640 0 -- 172.21.15.29:0/4222591835 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9a6c035940 msgr2=0x7f9a6c016430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:32:17.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.406+0000 7f9a70998640 0 -- 172.21.15.29:0/4222591835 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9a6c0348e0 msgr2=0x7f9a6c04e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.613+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.612 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 zone default found 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 4 Realm: () 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 zonegroup default 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.614+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 started sync module instance, tier type = 2024-09-14T11:32:17.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.615+0000 7f9a75533800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=0 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=1 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=2 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=3 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=4 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=5 2024-09-14T11:32:17.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.626+0000 7f9a75533800 20 add_watcher() i=6 2024-09-14T11:32:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.627+0000 7f9a75533800 20 add_watcher() i=7 2024-09-14T11:32:17.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.627+0000 7f9a75533800 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f99277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:17.627 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 5 note: GC not initialized 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f99267e4640 20 reqs_thread_entry: start 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 20 init_complete bucket index max shards: 11 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 20 Filter name: none 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9897fff640 20 reqs_thread_entry: start 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.629+0000 7f9a75533800 20 rados->read ofs=0 len=0 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.630+0000 7f9a75533800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.630+0000 7f9a75533800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.630+0000 7f9a75533800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.630+0000 7f9a75533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:17.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.633+0000 7f9a75533800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:32:17.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.633+0000 7f9a75533800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.631 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.633+0000 7f9a75533800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:32:17.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.634+0000 7f9954ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398987 cookie 94549113228576 notifier 9252 bl.length()=695 2024-09-14T11:32:17.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.634+0000 7f9954ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:32:17.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.634+0000 7f9954ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:32:17.634 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.636+0000 7f99277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:17.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.639+0000 7f9a75533800 20 remove_watcher() i=0 2024-09-14T11:32:17.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.639+0000 7f9a75533800 2 removed watcher, disabling cache 2024-09-14T11:32:17.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.640+0000 7f9a75533800 20 remove_watcher() i=1 2024-09-14T11:32:17.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.641+0000 7f9a75533800 20 remove_watcher() i=2 2024-09-14T11:32:17.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.642+0000 7f9a75533800 20 remove_watcher() i=3 2024-09-14T11:32:17.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.643+0000 7f9a75533800 20 remove_watcher() i=4 2024-09-14T11:32:17.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.644+0000 7f9a75533800 20 remove_watcher() i=5 2024-09-14T11:32:17.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.645+0000 7f9a75533800 20 remove_watcher() i=6 2024-09-14T11:32:17.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:32:17.646+0000 7f9a75533800 20 remove_watcher() i=7 2024-09-14T11:32:17.656 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:32:17.656 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:32:17.656 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:32:17.686 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:32:17.686 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:32:17.686 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:32:17.755 DEBUG:teuthology.orchestra.run.smithi029:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:32:17.940 INFO:teuthology.orchestra.run.smithi029.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:32:18.126 INFO:teuthology.orchestra.run.smithi029.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:32:18.403 INFO:teuthology.orchestra.run.smithi029.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:34:10.329 INFO:teuthology.orchestra.run.smithi029.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:34:11.805 INFO:teuthology.orchestra.run.smithi029.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=c3b1a745f478d6212438b2b5203e0288c4883f161802218623df93fd6952ccdc,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:34:11.805 INFO:teuthology.orchestra.run.smithi029.stdout:py run-test-pre: PYTHONHASHSEED='819489005' 2024-09-14T11:34:11.805 INFO:teuthology.orchestra.run.smithi029.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:34:11.945 INFO:teuthology.orchestra.run.smithi029.stdout:============================= test session starts ============================== 2024-09-14T11:34:11.945 INFO:teuthology.orchestra.run.smithi029.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:34:11.945 INFO:teuthology.orchestra.run.smithi029.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:34:11.945 INFO:teuthology.orchestra.run.smithi029.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:34:11.945 INFO:teuthology.orchestra.run.smithi029.stdout:configfile: pytest.ini 2024-09-14T11:34:13.775 INFO:teuthology.orchestra.run.smithi029.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:34:13.775 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:34:14.177 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:34:14.498 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:34:14.884 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:34:15.271 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:34:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:34:15.935 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:34:16.365 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:34:16.669 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:34:16.793 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:34:16.919 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:34:17.233 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:34:17.552 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:34:18.073 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:34:18.389 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:34:18.514 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:34:18.638 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:34:18.716 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:34:18.793 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:34:18.873 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:34:18.949 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:34:19.026 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:34:19.103 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:34:19.180 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.257 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.335 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.413 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.491 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.570 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.647 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:34:19.725 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:34:19.802 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:34:19.886 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:34:19.978 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:34:20.056 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:34:20.134 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:34:20.211 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:34:20.288 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:34:20.366 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.443 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.520 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.597 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.675 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.757 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.835 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:34:20.912 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:34:20.989 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.066 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.143 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.221 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.299 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.377 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.453 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:34:21.532 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:34:22.118 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:34:25.511 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:34:29.620 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:34:35.590 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:34:42.903 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:34:45.671 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:34:47.818 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:34:48.801 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:34:49.071 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:34:49.478 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:34:49.885 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:34:50.627 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:34:51.053 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:34:51.313 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:34:51.313 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:34:51.314 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:34:51.315 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:34:51.316 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:34:51.317 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:34:51.318 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:34:51.319 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:34:51.320 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.320 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.321 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.322 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.323 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:34:51.324 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.325 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.326 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:34:51.326 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:34:51.327 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:34:51.328 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:34:51.329 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:34:51.330 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:34:51.330 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:34:51.331 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:34:51.332 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:34:51.333 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:34:51.334 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:34:51.334 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:34:51.335 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:34:51.425 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:34:51.436 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:34:52.159 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:35:02.475 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:35:03.002 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:35:03.615 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:35:04.230 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:35:04.845 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:35:05.461 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:35:05.931 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:35:06.586 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:35:07.151 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:35:07.711 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:35:08.198 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:35:08.662 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:35:09.122 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:35:09.345 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:35:09.875 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:35:10.477 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:35:11.108 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:35:11.590 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:35:12.074 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:35:12.552 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:35:13.028 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:35:13.506 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:35:13.963 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:35:14.417 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:35:14.645 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:35:14.907 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:35:15.134 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:35:15.371 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:35:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:35:16.066 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:35:16.307 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:35:16.580 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:35:17.000 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:35:17.404 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:35:17.639 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:35:18.076 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:35:18.483 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:35:19.049 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:35:19.392 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:35:19.794 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:35:20.196 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:35:21.136 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:35:21.773 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:35:22.347 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:35:23.054 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:23.863 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:25.166 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:26.583 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:27.389 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:28.200 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:35:28.825 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:35:29.645 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:35:30.094 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:35:31.428 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:35:32.249 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:35:33.281 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:35:35.510 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:35:38.478 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:35:40.069 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:35:41.538 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:35:42.642 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:35:43.293 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:35:44.594 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:35:45.475 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:35:46.694 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:35:47.531 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:35:49.150 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:35:50.407 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:35:52.251 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:35:54.024 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:35:55.210 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:35:56.287 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:35:57.127 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:35:59.322 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:36:00.868 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:36:02.693 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:36:04.436 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:36:06.041 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:36:07.632 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:36:08.943 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:36:09.829 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:36:10.863 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:36:12.855 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:36:15.509 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:36:16.586 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:36:18.237 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:36:19.885 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:36:21.403 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:36:22.971 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:36:24.602 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:36:26.183 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:36:27.680 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:36:28.699 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:36:29.509 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:36:30.317 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:36:31.123 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:36:32.561 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:36:34.078 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:36:35.595 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:36:37.037 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:36:38.554 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:36:39.993 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:36:41.502 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:36:43.014 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:36:44.454 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:36:45.988 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:36:47.435 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:36:48.943 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:36:49.917 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:36:50.869 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:36:51.742 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:36:52.605 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:36:53.240 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:36:54.320 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:36:55.066 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:36:55.818 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:36:56.589 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:36:57.314 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:36:58.042 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:36:58.775 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:36:59.532 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:37:00.579 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:37:01.618 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:37:02.219 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:37:02.818 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:37:03.581 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:37:04.306 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:37:05.345 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:37:06.402 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:37:07.132 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:37:07.856 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:37:08.615 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:37:09.344 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:37:10.083 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:37:10.830 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:37:11.560 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:37:12.294 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:37:13.053 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:37:13.773 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:37:14.500 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:37:15.219 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:37:15.896 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:37:16.576 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:37:17.248 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:37:18.139 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:37:18.925 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:38:10.742 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:38:11.459 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:38:12.173 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:38:12.854 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:38:13.529 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:38:14.216 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:38:14.901 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:38:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:38:16.318 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:38:16.993 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:38:17.670 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:38:18.348 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:38:19.031 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:38:19.749 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:38:20.480 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:38:21.266 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:38:21.991 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:38:22.721 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:38:23.443 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:38:24.176 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:38:24.902 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:38:25.627 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:38:26.412 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:38:27.214 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:38:28.005 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:38:28.730 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:38:29.454 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:38:30.182 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:38:30.971 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:38:31.230 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:38:31.832 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:38:33.937 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:38:36.057 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:38:36.776 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:38:37.537 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:38:38.271 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:38:38.995 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:38:39.791 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:38:40.587 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:38:41.332 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:38:42.070 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:38:42.836 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:38:43.556 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:38:44.276 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:38:45.001 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:38:46.008 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:38:47.253 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:38:47.819 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:38:48.342 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:38:48.828 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:38:49.311 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:38:49.547 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:38:49.787 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:38:50.021 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:38:50.644 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:38:52.418 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:38:52.690 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:38:53.269 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:38:53.731 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:38:54.221 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:38:54.711 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:38:56.723 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:38:57.602 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:38:58.512 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:39:51.251 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:40:43.542 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:40:44.131 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:40:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:40:45.294 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:40:45.890 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:40:46.623 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:40:47.218 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:40:47.853 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:40:48.525 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:40:49.169 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:40:49.810 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:40:50.471 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:40:51.182 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:40:51.786 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:40:52.266 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:40:52.824 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:40:53.414 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:40:54.294 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:40:54.886 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:40:55.459 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:40:56.027 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:40:56.652 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:40:57.358 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:40:57.841 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:40:58.332 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:40:58.858 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:40:59.339 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:40:59.820 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:41:00.309 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:41:00.901 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:41:01.386 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:41:01.875 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:41:02.356 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:41:02.848 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:41:03.634 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:41:04.120 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:41:04.607 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:41:05.089 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:41:05.582 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:41:06.068 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:41:06.575 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:41:07.070 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:41:08.235 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:41:08.756 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:41:09.389 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:41:10.020 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:41:10.620 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:41:11.262 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:41:11.922 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:41:13.557 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:41:14.196 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:41:14.877 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:41:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:41:16.399 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:41:17.168 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:41:17.778 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:41:18.528 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:41:19.305 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:41:19.949 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:41:20.765 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:41:21.343 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:41:21.847 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:41:22.325 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:41:22.880 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:41:23.386 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:41:23.622 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:41:24.394 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:41:24.969 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:41:25.592 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:41:28.655 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:41:29.252 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:41:29.848 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:41:30.433 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:41:31.030 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:41:31.574 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:41:32.173 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:41:32.823 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:41:33.439 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:41:34.015 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:41:34.587 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:41:35.161 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:41:35.740 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:41:36.349 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:41:36.934 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:41:37.564 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:41:38.151 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:41:38.721 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:41:38.956 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:41:39.201 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:41:39.443 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:41:39.908 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:41:40.371 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:41:40.840 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:41:41.314 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:41:42.048 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:41:42.285 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:41:42.523 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:41:43.026 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:41:43.260 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:41:43.495 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:41:43.733 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:41:43.968 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:41:44.493 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:41:45.023 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:41:45.510 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:41:46.038 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:41:46.577 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:41:47.099 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:41:47.628 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:41:48.234 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:41:48.763 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:41:49.284 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:41:49.927 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:41:50.557 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:41:51.292 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:41:51.953 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:41:52.587 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:41:53.320 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:41:54.015 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:41:54.739 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:41:55.421 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:41:55.920 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:41:56.669 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:41:57.398 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:41:58.124 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:41:58.858 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:41:59.625 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:42:00.435 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:42:01.129 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:42:01.829 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:42:02.586 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:42:03.273 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:42:03.834 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:42:04.472 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:42:05.128 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:42:05.720 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:42:06.246 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:42:07.001 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:42:07.926 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:42:08.891 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:42:09.823 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:42:10.759 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:42:11.692 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:42:12.627 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:42:13.568 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:42:14.561 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:42:15.504 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:42:16.476 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:42:17.534 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:42:18.501 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:42:20.047 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:42:21.608 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:42:21.858 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:42:22.089 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:42:22.318 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:42:22.838 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:42:23.481 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:42:24.407 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:42:25.141 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:42:27.800 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:42:28.622 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:42:29.366 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:42:32.401 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:42:33.151 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:42:33.902 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:42:34.557 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:42:35.280 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:42:36.343 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:42:37.212 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:42:38.029 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:42:38.834 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:42:40.195 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:42:41.502 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:42:42.023 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:42:42.515 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:42:44.724 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:42:45.564 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:42:54.346 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:42:54.890 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:42:55.657 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:42:58.017 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:42:58.722 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:42:59.976 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:43:07.635 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:43:17.020 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:43:34.705 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:44:34.287 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:44:42.529 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:44:52.975 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:44:54.057 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:44:57.363 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:45:00.445 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:45:02.532 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:45:03.169 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:45:06.237 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:45:07.014 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:45:07.660 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:45:08.306 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:45:27.370 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:45:30.258 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:45:30.962 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:45:31.506 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:45:32.208 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:45:36.284 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:45:39.895 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:45:43.454 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:45:44.082 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:45:44.741 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:45:45.372 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:45:46.000 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:45:46.649 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:45:47.271 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:45:47.939 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:45:49.009 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:45:50.922 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:45:54.111 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:45:55.441 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:45:57.564 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:46:01.751 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:46:03.165 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:46:06.089 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:46:12.178 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:46:13.405 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:46:14.218 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:46:15.307 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:46:15.948 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:46:22.243 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:46:22.939 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:46:23.580 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:46:24.219 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:46:24.848 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:46:25.707 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:46:37.601 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:46:38.824 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:46:39.636 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:46:40.742 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:46:41.831 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:46:46.767 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:46:47.867 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:46:53.865 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:47:16.265 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:47:30.087 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:47:32.459 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:47:34.805 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:47:35.777 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:47:36.818 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:47:37.548 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:47:38.764 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:47:39.836 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:47:41.847 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:47:42.417 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:47:43.004 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:47:43.572 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:47:44.069 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:47:44.563 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:47:45.182 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:47:45.749 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:47:46.250 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:47:46.912 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:47:47.425 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:47:47.941 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:47:48.454 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:47:48.992 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:47:49.492 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:47:50.150 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:47:50.838 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:47:51.745 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:47:52.391 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:47:53.053 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:47:53.722 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:47:54.359 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:47:54.890 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:47:55.421 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:47:55.993 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:47:56.545 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:48:25.988 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:48:55.502 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:49:03.289 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:49:03.903 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:50:05.499 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:51:06.683 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:51:07.408 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:51:08.051 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:51:08.589 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:51:09.099 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:51:29.407 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:51:36.289 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:51:43.211 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:51:43.824 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:51:44.509 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:51:45.157 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:51:46.067 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:51:46.711 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:51:47.349 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:51:48.023 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:51:48.665 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:51:49.388 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:51:50.143 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:51:50.790 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:51:51.432 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:51:52.617 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:51:53.747 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:51:55.325 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:51:56.815 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:51:58.512 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:52:00.564 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:52:02.093 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:52:03.712 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:52:05.291 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:52:06.967 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:52:08.668 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:52:09.406 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:52:10.009 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:52:10.712 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:52:12.254 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:52:13.876 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:52:15.504 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:52:17.036 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:52:31.437 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:52:32.372 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:52:33.410 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:52:34.402 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:52:35.792 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:52:37.023 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:52:37.715 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:52:38.833 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:52:39.347 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:52:39.834 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:52:40.317 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:52:40.807 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:52:41.470 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:52:42.071 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:52:43.106 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:52:43.701 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:52:44.261 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:52:44.800 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:52:45.340 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:52:45.873 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:52:46.460 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:52:46.984 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:52:47.552 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:52:48.104 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:52:48.626 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:52:49.328 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:52:49.956 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:52:50.683 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:52:51.371 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:52:52.025 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:52:52.659 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:52:53.453 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:52:54.251 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:52:54.979 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:52:55.670 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:52:56.390 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:52:57.074 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:52:57.894 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:52:58.714 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:52:59.478 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:53:00.141 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:53:00.814 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:53:01.467 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:53:02.263 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:53:02.899 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:53:03.619 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:53:04.505 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:53:05.127 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:53:05.852 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:53:06.513 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:53:17.004 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:53:17.720 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:53:27.431 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:53:28.152 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:53:28.883 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:53:29.408 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:29.970 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:30.524 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:31.109 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:53:31.704 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:53:32.310 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:53:32.805 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:53:33.365 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:53:34.032 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:53:34.620 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:53:35.353 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:53:36.023 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:53:36.595 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:53:37.172 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:53:37.978 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:53:49.134 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:53:49.651 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:50.242 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:50.894 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:53:51.530 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:53:53.054 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:53:53.733 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:53:54.953 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:53:58.587 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:53:59.705 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:54:04.686 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:54:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:54:09.771 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:54:10.701 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:54:25.264 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:54:47.736 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:54:52.143 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:54:54.073 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:54:56.242 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:54:57.971 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:54:58.653 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:55:02.519 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:55:09.075 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:55:26.083 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:55:28.892 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:55:30.887 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:55:32.735 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:55:33.776 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:55:39.678 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:55:42.892 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:55:43.753 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:55:45.015 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:55:50.573 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:55:54.011 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:55:58.459 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:56:00.256 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:56:00.473 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:56:04.343 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:56:10.655 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:56:12.946 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:56:16.711 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:56:18.532 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:56:49.511 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:56:49.729 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:56:50.722 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:56:51.459 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:56:52.251 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:56:53.192 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:56:53.208 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout:=============================== warnings summary =============================== 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: import imp 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: if boto_type is 'S3Connection': 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:56:53.209 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: if k is 'BucketName': 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:56:53.210 INFO:teuthology.orchestra.run.smithi029.stdout: @pytest.mark.timeout(10) 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:53.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:56:53.212 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.213 INFO:teuthology.orchestra.run.smithi029.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:56:53.214 INFO:teuthology.orchestra.run.smithi029.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1361.26s (0:22:41) = 2024-09-14T11:56:53.338 INFO:teuthology.orchestra.run.smithi029.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:56:53.338 INFO:teuthology.orchestra.run.smithi029.stdout: py: commands succeeded 2024-09-14T11:56:53.338 INFO:teuthology.orchestra.run.smithi029.stdout: congratulations :) 2024-09-14T11:56:53.356 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:56:53.356 DEBUG:teuthology.orchestra.run.smithi029:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:56:53.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:53.472 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:56:53.472 DEBUG:teuthology.orchestra.run.smithi029:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:56:53.501 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:56:53.502 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:56:53.713 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:56:53.725 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:56:53.725 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:56:53.725 DEBUG:teuthology.orchestra.run.smithi029:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:53.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:56:53.755 INFO:teuthology.orchestra.run.smithi029.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:56:53.755 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:53.825 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:56:53.825 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:56:53.895 INFO:tasks.workunit:timeout=3h 2024-09-14T11:56:53.896 INFO:tasks.workunit:cleanup=True 2024-09-14T11:56:53.896 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:56:53.966 INFO:tasks.workunit.client.0.smithi029.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:57:51.204 INFO:tasks.workunit.client.0.smithi029.stderr:Updating files: 93% (12061/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.382 INFO:tasks.workunit.client.0.smithi029.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: git switch -c 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr:Or undo this operation with: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: git switch - 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:51.383 INFO:tasks.workunit.client.0.smithi029.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:57:51.384 DEBUG:teuthology.orchestra.run.smithi029:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:57:51.454 INFO:tasks.workunit.client.0.smithi029.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:57:51.456 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:57:51.456 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:57:51.508 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:57:51.558 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:57:51.598 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:57:51.600 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:57:51.600 INFO:tasks.workunit.client.0.smithi029.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:57:51.640 INFO:tasks.workunit.client.0.smithi029.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:57:51.643 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2024-09-14T11:57:51.643 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:57:51.714 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:57:51.715 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:57:51.715 DEBUG:teuthology.orchestra.run.smithi029:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:57:51.789 INFO:tasks.workunit.client.0.smithi029.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:57:51.790 INFO:tasks.workunit.client.0.smithi029.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:51.790 INFO:tasks.workunit.client.0.smithi029.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:54.258 INFO:tasks.workunit.client.0.smithi029.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ deactivate nondestructive 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:57:54.259 INFO:tasks.workunit.client.0.smithi029.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:57:54.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:57:54.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:57:54.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ export VIRTUAL_ENV 2024-09-14T11:57:54.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:57:54.260 INFO:tasks.workunit.client.0.smithi029.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:57:54.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PATH 2024-09-14T11:57:54.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n '' ']' 2024-09-14T11:57:54.261 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -z '' ']' 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ PS1='(rgw) ' 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ export PS1 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:++ hash -r 2024-09-14T11:57:54.262 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install pip --upgrade 2024-09-14T11:57:54.497 INFO:tasks.workunit.client.0.smithi029.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:57:54.684 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting pip 2024-09-14T11:57:54.690 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:57:54.736 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: pip 2024-09-14T11:57:54.736 INFO:tasks.workunit.client.0.smithi029.stdout: Attempting uninstall: pip 2024-09-14T11:57:54.736 INFO:tasks.workunit.client.0.smithi029.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:57:54.898 INFO:tasks.workunit.client.0.smithi029.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:57:54.904 INFO:tasks.workunit.client.0.smithi029.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:57:55.686 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed pip-24.2 2024-09-14T11:57:55.735 INFO:tasks.workunit.client.0.smithi029.stderr:+ pip install boto3 2024-09-14T11:57:56.559 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting boto3 2024-09-14T11:57:56.560 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:57:57.183 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:57:57.184 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:57:57.234 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:57:57.235 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:57:57.290 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:57:57.291 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:57:57.350 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:57:57.351 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:57:57.427 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:57:57.429 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:57:57.588 INFO:tasks.workunit.client.0.smithi029.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:57:57.590 INFO:tasks.workunit.client.0.smithi029.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:57:57.594 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:57:57.595 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:57:57.605 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:57:57.606 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:57:57.608 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:57:57.609 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:57:57.610 INFO:tasks.workunit.client.0.smithi029.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:57:57.687 INFO:tasks.workunit.client.0.smithi029.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:57:58.793 INFO:tasks.workunit.client.0.smithi029.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:57:58.911 INFO:tasks.workunit.client.0.smithi029.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:57:59.039 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:57:59.075 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:57:59.075 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:57:59.114 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.116+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.116 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 20 realm 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.117+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.118+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.118+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.119+0000 7fe0dbe14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:57:59.117 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.119+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.119+0000 7fe0dbe14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:57:59.118 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.119+0000 7fe0dbe14800 20 searching for the correct realm 2024-09-14T11:57:59.120 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.121+0000 7fe0d7ccc640 0 -- 172.21.15.29:0/3361923498 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fe0d007a040 msgr2=0x7fe0d0087a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:57:59.326 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.327+0000 7fe0d6cca640 0 -- 172.21.15.29:0/3361923498 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fe0d007a420 msgr2=0x7fe0d007a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:57:59.533 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.534 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.534+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 zone default found 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 4 Realm: () 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 zonegroup default 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.535 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.535+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.536+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.536+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.536+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.536+0000 7fe0dbe14800 20 started sync module instance, tier type = 2024-09-14T11:57:59.536 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.536+0000 7fe0dbe14800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=0 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=1 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=2 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=3 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=4 2024-09-14T11:57:59.545 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=5 2024-09-14T11:57:59.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.546+0000 7fe0dbe14800 20 add_watcher() i=6 2024-09-14T11:57:59.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.547+0000 7fe0dbe14800 20 add_watcher() i=7 2024-09-14T11:57:59.546 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.547+0000 7fe0dbe14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:57:59.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.549+0000 7fdf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:57:59.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:57:59.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:57:59.548 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 5 note: GC not initialized 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fdf8cfe1640 20 reqs_thread_entry: start 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 20 init_complete bucket index max shards: 11 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 20 Filter name: none 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fdf067fc640 20 reqs_thread_entry: start 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.550+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 20 rados->read ofs=0 len=0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:57:59.550 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.551+0000 7fe0dbe14800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.552+0000 7fe0dbe14800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.552+0000 7fe0dbe14800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.552+0000 7fe0dbe14800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:57:59.551 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.553+0000 7fdfbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399290 cookie 94895765290928 notifier 8738 bl.length()=613 2024-09-14T11:57:59.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.553+0000 7fdfbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:57:59.552 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.553+0000 7fdfbaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:57:59.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fe0dbe14800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:57:59.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fe0dbe14800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:57:59.554 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fe0dbe14800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:57:59.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fdfbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399583 cookie 94895765286576 notifier 8738 bl.length()=191 2024-09-14T11:57:59.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fdfbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:57:59.555 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.556+0000 7fdfbaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:57:59.557 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.558+0000 7fdf8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:57:59.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.561+0000 7fe0dbe14800 20 remove_watcher() i=0 2024-09-14T11:57:59.560 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.561+0000 7fe0dbe14800 2 removed watcher, disabling cache 2024-09-14T11:57:59.561 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.563+0000 7fe0dbe14800 20 remove_watcher() i=1 2024-09-14T11:57:59.562 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.564+0000 7fe0dbe14800 20 remove_watcher() i=2 2024-09-14T11:57:59.564 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.565+0000 7fe0dbe14800 20 remove_watcher() i=3 2024-09-14T11:57:59.565 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.566+0000 7fe0dbe14800 20 remove_watcher() i=4 2024-09-14T11:57:59.566 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.567+0000 7fe0dbe14800 20 remove_watcher() i=5 2024-09-14T11:57:59.567 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.568+0000 7fe0dbe14800 20 remove_watcher() i=6 2024-09-14T11:57:59.568 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:57:59.569+0000 7fe0dbe14800 20 remove_watcher() i=7 2024-09-14T11:57:59.855 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:57:59.855 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:57:59.994 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:58:00.023 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:00.023 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:00.063 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.064+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.064 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 realm 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.066+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.067+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:00.065 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.067+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.067+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:00.066 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.067+0000 7fd6f8a94800 20 searching for the correct realm 2024-09-14T11:58:00.068 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.069+0000 7fd6f6d7f640 0 -- 172.21.15.29:0/541677272 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7fd6f0017070 msgr2=0x7fd6f00689b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:00.274 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.275+0000 7fd6f5d7d640 0 -- 172.21.15.29:0/541677272 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7fd6f0073130 msgr2=0x7fd6f006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:00.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:58:00.481 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.482+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.482 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 zone default found 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 4 Realm: () 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 zonegroup default 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.483+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.483 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 started sync module instance, tier type = 2024-09-14T11:58:00.484 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.484+0000 7fd6f8a94800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=0 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=1 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=2 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=3 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=4 2024-09-14T11:58:00.494 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=5 2024-09-14T11:58:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.495+0000 7fd6f8a94800 20 add_watcher() i=6 2024-09-14T11:58:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.496+0000 7fd6f8a94800 20 add_watcher() i=7 2024-09-14T11:58:00.495 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.496+0000 7fd6f8a94800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:00.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.498+0000 7fd5acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.498+0000 7fd6f8a94800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.498+0000 7fd6f8a94800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.498+0000 7fd6f8a94800 5 note: GC not initialized 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd5277fe640 20 reqs_thread_entry: start 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 Filter name: none 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd5257fa640 20 reqs_thread_entry: start 2024-09-14T11:58:00.498 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 rados->read ofs=0 len=0 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 INFO: main: starting shard=0 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.0 2024-09-14T11:58:00.499 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 INFO: main: starting shard=1 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.500+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.1 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 INFO: main: starting shard=2 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.2 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 INFO: main: starting shard=3 2024-09-14T11:58:00.500 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.501+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.3 2024-09-14T11:58:00.501 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 INFO: main: starting shard=4 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.4 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 INFO: main: starting shard=5 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.503+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.5 2024-09-14T11:58:00.502 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 INFO: main: starting shard=6 2024-09-14T11:58:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.6 2024-09-14T11:58:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 INFO: main: starting shard=7 2024-09-14T11:58:00.503 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.504+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.7 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.505+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.505+0000 7fd6f8a94800 20 INFO: main: starting shard=8 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.505+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.8 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.505+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.506+0000 7fd6f8a94800 20 INFO: main: starting shard=9 2024-09-14T11:58:00.504 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.506+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.9 2024-09-14T11:58:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.506+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.506+0000 7fd6f8a94800 20 INFO: main: starting shard=10 2024-09-14T11:58:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.506+0000 7fd6f8a94800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.10 2024-09-14T11:58:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.507+0000 7fd6f8a94800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:00.505 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.507+0000 7fd6f8a94800 20 INFO: main: done 2024-09-14T11:58:00.506 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.508+0000 7fd5acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:00.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.511+0000 7fd6f8a94800 20 remove_watcher() i=0 2024-09-14T11:58:00.509 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.511+0000 7fd6f8a94800 2 removed watcher, disabling cache 2024-09-14T11:58:00.510 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.511+0000 7fd6f8a94800 20 remove_watcher() i=1 2024-09-14T11:58:00.511 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.512+0000 7fd6f8a94800 20 remove_watcher() i=2 2024-09-14T11:58:00.512 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.514+0000 7fd6f8a94800 20 remove_watcher() i=3 2024-09-14T11:58:00.514 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.516+0000 7fd6f8a94800 20 remove_watcher() i=4 2024-09-14T11:58:00.515 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.516+0000 7fd6f8a94800 20 remove_watcher() i=5 2024-09-14T11:58:00.516 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.517+0000 7fd6f8a94800 20 remove_watcher() i=6 2024-09-14T11:58:00.517 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.518+0000 7fd6f8a94800 20 remove_watcher() i=7 2024-09-14T11:58:00.531 INFO:tasks.workunit.client.0.smithi029.stderr:rados -p default.rgw.buckets.data ls | grep 74244fa7-d096-4afb-b54b-4f2369d3c9f2 2024-09-14T11:58:00.554 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:00.554 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:00.630 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:00.631+0000 7f504748c640 0 -- 172.21.15.29:0/4112729912 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f503002db40 msgr2=0x7f503002d210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:00.644 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:58:00.645 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:58:00.646 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:58:02.108 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:58:02.539 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:58:02.567 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:02.568 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:02.607 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.609+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:02.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:02.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 realm 2024-09-14T11:58:02.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:02.609 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.611+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.612+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:02.610 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.612+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:02.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.613+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:02.611 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.613+0000 7f9662baf800 20 searching for the correct realm 2024-09-14T11:58:02.613 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.615+0000 7f9660e9a640 0 -- 172.21.15.29:0/1304263581 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f9658089020 msgr2=0x7f965807f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:02.819 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:02.821+0000 7f965fe98640 0 -- 172.21.15.29:0/1304263581 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f965801a910 msgr2=0x7f9658096040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:03.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:58:03.026 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.028+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:03.027 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:03.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 zone default found 2024-09-14T11:58:03.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 4 Realm: () 2024-09-14T11:58:03.028 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 zonegroup default 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.029+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.030+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.030+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.030+0000 7f9662baf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.030+0000 7f9662baf800 20 started sync module instance, tier type = 2024-09-14T11:58:03.029 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.030+0000 7f9662baf800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=0 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=1 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=2 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=3 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=4 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=5 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.040+0000 7f9662baf800 20 add_watcher() i=6 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.041+0000 7f9662baf800 20 add_watcher() i=7 2024-09-14T11:58:03.038 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.041+0000 7f9662baf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:03.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.042+0000 7f95167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:03.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:03.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:03.041 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 5 note: GC not initialized 2024-09-14T11:58:03.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f95157e2640 20 reqs_thread_entry: start 2024-09-14T11:58:03.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:03.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 20 Filter name: none 2024-09-14T11:58:03.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9486ffd640 20 reqs_thread_entry: start 2024-09-14T11:58:03.042 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.043+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 rados->read ofs=0 len=0 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 INFO: main: starting shard=0 2024-09-14T11:58:03.043 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.044+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.0 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 INFO: main: starting shard=1 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.1 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 INFO: main: starting shard=2 2024-09-14T11:58:03.044 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.045+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.2 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.046+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.046+0000 7f9662baf800 20 INFO: main: starting shard=3 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.046+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.3 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 INFO: main: starting shard=4 2024-09-14T11:58:03.045 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.4 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 INFO: main: starting shard=5 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.047+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.5 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.048+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.048+0000 7f9662baf800 20 INFO: main: starting shard=6 2024-09-14T11:58:03.046 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.048+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.6 2024-09-14T11:58:03.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 INFO: main: starting shard=7 2024-09-14T11:58:03.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.7 2024-09-14T11:58:03.047 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 INFO: main: starting shard=8 2024-09-14T11:58:03.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.049+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.8 2024-09-14T11:58:03.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 INFO: main: starting shard=9 2024-09-14T11:58:03.048 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.9 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 INFO: main: starting shard=10 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.050+0000 7f9662baf800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.10 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.051+0000 7f9662baf800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.051+0000 7f9662baf800 20 INFO: main: done 2024-09-14T11:58:03.049 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.052+0000 7f95167e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:03.051 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.054+0000 7f9662baf800 20 remove_watcher() i=0 2024-09-14T11:58:03.052 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.054+0000 7f9662baf800 2 removed watcher, disabling cache 2024-09-14T11:58:03.053 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.055+0000 7f9662baf800 20 remove_watcher() i=1 2024-09-14T11:58:03.054 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.056+0000 7f9662baf800 20 remove_watcher() i=2 2024-09-14T11:58:03.055 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.057+0000 7f9662baf800 20 remove_watcher() i=3 2024-09-14T11:58:03.056 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.058+0000 7f9662baf800 20 remove_watcher() i=4 2024-09-14T11:58:03.057 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.059+0000 7f9662baf800 20 remove_watcher() i=5 2024-09-14T11:58:03.058 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.060+0000 7f9662baf800 20 remove_watcher() i=6 2024-09-14T11:58:03.059 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.061+0000 7f9662baf800 20 remove_watcher() i=7 2024-09-14T11:58:03.072 INFO:tasks.workunit.client.0.smithi029.stderr:rados -p default.rgw.buckets.data ls | grep 572dfcd9-cb7b-4dc6-b428-6c0a445d97a9 2024-09-14T11:58:03.095 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:03.095 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:03.175 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:03.178+0000 7f33f9ff4640 0 -- 172.21.15.29:0/3511399733 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x7f33f0006b80 msgr2=0x7f33f0011040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:03.188 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:58:03.188 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:58:03.308 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:58:04.820 INFO:tasks.workunit.client.0.smithi029.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:58:04.821 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:58:05.296 INFO:tasks.workunit.client.0.smithi029.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:58:05.296 INFO:tasks.workunit.client.0.smithi029.stderr: 2024-09-14T11:58:05.469 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:58:08.993 INFO:tasks.workunit.client.0.smithi029.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:58:09.415 INFO:tasks.workunit.client.0.smithi029.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:58:09.446 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:09.446 INFO:tasks.workunit.client.0.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:09.486 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.488+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 realm 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:09.488 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.490+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.491+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:09.489 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.491+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.492+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:09.490 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.492+0000 7f9262e0e800 20 searching for the correct realm 2024-09-14T11:58:09.492 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.494+0000 7f925ed6c640 0 -- 172.21.15.29:0/1823318103 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7f925801e070 msgr2=0x7f9258065b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:09.497 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.499+0000 7f925dd6a640 0 -- 172.21.15.29:0/1823318103 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7f9258090080 msgr2=0x7f925808fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:09.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:58:09.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:09.704 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.706+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.705 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 zone default found 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 4 Realm: () 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:58:09.706 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 zonegroup default 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.707+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 started sync module instance, tier type = 2024-09-14T11:58:09.707 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.708+0000 7f9262e0e800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=0 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=1 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=2 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=3 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=4 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=5 2024-09-14T11:58:09.716 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.718+0000 7f9262e0e800 20 add_watcher() i=6 2024-09-14T11:58:09.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.719+0000 7f9262e0e800 20 add_watcher() i=7 2024-09-14T11:58:09.717 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.719+0000 7f9262e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:09.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.721+0000 7f9114fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:09.719 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.721+0000 7f9262e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.721+0000 7f9262e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.721+0000 7f9262e0e800 5 note: GC not initialized 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.721+0000 7f908f7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 20 Filter name: none 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f908d7fa640 20 reqs_thread_entry: start 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:58:09.720 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:58:09.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:58:09.721 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.783 : miss 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.722+0000 7f9262e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.783 info.flags=0x17 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.783 to cache LRU end 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:11989569-703c-4397-b0f1-7ddb0279a491.4517.783 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.0 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.723+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.1 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.724+0000 7f9262e0e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:58:09.722 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.724+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.2 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.724+0000 7f9262e0e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.724+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.3 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.725+0000 7f9262e0e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.725+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.4 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.726+0000 7f9262e0e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:58:09.723 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.726+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.5 2024-09-14T11:58:09.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.726+0000 7f9262e0e800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:58:09.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.726+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.6 2024-09-14T11:58:09.724 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.727+0000 7f9262e0e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:58:09.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.727+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.7 2024-09-14T11:58:09.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.727+0000 7f9262e0e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:58:09.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.727+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.8 2024-09-14T11:58:09.725 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.728+0000 7f9262e0e800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:58:09.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.728+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.9 2024-09-14T11:58:09.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.728+0000 7f9262e0e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:58:09.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.728+0000 7f9262e0e800 20 bucket index object: :.dir.11989569-703c-4397-b0f1-7ddb0279a491.4517.783.10 2024-09-14T11:58:09.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.729+0000 7f9262e0e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:58:09.726 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.729+0000 7f9262e0e800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:58:09.727 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.729+0000 7f9114fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:09.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.732+0000 7f9262e0e800 20 remove_watcher() i=0 2024-09-14T11:58:09.730 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.732+0000 7f9262e0e800 2 removed watcher, disabling cache 2024-09-14T11:58:09.731 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.733+0000 7f9262e0e800 20 remove_watcher() i=1 2024-09-14T11:58:09.732 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.735+0000 7f9262e0e800 20 remove_watcher() i=2 2024-09-14T11:58:09.733 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.736+0000 7f9262e0e800 20 remove_watcher() i=3 2024-09-14T11:58:09.734 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.737+0000 7f9262e0e800 20 remove_watcher() i=4 2024-09-14T11:58:09.735 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.738+0000 7f9262e0e800 20 remove_watcher() i=5 2024-09-14T11:58:09.736 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.738+0000 7f9262e0e800 20 remove_watcher() i=6 2024-09-14T11:58:09.737 INFO:tasks.workunit.client.0.smithi029.stderr:2024-09-14T11:58:09.739+0000 7f9262e0e800 20 remove_watcher() i=7 2024-09-14T11:58:09.749 INFO:tasks.workunit.client.0.smithi029.stderr:Deleting bucket versioning-bucket 2024-09-14T11:58:09.914 INFO:tasks.workunit.client.0.smithi029.stderr:Completed bucket versioning tests 2024-09-14T11:58:09.914 INFO:tasks.workunit.client.0.smithi029.stdout:connected to http://localhost:80 2024-09-14T11:58:09.973 INFO:tasks.workunit.client.0.smithi029.stderr:+ deactivate 2024-09-14T11:58:09.973 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:58:09.973 INFO:tasks.workunit.client.0.smithi029.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ export PATH 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ hash -r 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' -n '' ']' 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ unset -f deactivate 2024-09-14T11:58:09.974 INFO:tasks.workunit.client.0.smithi029.stderr:+ echo OK. 2024-09-14T11:58:09.975 INFO:tasks.workunit.client.0.smithi029.stdout:OK. 2024-09-14T11:58:09.975 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:58:09.975 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:58:10.057 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:58:10.058 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:58:10.470 DEBUG:teuthology.parallel:result is None 2024-09-14T11:58:10.471 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:10.510 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:10.510 DEBUG:teuthology.orchestra.run.smithi029:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:58:10.580 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:58:10.580 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:58:10.590 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:58:10.668 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:58:10.668 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:58:10.668 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:58:10.733 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:58:10.733 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:58:10.792 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:10.792 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:10.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.831+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:10.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.832+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.832+0000 7efe7e62f800 20 realm 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.832+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.833+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.833+0000 7efe7e62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.833+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.833+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:10.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.833+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:10.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.834+0000 7efe7e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:10.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.834+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:10.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.835+0000 7efe7e62f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:10.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.835+0000 7efe7e62f800 20 searching for the correct realm 2024-09-14T11:58:10.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:10.837+0000 7efe7a1cd640 0 -- 172.21.15.29:0/3941571870 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efe74004040 msgr2=0x7efe740a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:11.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.044+0000 7efe791cb640 0 -- 172.21.15.29:0/3941571870 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe740a95c0 msgr2=0x7efe740cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:11.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:58:11.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:11.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.251+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 zone default found 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 4 Realm: () 2024-09-14T11:58:11.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 zonegroup default 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.252+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:11.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 started sync module instance, tier type = 2024-09-14T11:58:11.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.253+0000 7efe7e62f800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=0 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=1 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=2 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=3 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=4 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=5 2024-09-14T11:58:11.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.264+0000 7efe7e62f800 20 add_watcher() i=6 2024-09-14T11:58:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.265+0000 7efe7e62f800 20 add_watcher() i=7 2024-09-14T11:58:11.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.265+0000 7efe7e62f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:11.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.267+0000 7efd2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:11.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.267+0000 7efe7e62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:11.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.267+0000 7efe7e62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efd2a7fc640 20 reqs_thread_entry: start 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efe7e62f800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efe7e62f800 20 Filter name: none 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efe7e62f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efc9bfff640 20 reqs_thread_entry: start 2024-09-14T11:58:11.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.309+0000 7efe7e62f800 20 rados->read ofs=0 len=0 2024-09-14T11:58:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.310+0000 7efe7e62f800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:58:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.310+0000 7efe7e62f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:58:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.310+0000 7efe7e62f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:58:11.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.310+0000 7efe7e62f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:11.309 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.311+0000 7efe7e62f800 10 removing key index: ZQUXJQZVYWEFBETKFEMN 2024-09-14T11:58:11.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.312+0000 7efe7e62f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:ZQUXJQZVYWEFBETKFEMN, ofs0, ns] 2024-09-14T11:58:11.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.313+0000 7efd5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399111 cookie 94260535124800 notifier 9405 bl.length()=170 2024-09-14T11:58:11.312 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.314+0000 7efe7e62f800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:58:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.315+0000 7efe7e62f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:58:11.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.315+0000 7efd5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399013 cookie 94260535137200 notifier 9405 bl.length()=181 2024-09-14T11:58:11.314 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.317+0000 7efe7e62f800 10 removing user buckets index 2024-09-14T11:58:11.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.318+0000 7efe7e62f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:58:11.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.318+0000 7efd5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399291 cookie 94260535149104 notifier 9405 bl.length()=172 2024-09-14T11:58:11.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.320+0000 7efe7e62f800 10 removing user index: tester.client.0 2024-09-14T11:58:11.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.321+0000 7efe7e62f800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:58:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.321+0000 7efe7e62f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:58:11.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.321+0000 7efd5d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399586 cookie 94260535148048 notifier 9405 bl.length()=164 2024-09-14T11:58:11.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.323+0000 7efd2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:11.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.327+0000 7efe7e62f800 20 remove_watcher() i=0 2024-09-14T11:58:11.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.327+0000 7efe7e62f800 2 removed watcher, disabling cache 2024-09-14T11:58:11.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.328+0000 7efe7e62f800 20 remove_watcher() i=1 2024-09-14T11:58:11.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.329+0000 7efe7e62f800 20 remove_watcher() i=2 2024-09-14T11:58:11.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.330+0000 7efe7e62f800 20 remove_watcher() i=3 2024-09-14T11:58:11.329 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.331+0000 7efe7e62f800 20 remove_watcher() i=4 2024-09-14T11:58:11.330 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.332+0000 7efe7e62f800 20 remove_watcher() i=5 2024-09-14T11:58:11.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.333+0000 7efe7e62f800 20 remove_watcher() i=6 2024-09-14T11:58:11.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:11.334+0000 7efe7e62f800 20 remove_watcher() i=7 2024-09-14T11:58:11.345 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:58:11.355 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:58:11.381 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:58:11.442 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:58:11.452 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:58:11.452 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:58:11.460 INFO:tasks.rgw.client.0.smithi029.stdout:2024-09-14T11:58:11.459+0000 f878640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44566) UID: 0 2024-09-14T11:58:11.463 INFO:tasks.rgw.client.0.smithi029.stdout:2024-09-14T11:58:11.463+0000 a1c2240 -1 shutting down 2024-09-14T11:58:30.086 INFO:tasks.rgw.client.0.smithi029.stderr:==00:01:01:37.012 44569== could not unlink /tmp/vgdb-pipe-from-vgdb-to-44569-by-root-on-??? 2024-09-14T11:58:30.086 INFO:tasks.rgw.client.0.smithi029.stderr:==00:01:01:37.012 44569== could not unlink /tmp/vgdb-pipe-to-vgdb-from-44569-by-root-on-??? 2024-09-14T11:58:30.086 INFO:tasks.rgw.client.0.smithi029.stderr:==00:01:01:37.012 44569== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-44569-by-root-on-??? 2024-09-14T11:58:32.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-14T11:58:35.858 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:58:35.858 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:58:35.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:58:35.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:58:36.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:58:36.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:58:36.024 DEBUG:teuthology.orchestra.run.smithi029:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:58:36.124 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:36.125 INFO:teuthology.orchestra.run.smithi029.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:36.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.163+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 realm 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.165+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.166+0000 7efe2a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:36.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.166+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.167+0000 7efe2a614800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:36.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.167+0000 7efe2a614800 20 searching for the correct realm 2024-09-14T11:58:36.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.169+0000 7efe264cc640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.73:6824/2654257519,v1:172.21.15.73:6825/2654257519] conn(0x7efe2003f040 msgr2=0x7efe2003f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:36.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.375+0000 7efe1ffff640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe2003e920 msgr2=0x7efe200223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got zone_info.11989569-703c-4397-b0f1-7ddb0279a491 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got zonegroup_info.cfe5e123-f881-4a63-81e9-089f591339f5 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.581+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:36.580 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:36.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 zone default found 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 4 Realm: () 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 4 ZoneGroup: default (cfe5e123-f881-4a63-81e9-089f591339f5) 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 4 Zone: default (11989569-703c-4397-b0f1-7ddb0279a491) 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 zonegroup default 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.582+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.583+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.583+0000 7efe2a614800 20 rados->read ofs=0 len=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.583+0000 7efe2a614800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:36.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.583+0000 7efe2a614800 20 started sync module instance, tier type = 2024-09-14T11:58:36.583 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.583+0000 7efe2a614800 20 started zone id=11989569-703c-4397-b0f1-7ddb0279a491 (name=default) with tier type = 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=0 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=1 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=2 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=3 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=4 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=5 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.594+0000 7efe2a614800 20 add_watcher() i=6 2024-09-14T11:58:36.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.595+0000 7efe2a614800 20 add_watcher() i=7 2024-09-14T11:58:36.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.595+0000 7efe2a614800 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.597+0000 7efcd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.597+0000 7efe2a614800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:36.595 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.597+0000 7efe2a614800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.642+0000 7efcd67fc640 20 reqs_thread_entry: start 2024-09-14T11:58:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.643+0000 7efe2a614800 20 init_complete bucket index max shards: 11 2024-09-14T11:58:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.643+0000 7efe2a614800 20 Filter name: none 2024-09-14T11:58:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.643+0000 7efc47fff640 20 reqs_thread_entry: start 2024-09-14T11:58:36.641 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.643+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:58:36.642 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.645+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:36.643 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.645+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:36.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56236' 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_dUK9RxRXDGXrrwGRZboE2DZusZ9R2Om', time=2024-09-14T13:34:42.694920+0000, chain.objs.size()=3 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.OcSfuGsnph9d9DF301IiCrHCVU91_4M_0 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.OcSfuGsnph9d9DF301IiCrHCVU91_4M_1 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.OcSfuGsnph9d9DF301IiCrHCVU91_4M_2 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5445659177859272496', time=2024-09-14T13:35:04.512183+0000, chain.objs.size()=1 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.179__shadow_.C2bBc3fzctJXDW2A8L2XvIOjhpI1SqP_0 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10832007043218597092', time=2024-09-14T13:37:12.730386+0000, chain.objs.size()=1 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.254__shadow_.00UnFRAWLR9TvCc3cYgmM8RrN92g4q7_0 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1038672876854309208', time=2024-09-14T13:37:14.177598+0000, chain.objs.size()=1 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.256__shadow_.-98tDZm0MRKdBtgdywWFRtvEtSw1wAC_0 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14289059378013540572', time=2024-09-14T13:37:18.578200+0000, chain.objs.size()=1 2024-09-14T11:58:36.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.262__shadow_.Ko4myxm-wzWzcatxvtGRDz4kgcnAMK0_0 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3067102263941341704', time=2024-09-14T13:37:57.703621+0000, chain.objs.size()=1 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0q1dVwZCipP34ngGItz3idh1lHGmrjJ_0 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9577265974535507897', time=2024-09-14T13:37:58.035214+0000, chain.objs.size()=1 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0vn9NZGmzighOnjpDQR3AdvTcCIC4Xv_0 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9596863866100754253', time=2024-09-14T13:37:58.180132+0000, chain.objs.size()=1 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UogDc4Tv0cAxpQ_Q8eWeOtH1eR64Xwt_0 2024-09-14T11:58:36.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4068071294949972632', time=2024-09-14T13:37:58.320266+0000, chain.objs.size()=1 2024-09-14T11:58:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YsorLQkyVujV23mFVnczvJjJmtZkiw2_0 2024-09-14T11:58:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.649+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18081218180497321635', time=2024-09-14T13:37:58.638684+0000, chain.objs.size()=1 2024-09-14T11:58:36.648 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.649+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7A8e_H5qK-2ESoUCiTDAoZ_e5kM2nb1_0 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12209301861036043339', time=2024-09-14T13:37:58.741171+0000, chain.objs.size()=1 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vTdemfEpe_CrlRmx4tFnEeK7kDRFdAA_0 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11208082025596990188', time=2024-09-14T13:37:59.779276+0000, chain.objs.size()=1 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5WzdX5ZC1tnfebesRVEk7FPn3WXdmbw_0 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1766581240163505655', time=2024-09-14T13:37:59.983055+0000, chain.objs.size()=1 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lRuf_LYLx9AggioFwbJvvaWD5WrG2zy_0 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16777102292500955980', time=2024-09-14T13:38:00.357736+0000, chain.objs.size()=1 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.650+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4m4Vf4fgryhuWO1ETcvBQPEoLljlVh1_0 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17259002787911461313', time=2024-09-14T13:38:00.715935+0000, chain.objs.size()=1 2024-09-14T11:58:36.651 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.a3Op0US5hC-gSQRXeWhauxuy5zsjY2b_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9776072257071968492', time=2024-09-14T13:38:01.320912+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hHs2qDNdQgaCBjJQN_NQsDj1F1ww79R_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5021503567315670614', time=2024-09-14T13:38:01.355336+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KSW_ijpPWCGbrtsPQAxQzAJyaJLcNrc_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7425761597004115770', time=2024-09-14T13:38:01.502993+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.652+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xi3eg01tyBpEaJ4eddMVOB9Ed48ogKz_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2092004557441679886', time=2024-09-14T13:38:01.712978+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qP8G1Br_B4jJgwktKjWCoUk_0boKKSX_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9028725653823703067', time=2024-09-14T13:38:01.871523+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rMcP9KY3eLMY7r8OHgJ0oFj4_AFQXEl_0 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9156717166165453847', time=2024-09-14T13:38:02.013067+0000, chain.objs.size()=1 2024-09-14T11:58:36.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.653+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eCYVkMZu4E03PgduNxJgVncWnU_Ugda_0 2024-09-14T11:58:36.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6161509137144094615', time=2024-09-14T13:38:02.226246+0000, chain.objs.size()=1 2024-09-14T11:58:36.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iJNRGi3mP7kWIGs_Rmm9TPk3oyabPjT_0 2024-09-14T11:58:36.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8976308440553453493', time=2024-09-14T13:38:02.421191+0000, chain.objs.size()=1 2024-09-14T11:58:36.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KjZR6SwsVlfKnLVRQwlUnWjtHKVCugE_0 2024-09-14T11:58:36.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16907525093185704252', time=2024-09-14T13:38:03.306777+0000, chain.objs.size()=1 2024-09-14T11:58:36.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.yv8LFlnrVqPAb-_7FHQDHBux3Y95dfg_0 2024-09-14T11:58:36.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9041703200927014531', time=2024-09-14T13:38:03.374720+0000, chain.objs.size()=1 2024-09-14T11:58:36.655 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.657+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0knfgTDODpPHFcHRcx73qFpVPy2ljwr_0 2024-09-14T11:58:36.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10198432243701678594', time=2024-09-14T13:38:03.375388+0000, chain.objs.size()=1 2024-09-14T11:58:36.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rithNs_BtsfLSt4R-h1UkCAW9de89Cm_0 2024-09-14T11:58:36.656 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8423262386863444137', time=2024-09-14T13:38:03.859026+0000, chain.objs.size()=1 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.k1N27MO5mQNhp6sFPqmdWRla11keeNG_0 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16078154765965107418', time=2024-09-14T13:38:05.026099+0000, chain.objs.size()=1 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Gt2OfybxkQWknZJ5joIEhiIHXeUA1SC_0 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16114203337789016539', time=2024-09-14T13:38:05.045189+0000, chain.objs.size()=1 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fQpKQFduBjE6ATsAboFmfhFaEdf9lb1_0 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7288053675912169220', time=2024-09-14T13:38:05.109297+0000, chain.objs.size()=1 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FFwgG4s8JiMzOvNYPcvwJmix7G-qVD2_0 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3425633866290507539', time=2024-09-14T13:38:05.109837+0000, chain.objs.size()=1 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tV_m1ULInP9E3culzAaxzVcmKQu6Nk1_0 2024-09-14T11:58:36.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6786087284162678435', time=2024-09-14T13:38:05.375938+0000, chain.objs.size()=1 2024-09-14T11:58:36.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.658+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PSjby1eUIUgNCf2lrWnaXLjAs6S_RR-_0 2024-09-14T11:58:36.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12179140788406930177', time=2024-09-14T13:38:06.199929+0000, chain.objs.size()=1 2024-09-14T11:58:36.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HJHOsnyRrnYz43k-DT9_YzV5-LTLdhq_0 2024-09-14T11:58:36.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.661+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8611054944888448561', time=2024-09-14T13:38:06.460251+0000, chain.objs.size()=1 2024-09-14T11:58:36.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.662+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-WpG8_jUUuUIzF6EaENl_pY1rGskMX6_0 2024-09-14T11:58:36.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.662+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6694788772023307987', time=2024-09-14T13:38:07.807861+0000, chain.objs.size()=1 2024-09-14T11:58:36.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.662+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xtFY4ChrPLVp-at9PmsGROi4RAMSpm4_0 2024-09-14T11:58:36.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.662+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10664417709891546564', time=2024-09-14T13:38:08.983181+0000, chain.objs.size()=1 2024-09-14T11:58:36.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.662+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NBa0_okGixQ9u-P3G6kNBndwpJirt7H_0 2024-09-14T11:58:36.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5148705914043402083', time=2024-09-14T13:38:09.056146+0000, chain.objs.size()=1 2024-09-14T11:58:36.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aoz2ZFLYxkqJhC-dyDvh7dxDH4oXKzx_0 2024-09-14T11:58:36.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9528303417326712012', time=2024-09-14T13:38:09.999295+0000, chain.objs.size()=1 2024-09-14T11:58:36.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-qUNxOdpO5tyVHbgSv7nyVd-7CDPl4I_0 2024-09-14T11:58:36.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13791719009332645461', time=2024-09-14T13:38:10.334563+0000, chain.objs.size()=1 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iECHgmTMpnx2ahwPNphxOG4ksEDXfsH_0 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2732024426728526710', time=2024-09-14T13:38:10.381372+0000, chain.objs.size()=1 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BoatSSNT9aHhVKoeg1m7KqMd5Gnsx0a_0 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16167245785078688410', time=2024-09-14T13:38:17.352831+0000, chain.objs.size()=1 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.273__shadow_.IP-1oI4ncDFERUWYt0O8HuLyaRPfDyC_0 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17689827381654741278', time=2024-09-14T13:38:20.161855+0000, chain.objs.size()=1 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.277__shadow_.X92RRT6oT613gLVD95dAarHET5ZlKvY_0 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8122582917701321832', time=2024-09-14T13:38:28.414071+0000, chain.objs.size()=1 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.288__shadow_.NrW4r8lFE72JOSmVIcTyrhxGFo-yhKh_0 2024-09-14T11:58:36.666 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1232815690356741555', time=2024-09-14T13:38:43.236288+0000, chain.objs.size()=1 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.304__shadow_.ML6U0iigmHooirNlHKnCY0uNtmnIlc-_0 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7610822622500271513', time=2024-09-14T13:38:56.978964+0000, chain.objs.size()=1 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.666+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.322__shadow_.u_dhiHyQPHud0wxUpL36uZqsfqb7P6b_0 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.668+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4137907595218230733', time=2024-09-14T13:39:38.541394+0000, chain.objs.size()=1 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.668+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WbddA7ZpjTUGWW1w1YH0scu1-2Xe-MX_0 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.668+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12599464186539401922', time=2024-09-14T13:39:38.664782+0000, chain.objs.size()=1 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.668+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BmaRmXT8aeiY_ocLrr0qmTVGoVtzOiP_0 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.669+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.130763480156645804', time=2024-09-14T13:39:38.665542+0000, chain.objs.size()=1 2024-09-14T11:58:36.667 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.669+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nUBFHolCg79xccRC7Yg5aSlDhj8PXf-_0 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2305202288494788457', time=2024-09-14T13:39:38.708764+0000, chain.objs.size()=1 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.N7pCpC8U7Pebv8XXzKE1GuH_6YXj5ls_0 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14393371562508842850', time=2024-09-14T13:39:38.735870+0000, chain.objs.size()=1 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IJDqx2739gdppYYSG5piyNQIUmXgq6K_0 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1427202822838244871', time=2024-09-14T13:39:38.847146+0000, chain.objs.size()=1 2024-09-14T11:58:36.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-4ZXbSqBWUNhPUV8gSKIdQEvzRctq24_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15652135034833181674', time=2024-09-14T13:39:39.028823+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UQWMV-Bpl1loFq1WB6bQ4a1hCLGPsR6_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1610430984615153361', time=2024-09-14T13:39:39.599027+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jGZOmv4TzpwEPP9dJsZnyi14RyZUFen_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14437132665312626286', time=2024-09-14T13:39:39.681841+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-1BuLC_mi7Mnik2bj0x3kXW7FGJzY9W_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11719574224693970728', time=2024-09-14T13:39:40.514993+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qWDcKR_ZESti8GemgOiTOZVHQugO-MH_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9670380344338038291', time=2024-09-14T13:39:40.658768+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.U8RT-vuWjsO5A0dn184jB_trmjJ8iwl_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8638822394184992592', time=2024-09-14T13:39:41.432749+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bRZIsu5tOEKDLaimPhL05Dv46VUr573_0 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18163791752633190036', time=2024-09-14T13:39:41.521812+0000, chain.objs.size()=1 2024-09-14T11:58:36.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ViCEba4xbp0r1pFaEN9A194ZP50uwJ2_0 2024-09-14T11:58:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11701594721682712803', time=2024-09-14T13:39:41.974990+0000, chain.objs.size()=1 2024-09-14T11:58:36.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DQ9J19PaI7gr8cZx9vwKDcS11gVKRCK_0 2024-09-14T11:58:36.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.681+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14352666872544989712', time=2024-09-14T13:39:42.042311+0000, chain.objs.size()=1 2024-09-14T11:58:36.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.681+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hTw-GTVpOHCuPKdfaXRM2kAXEiX4sD9_0 2024-09-14T11:58:36.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.681+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15610165166452364086', time=2024-09-14T13:39:42.207562+0000, chain.objs.size()=1 2024-09-14T11:58:36.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5sE-ps-Jn0iG5_7T9-GuJDjT4x9mhcO_0 2024-09-14T11:58:36.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5226565007566982127', time=2024-09-14T13:39:42.527401+0000, chain.objs.size()=1 2024-09-14T11:58:36.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3NOfGTEiRBt3vpsdH-z8QTE8f5ScCWO_0 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7409842502565120878', time=2024-09-14T13:39:43.667220+0000, chain.objs.size()=1 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2GW49ex50tvKNnuuBaGSI7KgF7LNbxg_0 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11831109174773301170', time=2024-09-14T13:39:43.813671+0000, chain.objs.size()=1 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RyfS0DkNhXB2jmytOd191Jm6UrWjaLM_0 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13163273684300555758', time=2024-09-14T13:39:44.190247+0000, chain.objs.size()=1 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Uyks4md9TOosTMH9BEVPJ0qqvUqWPOh_0 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13301320285541461291', time=2024-09-14T13:39:44.618492+0000, chain.objs.size()=1 2024-09-14T11:58:36.681 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4m1dU_Lysu0YVZTtE8V7p9OZKSKgLHO_0 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2919267024920004199', time=2024-09-14T13:39:44.759471+0000, chain.objs.size()=1 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.f-8Ix2C9r9fzIZnT-KM0DWgORR7jD6r_0 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13409791787569411019', time=2024-09-14T13:39:44.794710+0000, chain.objs.size()=1 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JZZUmwHw0qKTwErpyxTK17qA76Zl1x1_0 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14895339816141243192', time=2024-09-14T13:39:45.611424+0000, chain.objs.size()=1 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ARASL6DvyoXo66X0mxaN0i6cx80Qc7j_0 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.685+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9650242706451402662', time=2024-09-14T13:39:46.404974+0000, chain.objs.size()=1 2024-09-14T11:58:36.682 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.685+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YiNPVGVf24iUtdbx17GIgSFG2AtJ3Qh_0 2024-09-14T11:58:36.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.687+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7827029336698288618', time=2024-09-14T13:39:46.484739+0000, chain.objs.size()=1 2024-09-14T11:58:36.684 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.687+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jztK0pnBsdbEmZvjikWyNEzR0gKakKD_0 2024-09-14T11:58:36.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.687+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10309778911678792261', time=2024-09-14T13:39:47.156699+0000, chain.objs.size()=1 2024-09-14T11:58:36.685 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.687+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PmvCKt0lGf6r83oKgbuy5V7eBlaXFXj_0 2024-09-14T11:58:36.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5334072303366472161', time=2024-09-14T13:39:47.572200+0000, chain.objs.size()=1 2024-09-14T11:58:36.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ToKv9WQJEASLIqftnXnIw3EBQzl5cXl_0 2024-09-14T11:58:36.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1849594452887129928', time=2024-09-14T13:39:48.569462+0000, chain.objs.size()=1 2024-09-14T11:58:36.687 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZDX3d1H9wQx3EOKRgEgV7qHUjbTNtew_0 2024-09-14T11:58:36.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4994090526461403338', time=2024-09-14T13:39:48.823375+0000, chain.objs.size()=1 2024-09-14T11:58:36.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.689+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nU_Fh6SkLvFnBB9RhnG3G_lNSpsyWTo_0 2024-09-14T11:58:36.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10913190849698720248', time=2024-09-14T13:39:48.934628+0000, chain.objs.size()=1 2024-09-14T11:58:36.688 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PaEyz-Q9YdcOA3XnPAtZuHQmRem_7zf_0 2024-09-14T11:58:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3529921152665557735', time=2024-09-14T13:39:50.078449+0000, chain.objs.size()=1 2024-09-14T11:58:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FyTiXt0o08uDmBBXEEFBe0cKD-Sskwd_0 2024-09-14T11:58:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13708484797337369346', time=2024-09-14T13:39:50.340125+0000, chain.objs.size()=1 2024-09-14T11:58:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.690+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.A9xIRbGRBf5IhN7J9HWGO7NJQKwHmZ6_0 2024-09-14T11:58:36.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.691+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10739691193542076083', time=2024-09-14T13:39:50.880621+0000, chain.objs.size()=1 2024-09-14T11:58:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.691+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.I_oMKmI9ZFRp5Y-XJMd0IuYLDqAZGOa_0 2024-09-14T11:58:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.691+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4810089689726470930', time=2024-09-14T13:40:30.874626+0000, chain.objs.size()=1 2024-09-14T11:58:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.691+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gTX-NuvsUFAyHlUnoQm7p5VgZhQxxhp_0 2024-09-14T11:58:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.692+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10884972154721955527', time=2024-09-14T13:40:31.880138+0000, chain.objs.size()=1 2024-09-14T11:58:36.690 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.692+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0aBzUT8cMSlstX7jzqHBaD64Lc1pJ9Y_0 2024-09-14T11:58:36.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.693+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4997385133609079037', time=2024-09-14T13:40:31.882402+0000, chain.objs.size()=1 2024-09-14T11:58:36.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.693+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.djaeJpwZ8NO-wCSJdQFVKVGpAvC8pdD_0 2024-09-14T11:58:36.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.693+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10498293248901101309', time=2024-09-14T13:40:32.752410+0000, chain.objs.size()=1 2024-09-14T11:58:36.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.693+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xZBvSvDOqvuhrSq0_FYs6FFHuL_sDnT_0 2024-09-14T11:58:36.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.697+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2259622396689743536', time=2024-09-14T13:40:32.857660+0000, chain.objs.size()=1 2024-09-14T11:58:36.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.697+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tluvebC3O1AlsCPWM7mhPe3Hfysn-6e_0 2024-09-14T11:58:36.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6684958376096550624', time=2024-09-14T13:40:32.900662+0000, chain.objs.size()=1 2024-09-14T11:58:36.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.O7EX5UVNtlQC2dK8pSo1eONy8i_v9j4_0 2024-09-14T11:58:36.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4493029499427926434', time=2024-09-14T13:40:32.901191+0000, chain.objs.size()=1 2024-09-14T11:58:36.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QpWGn61cat-r3iEAosyzf2bDKjRRqCc_0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13052217324024697249', time=2024-09-14T13:40:32.935326+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AMwzw2rY0qHthb6RftXuw3nqZ73zmTB_0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1541922000689467265', time=2024-09-14T13:40:33.513274+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kcYAqHnFVHdW0mR6cPwcMLkdGwA8fRj_0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14082301665809311677', time=2024-09-14T13:40:34.455749+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kXnOwoLKiouHpIBDBsv0Z8wKtUkOyBO_0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13083564461154086341', time=2024-09-14T13:40:34.802083+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GsbzVR95Su2Gd8aimQsvCF3kFndreXI_0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8293312764281026238', time=2024-09-14T13:40:34.950015+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BzjZo5N7b0T4jUR5c8lqpSeppkAPkK__0 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3716039343242265377', time=2024-09-14T13:40:35.880931+0000, chain.objs.size()=1 2024-09-14T11:58:36.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OolV3AjQLMHTiGpUR0NYkw5bGOpJ9hs_0 2024-09-14T11:58:36.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1850903328643312022', time=2024-09-14T13:40:35.881739+0000, chain.objs.size()=1 2024-09-14T11:58:36.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.56MVBOl7KCNrgP-gH9t1gkEaQ0-fYtG_0 2024-09-14T11:58:36.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17138414959476918941', time=2024-09-14T13:40:36.235532+0000, chain.objs.size()=1 2024-09-14T11:58:36.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CJLCUa22JLqiCROzHEXccYjXIOfgOIv_0 2024-09-14T11:58:36.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.703+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13968255347095057761', time=2024-09-14T13:40:36.288007+0000, chain.objs.size()=1 2024-09-14T11:58:36.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.703+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2HP_YZPcnJpccHRiux1Ip27VbvG-D23_0 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4227642761387723593', time=2024-09-14T13:40:37.061457+0000, chain.objs.size()=1 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-xVLd8xJNxUKQlu7nPdFA2wa6USXLIM_0 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6787327055501766636', time=2024-09-14T13:40:37.519523+0000, chain.objs.size()=1 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Am4_3eriHNwR-z91QJJSRG-S3sGHwsV_0 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5689202335865382467', time=2024-09-14T13:40:37.724170+0000, chain.objs.size()=1 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7opHgJ2KXNlx09NQKkcSlJEkpSCxwPi_0 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6151918874718008518', time=2024-09-14T13:40:37.724999+0000, chain.objs.size()=1 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8gPxmpXtBVv6HgoDd1BEGGFsJF9E_5s_0 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1825644295168551784', time=2024-09-14T13:40:38.167584+0000, chain.objs.size()=1 2024-09-14T11:58:36.705 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.707+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xMgYMlj9p-6PqYq7T_4GBD-S7_aDSpz_0 2024-09-14T11:58:36.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.714+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/56236 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8534269436233884054', time=2024-09-14T13:40:38.418850+0000, chain.objs.size()=1 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tgh3N54ztScXsuf2E72CvBVB7zUHKIz_0 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.472056527280901816', time=2024-09-14T13:40:38.453976+0000, chain.objs.size()=1 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jkAHsyDQZQTicB6woM6XMq5S_3LDdDB_0 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15464556391475801033', time=2024-09-14T13:40:38.585608+0000, chain.objs.size()=1 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.idfSuR7HVnwipv_p65Vf6AvFKuB7Stp_0 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4619351922877493907', time=2024-09-14T13:40:38.710231+0000, chain.objs.size()=1 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Km67ehpCoImbgYgeYSmb2S8ZtbdberG_0 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16969447716844140987', time=2024-09-14T13:40:39.314855+0000, chain.objs.size()=1 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2dyTjDEBkoMLZKDKQmXOAeWw1UO0YGm_0 2024-09-14T11:58:36.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4656444173479126893', time=2024-09-14T13:40:39.537820+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2GjbSZdGB8bgPEi4BFuDOIkeYmqothy_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6915930736470183661', time=2024-09-14T13:40:39.711266+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H7jJxHD3YCXGsG6uiSwxZjB2ETuDwJH_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2023098096952132120', time=2024-09-14T13:40:40.342392+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._3pdUqkYVt39fgu4f-yR0hDmRQTJznX_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4024021778540350390', time=2024-09-14T13:40:40.912447+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.T_3qsyQpQ1AvBsllYsznUaoA9WhUYkK_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11686426000409554230', time=2024-09-14T13:40:41.085308+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H4vjmGhFBdqxQ8Bg2Q2HOqb6WrIZfr4_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11525388257169918540', time=2024-09-14T13:40:41.473827+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.aSP_BR1XBkgJLM-f4vLawOJtp7xduAY_0 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15539426316841169180', time=2024-09-14T13:40:41.602720+0000, chain.objs.size()=1 2024-09-14T11:58:36.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.716+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HpwTHdwZArGlm_T3RVJopVyemf8g4hw_0 2024-09-14T11:58:36.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.719+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11685649670405742500', time=2024-09-14T13:40:42.747384+0000, chain.objs.size()=1 2024-09-14T11:58:36.718 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.719+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ftAsgYb1wDLdoIRLlQR4TAdclpSmvk5_0 2024-09-14T11:58:36.719 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5832054134727712889', time=2024-09-14T13:40:43.037811+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.e30ppnWJ8bdvOWj9d-YgPl2kERanfU__0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11298234927849618320', time=2024-09-14T13:40:55.117473+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.344__shadow_.RbMZfjnM2ux7bCGQGjqr1_aO_RBDncm_0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.368257507346381577', time=2024-09-14T13:42:04.799229+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.452__shadow_.-FNS1lkPYcVLvnzhOy4uUzSjyvaCyp8_0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5941245953505141942', time=2024-09-14T13:42:24.822048+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.482__shadow_.vWbU5yF-5cJitMPtQGQxgiHrV---912_0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1914155405407271497', time=2024-09-14T13:42:33.571166+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.489__shadow_.OMTzsqAYtE_hW1_TGPdANE7-jDTyqVv_0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11752244391755010831', time=2024-09-14T13:42:41.182291+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.501__shadow_.H2biTRdq506opi4bHfnMAkmQP6KmLGV_0 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1137425927859115557', time=2024-09-14T13:42:59.387899+0000, chain.objs.size()=1 2024-09-14T11:58:36.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.516__shadow_.hsM7_gODWO389g9yWziNU5CbBvoBSTS_0 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-', time=2024-09-14T13:44:16.506998+0000, chain.objs.size()=1 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.2 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-', time=2024-09-14T13:44:16.510999+0000, chain.objs.size()=1 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.721+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.3 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6761505336105778179', time=2024-09-14T13:45:55.094146+0000, chain.objs.size()=1 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.554__shadow_.RL_RgG6XoQU8eICqvZmMGKtkLp3af5y_0 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.723+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9242322083368464678', time=2024-09-14T13:46:01.130639+0000, chain.objs.size()=1 2024-09-14T11:58:36.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.723+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.556__shadow_.y3VoffpUgfjiHmb6r7hyW6KbkPP-UKE_0 2024-09-14T11:58:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.725+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2763010450919207975', time=2024-09-14T13:46:40.060385+0000, chain.objs.size()=1 2024-09-14T11:58:36.723 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.725+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.573__shadow:GHQbwKTdw07VS9wEhE2-HRP8QDCdU1z_.huIuKtxPA3PTgwsHsqvF6UYB9Gyu6SV_0 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.725+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2052902774701032696', time=2024-09-14T13:46:44.315997+0000, chain.objs.size()=1 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.725+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:YrwTZt665YQ6PIgG71vNiw4nJcEgc5B_.gPEUBFjtUBHIZo42UEaaoLFdepjy4tE_0 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.726+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1712765815118229187', time=2024-09-14T13:51:43.478813+0000, chain.objs.size()=1 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.726+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.627__shadow_.nMfNmFo7USxJedj9Y6vYCRwIdy9uNv4_0 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.726+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17443987166968932227', time=2024-09-14T13:52:08.333762+0000, chain.objs.size()=2 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.726+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.651__shadow_.ZreuQwRrEmJ1BsKjh5vkjAvrPhEHTN0_0 2024-09-14T11:58:36.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.726+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.651__shadow_.ZreuQwRrEmJ1BsKjh5vkjAvrPhEHTN0_1 2024-09-14T11:58:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.727+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16294999977145361354', time=2024-09-14T13:52:33.095434+0000, chain.objs.size()=1 2024-09-14T11:58:36.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.727+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.665__shadow_._78GpU-7Jj1osGJNuITZEgLZw2F8CBP_0 2024-09-14T11:58:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.728+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3104647115295964417', time=2024-09-14T13:53:01.142588+0000, chain.objs.size()=1 2024-09-14T11:58:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.728+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.708__shadow:MIgtNsBWu4mhRJ.d0Gvp4ucpA2mECCS_.bIPrx0T0pt1EHpFJ9Ga_auUgI_bQbk1_0 2024-09-14T11:58:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.728+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17565212079330396550', time=2024-09-14T13:53:28.542676+0000, chain.objs.size()=1 2024-09-14T11:58:36.726 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.728+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.720__shadow_.m_9I9-oplyDuDL2vGMlJA7m77lBaopN_0 2024-09-14T11:58:36.729 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.732+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:36.732 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.735+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:58:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.736+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:36.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.736+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/55133' 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_cnJmOhokNWU6q1dO-k-CcG09udHn-FA', time=2024-09-14T13:34:39.711718+0000, chain.objs.size()=3 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.qUizLz3ZtNAUXik_EuOYAtf4qBiBH8h_0 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.qUizLz3ZtNAUXik_EuOYAtf4qBiBH8h_1 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.qUizLz3ZtNAUXik_EuOYAtf4qBiBH8h_2 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16261816707801052349', time=2024-09-14T13:35:05.120317+0000, chain.objs.size()=1 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.180__shadow_.gu5y_1fIFUuoqP9xZ3pigeZfv-VFmZs_0 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9384412372127592717', time=2024-09-14T13:35:06.241741+0000, chain.objs.size()=1 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.182__shadow_.tEVcMogPrjMGAKwRUmPPhoP3_fXFBco_0 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9761793045518996108', time=2024-09-14T13:35:10.766891+0000, chain.objs.size()=1 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.190__shadow_.Hor76njTmczl0NPxPg6my6ojydRywdF_0 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14063934042893665803', time=2024-09-14T13:36:53.594770+0000, chain.objs.size()=1 2024-09-14T11:58:36.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.229__shadow_.CJqQexrT84yM53Dcr89sZyZSglSXgWc_0 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9195687975000956214', time=2024-09-14T13:37:00.238720+0000, chain.objs.size()=1 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.238__shadow_.T5ghocxBJfP0T0FQoCAKHAG4NIi0DLn_0 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10689993448143147042', time=2024-09-14T13:37:05.021617+0000, chain.objs.size()=1 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.244__shadow_.yWbpL4g5dQQQEwvhlSMROcMqzQKf0qU_0 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.459242308324543267', time=2024-09-14T13:37:06.807225+0000, chain.objs.size()=1 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.246__shadow_.aq9GQCe3u_1US0oIJDufOJTs_P2wgH9_0 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4403840554293688642', time=2024-09-14T13:37:57.736243+0000, chain.objs.size()=1 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zcSHDqi5MXSu1v3YLgVEAbGx6SScVI0_0 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3523747264957850149', time=2024-09-14T13:37:58.459819+0000, chain.objs.size()=1 2024-09-14T11:58:36.737 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.737+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LGuBG74U_cS8tVO7wlU2CRBw84_xOHu_0 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14700986027899273607', time=2024-09-14T13:37:58.782953+0000, chain.objs.size()=1 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.r6I7EAwdmcv_Nf--4DqMBYSLPg0W9HH_0 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16909533360446951639', time=2024-09-14T13:37:59.519776+0000, chain.objs.size()=1 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9bMAmH2EbWJKj5gK7mO61mcW1azuOhB_0 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.245144862629095851', time=2024-09-14T13:37:59.952994+0000, chain.objs.size()=1 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.742+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.E1jB3dYDkTAZucIjDZ7geLQo2oNUyRT_0 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8051056435791431057', time=2024-09-14T13:38:00.006445+0000, chain.objs.size()=1 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gQdMnscFrYCrjFH-oo6CfHMmmdzPz5K_0 2024-09-14T11:58:36.741 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15644924799914279959', time=2024-09-14T13:38:00.136888+0000, chain.objs.size()=1 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QMOa_tW27wtI8OTiCT63qEQkxK5L_CI_0 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15990398010358080692', time=2024-09-14T13:38:00.644032+0000, chain.objs.size()=1 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Oyp4KjU_LwrcKVhelE1HiPwy8Nj_vuc_0 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4105032833641516061', time=2024-09-14T13:38:02.865944+0000, chain.objs.size()=1 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Qn5zENBPYtg1FM2vf7So5BTMoLFHpFw_0 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5239879624193929630', time=2024-09-14T13:38:03.292168+0000, chain.objs.size()=1 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0oZhTiHxh6J-qwBcwkT33KOEbvgin8X_0 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12572982804396728672', time=2024-09-14T13:38:03.299349+0000, chain.objs.size()=1 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.743+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kF95yZKgvq_0LxRl8hApcVgB5Bfm2gP_0 2024-09-14T11:58:36.742 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.744+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3679632720815328019', time=2024-09-14T13:38:03.551629+0000, chain.objs.size()=1 2024-09-14T11:58:36.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.744+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YSSKMGsWe1xlOrc_rrdQ-D81eJmMsob_0 2024-09-14T11:58:36.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.744+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7998074966777122121', time=2024-09-14T13:38:04.774149+0000, chain.objs.size()=1 2024-09-14T11:58:36.743 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.744+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.y_QX9eKNQgoyFaY0Jt-pz2hs3hrzkBh_0 2024-09-14T11:58:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.746+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9010286205607906155', time=2024-09-14T13:38:06.312005+0000, chain.objs.size()=1 2024-09-14T11:58:36.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.746+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tV12iVcZJK-BDW66UwfX4aP-DKFR6x3_0 2024-09-14T11:58:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15838655793697325049', time=2024-09-14T13:38:07.079343+0000, chain.objs.size()=1 2024-09-14T11:58:36.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wCFeI8NmBsMZXAC_tKRl7tsW-7NNBHS_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17653579854651363972', time=2024-09-14T13:38:08.257713+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bacJdltgbY2CwnJipjs55ZikBsUI-o2_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15100011790005382725', time=2024-09-14T13:38:08.755275+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GR0cbZdA-Lhuz-E0qy28If3-t7h1yPl_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3169496524371970658', time=2024-09-14T13:38:09.083600+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qrLb4dnpWOCb9PO1OTMaX8dghu1iRz-_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1855837333341907851', time=2024-09-14T13:38:09.427544+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0zpaW6Jtz_uYxdeHxzwrZFdmJIZGZ8x_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18034112249100285448', time=2024-09-14T13:38:09.579583+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Rb4-yQywH0KuMrc94mCUOhEi_IBQLmm_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5929905403047244154', time=2024-09-14T13:38:19.436629+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.276__shadow_.xmkOMKsWedogjxo_JnVRhJQpA-cuOxp_0 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.773226279386462639', time=2024-09-14T13:38:35.595439+0000, chain.objs.size()=1 2024-09-14T11:58:36.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.szweLRumS52RdbvsuNODgnXVIyT_BBc_0 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3256040187040272', time=2024-09-14T13:38:44.688388+0000, chain.objs.size()=1 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.306__shadow_.yc3hrtXAmSAK_2zIUoe5265UmwBELSi_0 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.749+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14094422892811938067', time=2024-09-14T13:39:39.100742+0000, chain.objs.size()=1 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.750+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qI5gvje1RGavvLJSUkRKo8hTt9Uk8_S_0 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.750+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16461728901530847490', time=2024-09-14T13:39:39.517868+0000, chain.objs.size()=1 2024-09-14T11:58:36.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.750+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iDl7mOcUUenEu7JF_R2tSmbFkoLZcEW_0 2024-09-14T11:58:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3180685349627846284', time=2024-09-14T13:39:41.185979+0000, chain.objs.size()=1 2024-09-14T11:58:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.16ly5cQmqwNodyHX4D_0MqKPk6jyLuQ_0 2024-09-14T11:58:36.755 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12681096833499238408', time=2024-09-14T13:39:41.433636+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.edU0VRMYRw9G7i1VeyrXsLwVHYnrcPr_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13640211662648950781', time=2024-09-14T13:39:42.369463+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uN5q8ZlOw34_EBC8tU7gHbT0BnlNm07_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10772092727623933157', time=2024-09-14T13:39:42.786657+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MgSUHq-ZKiwcA3Ue8cuqmzTrcyApqTI_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18401703305451016687', time=2024-09-14T13:39:43.012533+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.M1RWtisvs1RVKgiMDyj5REUP_ly-Q-2_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10042042481722787310', time=2024-09-14T13:39:43.702021+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vmn6LurLtp4UtHcMdXB7iGfDHEyiymR_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.481465779041288190', time=2024-09-14T13:39:43.843005+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QKNwOIlgU6K86cv0bp7zTOo1b4BYVCc_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13391987355237599819', time=2024-09-14T13:39:44.709933+0000, chain.objs.size()=1 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TEFa4ykJvHRel8VvtPS4JmuvKeaHZwN_0 2024-09-14T11:58:36.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18272808554418700495', time=2024-09-14T13:39:45.417501+0000, chain.objs.size()=1 2024-09-14T11:58:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QcnV-nfgFoJjBR_pBITlik5y2gHqNhB_0 2024-09-14T11:58:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3235981248600519070', time=2024-09-14T13:39:45.670454+0000, chain.objs.size()=1 2024-09-14T11:58:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SImCz0ZI6OR1cGVRuoN8ZqyEnrkUKZF_0 2024-09-14T11:58:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.543748089698115154', time=2024-09-14T13:39:45.762189+0000, chain.objs.size()=1 2024-09-14T11:58:36.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.757+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.J6DOPyDB3F3vUFrYFWcpEyM6wLXp72Y_0 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4891598376517642091', time=2024-09-14T13:39:46.310482+0000, chain.objs.size()=1 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AK0VoZRwsLKch8QIV1IpB9vyHPZUJpw_0 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16182822683910482758', time=2024-09-14T13:39:46.312042+0000, chain.objs.size()=1 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TGWBDgzuUe6SJfXnzM2XLjZOImLs2CF_0 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6039192465617264210', time=2024-09-14T13:39:46.465378+0000, chain.objs.size()=1 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.69UlSJiNFjcVhRnr6QWDi-M4gPJ0zFy_0 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10710382702215359322', time=2024-09-14T13:39:46.836371+0000, chain.objs.size()=1 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-w_ESBebsmeKuFCDUPKfEK-RdtMrgOj_0 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14881702844663780412', time=2024-09-14T13:39:47.739749+0000, chain.objs.size()=1 2024-09-14T11:58:36.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IQpDeooEr5k-qATaJ_5iKbXy-Mqj1GT_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16502352697300136571', time=2024-09-14T13:39:47.783627+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CAti5Lmpw3QzsZ7pi3Lf0Oi7p-FP2a3_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1852320103412254648', time=2024-09-14T13:39:47.899956+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ML1qtPrXIz9_bx8L8Pdpk3lVmXPhoFP_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1022353179090776272', time=2024-09-14T13:39:48.471411+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.opBudNbtbv9m3NnP-RYm96BTOQS72C-_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2871764076524169672', time=2024-09-14T13:39:48.768590+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.URpMsLKPpBVaGq5izvAUAFtcJ_WPW-1_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13855768397179842477', time=2024-09-14T13:39:49.057093+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0g9FSUgrl3skrCEMkgu26IhZqftYGgG_0 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6773358022471757825', time=2024-09-14T13:39:49.206112+0000, chain.objs.size()=1 2024-09-14T11:58:36.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1o8nFIXBdors2sssDkgzV_SMxQ4tqZF_0 2024-09-14T11:58:36.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4538417999550081830', time=2024-09-14T13:39:49.572256+0000, chain.objs.size()=1 2024-09-14T11:58:36.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-OWx4E9ZquOtKeU5d5x26jGIGj1jmh6_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8696490018428098462', time=2024-09-14T13:39:50.234235+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wesqjQg4INBvYbcKK77INNoTBSFZCgz_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12419843265026150483', time=2024-09-14T13:39:50.300303+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.R60vJ86BBGI5JqEtu-tNPYLagqXl9mj_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1089619430274249480', time=2024-09-14T13:39:50.422668+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8_D-o9yssrNv7F4rCnZnmHXC3mw7U93_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17493748252893722503', time=2024-09-14T13:39:50.423486+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.o_1rXDiIiSfyWGhOGHF8URqJsUgWGLE_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6528213357412703650', time=2024-09-14T13:39:50.501344+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PLRsJI3q1Vw4EiNEtbz4UEVYDXLdBfF_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5852177873991399896', time=2024-09-14T13:39:50.502004+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DIWoT7VQoGeypsRcZIE_a5rQpixzysc_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2097495076145202012', time=2024-09-14T13:39:50.547431+0000, chain.objs.size()=1 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.a2LQJNQlK_BH-3w9zTO4PiNxM696G2R_0 2024-09-14T11:58:36.769 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15599801614883107707', time=2024-09-14T13:39:50.615282+0000, chain.objs.size()=1 2024-09-14T11:58:36.770 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XgzLEwdYo-BTy6IO-PHxP6HmzAkhv_d_0 2024-09-14T11:58:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.776+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5457198114409035230', time=2024-09-14T13:39:50.880250+0000, chain.objs.size()=1 2024-09-14T11:58:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.776+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zfIP_T4j7ZyCyhdpBEJ7vX6bU362PoH_0 2024-09-14T11:58:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.776+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17668589890673549016', time=2024-09-14T13:40:30.825703+0000, chain.objs.size()=1 2024-09-14T11:58:36.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.776+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.g3F-mkUia0_w0vEi31CPWtTEFjQwtab_0 2024-09-14T11:58:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16494558587073053692', time=2024-09-14T13:40:30.963976+0000, chain.objs.size()=1 2024-09-14T11:58:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7ZR5Ib5IKjMuXqQSjWxultkm_cvF4Xv_0 2024-09-14T11:58:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13059461319798220577', time=2024-09-14T13:40:30.964826+0000, chain.objs.size()=1 2024-09-14T11:58:36.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Od6aFWU2Up2GeLfWEYzsFD2VHKjGZzJ_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1457937321038351705', time=2024-09-14T13:40:32.538774+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2Z7Q9BeXE1HkbzZ1SRfgiuRUIefXMBH_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1670610054803182207', time=2024-09-14T13:40:32.676557+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.15LDMjtb1GmWzD_7fGTiV237na7b-dq_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.727330672802303117', time=2024-09-14T13:40:33.421625+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.InNv0NzUfRsYBPzKzbApJnKpHeBDCH8_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13094115422940375577', time=2024-09-14T13:40:34.990857+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QFqVFyrDrryCEQ_qWLLw19C2sATIPAb_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16205811208106160708', time=2024-09-14T13:40:35.406935+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3dzymNeqM74tdjtaAyCQIgx5GEpYwkG_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9896705187311007964', time=2024-09-14T13:40:35.407761+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9wQvvhHJ6Mv39cxRiyZZKeWr6skUlUc_0 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11636441321032581694', time=2024-09-14T13:40:36.271702+0000, chain.objs.size()=1 2024-09-14T11:58:36.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.q5bVgfsorEGw-VJUHrldA1_w6_l6RDL_0 2024-09-14T11:58:36.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14900228392615239453', time=2024-09-14T13:40:36.489534+0000, chain.objs.size()=1 2024-09-14T11:58:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cB_oT8OKWy9Ytw_o3xD-8_klM3_jMIQ_0 2024-09-14T11:58:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9459106019918276359', time=2024-09-14T13:40:36.883047+0000, chain.objs.size()=1 2024-09-14T11:58:36.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pM5dgOsUwdQyjBj-pbw9nNhT0ECafeX_0 2024-09-14T11:58:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14230706709715879096', time=2024-09-14T13:40:37.682734+0000, chain.objs.size()=1 2024-09-14T11:58:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lEksQ6mWDghZQKiAORE7J0nlmrECFe7_0 2024-09-14T11:58:36.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.358671003046088230', time=2024-09-14T13:40:39.472118+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qkvO2NOqEzh79HSlhtUhG2l6Fushj9Q_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5890518393591413604', time=2024-09-14T13:40:39.520711+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ehowmawdozl8xJ1kcDYzTt0-ZsI7Vx-_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3639936041794158063', time=2024-09-14T13:40:39.521576+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2nOLT5jgrpmz49-uICmcH6hHTncKz5O_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11317887159766327388', time=2024-09-14T13:40:39.847557+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.J40hzHc_j0yKJXwBk9DljExWNKaYE5Q_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3757531332642260975', time=2024-09-14T13:40:39.876885+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ORHGHSNbFe4H9MrQm1DPRX6s7phXpQ8_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4643104721009440445', time=2024-09-14T13:40:40.275988+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tB1m1rtG_mlneR-R6gcUxkrlxJyuXSw_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10995992379007691405', time=2024-09-14T13:40:40.343143+0000, chain.objs.size()=1 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yt-iZ0q4B_dgTXIBDX4Y9kj_vCt4d1W_0 2024-09-14T11:58:36.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16115159654100795105', time=2024-09-14T13:40:40.881820+0000, chain.objs.size()=1 2024-09-14T11:58:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9tcraf6U2XX4DIUCu8hsKbl1H7VVGNW_0 2024-09-14T11:58:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.264895561736575875', time=2024-09-14T13:40:42.585052+0000, chain.objs.size()=1 2024-09-14T11:58:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.18mFw-vQ6l2gchMwvZk8CNdLYeztyxj_0 2024-09-14T11:58:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7656475791315773700', time=2024-09-14T13:40:42.693366+0000, chain.objs.size()=1 2024-09-14T11:58:36.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.786+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.L1szzEYwlB9wvjJWD_Bp4lwXHYZyr6I_0 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13779012440278994896', time=2024-09-14T13:42:00.102526+0000, chain.objs.size()=1 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.445__shadow_.bPDqFHoOYEoOE3FYAvttUCdkOIHvwuS_0 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8217158006574547785', time=2024-09-14T13:42:28.289304+0000, chain.objs.size()=1 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.485__shadow_.pQNwlMHO3VSZCbAwkc9m-Yvf_m7OPYZ_0 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6984914180555987377', time=2024-09-14T13:42:39.593399+0000, chain.objs.size()=1 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.498__shadow_.RFQpWmtc0GJ-ICEa0jSlKmIY_R5l-fZ_0 2024-09-14T11:58:36.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16058964570918395365', time=2024-09-14T13:43:07.020019+0000, chain.objs.size()=1 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.4eQz0siAW3LNuImEep-gYH7mUygrZhk_0 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1011413667900008487', time=2024-09-14T13:43:29.547228+0000, chain.objs.size()=3 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~L4kGjOb9J5sn5f41bzpQ4UPyz0nAaO2.1 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~L4kGjOb9J5sn5f41bzpQ4UPyz0nAaO2.2 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~L4kGjOb9J5sn5f41bzpQ4UPyz0nAaO2.3 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14064610387423869500', time=2024-09-14T13:44:29.217988+0000, chain.objs.size()=6 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.1 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.H4Okp9PP4de59djNWsKIQURc5F87R3vL.2 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.P0B6tUnWghaZV9zmwZCGoHXLQPIMSaqF.3 2024-09-14T11:58:36.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.4 2024-09-14T11:58:36.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.5 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~8pCGr9JCxb_AfBFESEs8gf_kY3X1pM-.6 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6866301992408309963', time=2024-09-14T13:46:15.611666+0000, chain.objs.size()=1 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.563__shadow_.Hp-7rJVxq4Iph6YUrOB5uQtO2PhpVqm_0 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13300969474162443311', time=2024-09-14T13:46:32.726114+0000, chain.objs.size()=1 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:Oz1BgaiR9JbDzk-C4-VZ2TMV9roKrDS_.CXffFWxAdZANwp4WZ-UUhrKoruYSUZx_0 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.843073001474419149', time=2024-09-14T13:46:33.066229+0000, chain.objs.size()=1 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:68y1RregVd-DMmNmbN8arTwagcO7lWc_.YG1noNHJF4EVZYoOKYQ_L8SIiu5JQhm_0 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15913563893030745724', time=2024-09-14T13:47:31.882553+0000, chain.objs.size()=1 2024-09-14T11:58:36.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.799+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:l5L0k9G0jCCOXe5DM7nS12D7lSwM-7U_.F4FoTz3UEbBmUBv9oFchh4P6DGNBK12_0 2024-09-14T11:58:36.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8734703919253902837', time=2024-09-14T13:47:34.120129+0000, chain.objs.size()=1 2024-09-14T11:58:36.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:3TjB7yNFWMF9pW9aAc4lDUNSexm2KYa_.7NlRIqk6lSqq8GxP3QdZSxuT9sj5Jug_0 2024-09-14T11:58:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2865795973047387617', time=2024-09-14T13:52:30.840084+0000, chain.objs.size()=12 2024-09-14T11:58:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.1 2024-09-14T11:58:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.1_1 2024-09-14T11:58:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.801+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.2 2024-09-14T11:58:36.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.802+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.2_1 2024-09-14T11:58:36.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.802+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.3 2024-09-14T11:58:36.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.802+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.3_1 2024-09-14T11:58:36.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.4 2024-09-14T11:58:36.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.804+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.4_1 2024-09-14T11:58:36.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.804+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.5 2024-09-14T11:58:36.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.804+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.5_1 2024-09-14T11:58:36.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.806+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__multipart_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.6 2024-09-14T11:58:36.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.807+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.662__shadow_baz.2~-wzuIS3fzs3i_8qGmDGyDRVTaTejBru.6_1 2024-09-14T11:58:36.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.814+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/55133 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11042108931175974638', time=2024-09-14T13:52:35.464835+0000, chain.objs.size()=1 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.667__shadow_.7CBWarcUdP1VPj3eCBPUrvQ6u3BXmWA_0 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6552557585759441812', time=2024-09-14T13:52:42.783255+0000, chain.objs.size()=1 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.680__shadow_.G6e2GJ6sQhPgX8uKHvft3NqxLN-iZxZ_0 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1191529178095123515', time=2024-09-14T13:52:55.246782+0000, chain.objs.size()=1 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.700__shadow:4-KthClUowKcoCP9m-vIp776wsTItNj_.cShBgAbAFYo-nssO6x3D5LBuL8yKK2N_0 2024-09-14T11:58:36.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6031292204442772735', time=2024-09-14T13:54:58.308072+0000, chain.objs.size()=1 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.759__shadow_.z7upmeRRrstBzL0PehH71jiV6tP5uUE_0 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3142263349565644850', time=2024-09-14T13:56:49.174925+0000, chain.objs.size()=10 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_0 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_1 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_2 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_3 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_4 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_5 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_6 2024-09-14T11:58:36.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_7 2024-09-14T11:58:36.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_8 2024-09-14T11:58:36.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.780__shadow_.BZZZAq7oxChClfmT1vX_NgCIe0oh2TN_9 2024-09-14T11:58:36.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.827+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:36.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.829+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:58:36.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.830+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:36.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.831+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46049' 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9165322883386289887', time=2024-09-14T13:34:41.745155+0000, chain.objs.size()=5 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-FROZEN.2~8_gJLpBlJxioAZ1zqxMM0awlBa4Ci9y.1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_foo-FROZEN.2~8_gJLpBlJxioAZ1zqxMM0awlBa4Ci9y.1_1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-FROZEN.2~8_gJLpBlJxioAZ1zqxMM0awlBa4Ci9y.2 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_foo-FROZEN.2~8_gJLpBlJxioAZ1zqxMM0awlBa4Ci9y.2_1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-FROZEN.2~8_gJLpBlJxioAZ1zqxMM0awlBa4Ci9y.3 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9936646056461204903', time=2024-09-14T13:34:50.896710+0000, chain.objs.size()=1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.172__shadow_.SL-wqaqNpFXoFpIJgkmBYIgk0LZ_6PP_0 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5617223364872525521', time=2024-09-14T13:37:01.287999+0000, chain.objs.size()=1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.239__shadow_.2sw6-hwNFZScaiSx62FY2cW7aYARRa8_0 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13455078012982492290', time=2024-09-14T13:37:05.023454+0000, chain.objs.size()=1 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.244__shadow_.el06QhZYi60vT0ttxYVcQoLPazEjYzd_0 2024-09-14T11:58:36.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.191296351044340012', time=2024-09-14T13:37:08.294876+0000, chain.objs.size()=1 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.248__shadow_.CWDR382kImqrxKl2MELK0-A1cFPoYah_0 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8031095234394530261', time=2024-09-14T13:37:57.687648+0000, chain.objs.size()=1 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.f8BUzx2Boe5YEEGIwhl9sDxt9e6LhO4_0 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9324549671706316637', time=2024-09-14T13:37:57.733828+0000, chain.objs.size()=1 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rxkjdDbpjwc1wOs-LwXUskDWTISxKlk_0 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17944445684832763673', time=2024-09-14T13:37:58.078063+0000, chain.objs.size()=1 2024-09-14T11:58:36.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Bqz9NMrEv9QQYcnNhCLopXRF13at2To_0 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7457568299230463668', time=2024-09-14T13:37:58.490120+0000, chain.objs.size()=1 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UqXbvCQr7SlMzWiXLWESFa4I4EV6Z2F_0 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7585678089454664329', time=2024-09-14T13:37:58.815745+0000, chain.objs.size()=1 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Z9LwiZF-DuY1YbN7GZlSJZQqts_PDt0_0 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12365860382190533175', time=2024-09-14T13:37:59.505157+0000, chain.objs.size()=1 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.j5mAjgs6OsXvKTaT1eLrNP0ZmTeGGx2_0 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14091333316122512090', time=2024-09-14T13:37:59.628363+0000, chain.objs.size()=1 2024-09-14T11:58:36.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bGqGPrYG_X92R_smzjT8L5nX40gUKp9_0 2024-09-14T11:58:36.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.836+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11961404671631195602', time=2024-09-14T13:37:59.859852+0000, chain.objs.size()=1 2024-09-14T11:58:36.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.836+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Fqk8laTT1oHPm-WWoHBaLrRyAdVB9Ls_0 2024-09-14T11:58:36.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.836+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7410758284805865875', time=2024-09-14T13:37:59.937348+0000, chain.objs.size()=1 2024-09-14T11:58:36.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.836+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UR-EAksBd0QMtMTYDuYhssSWHM-rPg3_0 2024-09-14T11:58:36.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.837+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13245479726766379574', time=2024-09-14T13:38:00.494655+0000, chain.objs.size()=1 2024-09-14T11:58:36.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.837+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Y4gx8c9hzpQYc-SERSAaBBhdVxbztA4_0 2024-09-14T11:58:36.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.837+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7936214541174322431', time=2024-09-14T13:38:01.645431+0000, chain.objs.size()=1 2024-09-14T11:58:36.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.837+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.roAtBEHG5JbSEuzVIYcG_rVUA_HXnm6_0 2024-09-14T11:58:36.835 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10226797262916809376', time=2024-09-14T13:38:02.178044+0000, chain.objs.size()=1 2024-09-14T11:58:36.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tK4H8Jo30eWIoMZQl4JtuZvgrF0PDzp_0 2024-09-14T11:58:36.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8401327271770042595', time=2024-09-14T13:38:02.218605+0000, chain.objs.size()=1 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6xlrn5TzHiLf3nXuV6LJPVGAzLwj4M8_0 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2787825018372694450', time=2024-09-14T13:38:02.325890+0000, chain.objs.size()=1 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6cAFHKp3Itd-d-Mymkf9jVWyGdqU410_0 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18431808036258244941', time=2024-09-14T13:38:02.374722+0000, chain.objs.size()=1 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jcayRVc9i4EKQ8br9XpyEGUdI9KXdfb_0 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.800908127167449637', time=2024-09-14T13:38:02.918096+0000, chain.objs.size()=1 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Svlc9dx1Z453D-Cq4MbK_XyaGgHjq4g_0 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4315000588720582421', time=2024-09-14T13:38:03.146422+0000, chain.objs.size()=1 2024-09-14T11:58:36.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pF-6vDCbOeWad5NEY0rbBoSL20t-Xi1_0 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.309607899866066079', time=2024-09-14T13:38:03.436128+0000, chain.objs.size()=1 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8hXf8-6soq1BXRoQ3zTIr3JikafaGvM_0 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8497665718362854003', time=2024-09-14T13:38:03.877572+0000, chain.objs.size()=1 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DIodCdgF96hfNgI5DCPdrXBO5EKfX_m_0 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.841+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5857723390181540158', time=2024-09-14T13:38:04.834368+0000, chain.objs.size()=1 2024-09-14T11:58:36.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.841+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eXH3tg_SqZwXTazm3ywZWnAI_I-h8V6_0 2024-09-14T11:58:36.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.841+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13520248617258752382', time=2024-09-14T13:38:05.067399+0000, chain.objs.size()=1 2024-09-14T11:58:36.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.841+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cZ2EsD1ATiDKECxhALyDvcoaVSg0vSf_0 2024-09-14T11:58:36.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15625440027935412184', time=2024-09-14T13:38:05.199333+0000, chain.objs.size()=1 2024-09-14T11:58:36.840 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sGORJHzB3jy21KvHD0tqFMyGOJZewAm_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15103648624972765763', time=2024-09-14T13:38:05.241834+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HcmBSy4tv_1oZgwSxwQuNTDox4ilhOo_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2524698567509417617', time=2024-09-14T13:38:05.395235+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xMaUI3yfqnJ2tnxZQrciMxmICscazk-_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.122909982952018857', time=2024-09-14T13:38:05.577728+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.I4k4uLc8o5nHCjf4FNNEGLMnfuI0__O_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1177731202066197966', time=2024-09-14T13:38:05.645426+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Bll5Bvtp2U5H1DgDKPn2OLKnmDcjcR3_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2112808274806337066', time=2024-09-14T13:38:06.130988+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.845+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.54yTlsq4j68sWVXl12aoXqDu4hzub_I_0 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17394236728351387925', time=2024-09-14T13:38:06.597236+0000, chain.objs.size()=1 2024-09-14T11:58:36.844 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DG25Qa5y4degpal6zbfIa2dRMX0iBNl_0 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5598567991928664012', time=2024-09-14T13:38:06.610711+0000, chain.objs.size()=1 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ccm6SgY4dFlChSyW2_w05S1LGlmX8h6_0 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6857927187321200007', time=2024-09-14T13:38:06.695417+0000, chain.objs.size()=1 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.alcAxZNJFsJXQS7MS3zDQ-c96ZkkGYa_0 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10867069585914443133', time=2024-09-14T13:38:06.927386+0000, chain.objs.size()=1 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PsRn_7htzXx5LdeFmS5M1zlgGOR0_5v_0 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9650831012053035171', time=2024-09-14T13:38:06.979471+0000, chain.objs.size()=1 2024-09-14T11:58:36.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.846+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0BOfUvfFkfYNsk0VAPD7byA--iFnTPt_0 2024-09-14T11:58:36.846 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.849+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10187411990788862109', time=2024-09-14T13:38:07.353705+0000, chain.objs.size()=1 2024-09-14T11:58:36.847 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.849+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FbKqeRzTg2xjo2APiN0WbB_nJ_f0U7Z_0 2024-09-14T11:58:36.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1128669295043928136', time=2024-09-14T13:38:07.376977+0000, chain.objs.size()=1 2024-09-14T11:58:36.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OBf2ATYgAwwiFzDA8jW5M6_R9O6x8uo_0 2024-09-14T11:58:36.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10601498240145281794', time=2024-09-14T13:38:07.914217+0000, chain.objs.size()=1 2024-09-14T11:58:36.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v0rFdjIMiEgaLlN4kQNaUSfyzpPXVbx_0 2024-09-14T11:58:36.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15586783991126342357', time=2024-09-14T13:38:07.949386+0000, chain.objs.size()=1 2024-09-14T11:58:36.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AyRna9CTKEk9CQwm_w7YiWjknqH9udB_0 2024-09-14T11:58:36.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5325176222609369185', time=2024-09-14T13:38:08.112056+0000, chain.objs.size()=1 2024-09-14T11:58:36.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KkCTXQ60SmLkSfT5M2DA54VVuNOQYR3_0 2024-09-14T11:58:36.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13487636604509979519', time=2024-09-14T13:38:08.228441+0000, chain.objs.size()=1 2024-09-14T11:58:36.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NM4DOh08R6b4FOmvgFp8_WbPW-kurA9_0 2024-09-14T11:58:36.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17531412589026066489', time=2024-09-14T13:38:08.229202+0000, chain.objs.size()=1 2024-09-14T11:58:36.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wIfRrZA0oIuGGYem1jLleDeUVAQvyg-_0 2024-09-14T11:58:36.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11887233542913284073', time=2024-09-14T13:38:08.261342+0000, chain.objs.size()=1 2024-09-14T11:58:36.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9CDJ59LYbV1ZnY9qOeMYZ8i8aljaVMO_0 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9800150345687549558', time=2024-09-14T13:38:08.688094+0000, chain.objs.size()=1 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2CNluKwjwKIxkGh7ONcduqRhpWL65ep_0 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7365740612914434066', time=2024-09-14T13:38:08.984406+0000, chain.objs.size()=1 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1W83tHjOylfTWCO-jOUj6kW70B_xJFq_0 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4483961221346982847', time=2024-09-14T13:38:09.537328+0000, chain.objs.size()=1 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jvbTxY55yZsfc7yvEPxVUKoxLUZd9ht_0 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.853+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7309146464017837436', time=2024-09-14T13:38:10.077250+0000, chain.objs.size()=1 2024-09-14T11:58:36.851 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.853+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KuWgr_NwsaLA5JpABWs1Nq-zwKQ534C_0 2024-09-14T11:58:36.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14598534341159047786', time=2024-09-14T13:38:14.582792+0000, chain.objs.size()=1 2024-09-14T11:58:36.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.269__shadow_.4dD5BVH2OxSqJYY_ChQhez1953wt2Qw_0 2024-09-14T11:58:36.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12977438128405984705', time=2024-09-14T13:38:15.263442+0000, chain.objs.size()=1 2024-09-14T11:58:36.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.270__shadow_.jX9QvRYRkfWHWmcH8O8FGwga8HNsHs5_0 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11249899238908089465', time=2024-09-14T13:38:17.353808+0000, chain.objs.size()=1 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.273__shadow_.OESuFw5obLMl0aBGY23_HRgOqD9MYjT_0 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14324512147311718955', time=2024-09-14T13:38:20.154683+0000, chain.objs.size()=1 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.277__shadow_.FBz9j74goQPNP_hOwRa-BJCPxTrJqRX_0 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9254149424934081212', time=2024-09-14T13:38:21.664025+0000, chain.objs.size()=1 2024-09-14T11:58:36.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.279__shadow_.tZkMCmVVBJWEAPf7wq7vQF1oYh-_9XG_0 2024-09-14T11:58:36.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6056204197549310461', time=2024-09-14T13:38:26.892881+0000, chain.objs.size()=1 2024-09-14T11:58:36.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.856+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.286__shadow_.CcG9QjtEDBEkK93sYVYMVXZ9q5SEySp_0 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5534508381979327523', time=2024-09-14T13:38:26.902971+0000, chain.objs.size()=1 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.286__shadow_.Bjaeuj4C5G_Zxh5fmVg_GyZYR-foXik_0 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5726184677393814107', time=2024-09-14T13:38:33.471777+0000, chain.objs.size()=1 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.dDQg3Ew5e-f3xeqnInD_mINRkMHXkvj_0 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5655143738893878885', time=2024-09-14T13:38:33.608129+0000, chain.objs.size()=1 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.H8USrclcziTAoHaMcSJArNuDcibSWG2_0 2024-09-14T11:58:36.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10554069507217619300', time=2024-09-14T13:38:35.596517+0000, chain.objs.size()=1 2024-09-14T11:58:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.cAKw8PYHa5IROvHJG90RpvYhcL59VVC_0 2024-09-14T11:58:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15285193614549503365', time=2024-09-14T13:38:35.692119+0000, chain.objs.size()=1 2024-09-14T11:58:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.D1kkcFf4aDosxcOh7fpcC1wM-majL02_0 2024-09-14T11:58:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7417110928303797534', time=2024-09-14T13:38:40.259260+0000, chain.objs.size()=1 2024-09-14T11:58:36.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.300__shadow_.aDkWmTAr_UVc3qisJzcvG4VkiNYekJU_0 2024-09-14T11:58:36.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16926116915148660132', time=2024-09-14T13:38:40.268428+0000, chain.objs.size()=1 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.300__shadow_.-pLBKAs_MfAx0rFqrO9Wvi9-1sTmZ75_0 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10988167183711534545', time=2024-09-14T13:38:46.904592+0000, chain.objs.size()=1 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.308__shadow:of2uDUrAWfBiagBtryOlIdNCJwnGHXh_.YKFt8NoCDtmfyRi9zQFy0qKRfPKywxQ_0 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6972590467883131264', time=2024-09-14T13:38:55.685788+0000, chain.objs.size()=1 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.320__shadow:xkwWPnfiBe87LE5MhyQ.iDUDFus2ibP_.eZO1X1764_Gjw9RHh103hbAZLttjBrl_0 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14264728053997024487', time=2024-09-14T13:39:38.818912+0000, chain.objs.size()=1 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CdN_oOkCZPQJn8rafiTJGs6uYH3aVpy_0 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.37120264745042371', time=2024-09-14T13:39:39.204598+0000, chain.objs.size()=1 2024-09-14T11:58:36.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SLYZF-zScSmWzeP8SBtE5cvb5niQWwe_0 2024-09-14T11:58:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1496084017984963092', time=2024-09-14T13:39:39.341320+0000, chain.objs.size()=1 2024-09-14T11:58:36.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wJSSrfLVAteXm99FY3W6BwgSK6giwxM_0 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13756864351123167985', time=2024-09-14T13:39:40.353397+0000, chain.objs.size()=1 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LfdsYYuzBtI8EBER5iHY5pXtIHkAioj_0 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12656309442664001454', time=2024-09-14T13:39:40.354039+0000, chain.objs.size()=1 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.geIf74lMjxaacb3vAUqyYt9Gq8j3tQp_0 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4077897258435795003', time=2024-09-14T13:39:40.354767+0000, chain.objs.size()=1 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XFRJJni1TsbnTesJEQ3YJbNwddLN9fW_0 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2901065878386975338', time=2024-09-14T13:39:40.428232+0000, chain.objs.size()=1 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.g6xT6GhyAl0kAYuOO3ajVBkb1R_SXm__0 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12483393848648077864', time=2024-09-14T13:39:40.776398+0000, chain.objs.size()=1 2024-09-14T11:58:36.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.s4AvR69ctR1SogjakrRRtKT_ebMLlkU_0 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13467084329383362297', time=2024-09-14T13:39:41.021724+0000, chain.objs.size()=1 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mPhrI4Oxsv8oDutBvxXxaJe5FccyahI_0 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3377154105838571014', time=2024-09-14T13:39:41.244859+0000, chain.objs.size()=1 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aYxtewzcjg7zK0Z4cuFIJwpl9v0YEUa_0 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15214153135614681891', time=2024-09-14T13:39:41.433821+0000, chain.objs.size()=1 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kFJ3YkEg4ChIIWpjmh9vB3gkQ34IQNC_0 2024-09-14T11:58:36.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5467840377177100567', time=2024-09-14T13:39:41.434581+0000, chain.objs.size()=1 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9gIK14uUUPUOFYSen3EE57OJoJmCh3R_0 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17572093291409859617', time=2024-09-14T13:39:41.509896+0000, chain.objs.size()=1 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vK0J3AxXQluTwmvFZGlBts1BAVjiiGQ_0 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5649385635191394794', time=2024-09-14T13:39:41.976968+0000, chain.objs.size()=1 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0PlnBgV_z88FHMaHBBVbZIw7_uF0YNk_0 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3383103126626344517', time=2024-09-14T13:39:42.541168+0000, chain.objs.size()=1 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oy48Mjt6nfqIG9dW0HGX62fEx1t_gur_0 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1741403032163294978', time=2024-09-14T13:39:43.195550+0000, chain.objs.size()=1 2024-09-14T11:58:36.868 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MG8N2LzTf_BV9kKIyymFD2JRUiE7pNe_0 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.870+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11622503413874121859', time=2024-09-14T13:39:43.639120+0000, chain.objs.size()=1 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.870+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.70gx2fCbO9vSJZiPAmrJROpPHWX0dLG_0 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.870+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15274085565375666881', time=2024-09-14T13:39:43.841868+0000, chain.objs.size()=1 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.870+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dNmiMCtkZh3Dk6FSIUxgzb18ZDk5v8w_0 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.871+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.150605314888350242', time=2024-09-14T13:39:45.283297+0000, chain.objs.size()=1 2024-09-14T11:58:36.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.871+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MpwjupOh27re6yfFplPkOzeZ88qdoJn_0 2024-09-14T11:58:36.872 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13463316194090782386', time=2024-09-14T13:39:45.600544+0000, chain.objs.size()=1 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rduUvK9f6uiBsNYcyCI3b6O9Iiwtebu_0 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11803152796976887205', time=2024-09-14T13:39:46.110577+0000, chain.objs.size()=1 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TYrxuzXzEAGsNEuPLuk-EgdA70eDxqZ_0 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8930000099414696930', time=2024-09-14T13:39:46.126313+0000, chain.objs.size()=1 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.n1zGl5n4BwUa8ucImYlCQi16TUTjVj7_0 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16425407107519304085', time=2024-09-14T13:39:46.342339+0000, chain.objs.size()=1 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5b0yGUfHt2JJk0q4N9ocjfXdzdv9VKu_0 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9189003074527903689', time=2024-09-14T13:39:47.336235+0000, chain.objs.size()=1 2024-09-14T11:58:36.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.O_wtO6GHA-RWK-Ry2HJL-BDQ_vfW8jE_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15058094266948107012', time=2024-09-14T13:39:47.364444+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6143s1kwSuxgQZW-UrNIXNDxRA4W0RU_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14847206391677380595', time=2024-09-14T13:39:47.701404+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.K0cNre2hNyTSbNx8JSj4DgdV_Rc8ODi_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7928170719594531100', time=2024-09-14T13:39:47.859826+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gKSO2WxPt8_4TFue6koFfJQSwXRiyz1_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6774275950065438563', time=2024-09-14T13:39:48.041813+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CTcw_WGlpeysu-asPdacvXaMvnvteit_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4659249534926066067', time=2024-09-14T13:39:48.403390+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-FanfmOqp3wMl6AxFyPSnI96vbDo8tK_0 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2385725100777929154', time=2024-09-14T13:39:48.619110+0000, chain.objs.size()=1 2024-09-14T11:58:36.875 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NrSUYYVCRv7J6jYQaZQTCDPJjmYvuIs_0 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6832092582922493550', time=2024-09-14T13:39:48.619886+0000, chain.objs.size()=1 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oIfAOVHTbe48doDPKKbeSEc2PdfNRZ4_0 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3803215738999352500', time=2024-09-14T13:39:48.724548+0000, chain.objs.size()=1 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zjYGKrGN5BgJHJyU3kLOCp8LH9mM2Ld_0 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18174950704010280785', time=2024-09-14T13:39:48.725389+0000, chain.objs.size()=1 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kbQG8kEFBZYuvWVL_XVmN51vk2DwMRX_0 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10398369464401769803', time=2024-09-14T13:39:48.832720+0000, chain.objs.size()=1 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.48z2ZvzsCj9PgKkQtuaSEHwQuur_1wK_0 2024-09-14T11:58:36.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13930986035081074925', time=2024-09-14T13:39:48.910932+0000, chain.objs.size()=1 2024-09-14T11:58:36.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.879+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C-35JLUjQ6QQ1qAav4-wPDYQHR8wvJn_0 2024-09-14T11:58:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10366408069127773697', time=2024-09-14T13:39:49.904292+0000, chain.objs.size()=1 2024-09-14T11:58:36.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YlJIi65-YUtIkZcQ-xcRo3JQn1ahdA7_0 2024-09-14T11:58:36.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/46049 2024-09-14T11:58:36.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=45, truncated=0, next_marker='' 2024-09-14T11:58:36.885 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9425674022776483182', time=2024-09-14T13:39:50.547650+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8EWIrdie-LqOVF9IkDsXti3bjZd-gsu_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16188503640806676471', time=2024-09-14T13:40:31.967672+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CU5ywzTy0Ynh43cIi7lj61Ae2R7a5q-_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3372117974608432317', time=2024-09-14T13:40:31.984271+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HRYOdhBRVlt71sqn0GkptB3s5T3k1V1_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8734832064900934253', time=2024-09-14T13:40:32.675625+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qMtKLH5yiXRj72kGcFcvQB6AdhmmOTQ_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3286341274549185111', time=2024-09-14T13:40:33.150121+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-RCqbckFTkvzS_K_KjbpOAGxbb50_eo_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15810378993800803507', time=2024-09-14T13:40:33.639569+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.z6NegbJkClgrQWR9VLykF79uTPNtdIs_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6348604212791936463', time=2024-09-14T13:40:34.380067+0000, chain.objs.size()=1 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Xuyw74Tf1IiqdPGb4JNyuQLrVlo6PTp_0 2024-09-14T11:58:36.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15838219288460230557', time=2024-09-14T13:40:34.952402+0000, chain.objs.size()=1 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AfjGaFFa_LOqbZ67V9RqLfhaXsp8HWl_0 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15113147491927055827', time=2024-09-14T13:40:35.405735+0000, chain.objs.size()=1 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.V2VHEhBlyQRByxVk-mNFqZCiFmCsmXL_0 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15780862304452668849', time=2024-09-14T13:40:36.086473+0000, chain.objs.size()=1 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qDWkXBZikHigfg0TsGfc0WnMx7QHfjv_0 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7003490763855711963', time=2024-09-14T13:40:36.613526+0000, chain.objs.size()=1 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3HZlaEeW12mn_uGq-Rxa-Fek25s6gM4_0 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17293212843794930885', time=2024-09-14T13:40:36.891452+0000, chain.objs.size()=1 2024-09-14T11:58:36.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.887+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GSi_ZuaO0K5ANXgUhMDE1BKlljOFH-f_0 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10328483320647997572', time=2024-09-14T13:40:37.724746+0000, chain.objs.size()=1 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1YkH9zg23B5If3o0i5DMOY7EQNd8Ymn_0 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13305345382148278982', time=2024-09-14T13:40:37.785474+0000, chain.objs.size()=1 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FwQH4D8BlxeVsY_z0m-bDqetVmdgMpl_0 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13551423615046813094', time=2024-09-14T13:40:37.911963+0000, chain.objs.size()=1 2024-09-14T11:58:36.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.k876EO1AdKV8s-y0apKgrQJ6hKW_Nfg_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1683396465776174859', time=2024-09-14T13:40:38.058541+0000, chain.objs.size()=1 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TXq-alr7WsAJ0VuBm7s_3cQmnD9W8Wj_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.969167182133323616', time=2024-09-14T13:40:38.099584+0000, chain.objs.size()=1 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jrXR29ul52xgyI6Ylh1hBi1CX3b0Bzj_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11985177892492450170', time=2024-09-14T13:40:39.132818+0000, chain.objs.size()=1 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rc7ZrmU_0_eS4swbpazzrKRQGqPF45A_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9174561226323124256', time=2024-09-14T13:40:39.133537+0000, chain.objs.size()=1 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pjY0QTrEKJEQPBTsetnbNkx8E8V8VPW_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14688555464193878026', time=2024-09-14T13:40:39.937048+0000, chain.objs.size()=1 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Tjr9PtKxA3jc6dfPXzbddgHKouG8sJH_0 2024-09-14T11:58:36.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3753591700110971325', time=2024-09-14T13:40:40.974875+0000, chain.objs.size()=1 2024-09-14T11:58:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PPjQ3_8hfKX38PnBj1tD7jU4PRsvZSM_0 2024-09-14T11:58:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.892+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8845890003589625717', time=2024-09-14T13:40:41.349671+0000, chain.objs.size()=1 2024-09-14T11:58:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.892+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.K4831ybNU5SDUHcCB85zAvJ3CpUkQPg_0 2024-09-14T11:58:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.892+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11922984984426982049', time=2024-09-14T13:40:41.411918+0000, chain.objs.size()=1 2024-09-14T11:58:36.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.892+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Q7ci_VzVqFtDkOZBU3LBs_fE4HUX_D1_0 2024-09-14T11:58:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18213580202008769244', time=2024-09-14T13:40:41.452448+0000, chain.objs.size()=1 2024-09-14T11:58:36.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vNHsL9VybAKrle_FWLHGreq1uXe7Daj_0 2024-09-14T11:58:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10974977349745925866', time=2024-09-14T13:40:43.183633+0000, chain.objs.size()=1 2024-09-14T11:58:36.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nx79YXv11jKA8q4cI2vQMRhGxK9ir9J_0 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14851880946108730423', time=2024-09-14T13:40:43.200496+0000, chain.objs.size()=1 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EeXmSIcH3IONly-pd50cEl0prxWhh07_0 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8555733119142806706', time=2024-09-14T13:40:54.555802+0000, chain.objs.size()=1 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.343__shadow_.s7SRyXOQLXePLRqkYbgoxAZELTU2YWC_0 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7180891584368031189', time=2024-09-14T13:41:16.622215+0000, chain.objs.size()=1 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.380__shadow_.dC-bkSgWZbC6TapPZrNfl6KigtpEXjV_0 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1677355261383955878', time=2024-09-14T13:41:53.477984+0000, chain.objs.size()=1 2024-09-14T11:58:36.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.896+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.436__shadow_.7HPF442p0NbycC9mklvxPQDLOLgrTVs_0 2024-09-14T11:58:36.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.897+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.976244856144228935', time=2024-09-14T13:41:58.521174+0000, chain.objs.size()=1 2024-09-14T11:58:36.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.897+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.443__shadow_.6wFvUzR32EVI057_FfKXEcDwkvLT6K1_0 2024-09-14T11:58:36.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3745609677151732781', time=2024-09-14T13:42:15.884168+0000, chain.objs.size()=1 2024-09-14T11:58:36.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.465__shadow_.i6KvP7AD2X8eEIDA6PK0mz3mh_5N26-_0 2024-09-14T11:58:36.896 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9961595744643194138', time=2024-09-14T13:42:27.464161+0000, chain.objs.size()=1 2024-09-14T11:58:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.C14edMIEq7oJmhkxAHlj-fhLYcxwAvp_0 2024-09-14T11:58:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7986061602279748562', time=2024-09-14T13:42:27.464890+0000, chain.objs.size()=1 2024-09-14T11:58:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_._pCewxrtZtzVxKmzndSdR2-QdUmTUV6_0 2024-09-14T11:58:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~OMDXcUP_hpiHKMXZw2M3K_MZ-_b2cE-', time=2024-09-14T13:45:07.415390+0000, chain.objs.size()=1 2024-09-14T11:58:36.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.898+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.534__multipart_mymultipart.2~OMDXcUP_hpiHKMXZw2M3K_MZ-_b2cE-.1 2024-09-14T11:58:36.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8497495814569497196', time=2024-09-14T13:46:46.278533+0000, chain.objs.size()=1 2024-09-14T11:58:36.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:cnD2sz146UAOqKOW8ieASCn5v37fPhJ_.k_4V3jHDb20w1c9r6o6F3YIb1jm38HB_0 2024-09-14T11:58:36.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2948430952958709553', time=2024-09-14T13:46:49.478407+0000, chain.objs.size()=1 2024-09-14T11:58:36.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:C2ibfW8igZtoHEFKKNlrynb6rk1PO3-_.bxr6mIRUeQsp0wqQDniMERVzCW7SEIG_0 2024-09-14T11:58:36.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2689156258908168804', time=2024-09-14T13:46:58.849921+0000, chain.objs.size()=1 2024-09-14T11:58:36.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:4ftwF0IKi4Ld2v2JRuGz-lTjepk22Ir_.sJMAURXByCGTmfHPvf4tAjdjaK678m4_0 2024-09-14T11:58:36.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12331650319864562244', time=2024-09-14T13:47:00.901319+0000, chain.objs.size()=1 2024-09-14T11:58:36.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:PQHLmHg8Gv6R6p-TatnRi0Z-104mxSY_.1ImOLV-zLp4EW4uzKS2LWrahGvL0pum_0 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9163997912114212558', time=2024-09-14T13:47:40.961082+0000, chain.objs.size()=1 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:wWflciU5vLUeASz05rle0KN2T4bife8_.mTDgDoojfwR60GPYk7Fz_6X0lthUF4n_0 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9664774953687767936', time=2024-09-14T13:47:41.270478+0000, chain.objs.size()=1 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:jJ7I-vVSopZjUGC1WYW4CWLjq-ZorU5_.1gYm_61k7HaBWzO2cgds7jPYdLOHb8H_0 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3635730830029346356', time=2024-09-14T13:52:33.090900+0000, chain.objs.size()=1 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.665__shadow_.2kQ8AS_mXH7vvecc_IOSaPZJUPDp5aJ_0 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9816073073697310926', time=2024-09-14T13:52:36.428837+0000, chain.objs.size()=1 2024-09-14T11:58:36.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.669__shadow_.c7iZNqDCxN0EjzQ6SHUPXGryyqhmiYq_0 2024-09-14T11:58:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1213266343039252070', time=2024-09-14T13:52:58.969210+0000, chain.objs.size()=1 2024-09-14T11:58:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.705__shadow:bp3gKrHDJq-89LuVmpnbKzAAUfxHDzi_.JeYAA29WyyZngircjOQ9N-zhkfNkKh4_0 2024-09-14T11:58:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.328086681700160139', time=2024-09-14T13:52:59.819579+0000, chain.objs.size()=1 2024-09-14T11:58:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.706__shadow:S7FS3KB5lSlFXzGDNi0aHdXNXu5jd8x_.Wv8lG_3H1OidiRiu8vxkkhVIlHF09Lo_0 2024-09-14T11:58:36.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5833962568987901212', time=2024-09-14T13:54:10.316504+0000, chain.objs.size()=1 2024-09-14T11:58:36.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.749__shadow_.Y5-8ADUIgppZudhRsZCXp4o2Ui8F9j6_0 2024-09-14T11:58:36.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:36.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.913+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:58:36.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.914+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:36.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.915+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53922' 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.473651763632506454', time=2024-09-14T13:34:29.470850+0000, chain.objs.size()=3 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-STANDARD.2~dwH-Lj5IbaQedsx7L38KHyGZ5uJM2M0.1 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-STANDARD.2~dwH-Lj5IbaQedsx7L38KHyGZ5uJM2M0.2 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-STANDARD.2~dwH-Lj5IbaQedsx7L38KHyGZ5uJM2M0.3 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13537345961443874737', time=2024-09-14T13:34:50.476438+0000, chain.objs.size()=1 2024-09-14T11:58:36.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.171__shadow_.3bB_xKU62UjHdTD_R7IusO6thi3O4ym_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12745064813899246293', time=2024-09-14T13:37:03.227350+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.242__shadow_.XYk2BEL3DYv6fyBi_g2qFCYQBFozh_9_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18350847816787802686', time=2024-09-14T13:37:06.080542+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.245__shadow_.OqYW6PuUier0pxp5YwDKCUli58pK0Sh_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12753055925080401933', time=2024-09-14T13:37:06.088395+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.245__shadow_.SzuLJkjuo4K9Cv_ceUzx-RQZp2a70PI_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8530564946412229704', time=2024-09-14T13:37:09.015439+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.249__shadow_.DBmUYnkbWGlq4DzkSVzGFlksgMFkUcz_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6300534539026521624', time=2024-09-14T13:37:09.025333+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.249__shadow_.J84-HQy2dBEqQ0zleuhePCVllEf6rDB_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13936289570920137535', time=2024-09-14T13:37:58.125688+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pbWZrt2D3MNCKt96ro6TcvyfSEPJVZv_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16170856276658014497', time=2024-09-14T13:37:58.469814+0000, chain.objs.size()=1 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.P0u47rRP0iyEmXUwzHX1cxDIkivLxKd_0 2024-09-14T11:58:36.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8654537523325945644', time=2024-09-14T13:37:59.689319+0000, chain.objs.size()=1 2024-09-14T11:58:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h5Q75yODtagJi83FTIdGfTo3M1Y1Bk3_0 2024-09-14T11:58:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.919+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5834852140985600538', time=2024-09-14T13:37:59.985810+0000, chain.objs.size()=1 2024-09-14T11:58:36.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.919+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RKaNfrAS9yniOFnpFBJFFKO6csJmMHz_0 2024-09-14T11:58:36.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2510969137547451375', time=2024-09-14T13:38:00.549289+0000, chain.objs.size()=1 2024-09-14T11:58:36.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.q0wjCMPgRvRkVUmlmGnpXvMZM6oc8DN_0 2024-09-14T11:58:36.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2399035111016404972', time=2024-09-14T13:38:01.748467+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.d8ZmQJhfMSlxUPLYni_ZApvg8bzjSq4_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9925039215947118309', time=2024-09-14T13:38:02.178727+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NDa5EIuYVxQCY83a4unxAvbp9oXjVXH_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9221512518360040366', time=2024-09-14T13:38:02.342167+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8LmixUH3sa29BWZUM6AeAefG8V0YfTM_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4930496054372701190', time=2024-09-14T13:38:03.189450+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tVJjV6zSbO2lZwpVxrPUrD6EX70h0BF_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13320009601877482918', time=2024-09-14T13:38:03.553541+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DxNnSGG65y21Q6nQJhWpWsmyOitqDk6_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8441705805807578646', time=2024-09-14T13:38:03.565327+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wQLY3dZN0rJibYCXMm7VASn78mnzXA6_0 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2372665929329899613', time=2024-09-14T13:38:04.535267+0000, chain.objs.size()=1 2024-09-14T11:58:36.920 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dJARZbGt2l6Ef1mG-UDKnRLvYWQGneZ_0 2024-09-14T11:58:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12419782636793361387', time=2024-09-14T13:38:04.536016+0000, chain.objs.size()=1 2024-09-14T11:58:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.O5isdb4f_JYG-IRWVEhra7TIbuzsnyF_0 2024-09-14T11:58:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.924+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5124127071272156865', time=2024-09-14T13:38:04.536626+0000, chain.objs.size()=1 2024-09-14T11:58:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.924+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.C-l9pe94MOD9mGWqrKVzfoLctLf_VqG_0 2024-09-14T11:58:36.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.924+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13660377009733931469', time=2024-09-14T13:38:04.713129+0000, chain.objs.size()=1 2024-09-14T11:58:36.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.924+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Q2GwBeiZIq1bfVUFlIcHXY5EjuKRueF_0 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2885104295651517841', time=2024-09-14T13:38:04.853739+0000, chain.objs.size()=1 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oFB8utJiTSZyKxQSQCI1-Q5ulDAftYl_0 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15332099568556855739', time=2024-09-14T13:38:05.148473+0000, chain.objs.size()=1 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ccEM-K0BmHuU2RpS6-kGYTbXA9SEMgj_0 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10427872813477090425', time=2024-09-14T13:38:05.741978+0000, chain.objs.size()=1 2024-09-14T11:58:36.924 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VuOTwDJEb_-0k5l95KfikThboA8pXdT_0 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5674086009308276188', time=2024-09-14T13:38:06.493731+0000, chain.objs.size()=1 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.926+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zUAQVzplwa0IyQTiVqPPZA5MYjbNV9V_0 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3422849786573057595', time=2024-09-14T13:38:06.715905+0000, chain.objs.size()=1 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iOKApAkeLT-4JRJF6PdymHmBm37OsO5_0 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9873929710192787591', time=2024-09-14T13:38:06.800038+0000, chain.objs.size()=1 2024-09-14T11:58:36.925 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.L0Ntw5DQdcNAxgpVzCz9vGHttdewm74_0 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8535216810353793134', time=2024-09-14T13:38:07.096354+0000, chain.objs.size()=1 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dxhFg4megb2r0ulSAqYsd1QGxehU7Qo_0 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13098355205167496484', time=2024-09-14T13:38:07.179623+0000, chain.objs.size()=1 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.X0M_NrONUStM8AxgYixooYIvbBkuAfj_0 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8625278171104611235', time=2024-09-14T13:38:07.213878+0000, chain.objs.size()=1 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.927+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VMd25vwa8aTya9ZMRSH39ay10ZHMvxl_0 2024-09-14T11:58:36.926 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.929+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.852464873513639394', time=2024-09-14T13:38:08.461055+0000, chain.objs.size()=1 2024-09-14T11:58:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.929+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Wyr--RGhQkCsxJeDh3VhnDji2_n9JDy_0 2024-09-14T11:58:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.929+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13026446319999423646', time=2024-09-14T13:38:08.624008+0000, chain.objs.size()=1 2024-09-14T11:58:36.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.929+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.chqqc2G56hpKMM9OPCWTEu8yVE4Jq3d_0 2024-09-14T11:58:36.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5459414384269176097', time=2024-09-14T13:38:08.686999+0000, chain.objs.size()=1 2024-09-14T11:58:36.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Jqi9h6A0QoJT-QueRtqwBq5IfY1RdKl_0 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.559317077138240650', time=2024-09-14T13:38:09.083848+0000, chain.objs.size()=1 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ECJDmM0haffaq74ZSXhK2CW1JW8pCfL_0 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4454754369069222929', time=2024-09-14T13:38:09.443713+0000, chain.objs.size()=1 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.a1WmlO6u7MTyrJnNXE2mHGbBYCtYc76_0 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2462712828812667212', time=2024-09-14T13:38:09.630894+0000, chain.objs.size()=1 2024-09-14T11:58:36.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xEKpJdvAptgB3BPzbt_dAOWHjL00JWq_0 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11775654298489593247', time=2024-09-14T13:38:09.642075+0000, chain.objs.size()=1 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.V2abmjXIYQIRN4CSCVOOw2_0V9rMhAy_0 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3454165982515903057', time=2024-09-14T13:38:09.716167+0000, chain.objs.size()=1 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-htvtd-Mns1JjqvL1rI6tmzzviFUPet_0 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16056048187993036997', time=2024-09-14T13:38:10.137007+0000, chain.objs.size()=1 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8w1oHu6ylnwBqZMCdqLuZQzAGnFGKoQ_0 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14766224042214770175', time=2024-09-14T13:38:25.302884+0000, chain.objs.size()=1 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.284__shadow_.0Uim7bSYRFed_VyJuSSjrSm7n5I_xj5_0 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10235532725672531123', time=2024-09-14T13:38:25.310746+0000, chain.objs.size()=1 2024-09-14T11:58:36.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.284__shadow_.aJYGbMxphJQWUUstPOBnvkvBjrMzg7B_0 2024-09-14T11:58:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.934+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13485312897349675515', time=2024-09-14T13:38:56.979035+0000, chain.objs.size()=1 2024-09-14T11:58:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.934+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.322__shadow_.xj6Je22x-K01ARjIdjd5lzGxtcrzMmS_0 2024-09-14T11:58:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.934+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2008220445742872714', time=2024-09-14T13:39:38.526237+0000, chain.objs.size()=1 2024-09-14T11:58:36.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.934+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.A0fe-DcnFqPmyx10Nk3OOpfpbvDwna1_0 2024-09-14T11:58:36.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.936+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13962972882530439987', time=2024-09-14T13:39:38.664775+0000, chain.objs.size()=1 2024-09-14T11:58:36.934 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.936+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cOx2KMM6gM1gic8PlZo2yPStUsk6dQd_0 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14675274711501590686', time=2024-09-14T13:39:38.897620+0000, chain.objs.size()=1 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8YXe7qIPAsaQb7STwjRq8YU9eGt4of__0 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2998301842729178978', time=2024-09-14T13:39:39.205177+0000, chain.objs.size()=1 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ex-4Dh6B0bp1fAL8rbsiFZQHK4Np1mb_0 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13939240678927837719', time=2024-09-14T13:39:39.321544+0000, chain.objs.size()=1 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.o77i9u8RLZMl_HL86A97ezD-7oB8wYL_0 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1221276704414468402', time=2024-09-14T13:39:40.313793+0000, chain.objs.size()=1 2024-09-14T11:58:36.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Yx6ZJLwZN2yV7qYRT3K3K-VfeMuJhnp_0 2024-09-14T11:58:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.938+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10862795057129992686', time=2024-09-14T13:39:40.859786+0000, chain.objs.size()=1 2024-09-14T11:58:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.938+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hkW8xkWbqg9AsG6pw0_5vgvVJaiJhe7_0 2024-09-14T11:58:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.938+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3371052260328560219', time=2024-09-14T13:39:40.975632+0000, chain.objs.size()=1 2024-09-14T11:58:36.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.938+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.34yCoXriHZDOQX5Fx3o2g64FNtZARHf_0 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7710842325107336264', time=2024-09-14T13:39:42.342582+0000, chain.objs.size()=1 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bamqonien-u2llVR_ec7WncqYf_dLFD_0 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1382877326850373081', time=2024-09-14T13:39:42.442387+0000, chain.objs.size()=1 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9BpoWeWPF1CHUEvLQZejO3Lntn_u9DA_0 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14673733626521408896', time=2024-09-14T13:39:42.528577+0000, chain.objs.size()=1 2024-09-14T11:58:36.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.939+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WbOvEgrNcbW40bs0rKLs0bcn-CzVnuc_0 2024-09-14T11:58:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6509284096556050621', time=2024-09-14T13:39:42.836983+0000, chain.objs.size()=1 2024-09-14T11:58:36.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wLcgAhKQA1u5TP_xvQYLaGTxeD5iNL1_0 2024-09-14T11:58:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.941+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2993379520433047469', time=2024-09-14T13:39:42.974810+0000, chain.objs.size()=1 2024-09-14T11:58:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.941+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4wsfH2Dita1xbu7ws6t0U9iQoqvLw4U_0 2024-09-14T11:58:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.941+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7842292341831335703', time=2024-09-14T13:39:44.018729+0000, chain.objs.size()=1 2024-09-14T11:58:36.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.941+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2LLxiZ-19p0e0yeV2gbTkW2lnHrqs6d_0 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8504509926862011427', time=2024-09-14T13:39:45.273295+0000, chain.objs.size()=1 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.akn1vHuOhlHP0RRKVxqsTn0MDknx9Fc_0 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6362756994550722572', time=2024-09-14T13:39:46.012541+0000, chain.objs.size()=1 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.m7a1IeI7RWSrSFtk2dhr3rBpWOj9C_y_0 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3688949445371196435', time=2024-09-14T13:39:46.244901+0000, chain.objs.size()=1 2024-09-14T11:58:36.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Noxgwf6v8ea4QuQANo7vLUuH9rcf5He_0 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7053920136889023086', time=2024-09-14T13:39:47.383212+0000, chain.objs.size()=1 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tkB3H6mI5PvIQ3xH4lybs23i1phd-Y3_0 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18130946761855272109', time=2024-09-14T13:39:47.413639+0000, chain.objs.size()=1 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YFbTs1agUDpuUdL_WzknRkPm8pq38tt_0 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2400788416286353128', time=2024-09-14T13:39:47.571141+0000, chain.objs.size()=1 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xSFBLKqrt0-jX17hD5PY_Hisap3PJn4_0 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10021459709942237035', time=2024-09-14T13:39:48.042200+0000, chain.objs.size()=1 2024-09-14T11:58:36.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DLKSrBSYiyP5Yqumli_c8mwd0RrRAet_0 2024-09-14T11:58:36.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.945+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10005955944238386408', time=2024-09-14T13:39:49.024465+0000, chain.objs.size()=1 2024-09-14T11:58:36.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.945+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JYyESVNu7rIThuNem2nHYWUPUJ0nL_A_0 2024-09-14T11:58:36.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.945+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6375920852350851763', time=2024-09-14T13:39:49.347842+0000, chain.objs.size()=1 2024-09-14T11:58:36.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.945+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zv6puadm9eLscIZMuRjEFx3Pc5NU41T_0 2024-09-14T11:58:36.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.947+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13012793227236060195', time=2024-09-14T13:39:49.593959+0000, chain.objs.size()=1 2024-09-14T11:58:36.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.947+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FnyBIhiHJByms7fkFbLBopphEE0Uyop_0 2024-09-14T11:58:36.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.947+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8613719144688110686', time=2024-09-14T13:39:50.666488+0000, chain.objs.size()=1 2024-09-14T11:58:36.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.947+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rHm4oIocZx0JIATizKvau2wRQc1kThR_0 2024-09-14T11:58:36.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1463837408880786344', time=2024-09-14T13:39:50.712070+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.skfw_DBVMbxRnbQbWUCTuuyb9ZsKRvg_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10871961918366748497', time=2024-09-14T13:40:30.741911+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UHlyUir1x_8RgvWXKuBNOZoyTKHsmcn_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12962193170866727826', time=2024-09-14T13:40:31.152103+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KBh8CeJt6JOwgAiRCgIvrqn0t9Kxhpx_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10974666185520271172', time=2024-09-14T13:40:31.197604+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mGNJxhfmy_ydXS3omjjFKbGS1vPuZMT_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15335336970587464424', time=2024-09-14T13:40:31.233754+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1I0y51zC8DFaGTlIxzCrjQRJQer_Ntb_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.810061025356260042', time=2024-09-14T13:40:31.339022+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5SWvA0Fm93rB32Wwyj2bFCLJQlMEwrs_0 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14653351946683294347', time=2024-09-14T13:40:31.536162+0000, chain.objs.size()=1 2024-09-14T11:58:36.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fBzc75-Tjrk-8ufN28g7Isixz6RHgOY_0 2024-09-14T11:58:36.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10529245282454612490', time=2024-09-14T13:40:31.984008+0000, chain.objs.size()=1 2024-09-14T11:58:36.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.K-uMMyD6mS3dbevqYrsvvConRmRykGW_0 2024-09-14T11:58:36.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2573578465278277079', time=2024-09-14T13:40:32.588528+0000, chain.objs.size()=1 2024-09-14T11:58:36.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6MyC2O7Yh7wsnnujglQlfIWQRLxfQRG_0 2024-09-14T11:58:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6805592040780761828', time=2024-09-14T13:40:33.667402+0000, chain.objs.size()=1 2024-09-14T11:58:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dlD_93hN9MnqfmVbYIu4ADLm2L63n_j_0 2024-09-14T11:58:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7155723089512369431', time=2024-09-14T13:40:33.725412+0000, chain.objs.size()=1 2024-09-14T11:58:36.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IIIE01994MdeYJxoG2KH0_w-8dDpSfp_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12484498374703637031', time=2024-09-14T13:40:35.405903+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AqmSJIaY1mWfkn49xdkDiDx0weyOxyN_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16955883393159502744', time=2024-09-14T13:40:35.880891+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GBciW6x0AxJs4CT42QUooFoDBhBad-H_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11386250863138850775', time=2024-09-14T13:40:36.048531+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JQxWxW4euoQ7zeFWpF3mQdagEjzlzOh_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11289234566618001311', time=2024-09-14T13:40:36.089819+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JttLd_Ck04Y3XSE_UJvPmBcN4O6PvHl_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7693736657210474887', time=2024-09-14T13:40:36.424401+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vuSp97qo3ehLVx71Mp8Sox8BW3O_ddS_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1397288478683694138', time=2024-09-14T13:40:37.022889+0000, chain.objs.size()=1 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UlA2MR7mGW5iISygu5pA4DRe1mQ2n5t_0 2024-09-14T11:58:36.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11816161985351889977', time=2024-09-14T13:40:37.519481+0000, chain.objs.size()=1 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8o2KHAiDUOVnACE5VOQKK3AiE7Jqd11_0 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10155275335855396220', time=2024-09-14T13:40:38.495822+0000, chain.objs.size()=1 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yehpdc3xxNpP3eM6vSn7HWZTHGa5xwJ_0 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11071026543060204539', time=2024-09-14T13:40:39.406939+0000, chain.objs.size()=1 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VZmiMKoWp_IIZjOAnh1Vx1JzUC819t3_0 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1071078787542089496', time=2024-09-14T13:40:41.357464+0000, chain.objs.size()=1 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hoxbVEaA4qoz_z11NhG_RMjDmhKNICr_0 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8632152700162664566', time=2024-09-14T13:40:41.451750+0000, chain.objs.size()=1 2024-09-14T11:58:36.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zudjJkgz2_6NdUwFHGzgFAUrMfoTWre_0 2024-09-14T11:58:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15094446151735997853', time=2024-09-14T13:40:41.693362+0000, chain.objs.size()=1 2024-09-14T11:58:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.t0eXZvoaob4RPraqdwOFkBiEavnW7V4_0 2024-09-14T11:58:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3032195449388362217', time=2024-09-14T13:40:41.907003+0000, chain.objs.size()=1 2024-09-14T11:58:36.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.egdsFuiPbGLaqwf3itUkHsjnIaOt0NP_0 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4511856771193065587', time=2024-09-14T13:40:42.401602+0000, chain.objs.size()=1 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.961+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fuA_omxp3ppIQkX3Fh19sfpoXl4ucq1_0 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.962+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.468662005527149839', time=2024-09-14T13:40:42.520394+0000, chain.objs.size()=1 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.962+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VQxQgBwoK-lkrVAPVIrqlvCSDnJiqlg_0 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.962+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16143425669250041681', time=2024-09-14T13:40:42.652839+0000, chain.objs.size()=1 2024-09-14T11:58:36.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.962+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9To6pSzJOZ1qaalxFmmoYsfFDzsJmqJ_0 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9699627030601700906', time=2024-09-14T13:40:42.747356+0000, chain.objs.size()=1 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nzWNIX5NnRZXpsVuzSPTLPc-Fa0i9Ij_0 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3480445555451006085', time=2024-09-14T13:40:42.872787+0000, chain.objs.size()=1 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JRRw1i-1REKJtIgrwPrt3rMh_6kl1-s_0 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8824150742685055034', time=2024-09-14T13:40:43.147003+0000, chain.objs.size()=1 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ohuaNLSAEHcV1xEjNvhPmYay4jWY1gj_0 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6994665909246133638', time=2024-09-14T13:41:55.089777+0000, chain.objs.size()=1 2024-09-14T11:58:36.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.438__shadow_.FhC_005HpVJ5SByjLjW0rZkpit_EaPD_0 2024-09-14T11:58:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3031683710767880970', time=2024-09-14T13:42:11.364733+0000, chain.objs.size()=1 2024-09-14T11:58:36.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.460__shadow_.fLYwngn-wWkBuHlwhjweXpcPGTI_IMX_0 2024-09-14T11:58:36.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/53922 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13771724549596229054', time=2024-09-14T13:42:35.999601+0000, chain.objs.size()=1 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.492__shadow_.rdhkWTgbkyf0odLQOHuX4G43MJ1fnHY_0 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4247629807952576244', time=2024-09-14T13:42:54.025145+0000, chain.objs.size()=6 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm', time=2024-09-14T13:44:05.164072+0000, chain.objs.size()=1 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.3 2024-09-14T11:58:36.970 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~3knrkzHVrZPrEydIDJ4dQmhF0L1mdXp', time=2024-09-14T13:45:05.782226+0000, chain.objs.size()=2 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__multipart_mymultipart2.2~3knrkzHVrZPrEydIDJ4dQmhF0L1mdXp.1 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__shadow_mymultipart2.2~3knrkzHVrZPrEydIDJ4dQmhF0L1mdXp.1_1 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5793671051668720721', time=2024-09-14T13:46:36.142227+0000, chain.objs.size()=1 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:Mek1MVT2TyVMBM1kHzqB-iMO6WAHnwS_.WrYS3IlX8e-YDfvp2gkZs7gYEFihyGW_0 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7168247219812519028', time=2024-09-14T13:47:13.262308+0000, chain.objs.size()=1 2024-09-14T11:58:36.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.971+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:sVTETaAOX8uvFdNLGB7fbsZfAtQ.hIc_.s-uP6Qs-bQVLS34er-gK9PQdQH319vQ_0 2024-09-14T11:58:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.974+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5705660957580720426', time=2024-09-14T13:47:40.543164+0000, chain.objs.size()=1 2024-09-14T11:58:36.972 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.974+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:Et.nXLcE96oIftYMwWqhMTi5dTZIcsu_.1Wy4Rd9aMNOVW1GEwazDrOqwxeBMT26_0 2024-09-14T11:58:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.965654846357202800', time=2024-09-14T13:52:37.370537+0000, chain.objs.size()=1 2024-09-14T11:58:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.671__shadow_.C_QN6GLjooVs8w7N7Bntuaki_HohoYE_0 2024-09-14T11:58:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9699661384166447547', time=2024-09-14T13:52:53.128124+0000, chain.objs.size()=1 2024-09-14T11:58:36.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.697__shadow:owccjetuWQoRVaw9CZyxWakYcViFgSv_.KG-4Wivlxf94H7bLiIvYTYJtREts4nt_0 2024-09-14T11:58:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17141494256081676407', time=2024-09-14T13:52:54.556262+0000, chain.objs.size()=1 2024-09-14T11:58:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.699__shadow:nd5Pq473c6.9ShKQawmc4ckXYGcE4ft_.D75kWt-uFcRseQaX_Juiu9AAkwf09hu_0 2024-09-14T11:58:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11922986000194696318', time=2024-09-14T13:55:25.744277+0000, chain.objs.size()=1 2024-09-14T11:58:36.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.976+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.762__shadow_.E53FuxA1fJKXoUiJJp9jfokT-0TJJTg_0 2024-09-14T11:58:36.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:36.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.982+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:58:36.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.983+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:36.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.983+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:36.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48719' 2024-09-14T11:58:36.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_Vn51_OC4Bzw6NFtDpU6oxHYJCb6uYQE', time=2024-09-14T13:34:35.376515+0000, chain.objs.size()=3 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.b2T0BRiwV4LSkuaEhYBIBKEr06H7PkT_0 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.b2T0BRiwV4LSkuaEhYBIBKEr06H7PkT_1 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.b2T0BRiwV4LSkuaEhYBIBKEr06H7PkT_2 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1375675954665857703', time=2024-09-14T13:34:37.042923+0000, chain.objs.size()=3 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-STANDARD.2~HYQqFc0P8oVERlHZQ7XwcebQzSoBtpp.1 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-STANDARD.2~HYQqFc0P8oVERlHZQ7XwcebQzSoBtpp.2 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-STANDARD.2~HYQqFc0P8oVERlHZQ7XwcebQzSoBtpp.3 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15430367840661884609', time=2024-09-14T13:37:01.296701+0000, chain.objs.size()=1 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.239__shadow_.htmgxoRjrru_xhsiAxrjpsDEKRg3O-V_0 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16460490083681960421', time=2024-09-14T13:37:06.078561+0000, chain.objs.size()=1 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.245__shadow_.z9aQmFAHOLq_-H7Kv6f8W4AfDshk4qa_0 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17829555112822870090', time=2024-09-14T13:37:10.496632+0000, chain.objs.size()=1 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.251__shadow_.ESkFQ4yk6OeJubVJJz52RBrA70z-5fJ_0 2024-09-14T11:58:36.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4714650079448313090', time=2024-09-14T13:37:11.969950+0000, chain.objs.size()=1 2024-09-14T11:58:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.253__shadow_.JeLHJSbRJ7_8AJEY2u8L3S7w_Fa3yzw_0 2024-09-14T11:58:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12608874396085007140', time=2024-09-14T13:37:16.254118+0000, chain.objs.size()=1 2024-09-14T11:58:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.259__shadow_.ORmkpzpyHbwlZf58W-8dPTe0pXqfiuF_0 2024-09-14T11:58:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.227941528559115681', time=2024-09-14T13:37:58.873199+0000, chain.objs.size()=1 2024-09-14T11:58:36.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cIHheaQUgLYSxc7RH6jMCvqcnSx3xJu_0 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17849159949404581448', time=2024-09-14T13:37:58.913352+0000, chain.objs.size()=1 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.S9LtvHrk_DBGteP1aToYB95VgH9YGif_0 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17195006812695548120', time=2024-09-14T13:37:59.519859+0000, chain.objs.size()=1 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rg0HfmAbzCtAxjrACIpDbjJ_WC5YmPI_0 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16508731918263691364', time=2024-09-14T13:38:01.224712+0000, chain.objs.size()=1 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kcaJdq294PS89T_3f3R4LkzlfLJsqvU_0 2024-09-14T11:58:36.987 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1349123279803128953', time=2024-09-14T13:38:01.267564+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TixmnrYpUB2AwbbpVEmdmmHdPiGF4QE_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5077935902053133694', time=2024-09-14T13:38:01.497105+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0-jn4xN6dX3rJVncAHfONL9WRDdQYpv_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2492052768136017705', time=2024-09-14T13:38:02.192838+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.u79Q6-httPYZ_VjJ-3GOCW5TJcFIcBi_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13731644857426748383', time=2024-09-14T13:38:02.866810+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ndkLWYwru0vvdNUNxiURflu-VOIhvrv_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1658551620713801537', time=2024-09-14T13:38:02.947334+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fVpomgy_3nBkZ3MzDM3YgXa859pSNyN_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2501808192674443579', time=2024-09-14T13:38:03.868266+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MZN_FFwiM9_PGIWeTDiCRT6LqFvVA0X_0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16186211345135498498', time=2024-09-14T13:38:03.869020+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.c7WAsBaxRj85J1EKp38X_EZN5yvmIQ__0 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18206343561424297441', time=2024-09-14T13:38:04.045266+0000, chain.objs.size()=1 2024-09-14T11:58:36.988 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.989+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gGqgmvAINRVy5gaCZdoXtCfb-yhBE2h_0 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17733551931853297395', time=2024-09-14T13:38:04.083617+0000, chain.objs.size()=1 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OAbOW6S8-dU1Su_HCsqnb-32Eg9_QUZ_0 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12522095133291709207', time=2024-09-14T13:38:04.511941+0000, chain.objs.size()=1 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UAdu6Nzri7XJh_NPnAO0KSnDPLOOBvX_0 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2421378012823343037', time=2024-09-14T13:38:04.696282+0000, chain.objs.size()=1 2024-09-14T11:58:36.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cxJZ9lpQCHmT1-r3sNQwmPAxVhBjpew_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12793258679763358575', time=2024-09-14T13:38:05.719722+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3RxlF3D3_DXyR0yEGZeQc9FztsUdZCu_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7231592820221206653', time=2024-09-14T13:38:05.744106+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.68UVPjb5eO-LjyuH_wu0fZmL2FaWRfy_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12117545725140106791', time=2024-09-14T13:38:05.767743+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WnhF6MjfCesF7KG4TGozGnx-BLTX3iU_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6990456202762873802', time=2024-09-14T13:38:06.137885+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Mccl-v3mWuR58_bZumoVPuHW6_sSWaR_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3829119473585141480', time=2024-09-14T13:38:06.165945+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qsMeYiZ3-qofUe53y6Z6P5sjzwsNLAp_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7678074906340781603', time=2024-09-14T13:38:06.199197+0000, chain.objs.size()=1 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Fugwlj14z3tA8z0yd9KgZLYmVAAoy47_0 2024-09-14T11:58:36.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11829109025063766123', time=2024-09-14T13:38:06.692428+0000, chain.objs.size()=1 2024-09-14T11:58:36.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.993+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3wN9ErnpkxTvUlz4oa0i6D7EN1KgkbI_0 2024-09-14T11:58:36.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3710296879785580485', time=2024-09-14T13:38:06.899091+0000, chain.objs.size()=1 2024-09-14T11:58:36.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QQdwLBu_H69GPBcn2Kjr9xns7H9cZoX_0 2024-09-14T11:58:36.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.997+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5017962444295977333', time=2024-09-14T13:38:06.940930+0000, chain.objs.size()=1 2024-09-14T11:58:36.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:36.997+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vwNimQJ4tELsmTedL_1FWVzpZ_doDB7_0 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1947251823390743017', time=2024-09-14T13:38:07.020921+0000, chain.objs.size()=1 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Snymqi7FbSiddcD3MYGwuWciX1k0dim_0 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3237902155543338417', time=2024-09-14T13:38:07.723138+0000, chain.objs.size()=1 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gXMiVzT6J2vETwnn_LqlGc8e21Javth_0 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9130533298735539217', time=2024-09-14T13:38:07.968213+0000, chain.objs.size()=1 2024-09-14T11:58:36.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vCveOAr-YUgrtUd008e67RUp3a3OqmZ_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5959797456147092747', time=2024-09-14T13:38:08.110443+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AG94I9vyaz86LuqahnlUYFm3nfFeiHa_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10210424171849530307', time=2024-09-14T13:38:08.411417+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HuCzI60RRfUSzB9Rn1teHf9oiVfynhf_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16274438407636783548', time=2024-09-14T13:38:08.468134+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.R_Wq1kjjoOizGUuLJlv9HJHiSURLLch_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5679344217855294133', time=2024-09-14T13:38:21.669749+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.279__shadow_.PUnCaQjjZ_8mS3vb7G9XoljVemOC58Q_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3906628962624974936', time=2024-09-14T13:38:35.556071+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.bdDqfWcIghItPis_kpbyf5lhEmr6lwJ_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17246616071870315086', time=2024-09-14T13:38:36.453369+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.295__shadow_.Zt34pXxmSpk_ZZIBbrKoIAqQoiU9lka_0 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17573474428408784708', time=2024-09-14T13:39:38.819728+0000, chain.objs.size()=1 2024-09-14T11:58:36.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GtBkXj2C-7YpWdSEkA-cAgEyk6ZFu4P_0 2024-09-14T11:58:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.003+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13918764060242196493', time=2024-09-14T13:39:38.958500+0000, chain.objs.size()=1 2024-09-14T11:58:37.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.003+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._zKbDJFQuKccK7dHsHOR9J6rVKtskSw_0 2024-09-14T11:58:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5830886412028822838', time=2024-09-14T13:39:39.241170+0000, chain.objs.size()=1 2024-09-14T11:58:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Z7u7lcvtszqck9012QtxC-NuN4jByp1_0 2024-09-14T11:58:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16085762887620457326', time=2024-09-14T13:39:39.707844+0000, chain.objs.size()=1 2024-09-14T11:58:37.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ljYmyQle3UAfX5_l03P0wmicgnwc8HZ_0 2024-09-14T11:58:37.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.912185271964897882', time=2024-09-14T13:39:40.426630+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mD8waLvOenvfj1f5tJOJMfbtHZlt6jr_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10422863873897687614', time=2024-09-14T13:39:40.856408+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sG394gBKBQjFOkowEbV152B9Rurkclw_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13288447283055202773', time=2024-09-14T13:39:40.949515+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yoCU_2n_up2cGE4V1Lwknq5-zLVnlMc_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15925736071629136798', time=2024-09-14T13:39:41.186049+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KkPId6F9buTxFgtZ094d4gNhzuQ7R_M_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3420691802022711601', time=2024-09-14T13:39:42.033259+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FA0s949IJ-NySx5so6d_SbS91v6_y8x_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.223487288346756382', time=2024-09-14T13:39:42.034001+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Sn6TTILij_fZYcgS1ItPvPUiplRqe7R_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.006+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7554583068878491049', time=2024-09-14T13:39:42.848198+0000, chain.objs.size()=1 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.007+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.trXJAs3cS74490iFT8hr2KG6AMpoma9_0 2024-09-14T11:58:37.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.007+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15315264721942138998', time=2024-09-14T13:39:42.977265+0000, chain.objs.size()=1 2024-09-14T11:58:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.007+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Fgokp_yLRDwmG5Wubg6RNQFj-VQQdOe_0 2024-09-14T11:58:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.007+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3276609936375840085', time=2024-09-14T13:39:44.138930+0000, chain.objs.size()=1 2024-09-14T11:58:37.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.007+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KJujVde6k_fF9HgSo1vsSq7zwOYcJDF_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15714511199849806550', time=2024-09-14T13:39:44.192178+0000, chain.objs.size()=1 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YZc6QJT96G2qD3ZM3lmLflYNwQf73Z6_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2313445344429106863', time=2024-09-14T13:39:44.570345+0000, chain.objs.size()=1 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SaitCw3WiigSB2Uj9X2V1rm7_ePup4c_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12237407335493908188', time=2024-09-14T13:39:45.461581+0000, chain.objs.size()=1 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xywv2q5TxVqD68lsI-tRMGZ2JflWoPc_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2981696531700381142', time=2024-09-14T13:39:45.738235+0000, chain.objs.size()=1 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rWJxCfiO1zJhdqZKG1fwPBTwksTNBZN_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3890221146475354051', time=2024-09-14T13:39:45.945313+0000, chain.objs.size()=1 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.012+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7IOxud1pjrRfFHtHsGfTicXPPjBXoFs_0 2024-09-14T11:58:37.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3600569321922624263', time=2024-09-14T13:39:46.312053+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YksCd3Qazyq8W7V9qirs-epPcLqX714_0 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10255419522621236828', time=2024-09-14T13:39:47.038422+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ybEN6qOO9IKBpwn9m-Q_j_sKjgxezz7_0 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16749190211196386046', time=2024-09-14T13:39:47.428349+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wQX4JnH9w-PrN7_eYQ4XaDAzylsD_mp_0 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4898605483663661830', time=2024-09-14T13:39:47.635015+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hKl-cTmVfgpIoPfUNbUY3Fo_cFpwoao_0 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11305883519151005013', time=2024-09-14T13:39:48.070600+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xv9JT-YfVXou5BVWTAV4TuMqKkljwfT_0 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14527932212164209931', time=2024-09-14T13:39:48.406348+0000, chain.objs.size()=1 2024-09-14T11:58:37.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9xSNySysPFALASJr68J4MBL1NFDSpwG_0 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17796598709721433717', time=2024-09-14T13:39:49.256631+0000, chain.objs.size()=1 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HYJ55LcQyAwbChl1NxY3KI9aD4o8AN2_0 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4009575762037174878', time=2024-09-14T13:39:49.328326+0000, chain.objs.size()=1 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.eqKCRaj_wZmAdZpI4T8sjlA1EMz4imK_0 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11613484850428665222', time=2024-09-14T13:39:50.147668+0000, chain.objs.size()=1 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.f8JSoSlurnv0pkzy6DEyq6jaw1BLMso_0 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2029710240109820199', time=2024-09-14T13:39:50.300380+0000, chain.objs.size()=1 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.knZd3ZelEsCDkhIdYiEyqQ1iC2bdlbq_0 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8919498639661349797', time=2024-09-14T13:39:50.760903+0000, chain.objs.size()=1 2024-09-14T11:58:37.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jOIduvKzvMX1GUEdj9WmsniWPPCBgVh_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1456537395557963317', time=2024-09-14T13:40:30.825727+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-L3Pz1MdcvU_fONbz_LwQF9N3NraroN_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16533688654542150539', time=2024-09-14T13:40:30.963977+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.p9BUe64ZRJDnaXNPf-QvRzMP7aabM-0_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6328489881727717243', time=2024-09-14T13:40:31.155000+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sWdiR8Y-1GXufuCqPY2JStepk6CpdhD_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18190351153467337582', time=2024-09-14T13:40:31.542647+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.axH4cNxysZC4ggxzpcgXkhBmsGjpvaj_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11093118052021613065', time=2024-09-14T13:40:31.940329+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rYqgJ2nSLZMWbqBHzh8_Ac_H8r6NR8m_0 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2875307151621774730', time=2024-09-14T13:40:31.941220+0000, chain.objs.size()=1 2024-09-14T11:58:37.017 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.snmY69cK8Wj_cU_DAA8djQKCyuZtk2s_0 2024-09-14T11:58:37.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7948253752987131492', time=2024-09-14T13:40:32.751673+0000, chain.objs.size()=1 2024-09-14T11:58:37.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KQF5DbLPi6p7ewCPb64P2UOY8He9Kf5_0 2024-09-14T11:58:37.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2691264966913120260', time=2024-09-14T13:40:33.035169+0000, chain.objs.size()=1 2024-09-14T11:58:37.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bV5i-XitWOxeeAK3a7jDtVOzap41y0F_0 2024-09-14T11:58:37.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16044158910366838684', time=2024-09-14T13:40:33.070304+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.A79nELZ7hhFRc3IFJd_nmmRqs8MVLRU_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16843076899471865160', time=2024-09-14T13:40:33.421657+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1ixw9TLAMQIH95zXzovUCLKbjSSzkPw_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9745744323657640424', time=2024-09-14T13:40:33.544267+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fI8Z-2BqkFL_6y6DQH_O3jTck_qJb8f_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7930263263363572825', time=2024-09-14T13:40:34.388337+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5MLbfYaV5FixziuX-ULLzHVaV4mBmOB_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14641298280044919337', time=2024-09-14T13:40:34.725479+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2bddbX4mhB5AIskH19se8qAg9UxnElE_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8538454326201909022', time=2024-09-14T13:40:34.903504+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.90Z3i7qYNy07PFwaqRbBFtfbMk9nqsF_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.876448235884238630', time=2024-09-14T13:40:35.376650+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pz1jxyw66WhK1SUsw50q-BR8woYjaB0_0 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7240246617829684910', time=2024-09-14T13:40:36.108989+0000, chain.objs.size()=1 2024-09-14T11:58:37.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SF9fA14ZNDGwq8wl7AjJWGaUgc0VkYe_0 2024-09-14T11:58:37.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15498765742979122021', time=2024-09-14T13:40:36.773056+0000, chain.objs.size()=1 2024-09-14T11:58:37.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pINybGBpHcoan9NQEn37GIIMyXmt5DE_0 2024-09-14T11:58:37.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.029+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8634412925062077437', time=2024-09-14T13:40:37.697508+0000, chain.objs.size()=1 2024-09-14T11:58:37.027 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.029+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LMY65gb0ipk1C3WT0o-RHfQCu-eSSzb_0 2024-09-14T11:58:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.032+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11431073206979045904', time=2024-09-14T13:40:38.562748+0000, chain.objs.size()=1 2024-09-14T11:58:37.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.032+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yh53LXa6Yv0_X1VdJbN3sX8AQU6FT49_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.032+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2864189234683356711', time=2024-09-14T13:40:39.314285+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.032+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.aRaX_yua6BltycV1fLPUmcDFxIl4RZD_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17403202594283211589', time=2024-09-14T13:40:39.487735+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AayCPWpkG885kPkIUhKizqzKkv8oMoF_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6878968244288439100', time=2024-09-14T13:40:39.952068+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-15RY_vbFwpE6uY8ZLMj1sMczZpsfJy_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1532046268880646619', time=2024-09-14T13:40:41.272940+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HQ3ULneZSgI1X6Id-98meuw3AOwMGge_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2843408764011086450', time=2024-09-14T13:40:41.453726+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cA9Ze0SmtqBmIc0ThYLFbF0yglamKCO_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6167378176424979780', time=2024-09-14T13:40:41.574592+0000, chain.objs.size()=1 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xk96Uv1UnnBFRmcfTgpGimsywNb27mP_0 2024-09-14T11:58:37.034 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6967601098475339836', time=2024-09-14T13:40:42.423040+0000, chain.objs.size()=1 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tMX6JLsNvUDvSwiXjgWWhXptapzCuz-_0 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11693850137111077010', time=2024-09-14T13:40:42.423807+0000, chain.objs.size()=1 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IhqHDEh0R-rlpdcwtpXJXV9pX6dyQyy_0 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8531214610396805329', time=2024-09-14T13:40:42.500908+0000, chain.objs.size()=1 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vQ8Z1EOxIErYDLJtScGattTF42Eatxl_0 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.034+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11737374031309806166', time=2024-09-14T13:40:42.759085+0000, chain.objs.size()=1 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.034+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Wl7UpD6oWdrjieNrwmDfNpWDGfZ-Cb4_0 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6905077550502625570', time=2024-09-14T13:40:42.939413+0000, chain.objs.size()=1 2024-09-14T11:58:37.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jD29E-zfniAZ7pVCbE7Z-oR_X4gS1oc_0 2024-09-14T11:58:37.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6530852747139632266', time=2024-09-14T13:40:55.687186+0000, chain.objs.size()=1 2024-09-14T11:58:37.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.345__shadow_.WgsV_Y7InZ7k2ZIttBnG7Ka81zSgsS4_0 2024-09-14T11:58:37.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.043+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/48719 2024-09-14T11:58:37.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:58:37.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5829447981865312160', time=2024-09-14T13:41:09.686805+0000, chain.objs.size()=1 2024-09-14T11:58:37.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.371__shadow_.KKl7jNvLK8UBekLB69Ai_g7NAUa2tdl_0 2024-09-14T11:58:37.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.461251438880989566', time=2024-09-14T13:41:57.795188+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.442__shadow_.KEuP7yLHlsM_p13arD2BVArjUF2MVvF_0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4939669946525940123', time=2024-09-14T13:42:06.682717+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.455__shadow_.X4uwcIwHq4Qyd9Hvj_J5ZgfWGjUA9kw_0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9932759888101209947', time=2024-09-14T13:42:32.078834+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.487__shadow_.EnT9xWkXtigTAEg6ehc6gJJ1PNPX4Cs_0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9347733657098242547', time=2024-09-14T13:42:36.652828+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.494__shadow_.PFvcGjc1KOM_gqEPnlZGizycJhC_6k__0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16333814398555358096', time=2024-09-14T13:42:37.704686+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.496__shadow_.oPpt7kErGtOQUqYupnvNazm0SoWHSIG_0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17413116064117509610', time=2024-09-14T13:42:43.858423+0000, chain.objs.size()=1 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:37.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11904485251578468521', time=2024-09-14T13:43:04.599578+0000, chain.objs.size()=1 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.519__multipart_mymultipart.2~zS08yGYLjEAfzD2VQNSQcWqxDakvLwr.1 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4483158092685018130', time=2024-09-14T13:44:42.194235+0000, chain.objs.size()=4 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~9WGPbKbW3gMDFiJ4GIMPEgq6oh3LMp6.1 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__shadow_mymultipart.2~9WGPbKbW3gMDFiJ4GIMPEgq6oh3LMp6.1_1 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~9WGPbKbW3gMDFiJ4GIMPEgq6oh3LMp6.2 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__shadow_mymultipart.2~9WGPbKbW3gMDFiJ4GIMPEgq6oh3LMp6.2_1 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.049+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9435524688960016412', time=2024-09-14T13:44:57.024668+0000, chain.objs.size()=4 2024-09-14T11:58:37.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.049+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.528__multipart_mymultipart.2~N_MM7gWqokQ9AQrHC5s_WeDFgyutm2C.1 2024-09-14T11:58:37.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.049+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.528__multipart_mymultipart.2~N_MM7gWqokQ9AQrHC5s_WeDFgyutm2C.2 2024-09-14T11:58:37.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.049+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.528__multipart_mymultipart.2~N_MM7gWqokQ9AQrHC5s_WeDFgyutm2C.3 2024-09-14T11:58:37.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.528__multipart_mymultipart.2~N_MM7gWqokQ9AQrHC5s_WeDFgyutm2C.4 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7750234078391667491', time=2024-09-14T13:45:54.887786+0000, chain.objs.size()=1 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.554__shadow_.FXnNr47qryJ0VT0PbKzz-SwSBlhC8st_0 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8613124076607534874', time=2024-09-14T13:46:38.376451+0000, chain.objs.size()=1 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.571__shadow:UPwGJCWrUVnexw2H1Kuwtsb9gYz7WN4_.hGSLT9GO9bV9XRmRHuEOZ5h2cr-7pyD_0 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6086932654830643006', time=2024-09-14T13:46:42.694778+0000, chain.objs.size()=1 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow_.eqZRBh6dd2Lpar4YdlfQ9i--uESvYxf_0 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2514224563549345283', time=2024-09-14T13:47:02.879312+0000, chain.objs.size()=1 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:tmqImGdUroy0wAByf8djFFDUdSt0-Wi_.9CHIxX19YLVHGqt8SMTQ9qVgBFjgCmr_0 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15815901533883597122', time=2024-09-14T13:47:04.596082+0000, chain.objs.size()=1 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:.kwkFDH.hO09E6kr1k.iXZ4NlZ63SNn_.N7-bsWpymXF4P3lfrmFMGhkWPObYmgT_0 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq', time=2024-09-14T13:51:42.957788+0000, chain.objs.size()=12 2024-09-14T11:58:37.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.1 2024-09-14T11:58:37.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.051+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.1_1 2024-09-14T11:58:37.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.054+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.2 2024-09-14T11:58:37.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.054+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.2_1 2024-09-14T11:58:37.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.054+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.3 2024-09-14T11:58:37.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.054+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.3_1 2024-09-14T11:58:37.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.4 2024-09-14T11:58:37.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.4_1 2024-09-14T11:58:37.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.5 2024-09-14T11:58:37.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.057+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.5_1 2024-09-14T11:58:37.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.057+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__multipart_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.6 2024-09-14T11:58:37.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.057+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.626__shadow_multipart_enc.2~fa2XtKLkm7y6l9776bI3S_AxXbMIFLq.6_1 2024-09-14T11:58:37.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.057+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13411867196432321451', time=2024-09-14T13:51:47.685558+0000, chain.objs.size()=1 2024-09-14T11:58:37.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.057+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.633__shadow_.RZzAY_2rBgtwga2ZiBZcDQfl2RC4s8A_0 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15421339458844356856', time=2024-09-14T13:52:34.073600+0000, chain.objs.size()=1 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.666__shadow_.I9n9bC9pnDBs_AqixnUBrU6fdslmN7G_0 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14674249902810347332', time=2024-09-14T13:52:42.786086+0000, chain.objs.size()=1 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.680__shadow_.nIjr3rXHv65nfnHhapETtKLlJSdtbaG_0 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5364289552459935350', time=2024-09-14T13:53:04.697438+0000, chain.objs.size()=1 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.713__shadow:xC9I3GF7oegrtZliYjUfWLj1qPMbf8Z_.X27YmtbleZZvB0sG0L-lt9hYdf2kKB4_0 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8810861284025914426', time=2024-09-14T13:54:55.909919+0000, chain.objs.size()=1 2024-09-14T11:58:37.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.757__shadow_.rWPISS8jfqah7j8vBMO5EsAEwOSyn-V_0 2024-09-14T11:58:37.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.746907993460710186', time=2024-09-14T13:56:04.001009+0000, chain.objs.size()=1 2024-09-14T11:58:37.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.775__shadow_.Khs6tb6RHuoGkpFMBGfdhjS9lGV_aj6_0 2024-09-14T11:58:37.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3651423412563043361', time=2024-09-14T13:56:16.369550+0000, chain.objs.size()=1 2024-09-14T11:58:37.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.778__shadow_.R-fdUxi0M7eg--T2gHrfMmJzPcicq-6_0 2024-09-14T11:58:37.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.067+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.069+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:58:37.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.070+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.071+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.071+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46489' 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.071+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_akuynLhlxCEg-KDTk7lbnOW9l_zQ4Qd', time=2024-09-14T13:34:47.635172+0000, chain.objs.size()=1 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.071+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.166__shadow_.ZdD-OGG_BVkSc1mAKM7OxB2wtXaxnW7_0 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13309803099163871688', time=2024-09-14T13:36:56.988206+0000, chain.objs.size()=1 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.234__shadow_.eMo2FnS9Xq2n3G5xopQ0nTojNQAos4e_0 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5738742051000976144', time=2024-09-14T13:37:16.259594+0000, chain.objs.size()=1 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.259__shadow_.IblWFtok6nenr6d8qIaILzJUZ6LOMVA_0 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13346247184736228437', time=2024-09-14T13:37:57.889807+0000, chain.objs.size()=1 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-yU8stqHQthcPcqtT3B32DGdas0PM_B_0 2024-09-14T11:58:37.070 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5165371294954854429', time=2024-09-14T13:37:57.941340+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-OFD6aAeH79CYbicOafAE6kZVcVITUG_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7897606692127900665', time=2024-09-14T13:37:58.102040+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hzKT7BSLjW6oJpoc4EmZAl9FC7d7Df0_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3178781272646077098', time=2024-09-14T13:37:58.318878+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.X5HNGPrBBzinC-cHRrEisVrtJr5jMXo_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3938815113148881569', time=2024-09-14T13:37:58.955422+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.i2hetKFM6-PbsMKHfWRkuDmm4lL4rHn_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16685040240870471870', time=2024-09-14T13:37:59.821023+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aGGvkQI4-pUp4FEtC6a2LB2828N_L98_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15293266914868013027', time=2024-09-14T13:38:00.097164+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iuJ7rKcGR2D1jVvzZ_nVEWRqtl2ELPH_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13202602097059025750', time=2024-09-14T13:38:01.389039+0000, chain.objs.size()=1 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QtHwl3lxpokomkRD3BjIBaJZm00G2V6_0 2024-09-14T11:58:37.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9358492247818346441', time=2024-09-14T13:38:01.566931+0000, chain.objs.size()=1 2024-09-14T11:58:37.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qOnaEUO0TzXcb9BZvwm_rqjDUXooDa3_0 2024-09-14T11:58:37.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9542199199116268993', time=2024-09-14T13:38:01.840090+0000, chain.objs.size()=1 2024-09-14T11:58:37.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2wjJSdykydsggGKIHy2bNyQESD5bMtm_0 2024-09-14T11:58:37.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.075+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16499652765240436979', time=2024-09-14T13:38:02.065615+0000, chain.objs.size()=1 2024-09-14T11:58:37.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.075+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SZR_gz_iUCaFjjIm4dxDxdYjYquRKFw_0 2024-09-14T11:58:37.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14616349364963093182', time=2024-09-14T13:38:02.277738+0000, chain.objs.size()=1 2024-09-14T11:58:37.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.c3w0MoqNsLTEPgxNkXrUO31GhKYlfwz_0 2024-09-14T11:58:37.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6896600109926348579', time=2024-09-14T13:38:03.939142+0000, chain.objs.size()=1 2024-09-14T11:58:37.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YQ0Bt2tqdsXH5ErRXhVLxZ-XmmreR_3_0 2024-09-14T11:58:37.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10944510406479774655', time=2024-09-14T13:38:04.092938+0000, chain.objs.size()=1 2024-09-14T11:58:37.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.I_cl0ceKFxmeRZW-jhkFlzuhEaUY4HA_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16460153574655942615', time=2024-09-14T13:38:04.740561+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3myVzj7p177JhPpu6QtK4MSvYXD-87g_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14132939893999179315', time=2024-09-14T13:38:04.882850+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wBT8aOyvJqRnq9J10QhhrG6gOR80FTp_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2963769008937604888', time=2024-09-14T13:38:04.978561+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Tv79kXUrYa3XEG9ArhPrdCUc-cD0mur_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15842194852969082997', time=2024-09-14T13:38:05.157745+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CIXUs2LfZiBr5DDScamAMqnRuw3Ke_N_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14851186032142109635', time=2024-09-14T13:38:05.529421+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6X5GBHhBqAy6hvViKHM-Wotk0C2j-yz_0 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3327752670404663266', time=2024-09-14T13:38:05.556418+0000, chain.objs.size()=1 2024-09-14T11:58:37.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AeTDYdG5iThmKiK0GlLRQweaCBN_bwS_0 2024-09-14T11:58:37.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.081+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2018645486692599842', time=2024-09-14T13:38:06.361143+0000, chain.objs.size()=1 2024-09-14T11:58:37.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.081+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FTto1HJLpZC3MEzrQCpdEARq7gx9HfX_0 2024-09-14T11:58:37.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.081+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7159862336505766337', time=2024-09-14T13:38:06.910269+0000, chain.objs.size()=1 2024-09-14T11:58:37.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.081+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Bd3AnD67xA-h-_7JbOpvgGsJYOCVMHq_0 2024-09-14T11:58:37.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.083+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10498143243846942000', time=2024-09-14T13:38:06.933198+0000, chain.objs.size()=1 2024-09-14T11:58:37.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.083+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zfz0I3Aq4X9-ae6X3lySaPC9nR0TQ1J_0 2024-09-14T11:58:37.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.083+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1392930867401718027', time=2024-09-14T13:38:07.738538+0000, chain.objs.size()=1 2024-09-14T11:58:37.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.083+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.q-JyBdwmTqw9bVY-_nz_pqxAKF8Vb7Q_0 2024-09-14T11:58:37.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7345605217018288175', time=2024-09-14T13:38:08.336097+0000, chain.objs.size()=1 2024-09-14T11:58:37.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fyg1EICfPkf_Z-kOtCaSV6cqwmsN_H3_0 2024-09-14T11:58:37.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1100380383244851674', time=2024-09-14T13:38:09.082232+0000, chain.objs.size()=1 2024-09-14T11:58:37.082 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LxbvxjKD2nFU7OprOCeASOSKUmyINHl_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9200193224791575622', time=2024-09-14T13:38:09.443976+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XihP7Nr5LJPDmWVgt99AdoPk3TH8DtH_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7193993759512648861', time=2024-09-14T13:38:09.444815+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.084+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b0v8mDUMMAI-un-p-JNMoqCBDW11QAC_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3940101904010405011', time=2024-09-14T13:38:09.891188+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JTxgnVK9DKCl9HzK656VDEC20YHOcxZ_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3740523509161039184', time=2024-09-14T13:38:16.671394+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.272__shadow_.hJT1ofmViYjqGOLzytiB3Vqecn9C_C__0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7937607354133210483', time=2024-09-14T13:38:23.856878+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.282__shadow_.lakjsKhI-zmjwK8EuFL6_6g7s-OCVY-_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4231570159608915696', time=2024-09-14T13:38:29.859360+0000, chain.objs.size()=1 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.290__shadow_.wRDuRpGhr8WBNOLEDQOaaXdoz1bVWTB_0 2024-09-14T11:58:37.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6827335203693655612', time=2024-09-14T13:38:35.598359+0000, chain.objs.size()=1 2024-09-14T11:58:37.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.hvPTPz7Zrz44QIdvH0O2c0EP7Nd6G8c_0 2024-09-14T11:58:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.087+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7480869982679717149', time=2024-09-14T13:38:55.752193+0000, chain.objs.size()=1 2024-09-14T11:58:37.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.087+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.320__shadow:LhQZzzOLSf4Fg6ZkDJN8t71MeMbnDhL_.Uy9UO7sf_jsZk2lXKbny8q2Fn3CzN7Z_0 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10859878068609506572', time=2024-09-14T13:39:38.808133+0000, chain.objs.size()=1 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BekiPeSW4S8P0M3gYpNTLQBnVkFjlwq_0 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7331893503935059183', time=2024-09-14T13:39:38.953553+0000, chain.objs.size()=1 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.y4IdwEg8BcOunU66lZ8lmeQjBXNX9Gh_0 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8755922851536180273', time=2024-09-14T13:39:38.995431+0000, chain.objs.size()=1 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.e8tMzxTqZfmCyNjhz5WpLYvoc1F2MPj_0 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18163707497600417034', time=2024-09-14T13:39:39.055560+0000, chain.objs.size()=1 2024-09-14T11:58:37.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rRSRV3EFcvtxVTpGBJXyrRTVJGzeuUE_0 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4392447499597198651', time=2024-09-14T13:39:39.317407+0000, chain.objs.size()=1 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aF9O2RyVPDJ9i3HojCXcrGXIw8uSwCg_0 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2658238486576884785', time=2024-09-14T13:39:39.687791+0000, chain.objs.size()=1 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._id-H6CSvUWKmtXA4nDAh5UMRvaWS2W_0 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7139069305103346479', time=2024-09-14T13:39:40.304997+0000, chain.objs.size()=1 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GVfIoWPaQ1_Lz_3WvmtWsr-gS3PW7W-_0 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16409705840493775148', time=2024-09-14T13:39:40.945508+0000, chain.objs.size()=1 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kavbzEbLqP9I2LjVD-RO3nIgJ8O-rgh_0 2024-09-14T11:58:37.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3816499090167187970', time=2024-09-14T13:39:41.494866+0000, chain.objs.size()=1 2024-09-14T11:58:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.G03sW_clLeBcrX-mtXUoAOEIwg0Hjmu_0 2024-09-14T11:58:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2843433836078875225', time=2024-09-14T13:39:42.212474+0000, chain.objs.size()=1 2024-09-14T11:58:37.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0eBXTtQkWtP2Cqqg_tod-mpm-mkU6Ec_0 2024-09-14T11:58:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16827431063728029059', time=2024-09-14T13:39:42.698322+0000, chain.objs.size()=1 2024-09-14T11:58:37.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TBByZyPRjqhE6EN3ZTBz4Ht_89Kh4dL_0 2024-09-14T11:58:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.095+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14766108126582818594', time=2024-09-14T13:39:42.868378+0000, chain.objs.size()=1 2024-09-14T11:58:37.093 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.095+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fR8KHebRogX4Xa59hYleT5CzepM7JDp_0 2024-09-14T11:58:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.096+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17775311555644765377', time=2024-09-14T13:39:43.889205+0000, chain.objs.size()=1 2024-09-14T11:58:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.096+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Nq3s-83meJvAXt23iuWqmkvb-GyrdtL_0 2024-09-14T11:58:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.096+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4261929272582320871', time=2024-09-14T13:39:44.268668+0000, chain.objs.size()=1 2024-09-14T11:58:37.094 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.096+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cCIKD9h6GzjocMByLVzIRXqFvPExP9d_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10142668945550394458', time=2024-09-14T13:39:44.577094+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-Xl77xJFb71KBxcUE700kJKQaGh4S7w_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5757025176216297827', time=2024-09-14T13:39:44.794851+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BBZr7BGEWWnuEMJVnC5AAauDMGjO1SR_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9920907998457915170', time=2024-09-14T13:39:44.845458+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3tFM-2noQkoNLyRG_cVRf3a8CfgKs5X_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3692988008953338083', time=2024-09-14T13:39:45.615429+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ji4ZzZj0D7WLqQXo5XHcc59Ynz_BHR3_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16363084002943871933', time=2024-09-14T13:39:45.815631+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.l_0ZMoXo_prbrGPRI6-56_Evzp-nPY9_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2421159779532291465', time=2024-09-14T13:39:45.883786+0000, chain.objs.size()=1 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mb1ROsV5dfvOAqSUAAZDH9T0kk_6mFT_0 2024-09-14T11:58:37.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11343950170165731278', time=2024-09-14T13:39:47.402945+0000, chain.objs.size()=1 2024-09-14T11:58:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vJjHqLGXNM9S3JvWoNNIHg8HQN6rGOb_0 2024-09-14T11:58:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.097+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3501714320481295386', time=2024-09-14T13:39:47.857111+0000, chain.objs.size()=1 2024-09-14T11:58:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1aFZYBzmHKmtXoEc-qGIA1Ya5jPMeP5_0 2024-09-14T11:58:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5648233234908236898', time=2024-09-14T13:39:48.042062+0000, chain.objs.size()=1 2024-09-14T11:58:37.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._AKrG1xqm5av3eZULuJpQfxYnuDKmGH_0 2024-09-14T11:58:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15941275563150523533', time=2024-09-14T13:39:48.617394+0000, chain.objs.size()=1 2024-09-14T11:58:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.snzNDRjWX5NRKAJ5ACZLf37xUiBValC_0 2024-09-14T11:58:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6166868383439908951', time=2024-09-14T13:39:48.756923+0000, chain.objs.size()=1 2024-09-14T11:58:37.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.100+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.e9AM1AsqZ1-J2YwZkL-Viqb7rwDq_tK_0 2024-09-14T11:58:37.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.101+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18406718251589203345', time=2024-09-14T13:39:48.767608+0000, chain.objs.size()=1 2024-09-14T11:58:37.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.101+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.p7NY7fpeFOW4zT2d-WGlQ9wI20tMtSc_0 2024-09-14T11:58:37.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14643980203165820071', time=2024-09-14T13:40:30.787629+0000, chain.objs.size()=1 2024-09-14T11:58:37.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MjPVBtyBgRe7j_Ipbpy4VACsyhIFPbW_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16150523250590163116', time=2024-09-14T13:40:31.540113+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4198hW_Kp1hHP-q83Q_pqej8n3xyriX_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11180849417730783972', time=2024-09-14T13:40:31.989940+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DZo5IQOKtAAKhRAlD4gmqDU3It4hom8_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16108198943702062431', time=2024-09-14T13:40:32.568090+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2G043361bLTUwrBmGL-oa6B0i9lQJPq_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12539505761285433367', time=2024-09-14T13:40:32.820968+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3DqSS47wOXOWgQcbQHj0emMAUkDmOgI_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11368060780528172576', time=2024-09-14T13:40:32.913886+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.aYbtAsiCmMYrU7gGOJwykDE_jUYm2Ln_0 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3598246377124964268', time=2024-09-14T13:40:32.978121+0000, chain.objs.size()=1 2024-09-14T11:58:37.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.102+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.uq44OHVTeNnTcmwxhDL-xPcHQ36MEqg_0 2024-09-14T11:58:37.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.104+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17007716308063965107', time=2024-09-14T13:40:33.159578+0000, chain.objs.size()=1 2024-09-14T11:58:37.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.104+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6Epd1lc9oCgSR2rap5anQQU7AO9rjxV_0 2024-09-14T11:58:37.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3072812100423644167', time=2024-09-14T13:40:33.467903+0000, chain.objs.size()=1 2024-09-14T11:58:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hmsGlPCJLNNL-2GSw9MOzQRNkswV3tA_0 2024-09-14T11:58:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15813176742358653602', time=2024-09-14T13:40:33.513667+0000, chain.objs.size()=1 2024-09-14T11:58:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4LvwAvp8QmaxxlO-2fXTeyYoBxmoExT_0 2024-09-14T11:58:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15879245540846931815', time=2024-09-14T13:40:34.563311+0000, chain.objs.size()=1 2024-09-14T11:58:37.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.105+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.P_e46lM0dTDBYisrz3_6QtxG8M3V3qz_0 2024-09-14T11:58:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5205430996042618123', time=2024-09-14T13:40:34.893739+0000, chain.objs.size()=1 2024-09-14T11:58:37.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wqyOgkLzdyC9vItISrxDO9LrNF9QUop_0 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10023412378416756252', time=2024-09-14T13:40:34.951108+0000, chain.objs.size()=1 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.aMEVf_NKyrqM_wj59Yv5SEbvLg1FGG9_0 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1958342228700874459', time=2024-09-14T13:40:35.076139+0000, chain.objs.size()=1 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LpNcLHIcuXcl42Ax4j310eXpUPhDJSl_0 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16691454423141384697', time=2024-09-14T13:40:35.181613+0000, chain.objs.size()=1 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1ut_L87DQHGGY4XfdPyXbw4Oc8fp64x_0 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10332033426662085752', time=2024-09-14T13:40:35.891268+0000, chain.objs.size()=1 2024-09-14T11:58:37.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TacZ2_0lCpI_FwJ4sG8WlhcXvXR0Vu8_0 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13635696918758828660', time=2024-09-14T13:40:36.229022+0000, chain.objs.size()=1 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kWzcNKyM-mRhfbZMIxXa3bF44EpHuxY_0 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7924487904494948879', time=2024-09-14T13:40:36.301410+0000, chain.objs.size()=1 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mT3ygRyGjA7nVFiPMuRkVS7kY4cnMKX_0 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.109+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10609092392310184937', time=2024-09-14T13:40:36.521670+0000, chain.objs.size()=1 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.109+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._qJI-VpCTtRc-F11OhkmztpxL1Ho-ae_0 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.110+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9210461584108235064', time=2024-09-14T13:40:36.880985+0000, chain.objs.size()=1 2024-09-14T11:58:37.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.110+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3xARo-ThV0BJ187HWE-z-7ZMx-LiOPu_0 2024-09-14T11:58:37.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.110+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17611004507107791234', time=2024-09-14T13:40:37.514589+0000, chain.objs.size()=1 2024-09-14T11:58:37.108 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.110+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dRk7FI9I25mvOTFKDM3pff5aYwxKnzj_0 2024-09-14T11:58:37.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15311817433954739552', time=2024-09-14T13:40:37.530709+0000, chain.objs.size()=1 2024-09-14T11:58:37.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.w1RmItt8EZbMWUvE0WHa4g1PCEpw3X7_0 2024-09-14T11:58:37.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16498629680992074190', time=2024-09-14T13:40:37.860004+0000, chain.objs.size()=1 2024-09-14T11:58:37.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gzQxqbq9HacMjRibIdSlAzc-LK5i08v_0 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12810156244128805181', time=2024-09-14T13:40:38.064726+0000, chain.objs.size()=1 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wNSK-Tm7EXnQTW2vRkZOqep_MN7pn1g_0 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1920121228238572466', time=2024-09-14T13:40:38.220314+0000, chain.objs.size()=1 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.__C8nl3NOzUvkGWsR4fFNpy6pAapA3Z_0 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10932135982731221400', time=2024-09-14T13:40:38.254284+0000, chain.objs.size()=1 2024-09-14T11:58:37.111 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.113+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PMP3DkoTHiedfn5yOVkcxKcUNwRAO_J_0 2024-09-14T11:58:37.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16186162891082777459', time=2024-09-14T13:40:38.630312+0000, chain.objs.size()=1 2024-09-14T11:58:37.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.v-jmaNtG7MgpPynkIsZFN8SB7aeGmzB_0 2024-09-14T11:58:37.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14854166090603416712', time=2024-09-14T13:40:38.682587+0000, chain.objs.size()=1 2024-09-14T11:58:37.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lQgxWwkLS-m91cyVGlmXpGVckL5V_Pu_0 2024-09-14T11:58:37.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12387918692942421968', time=2024-09-14T13:40:39.105625+0000, chain.objs.size()=1 2024-09-14T11:58:37.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.P2E2vxsZUD2EUPYS6ggd5Nt4wINps0F_0 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11780602072961093712', time=2024-09-14T13:40:40.126651+0000, chain.objs.size()=1 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AP485nLMv5JLSJLy0PfmMn63pSHYLbY_0 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5124690006303437632', time=2024-09-14T13:40:40.680529+0000, chain.objs.size()=1 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PAoctRVPZXvBH6cIoJV7yYUCiOpqqeQ_0 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2382031975528672080', time=2024-09-14T13:40:40.974351+0000, chain.objs.size()=1 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OI7OrD8KmThfy0qCeiQ1QV3-dk1u94j_0 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9044334692147277013', time=2024-09-14T13:40:41.222450+0000, chain.objs.size()=1 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QEBuMIDwoEoi2dfk9lfinE3JCe_1ESQ_0 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3438407959200901783', time=2024-09-14T13:40:41.768732+0000, chain.objs.size()=1 2024-09-14T11:58:37.115 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kjxDE-wKJ_DqFfoifmmYnycv7iKqvCv_0 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15897785404036427360', time=2024-09-14T13:40:42.764106+0000, chain.objs.size()=1 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.m5txt16FNjDmaT7zFAHHmdIM6a0bmKI_0 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16820630428013063005', time=2024-09-14T13:40:43.087520+0000, chain.objs.size()=1 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kRTo86IY5TLxwPzGPa40Vci_2cNUl2s_0 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5021733588236708703', time=2024-09-14T13:41:24.069265+0000, chain.objs.size()=1 2024-09-14T11:58:37.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.117+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.391__shadow_.f8YoCTSo-vMUAbsPc9-AVlliqkRvdt2_0 2024-09-14T11:58:37.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.123+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/46489 2024-09-14T11:58:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:58:37.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11683364736366117411', time=2024-09-14T13:41:59.291599+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.444__shadow_.vIjHgSTSGKNnJ85aKBeLIIdbzKOsEBj_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1023438268119735336', time=2024-09-14T13:42:12.306508+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.461__shadow_.K3v-rOBPEp00lfBprBEg0Vf93rvU0mW_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8752999669624370901', time=2024-09-14T13:42:15.176724+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.464__shadow_.CZLFh3rkqL-IC8zaWsjy_i3hMUHFSu5_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.724664540252233292', time=2024-09-14T13:42:15.776936+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.465__shadow_.Sjw4Q3UvlhU2L0glON6KTtNGhD44QpX_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.118812062457356289', time=2024-09-14T13:42:27.445135+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.hONzrGvURcFikGiq8d30SKYhuKiazzI_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14412583556832653306', time=2024-09-14T13:42:32.823715+0000, chain.objs.size()=1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.488__shadow_.2tj3fo5n1Dq5I-KRzI_-YGDdtSiU0Vx_0 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16385340205862521482', time=2024-09-14T13:44:52.637700+0000, chain.objs.size()=2 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~mAvqjt9rJ8nICWH7EVu0iza9aWS4eNF.1 2024-09-14T11:58:37.125 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~mAvqjt9rJ8nICWH7EVu0iza9aWS4eNF.2 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15221248249476766023', time=2024-09-14T13:46:02.478563+0000, chain.objs.size()=1 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.557__shadow_.HWtuqb-snKPntbWzC6mwNf2IouyE5MI_0 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14038364502328372683', time=2024-09-14T13:46:13.074813+0000, chain.objs.size()=1 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.560__shadow_.e88y2507JnSdFAaqDiG27ei__B51Q_V_0 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16769362535510321725', time=2024-09-14T13:46:37.107396+0000, chain.objs.size()=1 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:9odIjFyCuv5D7BoB1D9c8ppgKMD7BD2_.Lp40TymSwo3h2VQ9iZUzBvX1cKiHYeN_0 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.380618498479601317', time=2024-09-14T13:46:57.983926+0000, chain.objs.size()=1 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:5GS0EoKxTPfEKksUeUjAFX9vSoFYysB_.36ZA2psOg1EQ_6Th_PyoU51RxtHwnBP_0 2024-09-14T11:58:37.126 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3971351548914212003', time=2024-09-14T13:46:59.173932+0000, chain.objs.size()=1 2024-09-14T11:58:37.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:RrYTq.pQ5IF4tlGSUZDVGGllqfH.wYC_.w9cEnzS7G72xOpdFmyuqtUsc3AUuy6Q_0 2024-09-14T11:58:37.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6780014193683733310', time=2024-09-14T13:47:07.709611+0000, chain.objs.size()=1 2024-09-14T11:58:37.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:yQWuGQc1XwYoi2X4BIYy6opsFXcFXjl_.BwjegzWlJf2QQEnqt0qxOj3P2VxRqpm_0 2024-09-14T11:58:37.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9158520851796029383', time=2024-09-14T13:47:10.951085+0000, chain.objs.size()=1 2024-09-14T11:58:37.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.129+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:sRG56lv5Mlf.ssDPv736eQqMree6vmu_.mWwn_NkojBS7zMKaoCwZHHWc7gzmJvJ_0 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11538812800050054207', time=2024-09-14T13:47:13.868031+0000, chain.objs.size()=1 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:3.jbJoCg7Pxxyp3vOupnyHNsKW-Wmwl_.mK1skU25ad2DmKCUDQ0fH3-MTgD9AL7_0 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1531862887374446784', time=2024-09-14T13:47:38.353583+0000, chain.objs.size()=1 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.586__shadow:pR4EXnoct.wb.69QpjyQjk.OxklgU07_.yEIsscB6g7P3qeMX3MqlMM7etbg1iJp_0 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17866021059949838379', time=2024-09-14T13:51:53.142805+0000, chain.objs.size()=1 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.641__shadow_.UcojQZwl4CjTikT82yY8hhckuDhPliS_0 2024-09-14T11:58:37.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15189962000427737646', time=2024-09-14T13:51:56.478539+0000, chain.objs.size()=1 2024-09-14T11:58:37.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.644__shadow_.dU9kudE6OSCDrIt3qZAOHEEVKxGEarT_0 2024-09-14T11:58:37.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4570655382992312490', time=2024-09-14T13:52:58.292944+0000, chain.objs.size()=1 2024-09-14T11:58:37.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.704__shadow:v-KJ6Sxxq2RTpvyxncNOzLsAwVR49uI_.qfuaHPxtqsF_mVSXtWnQaSnfA_oadL6_0 2024-09-14T11:58:37.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.135+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.138+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:58:37.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.139+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47352' 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_Q8ozUo91jmvH0HLOQPHlYpBLRA39FY6', time=2024-09-14T13:34:35.432797+0000, chain.objs.size()=3 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.-AmzL1bXAScPIee_UvUwlBXOx-uef5x_0 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.-AmzL1bXAScPIee_UvUwlBXOx-uef5x_1 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.-AmzL1bXAScPIee_UvUwlBXOx-uef5x_2 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1316879380844540697', time=2024-09-14T13:36:58.457486+0000, chain.objs.size()=1 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.236__shadow_.GMxSaAWEwPsNiOAVOjW3oD1Zx2edGbS_0 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4425003982279257840', time=2024-09-14T13:37:05.021895+0000, chain.objs.size()=1 2024-09-14T11:58:37.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.244__shadow_.pc5Euf6qxTazZJU1Phuj83tuiePRveQ_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10636714168060983360', time=2024-09-14T13:37:06.086595+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.245__shadow_.o612Zy5J_5nxSJRQs6PwYir0F2ET8HC_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12122756628547129246', time=2024-09-14T13:37:14.178906+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.256__shadow_.FwnGkGI5EwtQBgMJkyIHHbLv-ccONt3_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4381842841709582603', time=2024-09-14T13:37:57.746212+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Vumcwk8x2Q4QqDlDCqmjfPQvqcSXd_v_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7609270709822805697', time=2024-09-14T13:37:57.882727+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wdeTWgoLkkZOZ50hJ9mYFbX8Pc4gR2-_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17334620009074499824', time=2024-09-14T13:37:58.107300+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Wf4W2WackTHNl1VFrkG9C41GJvBXb_8_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7285053888364200432', time=2024-09-14T13:37:58.369196+0000, chain.objs.size()=1 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.B3cgX-4jD5Ju8AjjdrnZEsbuKMDwlEf_0 2024-09-14T11:58:37.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16044861707807639241', time=2024-09-14T13:37:58.394718+0000, chain.objs.size()=1 2024-09-14T11:58:37.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.140+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XEtQj7xsbbEPGqcJPExVaYhERo2xbqJ_0 2024-09-14T11:58:37.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1327493159166580636', time=2024-09-14T13:37:59.777556+0000, chain.objs.size()=1 2024-09-14T11:58:37.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FTe1gSmpr7vEXftQmDuIu3cKwUsGZGV_0 2024-09-14T11:58:37.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2146190477858118', time=2024-09-14T13:37:59.822642+0000, chain.objs.size()=1 2024-09-14T11:58:37.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gHQymanDp6g3yhARRsw0rEtGGcsV491_0 2024-09-14T11:58:37.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14110218325584830601', time=2024-09-14T13:37:59.980290+0000, chain.objs.size()=1 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.144+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.x4b3ARy3azlgoHB03mEiSxo-yGg0lTS_0 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13676574497541668275', time=2024-09-14T13:38:01.454818+0000, chain.objs.size()=1 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qedLPpr9BAGRRYUBHNg1YP5szWdzqVW_0 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6918569477651975471', time=2024-09-14T13:38:01.980738+0000, chain.objs.size()=1 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bJZocmgrWXRS3IUTcx367s5Rv5XgA3S_0 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5278038078705521192', time=2024-09-14T13:38:03.532872+0000, chain.objs.size()=1 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HmPVQqCWhz5_s7OtucomITm2SoVF9QC_0 2024-09-14T11:58:37.143 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15673067344524981300', time=2024-09-14T13:38:03.816988+0000, chain.objs.size()=1 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ayid0scFUv66sYrMp26Amjfw1sivf_i_0 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1711208391954600973', time=2024-09-14T13:38:04.056203+0000, chain.objs.size()=1 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Msnmb2AGb0SJlgBEHLP8JSbByQG4mCz_0 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15484117077595682358', time=2024-09-14T13:38:04.864507+0000, chain.objs.size()=1 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LZ-SpW0qSkzPn9SKfpAcjQTBkE6nwtH_0 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8237624980835671394', time=2024-09-14T13:38:05.289645+0000, chain.objs.size()=1 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5hfV7hRdT6TZBm1z3QhNLiuVU5vShVw_0 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18314353730962398738', time=2024-09-14T13:38:05.475421+0000, chain.objs.size()=1 2024-09-14T11:58:37.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.145+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-fq7KUty-hbUVvKQNmGsFdAcAe_mHVd_0 2024-09-14T11:58:37.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.149+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11390211150329480573', time=2024-09-14T13:38:05.658646+0000, chain.objs.size()=1 2024-09-14T11:58:37.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.149+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fI5M-RsdHAN9qOuXzvs0g03yq97pBSE_0 2024-09-14T11:58:37.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.149+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3730472393137705675', time=2024-09-14T13:38:05.659496+0000, chain.objs.size()=1 2024-09-14T11:58:37.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.149+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UuPixtwmqprffkKbWHZLBKnGtRrnXB2_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.150+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2213628037297236003', time=2024-09-14T13:38:06.131308+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.E5RP2daKrJguX5DDLfHXKEyv1se6Gv6_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3462502014482334098', time=2024-09-14T13:38:06.352622+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FlV6k3uU96XbH1F-qNbXpGb_jqzDfHR_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2539779748074110098', time=2024-09-14T13:38:06.856477+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pBaKiG4NE2gz-TMp5lwKBmzKoTO8m95_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7546740468091162624', time=2024-09-14T13:38:07.807500+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bewN9Mp4oX28V_z4RCh73CBi_RL4gHF_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14619413384249611200', time=2024-09-14T13:38:07.954742+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2OX1lE9uKy3pIC-_aJCTsTFLBjNmIY3_0 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9488012374605131634', time=2024-09-14T13:38:08.289224+0000, chain.objs.size()=1 2024-09-14T11:58:37.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gkm9fCwqQ_JHTnFOzBHsmr6vtwSUcM2_0 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.437757642188694352', time=2024-09-14T13:38:08.335964+0000, chain.objs.size()=1 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NYtSt4DHlPy9W-Y6_vDmuXsGVl7iDWj_0 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12144870185895688723', time=2024-09-14T13:38:08.388417+0000, chain.objs.size()=1 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BSXuw5gkr6Ar74OpgT_SW1VW-ey3z-i_0 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.152+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7649447840530340337', time=2024-09-14T13:38:08.465447+0000, chain.objs.size()=1 2024-09-14T11:58:37.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.152+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VfchVwZPedUJwafNmnBIUhNyDYJq5hH_0 2024-09-14T11:58:37.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.154+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3798175817430914258', time=2024-09-14T13:38:08.586111+0000, chain.objs.size()=1 2024-09-14T11:58:37.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.154+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9OVDZbnuoSR5Dgb_Dqx-cdbeazHOIwL_0 2024-09-14T11:58:37.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.154+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17478445095944705677', time=2024-09-14T13:38:19.429441+0000, chain.objs.size()=1 2024-09-14T11:58:37.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.154+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.276__shadow_.aTV_Ys0NddTzcgjnbA9U3MA8BxW0W4O_0 2024-09-14T11:58:37.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.155+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9353975959875381807', time=2024-09-14T13:38:23.123744+0000, chain.objs.size()=1 2024-09-14T11:58:37.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.155+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.281__shadow_.s1bCDzHQDG4esBaucoze8u4KMEVM8b5_0 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15878845820145096760', time=2024-09-14T13:38:23.856214+0000, chain.objs.size()=1 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.282__shadow_.X40MQsqNE-wALkzzhHRGk8VFi6UdX2b_0 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5446912489188716862', time=2024-09-14T13:38:26.094598+0000, chain.objs.size()=1 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.285__shadow_.W4DzJDFIvxpqGgoFS1sW-nkMMauOS4j_0 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12232105296462661319', time=2024-09-14T13:38:26.095300+0000, chain.objs.size()=1 2024-09-14T11:58:37.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.285__shadow_.D-kjs0Oxfa5zmYdBxnv8VmkSjmNavQN_0 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17793248959057125884', time=2024-09-14T13:38:35.681923+0000, chain.objs.size()=1 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.TvzsPrtpcLmSyb9IladPqkWmJ2eaxUL_0 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11915368652877400322', time=2024-09-14T13:38:44.686598+0000, chain.objs.size()=1 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.306__shadow_.pgHP3gdj3wq-VH6jIqv6ODATk8rwn9f_0 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17431033188683092438', time=2024-09-14T13:39:38.672218+0000, chain.objs.size()=1 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SrJWxC9VfOtY-W3fxdE61pH0NlM-vVE_0 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4546704802216145105', time=2024-09-14T13:39:39.314483+0000, chain.objs.size()=1 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PP0WZzsWrRQ0NVrE-e65FoQOIUQH4ft_0 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8819656597619261283', time=2024-09-14T13:39:39.593636+0000, chain.objs.size()=1 2024-09-14T11:58:37.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vlN2oI34iS77W_uPTbMzfkpLSlxtc5M_0 2024-09-14T11:58:37.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15345550815605124461', time=2024-09-14T13:39:40.819799+0000, chain.objs.size()=1 2024-09-14T11:58:37.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rTLeDcvepilw64dNCmnSwHk2xRbcAOD_0 2024-09-14T11:58:37.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18258640838941747418', time=2024-09-14T13:39:41.015833+0000, chain.objs.size()=1 2024-09-14T11:58:37.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sXeRxNcgAv3E4f4iccIcZNc5bZt95Wh_0 2024-09-14T11:58:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.160+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14467647770571436928', time=2024-09-14T13:39:41.187845+0000, chain.objs.size()=1 2024-09-14T11:58:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.160+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D1NKRfxfA4ffHI3aFVrhcJo5djew2E__0 2024-09-14T11:58:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.162+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6228572318537198078', time=2024-09-14T13:39:41.330635+0000, chain.objs.size()=1 2024-09-14T11:58:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.162+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hYGXIgMVJfE3HXI3toX6vjPcZssYBRs_0 2024-09-14T11:58:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.162+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1501257705209135057', time=2024-09-14T13:39:41.435641+0000, chain.objs.size()=1 2024-09-14T11:58:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.162+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fPAK9Bh8CqgPrgrJIKgm1eMP00cTkep_0 2024-09-14T11:58:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7366749689017358742', time=2024-09-14T13:39:42.005774+0000, chain.objs.size()=1 2024-09-14T11:58:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xD4Nyw1B6YnWEKbaDydTSH27_KhCrkq_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13902949598467773120', time=2024-09-14T13:39:42.148270+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.92wqlTTDS-QALHMKT_mOca7dYHi4nv8_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12007711610452156356', time=2024-09-14T13:39:42.204643+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.T4HEChnRwupbCrRF7cxjcgUTrWWVg-j_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15082135547405906852', time=2024-09-14T13:39:42.892240+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xhoGOcwF-T3_T2VSAcgWWZ0BKVdKaqE_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1001738392373472673', time=2024-09-14T13:39:43.106702+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vmLcLHl1hcvhfAmGEEuCDUZfVU9s4e4_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.591278730112274310', time=2024-09-14T13:39:44.069993+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FTsmQqffPA6J7-T-zib96kB9u-qrkTG_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6104232761713536715', time=2024-09-14T13:39:44.115145+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rFz31Z1Zm1fBRqGljLluIXGnzv93ebD_0 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3866389348244243002', time=2024-09-14T13:39:44.231322+0000, chain.objs.size()=1 2024-09-14T11:58:37.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.163+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hyrzdlKtmTwy2O5YnNY9Y3r9IFeJOBa_0 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5123509516714354496', time=2024-09-14T13:39:44.277168+0000, chain.objs.size()=1 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GUgJEoKtOPMQOyEwOuQJ6jz7vnp-hgA_0 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14346100572079471824', time=2024-09-14T13:39:44.801419+0000, chain.objs.size()=1 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.L4Fjhy2UUUAm71JIqRczZWRhIZ_N5RM_0 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14026956546126256131', time=2024-09-14T13:39:45.456758+0000, chain.objs.size()=1 2024-09-14T11:58:37.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.166+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BVTF-UUFJtZ-3lGonaqxjVWGPZ2nmVY_0 2024-09-14T11:58:37.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2504653959342422754', time=2024-09-14T13:39:46.197883+0000, chain.objs.size()=1 2024-09-14T11:58:37.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UYwJNrjYioieNv5DxJ6U9EFWd-IDdT__0 2024-09-14T11:58:37.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8069339354846709252', time=2024-09-14T13:39:46.235715+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GzJriTcweTiT2uvbIOsc2nIsh9RykpA_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7374748679377676439', time=2024-09-14T13:39:46.236457+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LxgN2MhV_N0KUErwWQ7nf_9-Cm3kOiW_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.865724391721464276', time=2024-09-14T13:39:47.978264+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.t-xJRumm0zNelYXKfci-GLctg8ssCqT_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15007199683039129340', time=2024-09-14T13:39:48.043526+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mYrY9N3Rf2QHEkdQ4_x9QWl7YvI_lqx_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.590307084942262230', time=2024-09-14T13:39:49.058548+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.buT1yu8F6-fd8CiBqzzxjiQimktJRWO_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2139298113805811036', time=2024-09-14T13:39:49.129050+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vUTD7g-ngPp2K-Xf-aTNaKyKWzXgbcO_0 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13701680832996701142', time=2024-09-14T13:39:49.284357+0000, chain.objs.size()=1 2024-09-14T11:58:37.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.169+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.K9ySXenM8FRMuOeF7vofvpOnrCyyrKt_0 2024-09-14T11:58:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.171+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7011064712336353282', time=2024-09-14T13:39:50.078416+0000, chain.objs.size()=1 2024-09-14T11:58:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.171+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RxleOGzwFkghQRVFPkaHe5HfbLcT8GR_0 2024-09-14T11:58:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.171+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17255995445456898871', time=2024-09-14T13:39:50.224535+0000, chain.objs.size()=1 2024-09-14T11:58:37.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.171+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OuKU_nA9Af9IPZvRV2F5ifgH-dwC7Kw_0 2024-09-14T11:58:37.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.172+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14754099843071516833', time=2024-09-14T13:39:50.428215+0000, chain.objs.size()=1 2024-09-14T11:58:37.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.172+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pBAKXPq5JT5Rso0Bk5_HSF82JeP4DfU_0 2024-09-14T11:58:37.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.173+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9805079209270044099', time=2024-09-14T13:39:50.467853+0000, chain.objs.size()=1 2024-09-14T11:58:37.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.173+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DohOTas7FD75VYZ3h_qUge6cYjUzV_O_0 2024-09-14T11:58:37.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.173+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2762517352602658768', time=2024-09-14T13:39:50.468456+0000, chain.objs.size()=1 2024-09-14T11:58:37.171 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.173+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.odP3Fa-WtkfLxK4nbuTIOuYQq1dS8Aj_0 2024-09-14T11:58:37.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16793318650395173297', time=2024-09-14T13:39:50.619888+0000, chain.objs.size()=1 2024-09-14T11:58:37.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FO8WcbUQlkVsv7PL-NwDA2xmznn72zM_0 2024-09-14T11:58:37.175 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13029930437619575236', time=2024-09-14T13:40:31.491586+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OFE27B2KrhneGwhrmWLXWjE4nyLMy98_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17300112563033297906', time=2024-09-14T13:40:32.567821+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Xcsk2YBWLRIZD3Zqcsba_QL_BrJKFzh_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7674326646164877401', time=2024-09-14T13:40:32.954261+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.N7jyWR66Q9BrYeBvwx3XP3S9enxHbf6_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14112298220576204156', time=2024-09-14T13:40:33.539198+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PiqiQb0_Dz37briGnyUxDcBTWE1wU2j_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7581339453486690926', time=2024-09-14T13:40:34.211576+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cl0esXU1DqKto9v_mhEu5rCD4ZFsrDj_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15672928495735692132', time=2024-09-14T13:40:34.253830+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mBatsfELUPb87YIEVtZWYL7lLPrTABv_0 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11062355365730560153', time=2024-09-14T13:40:34.254478+0000, chain.objs.size()=1 2024-09-14T11:58:37.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1rjO0iNRrS1w_VqkFS61nVCkWLrM_wU_0 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14087737854898856550', time=2024-09-14T13:40:34.677812+0000, chain.objs.size()=1 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9BTG-a7ko35Mgb7zby_UIi1gBfSsuDF_0 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9496335420636323384', time=2024-09-14T13:40:35.146128+0000, chain.objs.size()=1 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HO76yW8SMuhWzOYrjbL-5coLyx96oRO_0 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9970811828737816356', time=2024-09-14T13:40:35.889774+0000, chain.objs.size()=1 2024-09-14T11:58:37.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KpAdFXtE97zT3bc8veo7tkeHFnw-WMo_0 2024-09-14T11:58:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10460362203949996988', time=2024-09-14T13:40:36.579993+0000, chain.objs.size()=1 2024-09-14T11:58:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MBVcpM-GvXc35IztW1efe9mIN2Tr2gt_0 2024-09-14T11:58:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12139847734243418830', time=2024-09-14T13:40:36.744089+0000, chain.objs.size()=1 2024-09-14T11:58:37.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qY7Avl50ocogF7U7CWrmo2MXs58fCqW_0 2024-09-14T11:58:37.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13452478156591402951', time=2024-09-14T13:40:37.913701+0000, chain.objs.size()=1 2024-09-14T11:58:37.181 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.182+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BGPP3lmk_qyuZrdqJGqwZjCdDlluDLl_0 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15631212519890931375', time=2024-09-14T13:40:37.916211+0000, chain.objs.size()=1 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Hy7I3W0CSELDoCuXCfxNcb6ChOLyiQX_0 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11636980979306452394', time=2024-09-14T13:40:38.133218+0000, chain.objs.size()=1 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bWXpZ1cKITFczdHqPUtuNzuP92wNypw_0 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4736957966260364990', time=2024-09-14T13:40:38.214076+0000, chain.objs.size()=1 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZYVeU2e52hWSPhsSCPf-GnalSsb-7p6_0 2024-09-14T11:58:37.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8758138000401084674', time=2024-09-14T13:40:38.585960+0000, chain.objs.size()=1 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qIDV5iMeAwqaIuTLXZd11fV5043QdY7_0 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6400533494631726748', time=2024-09-14T13:40:38.684646+0000, chain.objs.size()=1 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KbK50lvqEiaRdiw3r1STbpXahTSjMW9_0 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8911726914978988990', time=2024-09-14T13:40:40.039650+0000, chain.objs.size()=1 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mJaUSbAImJMkDjGtTfqMiqbTHSrDKSL_0 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2806032631029570488', time=2024-09-14T13:40:40.848160+0000, chain.objs.size()=1 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KdEjI4_PxJHKGAChgqtfAhwArevI2I2_0 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9307933094890159169', time=2024-09-14T13:40:41.309320+0000, chain.objs.size()=1 2024-09-14T11:58:37.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hWcQlAtIpKjnNCQc_F8_CTmZMHZ7TKj_0 2024-09-14T11:58:37.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13747476595842299335', time=2024-09-14T13:40:41.381058+0000, chain.objs.size()=1 2024-09-14T11:58:37.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.E-nlpNsCp5-qFbWrope_8R9SqYtHdm6_0 2024-09-14T11:58:37.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13116537945474125876', time=2024-09-14T13:40:41.909145+0000, chain.objs.size()=1 2024-09-14T11:58:37.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wGI-3VJ6xOPXei3uwpn80agMxt60Rez_0 2024-09-14T11:58:37.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8136994582787234350', time=2024-09-14T13:40:43.096538+0000, chain.objs.size()=1 2024-09-14T11:58:37.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.187+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ahycOqb2TyyW_mY_XnlFs9GdwgxMy4m_0 2024-09-14T11:58:37.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11113384889978002533', time=2024-09-14T13:41:13.220963+0000, chain.objs.size()=1 2024-09-14T11:58:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.375__shadow_.iLqQF9TxflbYGiQCfmBZZ01hPZ-81JF_0 2024-09-14T11:58:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.190+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11102386605994803432', time=2024-09-14T13:41:37.862592+0000, chain.objs.size()=1 2024-09-14T11:58:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.190+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.411__shadow_.3x4qTGRrZKdluk0F0NJ-KfAjvgsWwBp_0 2024-09-14T11:58:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.190+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13506405099187720062', time=2024-09-14T13:41:52.744319+0000, chain.objs.size()=1 2024-09-14T11:58:37.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.190+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.435__shadow_.ES5nZDwaUIPjxjKKDNmkPKBuvNw0lZH_0 2024-09-14T11:58:37.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.193+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47352 2024-09-14T11:58:37.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17853179524787717670', time=2024-09-14T13:42:17.808921+0000, chain.objs.size()=1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.467__shadow_.5RIrv5aI-geWP3Fek7aHmiz2bUR0_LW_0 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2436127950033145274', time=2024-09-14T13:42:35.741545+0000, chain.objs.size()=1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.492__shadow_.rdhkWTgbkyf0odLQOHuX4G43MJ1fnHY_0 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14243146509820739836', time=2024-09-14T13:42:38.293206+0000, chain.objs.size()=1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.497__shadow_.IE7oKHy-26LVHexsZnQmu_xyomKgGBy_0 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~6o-j7M3S4Le1PV_yGcQ1luXV_tz9Dj5', time=2024-09-14T13:45:05.707008+0000, chain.objs.size()=2 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__multipart_mymultipart.2~6o-j7M3S4Le1PV_yGcQ1luXV_tz9Dj5.1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__shadow_mymultipart.2~6o-j7M3S4Le1PV_yGcQ1luXV_tz9Dj5.1_1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14740326902602872358', time=2024-09-14T13:45:57.218524+0000, chain.objs.size()=1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.555__shadow_.RJJJsicTNdASETcFgVXwJK4qEBrRg84_0 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~x3LIf-CePEG6uehRRdmqKJpY3c_22Ai', time=2024-09-14T13:46:14.674963+0000, chain.objs.size()=1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.562__multipart_mymultipart.2~x3LIf-CePEG6uehRRdmqKJpY3c_22Ai.1 2024-09-14T11:58:37.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5752093222380634613', time=2024-09-14T13:46:34.636790+0000, chain.objs.size()=1 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:1O8J8uJZh7OkeluTxZ-b6XZMKyoTfo-_.WlCEVWGjjr994xg2ILtOg7ZTeiIRh8O_0 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5597305454937273558', time=2024-09-14T13:46:45.301444+0000, chain.objs.size()=1 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:DOwtxUXNbWdEYNbskq.DRYTMlvT-T6t_.bO1U8kqkvEwPQcXybwWyrwFoPOr4oST_0 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9084443682665437963', time=2024-09-14T13:46:46.022812+0000, chain.objs.size()=1 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:9C3gs739aJdcZU0BLNiU2sEwdjDB6jC_.W-ybXQmz2ayickpMoSEXUWbyxCpa42g_0 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11711596565455652680', time=2024-09-14T13:46:52.000673+0000, chain.objs.size()=1 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:9Vq5TGiXGIiPYC-vwqU4Xo94gBQ3EYe_.k3ikbCC-lflsFiUvs4d968INecUstiz_0 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8169870963579290584', time=2024-09-14T13:46:53.178186+0000, chain.objs.size()=1 2024-09-14T11:58:37.197 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:OQXTscg-H3L8z5RtIlaMcFXWp7do2oJ_.1V_1jtGJu7kcUbahEGPPigZ6veY9_pa_0 2024-09-14T11:58:37.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3488928369073416482', time=2024-09-14T13:47:01.630680+0000, chain.objs.size()=1 2024-09-14T11:58:37.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:-qcysb2Bl5VbfCq1na313tohpR8Bw50_.pquYtHJlRKm0WfclMIkU5HVV065HDcd_0 2024-09-14T11:58:37.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4301980944165890798', time=2024-09-14T13:47:08.845076+0000, chain.objs.size()=1 2024-09-14T11:58:37.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:cL8yyB0PtCubz72dhCet16fyTGkMPZq_.IzZxK4FYzDDRAioJ-svP0A10SR5cAIe_0 2024-09-14T11:58:37.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12040460964444900381', time=2024-09-14T13:47:15.567964+0000, chain.objs.size()=1 2024-09-14T11:58:37.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:wT06XMrN6Tpx4w3LLeSz9RBaL6xP8G._.jn2qELMeZS6QCQRnJlXn3q9c8JfpvTK_0 2024-09-14T11:58:37.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14131736196372700608', time=2024-09-14T13:47:31.830760+0000, chain.objs.size()=1 2024-09-14T11:58:37.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:gkw6zynkHtIepgZH18FdZzW46xfmBk6_.kDFAEP7dq0oBPJvkzAIkBkL3EQSW4pF_0 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7921532793546404303', time=2024-09-14T13:47:36.152872+0000, chain.objs.size()=1 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.584__shadow:.zqoES-2Gfq6hDQdwbM20kfCh4ZtDaU_.YiQnV_9PGGX-eFQSxO1RR9jmmdQm1DJ_0 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4216381565366565061', time=2024-09-14T13:49:03.562928+0000, chain.objs.size()=1 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.617__shadow_.vxrgisxITCfDw_IrfNipC_lUTbXgZ1r_0 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15048144658976202713', time=2024-09-14T13:51:50.446481+0000, chain.objs.size()=1 2024-09-14T11:58:37.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.202+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.637__shadow_.suhRRsQx64sj_gVRSbvZ0PPTxlpI3gf_0 2024-09-14T11:58:37.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.208+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.211+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:58:37.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.212+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/72864' 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7805547284070474198', time=2024-09-14T13:35:27.005086+0000, chain.objs.size()=1 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.204__shadow_.d9ssb-s9D7oXW071BE-6_9tq4ncjDFP_0 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1295706596199497778', time=2024-09-14T13:36:56.992284+0000, chain.objs.size()=1 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.234__shadow_.wOH_EAgsOidUB00vV5SBWkohUc5HH6g_0 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15637596703728033051', time=2024-09-14T13:37:11.238130+0000, chain.objs.size()=1 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.252__shadow_.AE6mxnsS5ZUtv-XpbVnHdD9sqYIcsd0_0 2024-09-14T11:58:37.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16009201515735689688', time=2024-09-14T13:37:16.931463+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.260__shadow_.r3b6h1wLMy8jBUmJ0qyYwlCUS_Dt9a__0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13974610690001058841', time=2024-09-14T13:37:57.733372+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xlp0yIyEs_fXhEQGNdb-WggV0rfIiG__0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1930632665279041043', time=2024-09-14T13:37:57.917025+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EG9ijpO6RjHGGa1T0BTUdIKCHKgDa1__0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11531574922505338282', time=2024-09-14T13:37:58.558088+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tisTnHeYOJKfhiLPwaL8TMGc4GpfWU8_0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6204193189013097760', time=2024-09-14T13:37:58.621752+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.k0Dpu7muo4_RCJnvDSjkhCyRV9lo5_E_0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8332556937039209593', time=2024-09-14T13:37:59.821796+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NrY8Eow-XiZsmApvMRwof5jwqDuJ8s__0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6662117700864577171', time=2024-09-14T13:37:59.908819+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2HHsUapBpaMxdAfzCzmuF7RDL7TEKEI_0 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.214+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5102876023120604814', time=2024-09-14T13:38:00.325335+0000, chain.objs.size()=1 2024-09-14T11:58:37.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.214+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YaDqu4kaToD_NXnOX-URAG3d1oVfugg_0 2024-09-14T11:58:37.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.214+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.65965022676404247', time=2024-09-14T13:38:00.363457+0000, chain.objs.size()=1 2024-09-14T11:58:37.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.214+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.021W-eG_CoLrHFe1oB3Zd1IVBBZYgA8_0 2024-09-14T11:58:37.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7873164346632965386', time=2024-09-14T13:38:00.641763+0000, chain.objs.size()=1 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-eLVfn5D4TE0QEi_Ca0I_CjRmnpxles_0 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7580079210025784276', time=2024-09-14T13:38:00.642325+0000, chain.objs.size()=1 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MCfeY9SulcOXO1mIlp8Z2XBONAIhQc-_0 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4848966541122136835', time=2024-09-14T13:38:01.370364+0000, chain.objs.size()=1 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3KVJYOBfi6AEWtlwUrdWZHk8PtSk1QQ_0 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2185582542527023444', time=2024-09-14T13:38:01.727342+0000, chain.objs.size()=1 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nSteGdwiP-Y2Xm8BIImwSZdAX4nK7tp_0 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9283227558182188763', time=2024-09-14T13:38:01.739363+0000, chain.objs.size()=1 2024-09-14T11:58:37.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JX7JYF85FYYlWqD6webL-y01NNz_la8_0 2024-09-14T11:58:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12790279662839771203', time=2024-09-14T13:38:01.822090+0000, chain.objs.size()=1 2024-09-14T11:58:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qe_6jf7xOV-Nvw2EpDF-g9eHaFTV1mD_0 2024-09-14T11:58:37.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7183654657236049887', time=2024-09-14T13:38:01.875437+0000, chain.objs.size()=1 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.s4S6BrCb2K5RlapOOQL9TanVdkz55n9_0 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11966662420613099799', time=2024-09-14T13:38:03.386227+0000, chain.objs.size()=1 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YszoCNu9NM_gytDNY__AF2cTPa8bkf-_0 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9059464627414753953', time=2024-09-14T13:38:03.856285+0000, chain.objs.size()=1 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aQo5KaIX2W_4Q9SOumwSVN-PDTocwSb_0 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14396696223925358284', time=2024-09-14T13:38:03.884379+0000, chain.objs.size()=1 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.e8TEo9Oa2HymaKeNDqZWtnqnelQgAB2_0 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4210597734608654030', time=2024-09-14T13:38:03.999262+0000, chain.objs.size()=1 2024-09-14T11:58:37.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Uqj7FeD_EZb7FZU43I8HNVf5M90qeLq_0 2024-09-14T11:58:37.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.221+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18145586888776893838', time=2024-09-14T13:38:05.029267+0000, chain.objs.size()=1 2024-09-14T11:58:37.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.221+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uLEpKDpnL9Pvog0LZ5aQhh1CBKM7H1Y_0 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16411354044944053031', time=2024-09-14T13:38:05.198940+0000, chain.objs.size()=1 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zdf9Rzenc1FLNSLBZKQWLlpkHv2OMnl_0 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2942132342719675827', time=2024-09-14T13:38:06.269046+0000, chain.objs.size()=1 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zWHw9EeGadCg5mTJrOVBZwVN6zcUPfT_0 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7046653828585809894', time=2024-09-14T13:38:06.692861+0000, chain.objs.size()=1 2024-09-14T11:58:37.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.09PEdLxYtdGRtKzAGiigWqz94LiKJLz_0 2024-09-14T11:58:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11900160503495924669', time=2024-09-14T13:38:07.017493+0000, chain.objs.size()=1 2024-09-14T11:58:37.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nRJv4nsLmYBhnJbxC2RV2F0oqwbiRFr_0 2024-09-14T11:58:37.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2537461366714912728', time=2024-09-14T13:38:07.302934+0000, chain.objs.size()=1 2024-09-14T11:58:37.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YrbfEzQuRHiwPrH7-TveIjamQNeR_Wx_0 2024-09-14T11:58:37.222 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11493085563943911244', time=2024-09-14T13:38:07.929189+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-7Wv1EkigQCVksqY6IFrIAExuR3Lx1W_0 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7338526355439615541', time=2024-09-14T13:38:07.980279+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Duc3_PqBLHRCpEFVp9kmpL01TVmi5OG_0 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12295576506320345367', time=2024-09-14T13:38:08.062673+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1QRaY2nBMowt6ZYsnu3FkBtwXvbHxzl_0 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2154841262520486036', time=2024-09-14T13:38:08.414294+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tPp_tTfla1rsuVDqEo6coDoZsAD2IXO_0 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10275111876288892489', time=2024-09-14T13:38:08.753074+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.224+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.f5wF0UBPUVHHuKxw7NxHVaplbrpQQyB_0 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12778896800180431150', time=2024-09-14T13:38:16.677316+0000, chain.objs.size()=1 2024-09-14T11:58:37.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.272__shadow_.TYQGNQfVVfqvBVqYljsHmk1t8TW0g0m_0 2024-09-14T11:58:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.227+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2203871579811075430', time=2024-09-14T13:38:27.690145+0000, chain.objs.size()=1 2024-09-14T11:58:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.287__shadow_.F2AhvF9ksV5Z8RB55IEMldQ5PDcvKve_0 2024-09-14T11:58:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.227+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13670134734245342506', time=2024-09-14T13:38:31.496515+0000, chain.objs.size()=1 2024-09-14T11:58:37.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.292__shadow_.PJDOWMI2jkMqT8KcZcK0aNF9UOcRhmj_0 2024-09-14T11:58:37.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3054040642195295290', time=2024-09-14T13:38:35.550357+0000, chain.objs.size()=1 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.uSKS_nLUfveWlXmgsHNp-PEoLcTQMH8_0 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17057096143938316581', time=2024-09-14T13:38:35.696188+0000, chain.objs.size()=1 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.gfTFDrLWJ5uewszjB3w795WjbFF1RYT_0 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10342563798214031624', time=2024-09-14T13:38:37.944407+0000, chain.objs.size()=1 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.297__shadow_.JJ_SiivXGHdskHX47x0fpBVaRbVtqSb_0 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2843643679085656926', time=2024-09-14T13:38:43.963307+0000, chain.objs.size()=1 2024-09-14T11:58:37.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.305__shadow_.ZKGzJNPQQis7HRJubceL6zxThE8m45J_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1469859264293923795', time=2024-09-14T13:39:38.488893+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AOjJSy8QjdErpj_pUXVbFFyOEUzrL1W_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6432854950569191905', time=2024-09-14T13:39:38.698745+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.W7EsxZkGBKr4W_wtFMIzFSpVsSFfA0a_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7693746655972584055', time=2024-09-14T13:39:38.904384+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.232+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.R3Dlm5qMFHZ2i6dcx2Oxk6LFWyiccpg_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15986464667855617879', time=2024-09-14T13:39:39.084511+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MpNV72aL2hj6TdDKKwBw3RiqQwsX9pC_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4469208204621531008', time=2024-09-14T13:39:39.317111+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-jb0wDxzylqTm5N9XvvBmHSyteDTSLW_0 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17202250305953948640', time=2024-09-14T13:39:40.305216+0000, chain.objs.size()=1 2024-09-14T11:58:37.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tbh3v5fNQt3rEcR9CqBQGDR9bZp7CQ0_0 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12270863077548210186', time=2024-09-14T13:39:40.436124+0000, chain.objs.size()=1 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.f3yJ3Q2j0DMTI5p6CibMNzqxCIpHp4l_0 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8638827754346123280', time=2024-09-14T13:39:40.461644+0000, chain.objs.size()=1 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NnxSbDRSVn5p6hLGARPnGYuz1VSOHJo_0 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10856157841904515832', time=2024-09-14T13:39:40.810873+0000, chain.objs.size()=1 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Epsd7kVwZLwfRqHWnESbCsAsT13K6Ru_0 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3195421242184685901', time=2024-09-14T13:39:41.027078+0000, chain.objs.size()=1 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.atVLop9uADEinZmK7rRt2GXIWTvRevk_0 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.234+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18026197052060143358', time=2024-09-14T13:39:41.522567+0000, chain.objs.size()=1 2024-09-14T11:58:37.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5my7jA32QZv7JX5USs5x2YD7nYAcZW5_0 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.976101038038891525', time=2024-09-14T13:39:42.017350+0000, chain.objs.size()=1 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xqwD-YWOq4he2lyJ9zwoOYbPuckUMHs_0 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16715542205574010605', time=2024-09-14T13:39:42.018055+0000, chain.objs.size()=1 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rqmFLNsFaTo-GqKRSGkDNjfPncos2h8_0 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1486969156324193029', time=2024-09-14T13:39:42.018679+0000, chain.objs.size()=1 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LPv0VM_ywoPiXFOfFpXY8gO_jgbs41d_0 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11258894151931057213', time=2024-09-14T13:39:42.176215+0000, chain.objs.size()=1 2024-09-14T11:58:37.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C4Pr5-r-D4m0oAD6jZ_Vq5SCppyL7zR_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9054669980463071459', time=2024-09-14T13:39:42.492004+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DqFny-6jtYrfC2CSmlrtq6UtIWXYPLV_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7955699680375767669', time=2024-09-14T13:39:43.643566+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4SIRVnSF1pBrF-kruYPgKr1OgEHUBmW_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3129330784006821924', time=2024-09-14T13:39:43.691836+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3Q9dUCWHJIZIJTYk2rb2mzaXv2HxLZM_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4497310941016335088', time=2024-09-14T13:39:44.755291+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zKvfOs-ru5hT6YyzNJh6B3pqqyGwRn6_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9493961002400322238', time=2024-09-14T13:39:47.015127+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rDc-Enm0exBOURIW-p-uBCjdDT8rHR-_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2366225517488437038', time=2024-09-14T13:39:47.036197+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tX1SBT5_m2EgNRy28k7LKlT3sm8Xf4I_0 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10057000335631464907', time=2024-09-14T13:39:48.462698+0000, chain.objs.size()=1 2024-09-14T11:58:37.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.239+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9k-OAN2Os6rUsSMD1ONZir3g2u4R71J_0 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5899234376370526188', time=2024-09-14T13:39:48.760235+0000, chain.objs.size()=1 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VJeILk9A-VV8NU8-8ABXOsXa9oL6-r-_0 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10545432135840106040', time=2024-09-14T13:39:49.282932+0000, chain.objs.size()=1 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.emi4q9TljH-11gxPWX4QkP8q2QHZJFg_0 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9425575358015653744', time=2024-09-14T13:39:49.401823+0000, chain.objs.size()=1 2024-09-14T11:58:37.245 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BFEx0kcTrFk5BbEDLtMkLTI0NBH0Hig_0 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4886489973307241326', time=2024-09-14T13:39:49.594896+0000, chain.objs.size()=1 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tcls_4H4YF7k5FhSqlC3GzonUP1D6C6_0 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17864550432312035872', time=2024-09-14T13:39:50.051170+0000, chain.objs.size()=1 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6mROAy_04moUxwc8PmFmqUp5_18sXxW_0 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6341063576338322080', time=2024-09-14T13:39:50.337236+0000, chain.objs.size()=1 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZQtUgkP442tMcoxXEOmsnDKCXx6BE_E_0 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7273611827707389787', time=2024-09-14T13:39:50.480459+0000, chain.objs.size()=1 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0h4d1ArgueINXZMvjsadaBdpYW9xz-l_0 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9262002636521131104', time=2024-09-14T13:39:50.720217+0000, chain.objs.size()=1 2024-09-14T11:58:37.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.m1n5NRBs-wvCaFen9tPnVtOHPb23-9q_0 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2728531227328942577', time=2024-09-14T13:39:50.756878+0000, chain.objs.size()=1 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hsc8Ctse-CCqR_HYotre7L_CFEGwbO3_0 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10770452209077776561', time=2024-09-14T13:40:30.781209+0000, chain.objs.size()=1 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AZs6RQxSVBMgeuA8t_0FWrjfdcvXk7f_0 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7081737917153684078', time=2024-09-14T13:40:30.920105+0000, chain.objs.size()=1 2024-09-14T11:58:37.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.247+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Pfy0jQAWplaBD293DD2X-ZSf3LBQMEh_0 2024-09-14T11:58:37.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.251+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2755799797237734731', time=2024-09-14T13:40:31.463526+0000, chain.objs.size()=1 2024-09-14T11:58:37.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.251+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pkh6JgKivBYbjzsF_YGl9mGEjnRamRZ_0 2024-09-14T11:58:37.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.251+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1969162564354003009', time=2024-09-14T13:40:31.869281+0000, chain.objs.size()=1 2024-09-14T11:58:37.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.251+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MTCZH8OSuG2zqAS-2xC83fGJ-i9V95H_0 2024-09-14T11:58:37.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4486619118232815417', time=2024-09-14T13:40:32.574361+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zg7GonIy5S1qSghKqkJfToUTpz6qI0j_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9244334944133181032', time=2024-09-14T13:40:32.576898+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xy5U21dt3BMrJaXvn20lmyeuQI1zzPs_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5907885848236013846', time=2024-09-14T13:40:32.758815+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BMiZ3DTXnhCDIz1riJenfrKKHl51ctx_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4069518420342834313', time=2024-09-14T13:40:33.019179+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kbA2QmTwANNpwvKAwqSYrQuk9UhWxlg_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.253+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1542493794160116657', time=2024-09-14T13:40:33.021125+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1bGvOWUWX-X602vFNsWAZvV9T83a0_q_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16101013100093322696', time=2024-09-14T13:40:33.072069+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ccGGGP-u3UNj9KWYB9DMos38FsVG-AL_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3968983671964573889', time=2024-09-14T13:40:33.156585+0000, chain.objs.size()=1 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QKE5Lnjjc3K0Gb3Q_M3WVRePKLMH8ac_0 2024-09-14T11:58:37.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10370940639419172977', time=2024-09-14T13:40:33.207481+0000, chain.objs.size()=1 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3X5_rLeQj55ESuOC847J_DRl4oiVGMT_0 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12885494745503049728', time=2024-09-14T13:40:33.561091+0000, chain.objs.size()=1 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5j4u7MAtznodjMiL1UIhD9vzCgc5yl8_0 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.451367984660523126', time=2024-09-14T13:40:34.371186+0000, chain.objs.size()=1 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WVxCnDbEfnogCpS-FRC_TSuxKhM-In8_0 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16370128549612789274', time=2024-09-14T13:40:34.537178+0000, chain.objs.size()=1 2024-09-14T11:58:37.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1UsTpXIi3nBTELrYt2-CNodW6g3JyC7_0 2024-09-14T11:58:37.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15292851294072807154', time=2024-09-14T13:40:34.658923+0000, chain.objs.size()=1 2024-09-14T11:58:37.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.O049MV-qF-O44dgNkKdIv5la3m2vT4O_0 2024-09-14T11:58:37.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9474344083981062302', time=2024-09-14T13:40:34.737334+0000, chain.objs.size()=1 2024-09-14T11:58:37.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H-WGEa8LjC58HoMyJ_znRF0NUYVCV7K_0 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13755700725855125452', time=2024-09-14T13:40:35.100998+0000, chain.objs.size()=1 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.toaTLqZLcLUBhRDQI8LHH55ZQTiTFgV_0 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3090398905059531541', time=2024-09-14T13:40:35.245422+0000, chain.objs.size()=1 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1QdqLnc4AUyXipBAl-bvVw3nK_ns5nc_0 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1464961752070525795', time=2024-09-14T13:40:35.885547+0000, chain.objs.size()=1 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3UslzOZHeJIkm9VkCmhYZpWeXWThSW2_0 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5705200477648568642', time=2024-09-14T13:40:36.050388+0000, chain.objs.size()=1 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.258+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7EiGchh6Yc-FP3l_BPwr0HOYAPv-Jtw_0 2024-09-14T11:58:37.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11434674728448979810', time=2024-09-14T13:40:37.099040+0000, chain.objs.size()=1 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QlEcNcKnrMjlj70yFhKsJsW8tejRgTF_0 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18211978718578346829', time=2024-09-14T13:40:37.099615+0000, chain.objs.size()=1 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mPkhy80B3myA_9Ho3fveZjjj84IGEsZ_0 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7450344872216295980', time=2024-09-14T13:40:38.460805+0000, chain.objs.size()=1 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.W-Z9_U3BUuJdg2xP_CgelIJFWPhEqQn_0 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16409325571851026561', time=2024-09-14T13:40:38.581632+0000, chain.objs.size()=1 2024-09-14T11:58:37.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6vhWCLrIZL7rJj3WTFsuTsRcVYDL5KN_0 2024-09-14T11:58:37.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.261+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13776895251794771349', time=2024-09-14T13:40:39.122104+0000, chain.objs.size()=1 2024-09-14T11:58:37.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.261+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OdxQWgnzUMsqDmz602veIgghGjo1T5j_0 2024-09-14T11:58:37.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.263+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4754928479834726657', time=2024-09-14T13:40:39.177051+0000, chain.objs.size()=1 2024-09-14T11:58:37.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.263+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5R3jh212DgnQMxueTfvH_Or1QYfserJ_0 2024-09-14T11:58:37.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.264+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16384753744963778100', time=2024-09-14T13:40:39.179394+0000, chain.objs.size()=1 2024-09-14T11:58:37.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DBoYE9m4l1H3_4T5PNwW60nP_digLsW_0 2024-09-14T11:58:37.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.269+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/72864 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10649140410995484311', time=2024-09-14T13:40:40.126922+0000, chain.objs.size()=1 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Rfad8wFuymQ3nfiHSc9CjJLWuXrxMx4_0 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5165108902611987818', time=2024-09-14T13:40:40.845254+0000, chain.objs.size()=1 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WKiw2Un1x6x6uBYj0e0tj6pHQC_sUmq_0 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10018335665870557214', time=2024-09-14T13:40:41.024595+0000, chain.objs.size()=1 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.J2SyT5fb_8yfKm8M41vQyED1VN7bnYT_0 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17159424871245104981', time=2024-09-14T13:40:41.397455+0000, chain.objs.size()=1 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DgURomlTRISl_gLlGZ-6S8dRpTiCPTA_0 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8934148267124975598', time=2024-09-14T13:40:42.248517+0000, chain.objs.size()=1 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.r0PYLngWs_wUE0rSuCp2TetvcNHT0Yb_0 2024-09-14T11:58:37.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12834526560311046387', time=2024-09-14T13:40:43.199613+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pytECIDaXXBiqamfzu1INwjPFQcFOfQ_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10497590077795221930', time=2024-09-14T13:41:17.981098+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.382__shadow_.ZvbC1p32xyUs_V1CSinhZBvUjTEYRra_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3845883055397342222', time=2024-09-14T13:41:37.230998+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.410__shadow_.1u2U7Pf-9EDkbTtuOQBTOwLZX9y27Du_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13600329053038560085', time=2024-09-14T13:42:08.529088+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.457__shadow_.if1V36bjTaS00bE5v1Tl84I2rVu0Jny_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7176429608859040184', time=2024-09-14T13:42:13.240560+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.462__shadow_.irnu5mROdSlhT7qfPp7mPf4MW_JZ1FJ_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8382197226063518619', time=2024-09-14T13:42:24.818910+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.482__shadow_.Rn6JCGyP9rVVrmCTSqJSOk6Ab_qJLJP_0 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13525705630660206802', time=2024-09-14T13:42:37.701810+0000, chain.objs.size()=1 2024-09-14T11:58:37.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.273+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.496__shadow_.oPpt7kErGtOQUqYupnvNazm0SoWHSIG_0 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2538004166781946167', time=2024-09-14T13:42:40.930661+0000, chain.objs.size()=1 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.500__shadow_.SR76uI-_axL6PPaJAQXqH0ebhh_sI35_0 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2792781389288508274', time=2024-09-14T13:42:59.641927+0000, chain.objs.size()=1 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.517__multipart_mymultipartcopy.2~u055EoxBG5kpbgUJ3jFIvXrww0jPO3Q.1 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9772330192434871195', time=2024-09-14T13:43:16.674368+0000, chain.objs.size()=6 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.1 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.2 2024-09-14T11:58:37.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.3 2024-09-14T11:58:37.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.278+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.4 2024-09-14T11:58:37.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.278+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.5 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.520__multipart_mymultipart.2~dQRrbfOckkdPlrCr5qaYYREBJ7feVOu.6 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17901513955293981067', time=2024-09-14T13:45:50.305902+0000, chain.objs.size()=1 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.552__shadow_.sXU4NmW0ttFWPeCxqQ4shP6c3KHx5vF_0 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3335872786233048328', time=2024-09-14T13:47:00.102398+0000, chain.objs.size()=1 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:JuxDNp.JH3Zph63LvHKHmlinBVpVGDF_.PLOgakVqD-0Ui0XstMxZ2WCee2WV-pj_0 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16774965757185134550', time=2024-09-14T13:47:39.450924+0000, chain.objs.size()=1 2024-09-14T11:58:37.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.587__shadow:MaGZcpR5p1.vtN0nkBedDeywuv8XpPx_.p_CeUkEn6GSshLM4bkr4nMc8gqBmM3T_0 2024-09-14T11:58:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12995483396471115302', time=2024-09-14T13:47:51.407492+0000, chain.objs.size()=1 2024-09-14T11:58:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.605__shadow_.fdplrE_kNnGYn4-hBzEwemusigCYQF__0 2024-09-14T11:58:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15160993222197714567', time=2024-09-14T13:51:51.136103+0000, chain.objs.size()=1 2024-09-14T11:58:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.638__shadow_.EBN5ed-7Vj-Aw99jgshCGFVffnmoihc_0 2024-09-14T11:58:37.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11024051151773204863', time=2024-09-14T13:51:52.245126+0000, chain.objs.size()=1 2024-09-14T11:58:37.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.640__shadow_.uCkVSVTdV5pP9lJrGlo0uK8SlduonTi_0 2024-09-14T11:58:37.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2007639426610277234', time=2024-09-14T13:52:51.603539+0000, chain.objs.size()=1 2024-09-14T11:58:37.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.695__shadow:KUBc1C1VPVTVDQAi30LE5A9AvwEFWK6_.x_8ZyhN0uW8vtrHij4QCAKMS06uBeZ__0 2024-09-14T11:58:37.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16107560801057400345', time=2024-09-14T13:53:54.579864+0000, chain.objs.size()=1 2024-09-14T11:58:37.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.743__multipart_mymultipart3.2~2DhiYQPRiLMLzCdVWChoeCI9znQ4hG8.1 2024-09-14T11:58:37.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.288+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.289 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.291+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:58:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.292+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54091' 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2202199413550742973', time=2024-09-14T13:35:03.283356+0000, chain.objs.size()=1 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.177__shadow_.tuePQv7GuZAvnvt0-CsxCLWiO1j1-9K_0 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17556044575991005292', time=2024-09-14T13:35:10.130917+0000, chain.objs.size()=1 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.189__shadow_.03rYBeShLTiGSSk0x4_0yRbnuZun5F8_0 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3505952419068061141', time=2024-09-14T13:37:15.586577+0000, chain.objs.size()=1 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.258__shadow_.kzAKg_6zG6l7DSxgHudLXvzWrT7JhPB_0 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1702137109520523639', time=2024-09-14T13:37:57.736230+0000, chain.objs.size()=1 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.skhmETAWuma573H8cd_-t3puYRMWbB2_0 2024-09-14T11:58:37.292 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6614093893413854312', time=2024-09-14T13:37:58.248168+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WPwihqmg98A1L905HIC9D8F8wbvqP4E_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17310380741959919296', time=2024-09-14T13:37:58.458709+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oqjcWu56oFDpgePJkxyciRFPZGsB3zT_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9785021073997695789', time=2024-09-14T13:37:59.644592+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.86xHRZp5un-f1UK-HN1_jKqXxrTlO1N_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1195382893428272735', time=2024-09-14T13:38:00.108902+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NBRC6-mpRwe17iSg2AJrZG24qp7AI-o_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12941591730864739622', time=2024-09-14T13:38:00.449739+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RDZoQeH3PpvvW6KqSOd9WjO9bTXUSmy_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1290875714472655009', time=2024-09-14T13:38:00.513471+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.293+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nhln3HsbfnJ2ud7w11cYg-j0ioReZQE_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.294+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4252424199351704831', time=2024-09-14T13:38:00.593033+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.294+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5sBJkqPbKlnsY4mXnMqFzQFdU-CV-8B_0 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.294+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13352848231759075865', time=2024-09-14T13:38:01.208685+0000, chain.objs.size()=1 2024-09-14T11:58:37.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.294+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cuoYrtXT2v-V13QR2e744jUN6vvVLqv_0 2024-09-14T11:58:37.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.296+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1918147707534654619', time=2024-09-14T13:38:01.712125+0000, chain.objs.size()=1 2024-09-14T11:58:37.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.296+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.M24laAZkhRuIzjbGnDKyGpg8ANHX-xI_0 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7286841993879006259', time=2024-09-14T13:38:01.754673+0000, chain.objs.size()=1 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ASNYY4gQ9X2x3ugWBZRtfUy9RXxx_xd_0 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17387640087999470053', time=2024-09-14T13:38:01.936314+0000, chain.objs.size()=1 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pedV8KEGkYzWccBzBrMrLXZvhz_ust3_0 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16967064841751339121', time=2024-09-14T13:38:02.301360+0000, chain.objs.size()=1 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EqpAcqPsxjmW9CjXOTWntQov2G08l2P_0 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16856571122299199318', time=2024-09-14T13:38:02.987507+0000, chain.objs.size()=1 2024-09-14T11:58:37.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.298+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Tiu1f0g8UjwCX6oK7kYEoXW8bEQwVs-_0 2024-09-14T11:58:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10571614963879784612', time=2024-09-14T13:38:03.439686+0000, chain.objs.size()=1 2024-09-14T11:58:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.G2Epig6UQ61igTH779KVX-2cAo0IinJ_0 2024-09-14T11:58:37.297 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6363360940398154280', time=2024-09-14T13:38:03.490201+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._tcT7cZ1l1iKXslglDbCauaI7uiSzJA_0 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13197222095171316363', time=2024-09-14T13:38:03.656200+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zW1XkQsAHOkZQwUEh3OhRXesIY1XyPy_0 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11984039635647275732', time=2024-09-14T13:38:04.774003+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ekPsCtlssr-aId_jxB2b0lArB6DgJwt_0 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3241405222707504085', time=2024-09-14T13:38:04.774777+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zWk5MrcU058Yhk7M2JThu_EhPdZBSOE_0 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13084046753248339246', time=2024-09-14T13:38:05.244145+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.299+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xfa58W0c1VlMKyr6ic-IRee0TpEAnZ6_0 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.300+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13199587766637989246', time=2024-09-14T13:38:05.374052+0000, chain.objs.size()=1 2024-09-14T11:58:37.298 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.300+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NeHK6WSRDcJjM_lsOduUjzObM204Foq_0 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2684553123899384397', time=2024-09-14T13:38:05.720503+0000, chain.objs.size()=1 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FLwHQWpsulMlY_K_YisM5XSZ_xH-hNW_0 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11348854346083034937', time=2024-09-14T13:38:06.165934+0000, chain.objs.size()=1 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.e2QII7L9JB1SRqr17cwHNW8HREG1L9W_0 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11376706224359888663', time=2024-09-14T13:38:06.520313+0000, chain.objs.size()=1 2024-09-14T11:58:37.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.302+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VP-W4uVXgq3tSeQlim3nwMlTgsaFt2o_0 2024-09-14T11:58:37.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11844718082714844146', time=2024-09-14T13:38:06.740932+0000, chain.objs.size()=1 2024-09-14T11:58:37.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aATQmRtAf7P2nrfzwTLi_IvjLWWAXhH_0 2024-09-14T11:58:37.302 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5487309839625238905', time=2024-09-14T13:38:06.859970+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6KXMXoc-cdaQ0cpGmVSVE2dGP9N0cbk_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16860116134442212982', time=2024-09-14T13:38:07.136824+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1g5SW2JIgYbiascvTHsLT4RI8h-ivYn_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14206609512641284042', time=2024-09-14T13:38:07.334073+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ocX14yH_EKBnsB7jz95mxpM8BTftrD5_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13413681857937729076', time=2024-09-14T13:38:08.068448+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KFonUKik3ULep7861sKd4Rids7k9CZo_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2780667508884914791', time=2024-09-14T13:38:08.110443+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ARjN8zoPqoMJ16XvttIqLaFWI4cL6nC_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13195520100129691736', time=2024-09-14T13:38:08.384780+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AaeQBAfKd0bamQKrgqYoJlEaXzktrld_0 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5963643584361141518', time=2024-09-14T13:38:08.618727+0000, chain.objs.size()=1 2024-09-14T11:58:37.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BzCVbg3E6b7SwJadvIAWtMTIyScmYCs_0 2024-09-14T11:58:37.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7424323265625625930', time=2024-09-14T13:38:09.710593+0000, chain.objs.size()=1 2024-09-14T11:58:37.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ayldep2FzwCpuKEtkq4pATQBzOfg9_6_0 2024-09-14T11:58:37.306 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9005634118326295613', time=2024-09-14T13:38:29.131665+0000, chain.objs.size()=1 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.289__shadow_.Vz7ohOvEi92RDPZdd8xmQtd_bmbmMcZ_0 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14187788043422368895', time=2024-09-14T13:38:33.472943+0000, chain.objs.size()=1 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.WI71bIM1gFISn0a7LPjls3HpS7NgZK__0 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7130284995302320794', time=2024-09-14T13:38:35.691835+0000, chain.objs.size()=1 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.308+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.crZ85quI02gYsmF5jN7BkqBqyhhq_nL_0 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4558832978530237403', time=2024-09-14T13:39:38.481212+0000, chain.objs.size()=1 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.01u4e2z4rhRVNKGU9P0ngOa8AO-2WnP_0 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12298514617655303995', time=2024-09-14T13:39:38.547280+0000, chain.objs.size()=1 2024-09-14T11:58:37.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kwOW1aSs3gwERkE5P8rljhQFmH7Fa6-_0 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7209950892627167742', time=2024-09-14T13:39:38.998788+0000, chain.objs.size()=1 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RmyhyIfvMv6bGpu3wS_zKaL49m_NV66_0 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.310+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16459297696940350859', time=2024-09-14T13:39:39.051576+0000, chain.objs.size()=1 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.310+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OXaFToxjt1Y0tY8anWV0YgSH00XxW20_0 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.310+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11184223241875186741', time=2024-09-14T13:39:39.100742+0000, chain.objs.size()=1 2024-09-14T11:58:37.308 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.310+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TwRkK85-3wB59ews78Q_HshxVkquAq2_0 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2491610754560244462', time=2024-09-14T13:39:39.356415+0000, chain.objs.size()=1 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Jy0p3m3SfOtC-avqbBdnDGweYwoj3--_0 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12210007628469953589', time=2024-09-14T13:39:39.644469+0000, chain.objs.size()=1 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2vgw9hNFa_Lj4hUxOwmPFEU6DGKufZd_0 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6635115678712044989', time=2024-09-14T13:39:40.481495+0000, chain.objs.size()=1 2024-09-14T11:58:37.310 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Po13V7Z5iIKXZqVSjWNNdY5Qxq0houi_0 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16731963724924022083', time=2024-09-14T13:39:40.654050+0000, chain.objs.size()=1 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3Rm-0erW2YLMmgSZKNxBdLVgIx9FfaE_0 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6276473709872098125', time=2024-09-14T13:39:40.726967+0000, chain.objs.size()=1 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3czpSVwSdH4YpmqzmjMScdO_z5DTEwy_0 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18332076259774432971', time=2024-09-14T13:39:40.949507+0000, chain.objs.size()=1 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ux9g5YC-EpiL5nkleoNcuQRug2ehdlk_0 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16903261349148528771', time=2024-09-14T13:39:41.006604+0000, chain.objs.size()=1 2024-09-14T11:58:37.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.312+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LnZ4MqsqB4m1VYsvQZP8d-_JzMhlQ7-_0 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2534234032166427707', time=2024-09-14T13:39:41.283989+0000, chain.objs.size()=1 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nLx5yL1uDciVtZMELxXBD0rTzjclLWw_0 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13974715309780627642', time=2024-09-14T13:39:41.480006+0000, chain.objs.size()=1 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1Sa_LhbGL9a8SGZBuKCZS4L6tTWWkrO_0 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11527208933824095018', time=2024-09-14T13:39:42.324538+0000, chain.objs.size()=1 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.W2bcGpny1cTkzBBfJOi8JpHp9xfG1CG_0 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7884728585033065366', time=2024-09-14T13:39:42.579782+0000, chain.objs.size()=1 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zm-zhczmQSeSfOa2013R5fxmC2KQWtC_0 2024-09-14T11:58:37.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4474091691519470465', time=2024-09-14T13:39:43.187172+0000, chain.objs.size()=1 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uBVj8_8ZM_6cGnqjxATaezwwc__y4Lx_0 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6783895762097757940', time=2024-09-14T13:39:44.348387+0000, chain.objs.size()=1 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aJe6L1xywaTek2pZSdqcT7VCr8acP0o_0 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10297719442494193245', time=2024-09-14T13:39:45.240769+0000, chain.objs.size()=1 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.317+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AD0Wy048caE9Gs0bsfEi0BgNnS-1Lur_0 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13269827575798881494', time=2024-09-14T13:39:45.299243+0000, chain.objs.size()=1 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YKtyYzTcT-X1gd3dFnxXJqLnTLnm0a__0 2024-09-14T11:58:37.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15305426721716277562', time=2024-09-14T13:39:45.882030+0000, chain.objs.size()=1 2024-09-14T11:58:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.X5Av68ZbBrrscCOt8B33pYes4q3zoUO_0 2024-09-14T11:58:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.319+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12812174383449651815', time=2024-09-14T13:39:46.500898+0000, chain.objs.size()=1 2024-09-14T11:58:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.319+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.j-TwprKCcqF6ZZ7cn98oDWOB2TBqTY9_0 2024-09-14T11:58:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.319+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2380489986450799577', time=2024-09-14T13:39:47.153565+0000, chain.objs.size()=1 2024-09-14T11:58:37.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.319+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.V0x2ThKtQPia272i3TFYWICOeK8AkV1_0 2024-09-14T11:58:37.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.321+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6832002514605977471', time=2024-09-14T13:39:47.193076+0000, chain.objs.size()=1 2024-09-14T11:58:37.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.321+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8U1Tby9XERKXWBXNgrX3GJ4o-SW_IGi_0 2024-09-14T11:58:37.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15869269258771900803', time=2024-09-14T13:39:47.335913+0000, chain.objs.size()=1 2024-09-14T11:58:37.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IIWsnYPDYYgLL3OJDI1uPExU0ZQSWkm_0 2024-09-14T11:58:37.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2476673226743371316', time=2024-09-14T13:39:47.336865+0000, chain.objs.size()=1 2024-09-14T11:58:37.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8lhJwWDTavnKVp4fDBu9ToKPo3npb0m_0 2024-09-14T11:58:37.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7452580759493075002', time=2024-09-14T13:39:47.883935+0000, chain.objs.size()=1 2024-09-14T11:58:37.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cAJ_peLPYVEpUWyEbdEPQhb4wCbngz0_0 2024-09-14T11:58:37.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17090760717526686917', time=2024-09-14T13:39:47.934044+0000, chain.objs.size()=1 2024-09-14T11:58:37.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.deQ741d7DJcTTXvK-q3foaYBdh8K10i_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6588943712442055738', time=2024-09-14T13:39:48.616576+0000, chain.objs.size()=1 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ecoMRlL2H6m5Qt3S8Li_TD81095-XIX_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18296489954603069336', time=2024-09-14T13:39:48.991606+0000, chain.objs.size()=1 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xB75ET8350hKOOcgrQrkUrSVK_r9SMC_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7204662101526198624', time=2024-09-14T13:39:49.945606+0000, chain.objs.size()=1 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.x4221aBD5OBAHfmhKzdwBy4WtC3uS8n_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15684865256744389922', time=2024-09-14T13:39:49.946659+0000, chain.objs.size()=1 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HxC9U-T0MgR33QB5pdIohIGqYg67133_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4162622731253226049', time=2024-09-14T13:39:50.839953+0000, chain.objs.size()=1 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Jz__FRUNqG62HSiCiO2949ZT7uPvTMC_0 2024-09-14T11:58:37.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14840746117604245029', time=2024-09-14T13:39:50.862482+0000, chain.objs.size()=1 2024-09-14T11:58:37.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.324+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.w2zsx5RvtTPnHuuyFK10jY44jNe7Th4_0 2024-09-14T11:58:37.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.326+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16935255364954405947', time=2024-09-14T13:40:30.867519+0000, chain.objs.size()=1 2024-09-14T11:58:37.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.326+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yu_txkbPDQbF7Qur6k0dcjWaCfgoVi3_0 2024-09-14T11:58:37.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15515748949662651073', time=2024-09-14T13:40:31.154451+0000, chain.objs.size()=1 2024-09-14T11:58:37.325 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IuPMhlVPL5Dt28vNC_x6R6HmzJ-BeEJ_0 2024-09-14T11:58:37.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6767462455117759945', time=2024-09-14T13:40:31.335459+0000, chain.objs.size()=1 2024-09-14T11:58:37.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WNOkM17TItH3Daby4pzIcIA1vS2SLnE_0 2024-09-14T11:58:37.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7418229168297249559', time=2024-09-14T13:40:31.499823+0000, chain.objs.size()=1 2024-09-14T11:58:37.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.327+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OXVYB4yWe4wRHTBiflO6ZKIQocw6tR1_0 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11551759869826936695', time=2024-09-14T13:40:31.612412+0000, chain.objs.size()=1 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.khmSsIg8ncCkNbiVUPK7K-en38pLMfN_0 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16594442861859050904', time=2024-09-14T13:40:31.706847+0000, chain.objs.size()=1 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.y0K4POcLBwUGAGTmnHoLVr_i6m_hbff_0 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4059307506663275815', time=2024-09-14T13:40:31.752480+0000, chain.objs.size()=1 2024-09-14T11:58:37.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.329+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zUJOqK2sI47lWGIEr6IYpUggOa6WAV-_0 2024-09-14T11:58:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.330+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9948221509108670449', time=2024-09-14T13:40:32.538812+0000, chain.objs.size()=1 2024-09-14T11:58:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.330+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ORjTWzyJCsc5d-cDXPU0JKvhCMrMvgw_0 2024-09-14T11:58:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.330+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2186314535236465730', time=2024-09-14T13:40:33.210423+0000, chain.objs.size()=1 2024-09-14T11:58:37.328 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.330+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-xUt1AKOV4pKRxJMKY1CDvL84QbITzb_0 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5948221855322079138', time=2024-09-14T13:40:33.421596+0000, chain.objs.size()=1 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.b1QTiMxqG2c35QAMsW3Ysl7HM9rAbOn_0 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13091585325954018296', time=2024-09-14T13:40:34.590330+0000, chain.objs.size()=1 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.W0n8NRR9yF3O8hgmQJ-HdfNxWrcSd2q_0 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3081318197245965990', time=2024-09-14T13:40:34.832867+0000, chain.objs.size()=1 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Y-U7TMBFdjY9GxFMZW70e4E3eYA1uxa_0 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1743317805844820557', time=2024-09-14T13:40:34.903504+0000, chain.objs.size()=1 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EwduUJ0ZGsxhuf_vbaCuXXNCf60P7ZJ_0 2024-09-14T11:58:37.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3841258140438963489', time=2024-09-14T13:40:34.990940+0000, chain.objs.size()=1 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HvP_ld-5Az7CJETPZVZpTH3M5TW36S__0 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4911585661455028219', time=2024-09-14T13:40:35.954420+0000, chain.objs.size()=1 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9rMqakDsESUaKPcRlZCCn-eB8_U0v_W_0 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16395310741226340266', time=2024-09-14T13:40:36.659559+0000, chain.objs.size()=1 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9j-JkOYPwHgojxHorZ5fpyJsq8M668q_0 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2652746322888015661', time=2024-09-14T13:40:36.717704+0000, chain.objs.size()=1 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KDRT7Jr4AGm-g9AvhSo433aVdeUCv4__0 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8588420554254989382', time=2024-09-14T13:40:36.936162+0000, chain.objs.size()=1 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ahKW9KXsSeBh8i3qOipjqBI3_cFHS_b_0 2024-09-14T11:58:37.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1353390421186021080', time=2024-09-14T13:40:37.959233+0000, chain.objs.size()=1 2024-09-14T11:58:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2bbGHjxYszwXw5xZPRdNdo3eT-psO9V_0 2024-09-14T11:58:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13575040053342478685', time=2024-09-14T13:40:38.216504+0000, chain.objs.size()=1 2024-09-14T11:58:37.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5ckvUQ40AeSiQcLSe4p56hFjDmGrueS_0 2024-09-14T11:58:37.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4340796394228604527', time=2024-09-14T13:40:38.217094+0000, chain.objs.size()=1 2024-09-14T11:58:37.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fv4Hxk9oXi0e7EWLv-TQzkz6wNuQMKF_0 2024-09-14T11:58:37.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8829661533792853480', time=2024-09-14T13:40:39.801585+0000, chain.objs.size()=1 2024-09-14T11:58:37.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zOclu9NdzmzHFkX32SKpALRPRJWxbBJ_0 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5687309352870970285', time=2024-09-14T13:40:40.023184+0000, chain.objs.size()=1 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IzM-UEbKy8QP1EsOPzUtjXPoddfOClw_0 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11496730275942972692', time=2024-09-14T13:40:40.098659+0000, chain.objs.size()=1 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Ghmv2vNZRtzHH1kWUAqoEXnDD4mJTWn_0 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3559908531163014545', time=2024-09-14T13:40:40.117990+0000, chain.objs.size()=1 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6MSn49r-I2WUQmikU6LM4zMrllg5SqU_0 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1668787241386054994', time=2024-09-14T13:40:40.178391+0000, chain.objs.size()=1 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IL-9o8irQR1JLmmC7IoFm5zYp0D85_H_0 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17577935263595035170', time=2024-09-14T13:40:41.137500+0000, chain.objs.size()=1 2024-09-14T11:58:37.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.deJxUrObvfkqLIC32RRbW0LiimMoYV__0 2024-09-14T11:58:37.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.343+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/54091 2024-09-14T11:58:37.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:58:37.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9793175199790755012', time=2024-09-14T13:40:41.521633+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BxqrtgHmtQkeJOSicy_h-q8h3QumvwG_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15166187269873681425', time=2024-09-14T13:40:41.742067+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nN-81Mqcnkan71m32Wkagcc5Xq11S0j_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1433985355124392135', time=2024-09-14T13:40:42.206384+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SVyVwMp84qPAcbFsIqqIZUr9ml27CDM_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12317594691026269855', time=2024-09-14T13:40:42.245634+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-QHUWspbgIlJcwVcc_DxcXh2S1TQj7g_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10662075587914858085', time=2024-09-14T13:40:42.521293+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yCMljSKo5A6mhKyzKA53Hdf95x1EZ3k_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18222066992802018597', time=2024-09-14T13:40:42.633270+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6KnCHbPc5ZAav-hOsL6fLruf1UaQX3X_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11184685959502810551', time=2024-09-14T13:40:42.708683+0000, chain.objs.size()=1 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oa9fmOzSENhmQe-2oYdwi3A-jAbEfSW_0 2024-09-14T11:58:37.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11846131653413110896', time=2024-09-14T13:40:49.473385+0000, chain.objs.size()=1 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.335__shadow_.CZbGZvvmDHfKtOXHLGW5uK8T3b46VDL_0 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14329278846692522913', time=2024-09-14T13:41:11.586730+0000, chain.objs.size()=1 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.374__shadow_.V0_AfLt6Seh9FTWrkvuaZ7BkC-sMNer_0 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9934117829947742185', time=2024-09-14T13:42:07.600340+0000, chain.objs.size()=1 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.456__shadow_.SSSoM1c9NnUcWH3PuV6ibJnVgCv7UJt_0 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6987326338964949545', time=2024-09-14T13:42:39.856613+0000, chain.objs.size()=1 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.499__shadow_.L1RGOpjurXSZqE_enYYjTrmuDtm9uUT_0 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.294018839739206392', time=2024-09-14T13:42:44.387842+0000, chain.objs.size()=1 2024-09-14T11:58:37.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2939071564011341386', time=2024-09-14T13:43:07.019971+0000, chain.objs.size()=1 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.X4iHZPIw45diohlOvRQKZKGOPusPlQK_0 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16669696798960440411', time=2024-09-14T13:45:26.994476+0000, chain.objs.size()=4 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.536__multipart_mymultipart.2~_gWVCRT1Zvv7o_GrrGdJ8d7ijjG7MRv.1 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.536__multipart_mymultipart.2~_gWVCRT1Zvv7o_GrrGdJ8d7ijjG7MRv.2 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.536__multipart_mymultipart._ZL-RrwoiZwsYtJs-5DtDxu3NJooqvbR.3 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.536__multipart_mymultipart.2~_gWVCRT1Zvv7o_GrrGdJ8d7ijjG7MRv.4 2024-09-14T11:58:37.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16029895994047303664', time=2024-09-14T13:46:28.935779+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:BBCvw5wS7MHsHR.ZJyjXhy9Pi-EzLhg_.1NVfYlSvnWtpTuDznYi-azadmaOo8T3_0 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12773040272237185163', time=2024-09-14T13:46:45.697551+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:FyJ7k15-HjwhEPYPN7WRUCpB7lULw7l_.Iofw94aZ_Bd1hX5Vc7s7SybTE5TwUsV_0 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16368719230965419464', time=2024-09-14T13:46:48.681843+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:kIB3goNwYaMuQZr.mQAoFqgPFFOe0iG_.h3_rFHOrlBxHjYmcNWUss13xN5Fx72L_0 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17992372771010583865', time=2024-09-14T13:46:58.461469+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:M-eIzMj0cgTmC6wEUH75xCmnccwCJKH_.bUd9T0VB2IlqghST4xhqAO90FhUKGd0_0 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12471013645975805586', time=2024-09-14T13:47:31.949914+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:KJt11oaHl03MdsvW4O8FOola3jRQEWy_.mxBTtoHZji4mwnUlpdTTspvVysnemtH_0 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4713359105255907204', time=2024-09-14T13:47:35.125517+0000, chain.objs.size()=1 2024-09-14T11:58:37.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.583__shadow:Af67CMCjB4wiDL7yrheIjctq8dSrR2g_.4dwr-mZgSgFukfnU-c7kBnLXzMLTlio_0 2024-09-14T11:58:37.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.353+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10667397686747836427', time=2024-09-14T13:47:36.172156+0000, chain.objs.size()=1 2024-09-14T11:58:37.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.353+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.584__shadow:wMzXsEewIN0mmFpx74Uhpjj1ufUF7kY_.uDTIFpes60wEBg4Ch2foLmAzVppOp6z_0 2024-09-14T11:58:37.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.353+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11416360327037077441', time=2024-09-14T13:47:41.113806+0000, chain.objs.size()=1 2024-09-14T11:58:37.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.353+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:Mo2IozUYggsDw.y.FPyx5BHmGYyISQu_.hg3encGgRUJvR6VhKzJvqyFqRikFWQT_0 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15424884110207294416', time=2024-09-14T13:52:49.622779+0000, chain.objs.size()=1 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.692__shadow_.JoOi6SmStSOEZ_NEFZZra5XSfzBwecI_0 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2755612457888200017', time=2024-09-14T13:53:27.098154+0000, chain.objs.size()=1 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.718__shadow:GoD4zRSXggJnfIWOnVhh7VZ0Fh2KBkV_.Z2YQp2Ewh7Igo2RZ-zwsMhfn0i8wTgy_0 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11461680306862278966', time=2024-09-14T13:53:51.194077+0000, chain.objs.size()=1 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.740__shadow_.5jr3A3NSJ0mrNXF74k-zjszDJJ380F__0 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1606644992856289949', time=2024-09-14T13:55:32.399684+0000, chain.objs.size()=1 2024-09-14T11:58:37.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.765__shadow_.K3BP7Ywyj9FQHSTMkuPJcu5wz1WTbFe_0 2024-09-14T11:58:37.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.359+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.363 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.365+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:58:37.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.366+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.367+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52297' 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_-G24uQz2oAyo179ZbMTXViiKx7Xf1Fq', time=2024-09-14T13:34:42.294156+0000, chain.objs.size()=3 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.YXS2qdMfXwox5yVSdzpAGWPIRQvo3qq_0 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.YXS2qdMfXwox5yVSdzpAGWPIRQvo3qq_1 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.YXS2qdMfXwox5yVSdzpAGWPIRQvo3qq_2 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.884021862239795193', time=2024-09-14T13:34:45.280877+0000, chain.objs.size()=1 2024-09-14T11:58:37.366 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.163__shadow_.Wyrnob9tod8kQZnQ-hZho02c9z2MNA2_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.478289458366080990', time=2024-09-14T13:34:47.421927+0000, chain.objs.size()=2 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.165__multipart_foo.2~1VJIsnH0euPi6xL9GO0Q8KzEKZYT714.1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.165__multipart_foo.2~1VJIsnH0euPi6xL9GO0Q8KzEKZYT714.2 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10275323413673531607', time=2024-09-14T13:36:55.507159+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.232__shadow_.5HeZKMWVpDBhoz1Te_iY1MNEHTsbGhp_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6751264866377501848', time=2024-09-14T13:37:17.756926+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.261__shadow_.q7f2zo3bPeYh_EOGhr2LlcZ6ZLoSZAf_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16841367617961203504', time=2024-09-14T13:37:18.577094+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.262__shadow_.-XQzYcfxc7eEIl8LMz0wWww54fsK9xi_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17977963365095131097', time=2024-09-14T13:37:57.706730+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.npQLvXxyU1ATqHStTaIb47RHAt2INxK_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.109642452420020638', time=2024-09-14T13:37:57.914578+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xnWcyRV6rkmYFdaEV6Ndar0o-jADXCs_0 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13430226635223740942', time=2024-09-14T13:37:58.318890+0000, chain.objs.size()=1 2024-09-14T11:58:37.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.368+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.N9H1mbthLogWt90uefJY9GbOJ2cdRaH_0 2024-09-14T11:58:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.371+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6927815134975335952', time=2024-09-14T13:37:58.395730+0000, chain.objs.size()=1 2024-09-14T11:58:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.371+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WUyhbpMKnwAX0FX5txdk5UNt7R1AoPp_0 2024-09-14T11:58:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.371+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12361333906505436315', time=2024-09-14T13:37:58.398438+0000, chain.objs.size()=1 2024-09-14T11:58:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.371+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Jo7UEcW0_RcgvH3t2TFOVrX2kogX6hU_0 2024-09-14T11:58:37.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.247348827311641028', time=2024-09-14T13:37:58.464105+0000, chain.objs.size()=1 2024-09-14T11:58:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5B-2w599BRMU5ju-6g-y_XjixqTLwuf_0 2024-09-14T11:58:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7326871715860446073', time=2024-09-14T13:37:59.466051+0000, chain.objs.size()=1 2024-09-14T11:58:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EPYLRkJiECRwyqiWA47psesCgTCwnzI_0 2024-09-14T11:58:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7377636079636937925', time=2024-09-14T13:38:00.265129+0000, chain.objs.size()=1 2024-09-14T11:58:37.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.372+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lhMuzd_Uq7zy5bK7jb9l8Uo7zzN404u_0 2024-09-14T11:58:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6386909444664489669', time=2024-09-14T13:38:01.369435+0000, chain.objs.size()=1 2024-09-14T11:58:37.372 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.M6uNL6FYh6ME2kOQ2JmqXOU0kdV_Hv2_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4105881519378090720', time=2024-09-14T13:38:01.408236+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.T8aDhU_SicxoUd2FytPMa_ie83lZAOI_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3113964956552068393', time=2024-09-14T13:38:01.893024+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FwW5sZg1qFoRWAFxTbuUWOzfIihmKNM_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3207903300803460775', time=2024-09-14T13:38:01.909569+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BJaucAVpQiQpdpfnARtpdrKaqOhDgiZ_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8535577974832495027', time=2024-09-14T13:38:02.889765+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.s4Xiy20NzRoJRZAXsYgoc5iR2t5wmrx_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10583306847559327265', time=2024-09-14T13:38:03.290604+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.374+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b4D00DsTEdVOC_3-Px7NN6emDPsCnW7_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.375+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11903728624891313066', time=2024-09-14T13:38:03.592160+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.375+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9-QqRDO9oq23DNjDlKVzIhPlbyHfGeM_0 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.375+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1906484883831258768', time=2024-09-14T13:38:03.683434+0000, chain.objs.size()=1 2024-09-14T11:58:37.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.375+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UlMmA8G4OdykhdRu4g7VI-L78esRmpS_0 2024-09-14T11:58:37.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3653489627976514500', time=2024-09-14T13:38:03.715336+0000, chain.objs.size()=1 2024-09-14T11:58:37.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wc0frDhsyVQmqzcb1p7ApL_98kpWhqR_0 2024-09-14T11:58:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8716078123833780497', time=2024-09-14T13:38:04.015795+0000, chain.objs.size()=1 2024-09-14T11:58:37.376 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.R5AoVvWVQtmGPGQQ4pOewDfTdnNEvCg_0 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16075984051032076040', time=2024-09-14T13:38:04.555737+0000, chain.objs.size()=1 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2bVW5b92-YfKYpzuFdqvhetty1PHaPX_0 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4758590992465026216', time=2024-09-14T13:38:05.040792+0000, chain.objs.size()=1 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bdhDryDmp83wvsFXRMOvvQuuJVyVw-x_0 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9356388857024516613', time=2024-09-14T13:38:06.190808+0000, chain.objs.size()=1 2024-09-14T11:58:37.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cE_3VjTRgADwqlnGlgdA1hY2Q5FD0Ta_0 2024-09-14T11:58:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8325337162923312458', time=2024-09-14T13:38:06.540199+0000, chain.objs.size()=1 2024-09-14T11:58:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._X6W2Vg8e4x4t2GT-nGc48AZq2BqBpn_0 2024-09-14T11:58:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12126922873916221268', time=2024-09-14T13:38:06.876062+0000, chain.objs.size()=1 2024-09-14T11:58:37.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.380+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6bNnkCcPdGepCRo0Qhw-sn0gL4wDCNV_0 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7506687954687415121', time=2024-09-14T13:38:06.954935+0000, chain.objs.size()=1 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dXVaGGX4HxP7kuYVeOs6uvbOsTGwGhI_0 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15458636604611711025', time=2024-09-14T13:38:07.830812+0000, chain.objs.size()=1 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XuZCsK9HsFct3Is6ATgTVNw7RY20GiD_0 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9061553069457930448', time=2024-09-14T13:38:07.972169+0000, chain.objs.size()=1 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zmhXAbDH--Q-bKGVrq3VK4mZi5pLbsK_0 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12830899075560635711', time=2024-09-14T13:38:08.105414+0000, chain.objs.size()=1 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MB4wc_ySiFg5ZTBduVF1deuY2zzXBea_0 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9076343089763687930', time=2024-09-14T13:38:09.720865+0000, chain.objs.size()=1 2024-09-14T11:58:37.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0t3jWAxPO1SmSKZTq3gxa6se2E9cnDg_0 2024-09-14T11:58:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10924882009670610240', time=2024-09-14T13:38:10.381123+0000, chain.objs.size()=1 2024-09-14T11:58:37.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.t6HuRkpf_GjkLZDyMkaAnXZLqlLFIVM_0 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4420129920760806600', time=2024-09-14T13:38:17.354882+0000, chain.objs.size()=1 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.273__shadow_.avrlwFeXyFCQ-ZHyO7gxUw20-nsGWaI_0 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.621042723465109607', time=2024-09-14T13:38:20.948547+0000, chain.objs.size()=1 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.278__shadow_.urtjMMWHCs-3WAZfTI0Om9hX9MdJ5WX_0 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12645888067497547597', time=2024-09-14T13:38:33.461780+0000, chain.objs.size()=1 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.01RM27B0NH5OdSWX5TPGN0GtZGttB6A_0 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.79283526279154874', time=2024-09-14T13:38:33.515810+0000, chain.objs.size()=1 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.-61pnxWHr0fkBYUkzBXZLQTSuIfwKgR_0 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11415679889370993520', time=2024-09-14T13:38:33.580891+0000, chain.objs.size()=1 2024-09-14T11:58:37.383 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.385+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.CxXjSnr7oCZbVUeRWdrXIgiwUXVXHyw_0 2024-09-14T11:58:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4962980780474623837', time=2024-09-14T13:38:35.557820+0000, chain.objs.size()=1 2024-09-14T11:58:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.hG_O4d2w7TFOETeY3ZbOSeL3HHN9BPD_0 2024-09-14T11:58:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.382185243942679198', time=2024-09-14T13:38:35.593672+0000, chain.objs.size()=1 2024-09-14T11:58:37.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.oEaDgAdHUY_R9yFE-zxFEyaaYUEBWW5_0 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17122270873562963692', time=2024-09-14T13:38:35.596054+0000, chain.objs.size()=1 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.F92DWrLUOwuIYsdlzfODiMfhsc10Odk_0 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13946461636316501263', time=2024-09-14T13:38:35.694733+0000, chain.objs.size()=1 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.JTHGDaH0lYmBBLVb4UyqFLJxP_xjRON_0 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5833306565581988331', time=2024-09-14T13:38:40.262012+0000, chain.objs.size()=1 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.300__shadow_.NETFpdPxo6D3s-QDQbDJmLw6DzS6F2V_0 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1873473850465781722', time=2024-09-14T13:38:45.670210+0000, chain.objs.size()=1 2024-09-14T11:58:37.387 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.389+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.307__shadow_.85j6RXadWd9vaCM6huJQUedvXasQ_FX_0 2024-09-14T11:58:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.390+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16818257867364953704', time=2024-09-14T13:39:38.507608+0000, chain.objs.size()=1 2024-09-14T11:58:37.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.390+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._aiiL8QJb7x27Og7EM2OtQuExlCIbfC_0 2024-09-14T11:58:37.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.391+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14888809857825891423', time=2024-09-14T13:39:39.121942+0000, chain.objs.size()=1 2024-09-14T11:58:37.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.391+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.y8_3TwE4qfdXxTZw-bPhwQOuC76VFHc_0 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11066144402645049113', time=2024-09-14T13:39:39.708762+0000, chain.objs.size()=1 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aO2lvbAwmPd7esZgqCnrrbMocgVoJiV_0 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4972995212895202394', time=2024-09-14T13:39:40.504630+0000, chain.objs.size()=1 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-e3cvuRWjH-BmeG1-RgXUoKe8uYXyY8_0 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7436254309988117834', time=2024-09-14T13:39:40.615613+0000, chain.objs.size()=1 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Kg1krU00WjJgbjCdLzAQDLzNt60VKTu_0 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14267846211769979441', time=2024-09-14T13:39:40.616504+0000, chain.objs.size()=1 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kBLqNCsuO_Pa_M7bMfMNT-m0qjdBUKh_0 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2598611998320452793', time=2024-09-14T13:39:40.861098+0000, chain.objs.size()=1 2024-09-14T11:58:37.390 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.392+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.O2WcK8_4AASXZo4QnTxuec7fEAD3e_O_0 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13769007925015508293', time=2024-09-14T13:39:41.328925+0000, chain.objs.size()=1 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.EO5x-haJtL28G_KVpREWCp8la3tcz0n_0 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14328299068938278516', time=2024-09-14T13:39:41.403182+0000, chain.objs.size()=1 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MzGYFQxXUW4BJJey9HCSGKpcUjE-RX2_0 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10143305780367263861', time=2024-09-14T13:39:42.298932+0000, chain.objs.size()=1 2024-09-14T11:58:37.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cChJKMLdzxK1gDEcwMPhai3GK_w4Y81_0 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12179219270958485515', time=2024-09-14T13:39:42.417812+0000, chain.objs.size()=1 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Yr_Ma7x1r3Dm927XIE53bJp0r0uBebz_0 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2228445111813700379', time=2024-09-14T13:39:42.789763+0000, chain.objs.size()=1 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.d4MEK3_cD9PXH4WEz5Mj-rOpzFBKsje_0 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13997896864202040756', time=2024-09-14T13:39:42.976656+0000, chain.objs.size()=1 2024-09-14T11:58:37.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.395+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.w78GPTw9gMX3jDJKL1gFILtsXJMcNA-_0 2024-09-14T11:58:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8894411721905412956', time=2024-09-14T13:39:43.144861+0000, chain.objs.size()=1 2024-09-14T11:58:37.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.roCiwB4bP4-A8VK82Ot8NBOkThNj-YR_0 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17725587580675286588', time=2024-09-14T13:39:43.653381+0000, chain.objs.size()=1 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bRJrKbipdNy37Pm7vmZRLw3Ra4apPT-_0 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13904463674334740723', time=2024-09-14T13:39:43.787309+0000, chain.objs.size()=1 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Uo5UhBlZ_ggyPFFTjv5hHkw2kc9ZxKL_0 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5074826491049523809', time=2024-09-14T13:39:44.471211+0000, chain.objs.size()=1 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.396+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.h4HtvvAF6o2SHHAaFYKEcNvtWSDRIZX_0 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.397+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13450632034204358876', time=2024-09-14T13:39:44.615251+0000, chain.objs.size()=1 2024-09-14T11:58:37.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.397+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D60nqy52XEp9DkniiaGotK6jf1RviF4_0 2024-09-14T11:58:37.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14850801760558516656', time=2024-09-14T13:39:45.244167+0000, chain.objs.size()=1 2024-09-14T11:58:37.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nMIZdLjngdYI9YOvf0hmRSY0SH2bB2d_0 2024-09-14T11:58:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7124580785271221997', time=2024-09-14T13:39:45.919117+0000, chain.objs.size()=1 2024-09-14T11:58:37.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.X5Tq7yitwM8O3xKmKMm8pl3BlcJNbYf_0 2024-09-14T11:58:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2786009809254671310', time=2024-09-14T13:39:46.112118+0000, chain.objs.size()=1 2024-09-14T11:58:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nbnbSAmxVvhp1YKHiFGECsjrs4qH2ge_0 2024-09-14T11:58:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11976715873116926172', time=2024-09-14T13:39:46.876870+0000, chain.objs.size()=1 2024-09-14T11:58:37.400 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yhjyf3EbNC7p2M65N2Y1dvF0V-f5NiK_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10988372375232335048', time=2024-09-14T13:39:46.994643+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ciUAH5PIQacd1DVYzZ43Nl8rKedk7p-_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3361315791776632976', time=2024-09-14T13:39:47.066553+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ITaPUGv1StX3QUkfN7DmjlDy_JvCtSy_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11942405312064755747', time=2024-09-14T13:39:47.067166+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IhzRA6xr821kl9tj2hMTfPZ8AkKcGpX_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4138922392262362201', time=2024-09-14T13:39:47.082752+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vH685rDG3HSLUGmrriMbWFbvRvJtBBa_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2882398823040649509', time=2024-09-14T13:39:47.227332+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nmFi2TVKLlgjINQJWQYhFnI0CdR2w9k_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4797246266911452034', time=2024-09-14T13:39:47.254220+0000, chain.objs.size()=1 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yGfjaacm0dDn0ailJIo9S6iDVBli_uj_0 2024-09-14T11:58:37.401 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5963184577614283686', time=2024-09-14T13:39:47.405627+0000, chain.objs.size()=1 2024-09-14T11:58:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.402+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.V011eDQnV5P61XIKczprInd-WTPxt4t_0 2024-09-14T11:58:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.403+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14729710377627736226', time=2024-09-14T13:39:47.498190+0000, chain.objs.size()=1 2024-09-14T11:58:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.403+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.R-t0y_bnlNRPJWsWmGNHI-zhDEmG3AV_0 2024-09-14T11:58:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.403+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16869000144099286451', time=2024-09-14T13:39:48.619893+0000, chain.objs.size()=1 2024-09-14T11:58:37.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.403+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5QBzoAc1kuyV3OZi9d8yMQBHYjj_tvG_0 2024-09-14T11:58:37.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5070163013425510555', time=2024-09-14T13:39:49.071378+0000, chain.objs.size()=1 2024-09-14T11:58:37.403 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SKuSXtLIMIfrQNb0ZQJ1Lw4Q3rS2DkQ_0 2024-09-14T11:58:37.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11759952644913982770', time=2024-09-14T13:39:49.204951+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.epb0oCaUXOd3u6U05MUPArdiCXDluTa_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.803016261789780142', time=2024-09-14T13:39:49.574533+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Az_egy4Kh4Rgb0015Xr5_iTA5mh-r_T_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16532149723504939914', time=2024-09-14T13:39:49.597294+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xMFp61wXfzCpg8zdFTfgzMEY23AoMeB_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18013693587156852980', time=2024-09-14T13:39:50.143187+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fzZwON-EThhGRZ8USiSKuOmsLRxNqFF_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10378466964929751762', time=2024-09-14T13:39:50.222582+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xgrulGhjWPiAZzGG01zt7dwuOgDBNDC_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18124807354414821085', time=2024-09-14T13:40:31.255816+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZBrLEyyWs2lG2XRAB2qWtlh_zH8-5FW_0 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2049802305889325909', time=2024-09-14T13:40:31.258727+0000, chain.objs.size()=1 2024-09-14T11:58:37.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eH7G9Wx0E-5ll0Za6NLJhaR25jtlu_l_0 2024-09-14T11:58:37.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.408+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6778355977586343541', time=2024-09-14T13:40:31.330870+0000, chain.objs.size()=1 2024-09-14T11:58:37.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.408+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jNgsgLZGLrhLlAHsTbdD6m8LmBEcRXH_0 2024-09-14T11:58:37.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.408+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3286598742673512993', time=2024-09-14T13:40:31.399951+0000, chain.objs.size()=1 2024-09-14T11:58:37.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.408+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iLVea9HSwHiZThO-wrUaK2tj54wdqQG_0 2024-09-14T11:58:37.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.409+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.538696367614687677', time=2024-09-14T13:40:31.452742+0000, chain.objs.size()=1 2024-09-14T11:58:37.407 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.409+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H2Tx6aK3mC1EBZ9-SoWyaTsDZsS4XDl_0 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16763679882088770142', time=2024-09-14T13:40:31.667316+0000, chain.objs.size()=1 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.P5MW6FVyEpIK9ke-g6Vz1dSAeq_EzZ5_0 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11250198284788687880', time=2024-09-14T13:40:31.794175+0000, chain.objs.size()=1 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.w1EUfEk33oeRHmTRMhkFfdRbWAwvmjR_0 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18060035583922708959', time=2024-09-14T13:40:32.821694+0000, chain.objs.size()=1 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NpEK6wp122zQvf5ffyJxYyRCtTZJk25_0 2024-09-14T11:58:37.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12467936217696459036', time=2024-09-14T13:40:33.293331+0000, chain.objs.size()=1 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IqwU0WDDrLamRqMuY9i7ZHFMykcd8cm_0 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12475046870871837882', time=2024-09-14T13:40:33.337196+0000, chain.objs.size()=1 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.aelB4A02hr29Q59lym8Z_fQPvfVG4MR_0 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3366302440301333647', time=2024-09-14T13:40:33.376426+0000, chain.objs.size()=1 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.u3ax43jJi_hn-7xEanrUJ19O87JgxGP_0 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15112154721795087586', time=2024-09-14T13:40:34.251129+0000, chain.objs.size()=1 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tteChwEtv3_rj4u5QYdqRg2d7YDxUOh_0 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2540835609621887026', time=2024-09-14T13:40:34.420927+0000, chain.objs.size()=1 2024-09-14T11:58:37.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._FzKFC4c3wsTfShvp5zHjw3sjxZnzPf_0 2024-09-14T11:58:37.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8032397620404343389', time=2024-09-14T13:40:34.676000+0000, chain.objs.size()=1 2024-09-14T11:58:37.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9g--5bu55jxLTbK_oqceHwxPchgAD3Z_0 2024-09-14T11:58:37.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.620260994645159035', time=2024-09-14T13:40:34.733702+0000, chain.objs.size()=1 2024-09-14T11:58:37.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UoRwNLQFwqSBgPIwdul6JQhbfkjWgIa_0 2024-09-14T11:58:37.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15103165761643375554', time=2024-09-14T13:40:35.107131+0000, chain.objs.size()=1 2024-09-14T11:58:37.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.414+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8rgwM_QSqbYbsgbCxlDTqxR_pGmJKoc_0 2024-09-14T11:58:37.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.415+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17237165654673728349', time=2024-09-14T13:40:35.377956+0000, chain.objs.size()=1 2024-09-14T11:58:37.413 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.415+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BCtWRDp9wrocrqGGIbJhoLepYlxX_O3_0 2024-09-14T11:58:37.417 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.420+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/52297 2024-09-14T11:58:37.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-14T11:58:37.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12124185377778597800', time=2024-09-14T13:40:35.907178+0000, chain.objs.size()=1 2024-09-14T11:58:37.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yYF0zhHfIRtllCGbl6ckcziG6dyzI_u_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2066889647017321384', time=2024-09-14T13:40:36.329859+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iLg-6XwAdSXZhemI_XOAapYhDbNMsCS_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5240035809754375867', time=2024-09-14T13:40:36.714318+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-UNVOwoITGvdUA4tCvZ2sKE8Hea7Hzd_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2160038832097195814', time=2024-09-14T13:40:36.882097+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZUJp0WTAo5es36ElV202FL95cBWPAtd_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16968761369256810410', time=2024-09-14T13:40:37.059540+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HezoWxZLO6f4W6F5ynOZVDXCpzv8kcT_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1533664739039652264', time=2024-09-14T13:40:38.435007+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PjFGGo07Vfskk6sL4fYDhqhnm0y-hOz_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7732584459367513061', time=2024-09-14T13:40:38.461354+0000, chain.objs.size()=1 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xpaYzmY94mS9nbwXCdAw3bfqxpt2fKh_0 2024-09-14T11:58:37.421 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11622448034132439895', time=2024-09-14T13:40:38.510653+0000, chain.objs.size()=1 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kUkDxCAgcG-isAwA-pcWIh9-_ZeOhl2_0 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10985271932190633697', time=2024-09-14T13:40:38.659181+0000, chain.objs.size()=1 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bGNBR_DhkNFWetVizK1CsRUuD2qHn4U_0 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11761451568017754005', time=2024-09-14T13:40:39.621044+0000, chain.objs.size()=1 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oMNzusV-5ec6aXQ__GjZULBIx_htxA3_0 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7726642853898820573', time=2024-09-14T13:40:39.763102+0000, chain.objs.size()=1 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4KEgKsgd2rpH2igiHB2_nSV6cx5ggIE_0 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8818107349989874446', time=2024-09-14T13:40:39.868210+0000, chain.objs.size()=1 2024-09-14T11:58:37.422 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Pm4B0JV0-QdKK0PAfaRBx2L2MKWkbkb_0 2024-09-14T11:58:37.426 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.754355619522187880', time=2024-09-14T13:40:39.892770+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CNF0PtGQV8-h1UK0uTG220DRYlOzmtO_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2796539869419051497', time=2024-09-14T13:40:40.073978+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Q7qCLWr2DaGIfcX-eQOxZAcw4tcmrjK_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3888444190782917006', time=2024-09-14T13:40:40.682324+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zvHyAy_GcJsbL3m8d_9Dynl1uDCo637_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14015163721335420666', time=2024-09-14T13:40:41.799888+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fNHUEzxouCTjRlQwZ8sQfGjS39_Rh5e_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17770734819859049699', time=2024-09-14T13:40:42.357788+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.c4a-4VLP7f4MBp3kcnbgq8AlOmYHTqX_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6046640907728914044', time=2024-09-14T13:40:42.377992+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GFShQBOH2EbZOEMx86ubJV9lVXyLDS1_0 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1353391256563697297', time=2024-09-14T13:40:42.805613+0000, chain.objs.size()=1 2024-09-14T11:58:37.427 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.25Bes1RJ29FmEt1dPhCo48VO7-hlQ2H_0 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14757966555077407609', time=2024-09-14T13:40:43.100807+0000, chain.objs.size()=1 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5Cp4QwIncQpPGZyTUQQHHoVwdcR7bgA_0 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15155332819028339711', time=2024-09-14T13:40:43.136297+0000, chain.objs.size()=1 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.428+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Rsizsaia1SuQAU5ddzWmx4u64VLt4-y_0 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.429+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3975055315028213692', time=2024-09-14T13:40:43.200208+0000, chain.objs.size()=1 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.429+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xiB5HL1mGrcorYYZDxV_oAnp2Y9ghI__0 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.429+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3916743648956718151', time=2024-09-14T13:40:50.843704+0000, chain.objs.size()=1 2024-09-14T11:58:37.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.429+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.337__shadow_.gJA80cvcFxL436k0wt5QzdnwLb39tw2_0 2024-09-14T11:58:37.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16714810923687218262', time=2024-09-14T13:42:13.241156+0000, chain.objs.size()=1 2024-09-14T11:58:37.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.462__shadow_.O6IwpKmOLRLQU3iYcMmGFzqFaV-AfmR_0 2024-09-14T11:58:37.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13065619773420172452', time=2024-09-14T13:42:16.155266+0000, chain.objs.size()=1 2024-09-14T11:58:37.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.465__shadow_.SSghldz1JlDTW5yh9qHja5eeez9o0Fv_0 2024-09-14T11:58:37.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8338954001584011557', time=2024-09-14T13:42:27.462296+0000, chain.objs.size()=1 2024-09-14T11:58:37.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.-TrUGk7sxDnUr3YPujNVGPzZl9p8WWf_0 2024-09-14T11:58:37.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13422179725538315003', time=2024-09-14T13:43:34.081132+0000, chain.objs.size()=4 2024-09-14T11:58:37.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:L4n0R6jYSmUWn3hE33Efy.NbGRZqEWh_.LBNldjV2URcXZvhWKMC4bzNf1Aa23Fj_0 2024-09-14T11:58:37.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:L4n0R6jYSmUWn3hE33Efy.NbGRZqEWh_.LBNldjV2URcXZvhWKMC4bzNf1Aa23Fj_1 2024-09-14T11:58:37.432 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:L4n0R6jYSmUWn3hE33Efy.NbGRZqEWh_.LBNldjV2URcXZvhWKMC4bzNf1Aa23Fj_2 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:L4n0R6jYSmUWn3hE33Efy.NbGRZqEWh_.LBNldjV2URcXZvhWKMC4bzNf1Aa23Fj_3 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1702979898220854360', time=2024-09-14T13:44:52.372933+0000, chain.objs.size()=1 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.525__shadow_.BwoZpvsW-ejWNmZTznY6UNAzRJwe-Pl_0 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2429412978111249390', time=2024-09-14T13:46:33.784657+0000, chain.objs.size()=1 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:f7HlNUaVhlEw.zwdUJjAdTZCZ2vH-UK_.pdHcs8lB4MBE4_Bu25gFAw-2U5Y1Ohg_0 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12589119706921685442', time=2024-09-14T13:46:34.245191+0000, chain.objs.size()=1 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:JNO4CKqfQ.DImJ7OfmM4Yk3u2D2.pXe_.Fj-decRE5YFaN_OsiAee6-7bv1k22Pk_0 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3074389010006382903', time=2024-09-14T13:52:34.077179+0000, chain.objs.size()=1 2024-09-14T11:58:37.433 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.434+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.666__shadow_.rARE6o7-DRQDbmN0Tc4sa5mNbI0iW3c_0 2024-09-14T11:58:37.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.438+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1354892617080482687', time=2024-09-14T13:52:59.030699+0000, chain.objs.size()=1 2024-09-14T11:58:37.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.438+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.705__shadow:5gFtpDFm5esFdqXlvtfEebpkg0q41ps_.w0vWK6CPJ23sD-VWwHyl7c401MRnIXR_0 2024-09-14T11:58:37.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.438+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7931182981972631365', time=2024-09-14T13:54:53.735623+0000, chain.objs.size()=1 2024-09-14T11:58:37.436 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.438+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.756__shadow_.hWcj9Oy8EK6IhBL2riugtufMtsVg5j9_0 2024-09-14T11:58:37.440 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.442+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.445+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:58:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.446+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.446+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50756' 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14288436699519657345', time=2024-09-14T13:34:29.411673+0000, chain.objs.size()=5 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-FROZEN.2~cc2eiIx96xnjnNcgK8hYAJNowvenluj.1 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__shadow_mymultipart-FROZEN.2~cc2eiIx96xnjnNcgK8hYAJNowvenluj.1_1 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-FROZEN.2~cc2eiIx96xnjnNcgK8hYAJNowvenluj.2 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__shadow_mymultipart-FROZEN.2~cc2eiIx96xnjnNcgK8hYAJNowvenluj.2_1 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-FROZEN.2~cc2eiIx96xnjnNcgK8hYAJNowvenluj.3 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15526897711150075531', time=2024-09-14T13:34:32.701361+0000, chain.objs.size()=3 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.LfAV7unYcJXTsjVHVt_NyA6czMyJqWn_0 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.LfAV7unYcJXTsjVHVt_NyA6czMyJqWn_1 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.LfAV7unYcJXTsjVHVt_NyA6czMyJqWn_2 2024-09-14T11:58:37.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_E_9RH4iTzF4jQNDC-BAAyb3u9RtDxg8', time=2024-09-14T13:34:45.491664+0000, chain.objs.size()=1 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.164__shadow_.ndnx98dEeKMjsiIahavBtty1jREmZzA_0 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18088725272993860158', time=2024-09-14T13:37:01.301775+0000, chain.objs.size()=1 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.239__shadow_.OwH3AS5E7PYCuivDRLTTOBimoDlewh6_0 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17054306485014689743', time=2024-09-14T13:37:03.230371+0000, chain.objs.size()=1 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.242__shadow_.RaqBVxp_YAxV-I_QBau0a800SJjXGal_0 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3392471741235658772', time=2024-09-14T13:37:03.983235+0000, chain.objs.size()=1 2024-09-14T11:58:37.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.447+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.243__shadow_.6lDydkyma5ogyFAdqSTlIfGcgDg7cpg_0 2024-09-14T11:58:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.450+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6697569179514983301', time=2024-09-14T13:37:03.984935+0000, chain.objs.size()=1 2024-09-14T11:58:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.450+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.243__shadow_.OAbAUZlmgrzNCd0UJS0v-uY0VNVmtq2_0 2024-09-14T11:58:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.450+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15265214238856285636', time=2024-09-14T13:37:58.057674+0000, chain.objs.size()=1 2024-09-14T11:58:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.450+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.m01K3CQoRLdefSAoPeR3QHflzx8ggZ7_0 2024-09-14T11:58:37.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8694840385890019334', time=2024-09-14T13:37:59.690014+0000, chain.objs.size()=1 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Gd5a0sh3Rhf-y5J3K0CYZzWRHNOfwt4_0 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17481217188314626975', time=2024-09-14T13:37:59.909404+0000, chain.objs.size()=1 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YxT26GFLyu8upmpeo8n0Iy6z5KGBdPy_0 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6134728468600755408', time=2024-09-14T13:38:00.057668+0000, chain.objs.size()=1 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ov1uEygYRRHuKM8-KLY0GpWeoPMfw3q_0 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9735381712693582459', time=2024-09-14T13:38:00.111045+0000, chain.objs.size()=1 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NpiEojHHGTdojABGiZaOsYqfA-zr7uU_0 2024-09-14T11:58:37.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.337729738277382788', time=2024-09-14T13:38:00.355998+0000, chain.objs.size()=1 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6mNcj2jxhI9EELukQjGY_xPRLwgSIAy_0 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4333338644849991391', time=2024-09-14T13:38:00.404173+0000, chain.objs.size()=1 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CFa8Zl1zwYWnaTI54gUd_jSxgIZZtoK_0 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2599353077104328528', time=2024-09-14T13:38:00.404806+0000, chain.objs.size()=1 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6keK3o-os0g61UZw23TmNffULyeOGFH_0 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13578714029330196358', time=2024-09-14T13:38:00.672904+0000, chain.objs.size()=1 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SlM1k1rAoVwAEq1iJidtI0_qQsNEEsy_0 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15833465416099649174', time=2024-09-14T13:38:01.789142+0000, chain.objs.size()=1 2024-09-14T11:58:37.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.451+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.l4zsVq8dknsijUxAqnOMtaHu3qnWKKt_0 2024-09-14T11:58:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.456+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5767522995956377125', time=2024-09-14T13:38:01.824792+0000, chain.objs.size()=1 2024-09-14T11:58:37.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.456+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xRTuLO4jTMSaXAcsPUGj-5GArP-pstn_0 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2263123664248512784', time=2024-09-14T13:38:01.846176+0000, chain.objs.size()=1 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8J_ueb-w6AVNs_J9k3MV8lXyi1Vi3CB_0 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4274370522249970580', time=2024-09-14T13:38:01.925491+0000, chain.objs.size()=1 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GwUBRCTCUz5Q6gFh6ZBSlNXBoC0Zs2K_0 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15969633130539099211', time=2024-09-14T13:38:02.891742+0000, chain.objs.size()=1 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xhgqkBHEX2g_tGFhiijEVjeNOMIYq1j_0 2024-09-14T11:58:37.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4713930587338990911', time=2024-09-14T13:38:03.189182+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QrWPIvSEwALPs205MU918pKzlmO8ONa_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15613471350774981908', time=2024-09-14T13:38:03.292994+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W3oacjGB-THhm9hiD5OmMHczbQaPMNp_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16836801654037760074', time=2024-09-14T13:38:04.056270+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CnU-_ivCfwbkM6RbrHaJEMjvTNcUNfu_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1941742627875781150', time=2024-09-14T13:38:04.740175+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-P8_U8Zz0mWwsE_a6QWH53HzH47AOV8_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9628295273295402712', time=2024-09-14T13:38:05.194567+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-hgtx5O5fAjAo790_k3c_QZjfdtZBg8_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9564452569481837841', time=2024-09-14T13:38:05.551259+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.81itmug_2K6Kc9ctGjUF1Wp_iSjgRLU_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2002074097580974400', time=2024-09-14T13:38:05.551960+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lkKDxyIYBr8OnwvN1JP7pdvmA_Lp8YC_0 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6652571110007703282', time=2024-09-14T13:38:06.153207+0000, chain.objs.size()=1 2024-09-14T11:58:37.458 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.459+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4tagDP8VB1bS0y5Rufvadq_aoRFj_NA_0 2024-09-14T11:58:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.463+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4980597083176733619', time=2024-09-14T13:38:08.147294+0000, chain.objs.size()=1 2024-09-14T11:58:37.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.463+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PUx3Y4I_Ig3vFXTTZmEHbCiwSUCASFr_0 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5828698287309618989', time=2024-09-14T13:38:08.464851+0000, chain.objs.size()=1 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aLzbrLU4_bPf77q0e8i0y5GxEG5Mmgg_0 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15097243434286232841', time=2024-09-14T13:38:09.376882+0000, chain.objs.size()=1 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.I7trps5TVh82CWoiWfEev_pU1yGnBOf_0 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5547448908322329720', time=2024-09-14T13:38:09.929609+0000, chain.objs.size()=1 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hQFNyF2cwffNY9BF7Q0T-3rYnaj6j_n_0 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9069992166413619124', time=2024-09-14T13:38:10.001094+0000, chain.objs.size()=1 2024-09-14T11:58:37.463 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.p9W2ZpC8zdy6QexM1vWtUNS80wKeKH0_0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13349323865685417343', time=2024-09-14T13:38:10.338251+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6FiN4hwAZSmk1OMIrtuB1axGhXvLBbJ_0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13904954068948219603', time=2024-09-14T13:38:10.361372+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LXHGYA3xOw1gKb-L7OeVGhoBExLbaN__0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7046855208293289516', time=2024-09-14T13:38:18.026696+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.274__shadow_.7PLm3rxSPQCp9quIWNAblLW7rbCr90k_0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1641350124904209135', time=2024-09-14T13:38:28.405217+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.288__shadow_.3Wwk0xpO1gNKZ7NjSYYicMp37QJOu1i_0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5208291148816131945', time=2024-09-14T13:38:35.642206+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.nkdANl0ZYshti5I11MRSzsa5XbSY0nz_0 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6143188011908257097', time=2024-09-14T13:38:55.683804+0000, chain.objs.size()=1 2024-09-14T11:58:37.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.465+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.320__shadow:pEueWscdmsR.ZVdYvPvjqqaA-9YfqbN_.1WO7limcxJ_2dX8Iqro9u09L0nm8aNO_0 2024-09-14T11:58:37.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.466+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1920841100455474826', time=2024-09-14T13:39:38.698289+0000, chain.objs.size()=1 2024-09-14T11:58:37.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.466+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rTNS70FEaP2cC9zcugNI4HFRv520mLb_0 2024-09-14T11:58:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.469+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1390745347600563667', time=2024-09-14T13:39:38.886998+0000, chain.objs.size()=1 2024-09-14T11:58:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.469+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dubYslluHw2oKfgcGIye1rOrLJj7qBR_0 2024-09-14T11:58:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.469+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.878521164384125847', time=2024-09-14T13:39:39.700054+0000, chain.objs.size()=1 2024-09-14T11:58:37.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.469+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rVjRIPNklL66MjVkvmwXn-seqGEWrFL_0 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9012781549594432537', time=2024-09-14T13:39:40.249098+0000, chain.objs.size()=1 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aWnFsi5wnFYqEJJ0KpZTNqvK-GNNY-k_0 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14748097716745041093', time=2024-09-14T13:39:40.258747+0000, chain.objs.size()=1 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RbUyu-4X-yFngzBNQbVKEnUSGoJB9wg_0 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3878540343898165684', time=2024-09-14T13:39:40.301740+0000, chain.objs.size()=1 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6YjBcCxD6gB97UPBkAuV7ONqoAhAZ3m_0 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12174571190912720271', time=2024-09-14T13:39:40.455709+0000, chain.objs.size()=1 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PWZWHmG8zUGCqVORk1duLSTZGV9cdzm_0 2024-09-14T11:58:37.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13041975239376080262', time=2024-09-14T13:39:40.654288+0000, chain.objs.size()=1 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.u80MsadU0bs13GSezav3TeeYt4Ldy-q_0 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2734961122860686811', time=2024-09-14T13:39:41.187733+0000, chain.objs.size()=1 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.EeFCU0u_gYo3Ged4i8vFQFIwAyaHIvX_0 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6584185663193093270', time=2024-09-14T13:39:41.188548+0000, chain.objs.size()=1 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xg6BSWt3tUIoo23yS_ycwCXW_H18nVb_0 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4490735313956349821', time=2024-09-14T13:39:41.511572+0000, chain.objs.size()=1 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.id5mKGaClfGI2hawiFMBeXvHflONpfV_0 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15639433458718084334', time=2024-09-14T13:39:42.405195+0000, chain.objs.size()=1 2024-09-14T11:58:37.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.472+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gyHWJxT9WB28ZQEMF9P4fx0zNQkr7Wg_0 2024-09-14T11:58:37.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.473+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4716121778688841644', time=2024-09-14T13:39:42.522472+0000, chain.objs.size()=1 2024-09-14T11:58:37.471 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.473+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ueeNcb8Kst4kvlz-kcMQQ07r5e5M9XT_0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15497074762467320831', time=2024-09-14T13:39:42.687139+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.i0Zuf7tIxqOjynnB6vldHQfUEhu9PDm_0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12785261609268445860', time=2024-09-14T13:39:43.001061+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lpgrzx5EZcwMtX-5oAATW_DOZmLwsjn_0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10733288513283572718', time=2024-09-14T13:39:43.028461+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-sWIhcJdMY6EjOUp5sziTco21BuYJd__0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12291664574397415770', time=2024-09-14T13:39:43.106698+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pQdqNfu6mpk5RcQGbEM3Vg3VK4W9yzz_0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13098060540187822189', time=2024-09-14T13:39:44.191770+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.G2BUScXHpEBjBcHH5PvpDwl1zSBQ_us_0 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9527643675122493652', time=2024-09-14T13:39:44.262061+0000, chain.objs.size()=1 2024-09-14T11:58:37.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bujDU88Wu6SO7rScBL6v_hHRjw4oFH4_0 2024-09-14T11:58:37.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10740171458395901356', time=2024-09-14T13:39:44.510559+0000, chain.objs.size()=1 2024-09-14T11:58:37.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._vNYry20XO9kRWzusjxkzO9LlRdkrlW_0 2024-09-14T11:58:37.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7663270225049431490', time=2024-09-14T13:39:45.273742+0000, chain.objs.size()=1 2024-09-14T11:58:37.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.r1bxMwkW2uWcuOBGSGq5xfJLAZVtd7e_0 2024-09-14T11:58:37.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16197313626123135030', time=2024-09-14T13:39:45.520340+0000, chain.objs.size()=1 2024-09-14T11:58:37.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.svlAynf9DF0brKhuX_1Q9ur-DQ02r53_0 2024-09-14T11:58:37.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6103534108948610448', time=2024-09-14T13:39:45.531453+0000, chain.objs.size()=1 2024-09-14T11:58:37.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.478+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MT1mPO00Uo1tIT1DD0sKoPJzd26HYya_0 2024-09-14T11:58:37.476 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.479+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13967855136763102616', time=2024-09-14T13:39:46.050928+0000, chain.objs.size()=1 2024-09-14T11:58:37.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.479+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.N3MFgL0NKg3rRQ9zwmWbisqZ-PRP4tO_0 2024-09-14T11:58:37.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8044299143078107902', time=2024-09-14T13:39:46.052188+0000, chain.objs.size()=1 2024-09-14T11:58:37.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.u8dquxI1hyhrl3-gYkBEarYH5Rz47Zb_0 2024-09-14T11:58:37.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13986145249944898361', time=2024-09-14T13:39:46.110411+0000, chain.objs.size()=1 2024-09-14T11:58:37.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wp7O_8eFua4h2Q53PUTUwYDxH2SEPzn_0 2024-09-14T11:58:37.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6052114252871313529', time=2024-09-14T13:39:46.197024+0000, chain.objs.size()=1 2024-09-14T11:58:37.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.480+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3qAshB_622Wr3GYwNddfgDveX_8NdR3_0 2024-09-14T11:58:37.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.482+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.619988809700226744', time=2024-09-14T13:39:46.447563+0000, chain.objs.size()=1 2024-09-14T11:58:37.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.482+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2kSjRncC9iMMyovo2imHgi89K2qzswa_0 2024-09-14T11:58:37.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9054755949201205955', time=2024-09-14T13:39:47.067348+0000, chain.objs.size()=1 2024-09-14T11:58:37.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.l8tpqTcC7gBQNNjRlhCGtJMgm2HthGj_0 2024-09-14T11:58:37.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18202664562433020201', time=2024-09-14T13:39:47.403792+0000, chain.objs.size()=1 2024-09-14T11:58:37.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wVqRj2Kt6dh24_4M_jGRMbcYKxI-9Jj_0 2024-09-14T11:58:37.483 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5086843209942604954', time=2024-09-14T13:39:47.618470+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.q9Gu_VjpQt7Lv8DyNuQJjTbhO45sEgW_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8781891883020759977', time=2024-09-14T13:39:47.619410+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RePctMgXVkW3IoZ3MhECExAkrXrflz0_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15226549139595287343', time=2024-09-14T13:39:47.644079+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aUutSuUcpW-encdw3uhR4fk2JnXogsU_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18253042159230409494', time=2024-09-14T13:39:48.044584+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7jh3Z7HYAG3YSPou9VsIgM2YAlN99gZ_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17672686526962940690', time=2024-09-14T13:39:48.066345+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vd7z9UXGZ5xMFwcSDLHZzTp5Vk07U9r_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4126925310113423288', time=2024-09-14T13:39:48.898618+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2YobcNolMiexKeN94oM72VhZJlZEmxv_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16352496576599873951', time=2024-09-14T13:39:49.025532+0000, chain.objs.size()=1 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Y-cO4Si-YXtJ6pAqXSbW79esfrsVvt7_0 2024-09-14T11:58:37.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3720179543725863415', time=2024-09-14T13:39:49.129033+0000, chain.objs.size()=1 2024-09-14T11:58:37.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b6YeiEkruJuJ4RPR-mME24eMOCnt0C4_0 2024-09-14T11:58:37.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13744385359135039995', time=2024-09-14T13:39:49.505183+0000, chain.objs.size()=1 2024-09-14T11:58:37.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.485+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.j_ouOjyL5V9lUoZMzfBKO9me3nDIbVX_0 2024-09-14T11:58:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.489+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3876321892177564569', time=2024-09-14T13:39:49.930584+0000, chain.objs.size()=1 2024-09-14T11:58:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.489+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6ez9gPcSu3GnTWlAigdnFPMTc9NWKyH_0 2024-09-14T11:58:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.489+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5761295163037273373', time=2024-09-14T13:39:49.931309+0000, chain.objs.size()=1 2024-09-14T11:58:37.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.489+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Z5ZbkFLPqUXW7iFNsnVlDZe1DRQ3zIo_0 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6541037469903649170', time=2024-09-14T13:39:50.144143+0000, chain.objs.size()=1 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.snXMySq61XtWPUZaphW6atwZVAv0eM__0 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10909426837606993291', time=2024-09-14T13:39:50.850571+0000, chain.objs.size()=1 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FVTtKNf0xwRG1KnIaWqRj9rCIt51mxR_0 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8330852124476990630', time=2024-09-14T13:40:30.739688+0000, chain.objs.size()=1 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.viuxnQ--xvf2rphh1GQWkiRiJq41XQ2_0 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15207641540575703725', time=2024-09-14T13:40:30.966856+0000, chain.objs.size()=1 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.D_h53ze8ZzKUo_U5NqQOtBfIKdmuGZX_0 2024-09-14T11:58:37.489 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2857878325709228654', time=2024-09-14T13:40:31.087607+0000, chain.objs.size()=1 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Zk10YjHK_FVU2dqtuPky3WrYtPT34KO_0 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15260218399029629319', time=2024-09-14T13:40:31.088404+0000, chain.objs.size()=1 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JnmFbaeHaZNZvtR54nxc2Jx0xkHjDEp_0 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.536170771789279884', time=2024-09-14T13:40:31.937877+0000, chain.objs.size()=1 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HRrYKpKDtPUE3bA36rFmHNNHNcrXOub_0 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2257464710641960509', time=2024-09-14T13:40:32.532765+0000, chain.objs.size()=1 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.o6ZsrYfmTFdoXQe7wtxWirdI5Szebzl_0 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.642227321510144479', time=2024-09-14T13:40:32.567860+0000, chain.objs.size()=1 2024-09-14T11:58:37.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.491+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3F2VxQPutyY86ktHB2tYM7iDBpIDWHv_0 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15110278429174179314', time=2024-09-14T13:40:32.719424+0000, chain.objs.size()=1 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.R8RJaoVW--g01jqA1q5JREbK_NMFB_Y_0 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1119549552114628404', time=2024-09-14T13:40:33.027467+0000, chain.objs.size()=1 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lt4824xR02L5W6tESF8EMycnOpTBVvC_0 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15451500711863508070', time=2024-09-14T13:40:33.407431+0000, chain.objs.size()=1 2024-09-14T11:58:37.493 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.495+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BGRfg5RY_EnLNOjh0ZkyftL4RrG6-zw_0 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3664340032931002762', time=2024-09-14T13:40:33.729380+0000, chain.objs.size()=1 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Tp-YoPuZ_u7WjGy0poOt-a2b1RpEDjD_0 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18350918725105260293', time=2024-09-14T13:40:33.741941+0000, chain.objs.size()=1 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pWEjy8gU5of893MOr2WkBDfWwmnyME0_0 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13559084580245809973', time=2024-09-14T13:40:33.742877+0000, chain.objs.size()=1 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.L4DQNMF_GG1Jvj5AZadbKLZy86bZIw__0 2024-09-14T11:58:37.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12332799470979551557', time=2024-09-14T13:40:34.211461+0000, chain.objs.size()=1 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BWcjUjpX-rtSG0qGRpL2HWv3BIFKucm_0 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.987663605683639071', time=2024-09-14T13:40:34.212270+0000, chain.objs.size()=1 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3tGmu8GDhgJYsBBmVIi71JBQsIdDweH_0 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12135289391799099903', time=2024-09-14T13:40:34.253838+0000, chain.objs.size()=1 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rrckpXwp-SVwdDPmgo9m-XAXjPX2nIt_0 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3176325537157905848', time=2024-09-14T13:40:35.244130+0000, chain.objs.size()=1 2024-09-14T11:58:37.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.498+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.U_ZVpsdskpSDMdbVxGzy4H3MvI5xUFw_0 2024-09-14T11:58:37.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.504+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/50756 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15062462873432402483', time=2024-09-14T13:40:35.306960+0000, chain.objs.size()=1 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OmVFIGGLMTexscCqcPDb0FjyEmt_ISU_0 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15374067678134802320', time=2024-09-14T13:40:36.455540+0000, chain.objs.size()=1 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6oRBePxhYUjH9P9bQ61OzwbjZQZjhA8_0 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17362957323386303259', time=2024-09-14T13:40:37.098664+0000, chain.objs.size()=1 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FpFIBVLBysDJoCIgtZGIZU6zVzrpe-F_0 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2958928373263704593', time=2024-09-14T13:40:37.545069+0000, chain.objs.size()=1 2024-09-14T11:58:37.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-uhM4Rri1hXSdffiTRm1pzUFTO8PaWE_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6523265956606282007', time=2024-09-14T13:40:37.789079+0000, chain.objs.size()=1 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.S2Xtisidf3xSSjaKyPC9Jaz4zNpEokF_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9013660487169888607', time=2024-09-14T13:40:39.265375+0000, chain.objs.size()=1 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qIi8jZbqNxQroM3q1KAePPP4JDKQfcD_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4676950496391034015', time=2024-09-14T13:40:39.532741+0000, chain.objs.size()=1 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5m-gAq4bZJ3hVu1GO_2ZJuZSiDeGVtj_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15639296710184238200', time=2024-09-14T13:40:40.014053+0000, chain.objs.size()=1 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dxI3ey04piyRZ30s2eNrfUzlCehCiBJ_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4633525286280638374', time=2024-09-14T13:40:40.689933+0000, chain.objs.size()=1 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4dEJ0hrnWC_m36GqrvQ95Yeza-3cnF-_0 2024-09-14T11:58:37.506 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17736164198649504621', time=2024-09-14T13:40:41.018708+0000, chain.objs.size()=1 2024-09-14T11:58:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.68gcqkltsiktHYygrg6UU2y_FYn3zqi_0 2024-09-14T11:58:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.75509936335424343', time=2024-09-14T13:40:42.844193+0000, chain.objs.size()=1 2024-09-14T11:58:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VX4BYaOSdoYSDdPRiJecUMX2QyN7bB3_0 2024-09-14T11:58:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.870083918573827657', time=2024-09-14T13:40:42.994888+0000, chain.objs.size()=1 2024-09-14T11:58:37.507 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.507+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2RUP1MrFfPO2wpMKB8MX8AhpUPVb77i_0 2024-09-14T11:58:37.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.510+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4393743234798108838', time=2024-09-14T13:40:44.362550+0000, chain.objs.size()=1 2024-09-14T11:58:37.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.510+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.327__shadow_.wbGzOC3okqHWGIzTqki2rYOD4B-Q4jd_0 2024-09-14T11:58:37.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.510+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13910861640829749753', time=2024-09-14T13:41:36.005754+0000, chain.objs.size()=1 2024-09-14T11:58:37.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.510+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.408__shadow_.lxlOuGKXDrsccwmSepIhlQS5V2_2DPg_0 2024-09-14T11:58:37.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7099069233660678042', time=2024-09-14T13:41:54.401988+0000, chain.objs.size()=1 2024-09-14T11:58:37.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.437__shadow_.46LFneknHKmZKqAxAOVur4H76k0-Ift_0 2024-09-14T11:58:37.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8641850844421507571', time=2024-09-14T13:41:57.062849+0000, chain.objs.size()=1 2024-09-14T11:58:37.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.441__shadow_.FIsIpBCQKkXRuo-Ynm0BjXEDLzHe-DV_0 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17456829056468627681', time=2024-09-14T13:42:27.462601+0000, chain.objs.size()=1 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.rcn5CzlHrffUlmffhN_mNt6D1PetBIE_0 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17488780884628088866', time=2024-09-14T13:42:28.302130+0000, chain.objs.size()=1 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.485__shadow_.vjTgeNlVeoeIzYOPCpqaQwKal95VnjL_0 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4440003053164129866', time=2024-09-14T13:45:48.675111+0000, chain.objs.size()=1 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.551__shadow_.9XSWdLWso40vtWXtNjgF82Ei89d0bBz_0 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.759819762625146260', time=2024-09-14T13:46:50.877840+0000, chain.objs.size()=1 2024-09-14T11:58:37.510 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.511+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:h5L8Ak36TJfr8RHpcZfDKhdxgRuU06w_.xvtkLMEJ6D4VGxVCf-DPmnvf6m_Sr3W_0 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8536908613358267823', time=2024-09-14T13:47:34.193268+0000, chain.objs.size()=1 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:Clhbha0t-LTYzzaKp7RT3h9xWnRM-1t_.SBkEheLedA9NMyls-q896g99eEuNuKT_0 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.166106024699073056', time=2024-09-14T13:47:49.816444+0000, chain.objs.size()=1 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.603__shadow_.xc8_86-1tJ_Bsm03pvIi1WKGFc7JHt4_0 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1868655628254126194', time=2024-09-14T13:48:25.659383+0000, chain.objs.size()=12 2024-09-14T11:58:37.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.1 2024-09-14T11:58:37.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.514+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.1_1 2024-09-14T11:58:37.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.2 2024-09-14T11:58:37.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.2_1 2024-09-14T11:58:37.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.3 2024-09-14T11:58:37.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.3_1 2024-09-14T11:58:37.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.4 2024-09-14T11:58:37.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.4_1 2024-09-14T11:58:37.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.5 2024-09-14T11:58:37.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.5_1 2024-09-14T11:58:37.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__multipart_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.6 2024-09-14T11:58:37.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.614__shadow_multipart_enc.2~9phcEdengGnysLsSmyu3y8o1Dwa5IyD.6_1 2024-09-14T11:58:37.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16694363143785143567', time=2024-09-14T13:51:51.972943+0000, chain.objs.size()=1 2024-09-14T11:58:37.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.639__shadow_.WMl54z99JGl3Etf_qrZ_p9SKcUYx6BB_0 2024-09-14T11:58:37.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10919857618825431288', time=2024-09-14T13:52:50.356790+0000, chain.objs.size()=1 2024-09-14T11:58:37.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.693__shadow:ov1m0XKMJ2huYU-gRAeR6ga0CVjNZ.n_.GEIV5YcGZtZLsXfkdwST2Hf5nh_JuQ-_0 2024-09-14T11:58:37.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1966963841720063605', time=2024-09-14T13:52:53.749635+0000, chain.objs.size()=1 2024-09-14T11:58:37.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.698__shadow:RvUmuGzTaIrRQggQr3ZFjQ0NjxwsVhn_.VCTowY48c_F7egia9GQnuQhSkBRR1QH_0 2024-09-14T11:58:37.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10130990713531231526', time=2024-09-14T13:53:48.801081+0000, chain.objs.size()=10 2024-09-14T11:58:37.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.1 2024-09-14T11:58:37.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.522+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.2 2024-09-14T11:58:37.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.522+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.3 2024-09-14T11:58:37.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.522+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.4 2024-09-14T11:58:37.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.522+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.5 2024-09-14T11:58:37.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.522+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.6 2024-09-14T11:58:37.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.525+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.7 2024-09-14T11:58:37.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.525+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.8 2024-09-14T11:58:37.523 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.525+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.9 2024-09-14T11:58:37.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.527+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.736__multipart_foo.2~2nhPK_BHo8UeCyAvpNSbhBIC907KYX6.10 2024-09-14T11:58:37.529 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.531+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.531 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.534+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:58:37.532 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.535+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.535+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.535 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50808' 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8784945336605049235', time=2024-09-14T13:34:14.732799+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.148__shadow_.uLJuDD4qnQ5SIPd0MWV6twJdJVdkYRh_0 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5478448415230429637', time=2024-09-14T13:35:03.896584+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.178__shadow_.NJsF1A-Kpnk2BR5wOzlBNYHAfkOMOdd_0 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~oht-DxbSuRbsg5Z1TNRvYSYT1-VlxNp', time=2024-09-14T13:35:26.262161+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.203__multipart_mymultipart.2~oht-DxbSuRbsg5Z1TNRvYSYT1-VlxNp.1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11513478101544332967', time=2024-09-14T13:37:00.251383+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.238__shadow_.ekDfrP-q437kEVSqhfMP5qwbcFDk_lJ_0 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1007839842743416922', time=2024-09-14T13:37:03.991987+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.243__shadow_.l1fuK4A5VIZRMVljicgV7TxaeYzMa9h_0 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2497344926517680321', time=2024-09-14T13:37:06.813128+0000, chain.objs.size()=1 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.246__shadow_.5ReIEHYGaF_C2P9V628xLpaVMgWUUMG_0 2024-09-14T11:58:37.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3932967381367491070', time=2024-09-14T13:37:09.024022+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.249__shadow_.tZpqRgznvrxLrCivMo9KGvbnweQ13Zn_0 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.292718534657332221', time=2024-09-14T13:37:58.059046+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.H3E0GWG370mE4uVlA5ME4bNWp99_-m2_0 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6669273754347032890', time=2024-09-14T13:37:59.585207+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aK9p0Q5ibKfvK2kzxzclbe80Yh2OzFJ_0 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11588675099818711632', time=2024-09-14T13:37:59.694419+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vuQMKVv5x7h-y2vm92yYd1GMaY2WoWb_0 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7968793591938625391', time=2024-09-14T13:37:59.782833+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mlaG-VwKeQLbH2xXrIT3eDKPuHeW1jw_0 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6836165126404303017', time=2024-09-14T13:38:00.136598+0000, chain.objs.size()=1 2024-09-14T11:58:37.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.536+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Omco6DjQFoOgzlSjdMe6fVSq82N1oE5_0 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2784712478460924544', time=2024-09-14T13:38:00.462892+0000, chain.objs.size()=1 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ju2__s7ZIY03H90Jl3ZbeoY0ZFVxNs7_0 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.895638624205991453', time=2024-09-14T13:38:01.196571+0000, chain.objs.size()=1 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.39J-CAljeJobD3yUG78iXLQMLaf85yE_0 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8980794446592513568', time=2024-09-14T13:38:01.201766+0000, chain.objs.size()=1 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EMWLe2HFXpm79eydScR3eENz535Jzf9_0 2024-09-14T11:58:37.538 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12650049156718051966', time=2024-09-14T13:38:01.889189+0000, chain.objs.size()=1 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.540+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.s6_KrKALpBZ3qeWZoSLR83NEfR6oTr4_0 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9056707614793013621', time=2024-09-14T13:38:02.164207+0000, chain.objs.size()=1 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ufeRWjtCBJYvG8_X11JDOD6oHvHYDLp_0 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5147996397073684089', time=2024-09-14T13:38:02.341289+0000, chain.objs.size()=1 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CjnJ4sbOSfbrGlcwRAPqcjr_3K_WqiW_0 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8727336695609385463', time=2024-09-14T13:38:02.433964+0000, chain.objs.size()=1 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aUmo6vZSlvjU23eQ3F-iXBlRX-vY0jc_0 2024-09-14T11:58:37.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17441312319862024128', time=2024-09-14T13:38:02.437334+0000, chain.objs.size()=1 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mrZKjTBfuoZhs9v5A031RvMdm3qpbaM_0 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5209920272724884923', time=2024-09-14T13:38:02.890153+0000, chain.objs.size()=1 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JRCY0tthw6_OMSRbOsdvNfaOjAX5lcM_0 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11781393420435573271', time=2024-09-14T13:38:03.434693+0000, chain.objs.size()=1 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IX1mLA_FJezCfYtq8Hg049VQoyBNskr_0 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.542+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.861792569649322187', time=2024-09-14T13:38:03.604860+0000, chain.objs.size()=1 2024-09-14T11:58:37.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.542+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1tpXhhtC3O734e9-8vPsDwN_oPZyG7Z_0 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1844693979260607241', time=2024-09-14T13:38:05.029286+0000, chain.objs.size()=1 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pmqgzO1nezL0luvbkFCThD11jMeNrsG_0 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16429026107495424958', time=2024-09-14T13:38:05.407825+0000, chain.objs.size()=1 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.te7jCDjZgHmMBLaOczHvGoTcz4aNO8j_0 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2319466315072057678', time=2024-09-14T13:38:05.437779+0000, chain.objs.size()=1 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XtkP4_K0ScGXjDa2IaqTTHyON9ndvkg_0 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4258299363303898758', time=2024-09-14T13:38:05.524765+0000, chain.objs.size()=1 2024-09-14T11:58:37.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cGpfYSUqxcHh_MZcIHxvgdE1uti_nLC_0 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1569944231587272475', time=2024-09-14T13:38:05.744119+0000, chain.objs.size()=1 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gAeUSC5wSLjllW5H5Qtd2TnrJSI2CXa_0 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15026375073217718411', time=2024-09-14T13:38:07.335117+0000, chain.objs.size()=1 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NuPBhsEUOtm9GcM7OYebvRif0ubSIqe_0 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1143502658351328517', time=2024-09-14T13:38:08.063890+0000, chain.objs.size()=1 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.x6xbKzoPIXo8-vH_e4ZAUDM5aj5a55G_0 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2255746441841886242', time=2024-09-14T13:38:08.392908+0000, chain.objs.size()=1 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.APxNtVFPZJ3KZWlMX_l6mMP-X517ZjF_0 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9786448188981336416', time=2024-09-14T13:38:08.675326+0000, chain.objs.size()=1 2024-09-14T11:58:37.546 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.547+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2Mzeg6P6we-MbwC8a2YpYnuGpehHYv0_0 2024-09-14T11:58:37.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.549+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6663083595028392923', time=2024-09-14T13:38:09.516094+0000, chain.objs.size()=1 2024-09-14T11:58:37.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.549+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pBQjBvSh1GH2Vn3ne8FuOcZC8vbheAO_0 2024-09-14T11:58:37.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.549+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15957042468527415221', time=2024-09-14T13:38:09.754934+0000, chain.objs.size()=1 2024-09-14T11:58:37.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.549+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7sX-k4k8gYO2kpOOH3J7oPUHRR71gUx_0 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3269706800464252341', time=2024-09-14T13:38:09.810853+0000, chain.objs.size()=1 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kuNObsJZDUMn_CaUJwJbX6lWmN5hyY0_0 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11270295755826833791', time=2024-09-14T13:38:09.954882+0000, chain.objs.size()=1 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IowGCpL6LrMwPzJYo-qPEMM98f-pcVv_0 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12296475215932472208', time=2024-09-14T13:38:10.233057+0000, chain.objs.size()=1 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NUVkogw8VWovfzE8L1CdDkBsIW3iIV5_0 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9442864349436202725', time=2024-09-14T13:38:18.025620+0000, chain.objs.size()=1 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.274__shadow_.idkth2dtpA-BmseEgl__fZ8RTwkVdBL_0 2024-09-14T11:58:37.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5424216115249699550', time=2024-09-14T13:38:23.856467+0000, chain.objs.size()=1 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.282__shadow_.6pk5TqN4CWdMvu0tTNuyA-ZS46IoxYS_0 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17260072803634740770', time=2024-09-14T13:38:24.584185+0000, chain.objs.size()=1 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.283__shadow_.UrWYRL2zT_ewTadRbNGR-RlvEm_Jtb8_0 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12730358685698685256', time=2024-09-14T13:38:41.006248+0000, chain.objs.size()=1 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.301__shadow_.BUVe07U0DPGWwkNgJmleSVyv31VFMaS_0 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10868492755939734793', time=2024-09-14T13:38:44.681620+0000, chain.objs.size()=1 2024-09-14T11:58:37.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.552+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.306__shadow_.pbZKWRYAwMuiN-EEy5qEmLIGvqOf_ik_0 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13907557097197478023', time=2024-09-14T13:38:57.862066+0000, chain.objs.size()=1 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.323__shadow_.8LK6Vbg3FujwmD1TBjLhbYvSEIWa9zh_0 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13532574537562074179', time=2024-09-14T13:39:38.489157+0000, chain.objs.size()=1 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D0fEXPWrydl1TUTYeLqZ7U8TfOPKWsN_0 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6991566439022137496', time=2024-09-14T13:39:39.124774+0000, chain.objs.size()=1 2024-09-14T11:58:37.552 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.553+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lUASa01F7nUX6rfPbF0yWBmyrNsU9aY_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13189887455551172358', time=2024-09-14T13:39:39.126169+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ApFYeqSQezDpbC_Gki0JWEllqqaYl77_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11481840925151245342', time=2024-09-14T13:39:39.360617+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dHIMtV3NLxZP3vo7w_RaF39Xrqkrd8i_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6902805503613202128', time=2024-09-14T13:39:39.421035+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DeiV8N9pNpxPvTkWtx--7XdpY69E9EH_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14052713627906109741', time=2024-09-14T13:39:39.470296+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xB7RwESOU4yN45nOElK97vLKzvtb8T4_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5269892897251848714', time=2024-09-14T13:39:39.558343+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hHayV0JbT97bCNAY-M0jbqLNd3Zzm-2_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16608243324693501027', time=2024-09-14T13:39:39.633544+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.c4omK69BUIRz3ejQeWeergTRCBQyn_t_0 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.557+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16016680789511343243', time=2024-09-14T13:39:39.709606+0000, chain.objs.size()=1 2024-09-14T11:58:37.555 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.557+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NdvcuB8roLaLfaWN0CF8bqWzSPhgAGl_0 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2855150516946148669', time=2024-09-14T13:39:42.043849+0000, chain.objs.size()=1 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.U0Ffm6gPU5YRPqoeFye2EiJvFiaUBAD_0 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11660717261012398103', time=2024-09-14T13:39:42.173119+0000, chain.objs.size()=1 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GsvUoxQBfH2SF4am6dL_4W7R8ApYgl9_0 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3166716741802910361', time=2024-09-14T13:39:42.304663+0000, chain.objs.size()=1 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YQgPeIYCeSsoUkLsPgWyLtt4W8ZfsL9_0 2024-09-14T11:58:37.557 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16878235373160447164', time=2024-09-14T13:39:42.860501+0000, chain.objs.size()=1 2024-09-14T11:58:37.558 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.559+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.J2Dvq5v1JmVSd9F3dKdXwUa0t9h-g3G_0 2024-09-14T11:58:37.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.561+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1488773477614902653', time=2024-09-14T13:39:42.901785+0000, chain.objs.size()=1 2024-09-14T11:58:37.559 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.561+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZK0kZpSmsiMKxk9X-ZfjwHXroopIamp_0 2024-09-14T11:58:37.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.563+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4003105102651848604', time=2024-09-14T13:39:43.645557+0000, chain.objs.size()=1 2024-09-14T11:58:37.561 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.563+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YjkPJFKr1pTNTMP4PS5UBTatq9C1Kh1_0 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17939140727348401177', time=2024-09-14T13:39:43.693099+0000, chain.objs.size()=1 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ufmo1me3RTqy479vqUU2zAYrJlumdm4_0 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8856910082554905509', time=2024-09-14T13:39:43.890727+0000, chain.objs.size()=1 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cjprEahVmjrIHTuF1dS24daufgEO_-2_0 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15349580089100323237', time=2024-09-14T13:39:44.341865+0000, chain.objs.size()=1 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.boMhrGwg_vpTa0ODWrqFWoW76m__o9j_0 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12071119909284069769', time=2024-09-14T13:39:44.429248+0000, chain.objs.size()=1 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wM6LbABZzca--sK22LgHrzk2eVWeKdx_0 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4767918046498073562', time=2024-09-14T13:39:44.504464+0000, chain.objs.size()=1 2024-09-14T11:58:37.562 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.564+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xm8ggh5bPVVN90lH2WGIMle2S2DmxEs_0 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1988848419685304698', time=2024-09-14T13:39:44.640230+0000, chain.objs.size()=1 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.P7S8c87606gy2o_kVr3PRAtvok6V3aM_0 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16483337834927926509', time=2024-09-14T13:39:44.801151+0000, chain.objs.size()=1 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ssFyX3PjwRlYYFk8yxKNNvEgkMZi52w_0 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14541499699116998637', time=2024-09-14T13:39:44.849092+0000, chain.objs.size()=1 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fUF2URtFO2MmAkzaxyeOrJ1aeAR3CiK_0 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15149354555726897707', time=2024-09-14T13:39:45.638057+0000, chain.objs.size()=1 2024-09-14T11:58:37.563 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.565+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._qa7pwS9gQeo2ULeBT-DcgtvWoOmD5h_0 2024-09-14T11:58:37.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.566+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13063942650728794471', time=2024-09-14T13:39:46.119006+0000, chain.objs.size()=1 2024-09-14T11:58:37.564 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.566+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9sFr9EPLd7FjiSi_6bXWk0uYUtyHlls_0 2024-09-14T11:58:37.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.568+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6810938661921429783', time=2024-09-14T13:39:46.488807+0000, chain.objs.size()=1 2024-09-14T11:58:37.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.568+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UZAlFVFZOAn76Ik_ra00AR-uQqkufSw_0 2024-09-14T11:58:37.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.568+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7991968177721068520', time=2024-09-14T13:39:46.886383+0000, chain.objs.size()=1 2024-09-14T11:58:37.566 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.568+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AS2FlJI1v9BSNrYhWlcGLUiCn_uTzjF_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1675663814864539581', time=2024-09-14T13:39:47.212985+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iDfgQW5pqvaKgb1ScH6W8ul9QHmDNoX_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6647868728265483480', time=2024-09-14T13:39:48.015198+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BIK4G8lzTx2U4wlbEaZ_XiBlc2qx6me_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.276724642777559339', time=2024-09-14T13:39:48.577554+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1xyqxz4wUJYQ_FbkYpiwA9oqNh2El6w_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15564939264327007585', time=2024-09-14T13:39:49.282870+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VoEqtR9UXe-ULbtN9mMm1Gz3fAkAL1m_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15864512244618156681', time=2024-09-14T13:39:49.947805+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0mRewzD6h_vMQs1fpc611cZQuBVj1gh_0 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10787962189032458313', time=2024-09-14T13:39:49.958719+0000, chain.objs.size()=1 2024-09-14T11:58:37.567 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cMD5jWjHG7lryTLV3sgjwGM23Fj1JTc_0 2024-09-14T11:58:37.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16533146606100292456', time=2024-09-14T13:39:50.108423+0000, chain.objs.size()=1 2024-09-14T11:58:37.568 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.569+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.h6XWOxZw2gn15ayG5QEv-Ug1TqcyYSV_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.572+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10673651315442381615', time=2024-09-14T13:39:50.223087+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.T6bKTNgI_qjVldk1dNcjemp6qKXLDna_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4085198517308897576', time=2024-09-14T13:39:50.360379+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5ZqYsT9pfGnqNJXXFXiUSRBQbmT4qbz_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.835352941357956616', time=2024-09-14T13:39:50.438124+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Kse7wWpu54zYxLzHTcEjz4TG_p4sNf3_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3304710243947615016', time=2024-09-14T13:40:31.083696+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.e7hVWBEkNVq_Inm55RY88FVeYoR_yLI_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10505522660999031508', time=2024-09-14T13:40:31.621351+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VYA-haOz9x9NfgijQpEQHf6GIDDDYXb_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18203973070966624832', time=2024-09-14T13:40:31.626605+0000, chain.objs.size()=1 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7bsRdGL_V8ZFUDii5VSYWqlsdVUN4ix_0 2024-09-14T11:58:37.571 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4424470021324088949', time=2024-09-14T13:40:31.768836+0000, chain.objs.size()=1 2024-09-14T11:58:37.572 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.573+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fqr01yovdjatdnYaYFJRPTed99X2UXj_0 2024-09-14T11:58:37.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15462329493635918269', time=2024-09-14T13:40:31.948632+0000, chain.objs.size()=1 2024-09-14T11:58:37.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mF3s4y3e7a4X2hENAwo_QJnx7Um5tQ0_0 2024-09-14T11:58:37.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17064155948597969293', time=2024-09-14T13:40:31.982976+0000, chain.objs.size()=1 2024-09-14T11:58:37.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.965rwvZG0VtVcloAd407KN7A4wm59cM_0 2024-09-14T11:58:37.573 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7610716671270405046', time=2024-09-14T13:40:31.983524+0000, chain.objs.size()=1 2024-09-14T11:58:37.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.usCEc2wxXXoDUMLEJT7h8SkpG99srx3_0 2024-09-14T11:58:37.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16591826300061937678', time=2024-09-14T13:40:32.689225+0000, chain.objs.size()=1 2024-09-14T11:58:37.574 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.575+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CoYqkUBuAUpw5y0BjEt2D6hdFOpwgi8_0 2024-09-14T11:58:37.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.577+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6393288818100559819', time=2024-09-14T13:40:33.550398+0000, chain.objs.size()=1 2024-09-14T11:58:37.575 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.577+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.e7l2KLNsDo7QI9xPukDSP6qoeqfQ70P_0 2024-09-14T11:58:37.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.578+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8633872461475536862', time=2024-09-14T13:40:34.736050+0000, chain.objs.size()=1 2024-09-14T11:58:37.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.578+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.twK-09Irevuv58OPqMv9nb9fCcitgZC_0 2024-09-14T11:58:37.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.578+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2102641543801115396', time=2024-09-14T13:40:35.242765+0000, chain.objs.size()=1 2024-09-14T11:58:37.576 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.578+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZSRp46Bj2VP6tmDP5ktTkp0IFoQlFRX_0 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.578+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6959185437192111555', time=2024-09-14T13:40:35.243726+0000, chain.objs.size()=1 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.C-ryizQhNDi0drlHbntdAOY4LGUerGo_0 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4993411931350724897', time=2024-09-14T13:40:36.842351+0000, chain.objs.size()=1 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2NfGWtj-yZn9idqoX_gcPnNQS2bijTL_0 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13742068751611233609', time=2024-09-14T13:40:36.975982+0000, chain.objs.size()=1 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bJ8Ca4D7W0lXeTaCrHa80RqSzERBwpx_0 2024-09-14T11:58:37.577 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15603952456231450360', time=2024-09-14T13:40:37.084157+0000, chain.objs.size()=1 2024-09-14T11:58:37.578 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.579+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2FhPT1t7phORbH9RnYZnWePqTU0y9YK_0 2024-09-14T11:58:37.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.582+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18444523410063736000', time=2024-09-14T13:40:37.872648+0000, chain.objs.size()=1 2024-09-14T11:58:37.579 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.582+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XBK41SJYV54wHenbOrAyFJGb9kWOguc_0 2024-09-14T11:58:37.581 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.583+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6585710173764778806', time=2024-09-14T13:40:38.531883+0000, chain.objs.size()=1 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.583+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7KWHuwYJF1_fcSHHHM5fqb6l-cvkHix_0 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.583+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5438026944068836304', time=2024-09-14T13:40:39.179766+0000, chain.objs.size()=1 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.583+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kC3tZkdPxJ3pw8FSFPyqWNNV4V6CjN0_0 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.584+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1423396326745056215', time=2024-09-14T13:40:39.383835+0000, chain.objs.size()=1 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.584+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BnbvvZAuNWbNN59IUHj5GykPtv1zL2J_0 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.584+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.602899505756817227', time=2024-09-14T13:40:39.392926+0000, chain.objs.size()=1 2024-09-14T11:58:37.582 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.584+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5K85TySScaHCqAo8WFA9wF4b2jEGraJ_0 2024-09-14T11:58:37.585 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.587+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/50808 2024-09-14T11:58:37.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:58:37.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7057930740015283480', time=2024-09-14T13:40:39.539310+0000, chain.objs.size()=1 2024-09-14T11:58:37.588 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UrXOQI76_d4ONGMnrd42PzcWnJ6pWzm_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16814520883713928205', time=2024-09-14T13:40:40.012527+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FM6C82MvVwka_lhZSpowhRxSngmLGQN_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.306250935747736619', time=2024-09-14T13:40:40.683055+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FtLF9uE0nfleFuwW_wsHiok2bwU1qPL_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14073847433270430257', time=2024-09-14T13:40:41.214357+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.alePR8HhFHSVCkr-ldZ_9iVQNNWiwm5_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4993220073660237071', time=2024-09-14T13:40:41.261973+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HaIp148Q_W5uOsJ0FUB4xV_alz-mp9N_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13697287826612258685', time=2024-09-14T13:40:41.804279+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AllX0dYYDUsibqFZPdricGZbUWE3dqa_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17142382045653999743', time=2024-09-14T13:40:42.895919+0000, chain.objs.size()=1 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MGjUAbQuyxHybZf8V7qUkYYTlI3a4SV_0 2024-09-14T11:58:37.589 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5604153193927158908', time=2024-09-14T13:40:44.956115+0000, chain.objs.size()=1 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.328__shadow_.Bfoi2DAy_lphVXH5flQTDkSyYel8F0Q_0 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3259208628534081945', time=2024-09-14T13:40:46.096494+0000, chain.objs.size()=1 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.330__shadow_.NmH0JFbPUGcpzejyUbSDTcdak2_GD7t_0 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3197801692749476330', time=2024-09-14T13:40:48.027451+0000, chain.objs.size()=1 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.333__shadow_.8agm2XDrnVq9-ALscCEBajJz1P137XW_0 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12892680589111789463', time=2024-09-14T13:42:12.306078+0000, chain.objs.size()=1 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.461__shadow_.ssn9bqw0zTePATN3cwYLRV8muteYl40_0 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16017142862888847959', time=2024-09-14T13:42:38.509983+0000, chain.objs.size()=1 2024-09-14T11:58:37.590 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.590+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.497__shadow_.IE7oKHy-26LVHexsZnQmu_xyomKgGBy_0 2024-09-14T11:58:37.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.594+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks', time=2024-09-14T13:43:51.781079+0000, chain.objs.size()=1 2024-09-14T11:58:37.591 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.594+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.2 2024-09-14T11:58:37.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.594+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5157564286840050832', time=2024-09-14T13:46:21.899517+0000, chain.objs.size()=2 2024-09-14T11:58:37.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.594+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.564__shadow_.zzYU9jckx1YLLde1dyYYEgDiXYOC4Qy_0 2024-09-14T11:58:37.592 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.594+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.564__shadow_.zzYU9jckx1YLLde1dyYYEgDiXYOC4Qy_1 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12422231944812676808', time=2024-09-14T13:46:26.635478+0000, chain.objs.size()=1 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:82LenMhSDaBOZg1Uw-hpx-j2DcsBKmd_.AjJtBhGeLKa3WOKOx5AYPs1d_MRfVWL_0 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8269663922351025330', time=2024-09-14T13:46:35.683393+0000, chain.objs.size()=1 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:ecJ.EC9D4Z1V3gmQz6woenjWj0v42hN_.4p-RQBtuLqOI7vuLI4PUgmCbZBL2qKG_0 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11187437592635916118', time=2024-09-14T13:52:13.535961+0000, chain.objs.size()=2 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.656__shadow_.4rkZuVyTStNxOAvstVgoA-O7SAJMKMq_0 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.656__shadow_.4rkZuVyTStNxOAvstVgoA-O7SAJMKMq_1 2024-09-14T11:58:37.593 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6505458595083852915', time=2024-09-14T13:52:31.110315+0000, chain.objs.size()=6 2024-09-14T11:58:37.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.1 2024-09-14T11:58:37.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.595+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.2 2024-09-14T11:58:37.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.596+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.3 2024-09-14T11:58:37.594 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.596+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.4 2024-09-14T11:58:37.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.599+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.5 2024-09-14T11:58:37.597 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.599+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.663__multipart_foo.2~WilNjrI7_1JYEhkEaHSmOOLk6u7_8sU.6 2024-09-14T11:58:37.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.600+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8626809852180292532', time=2024-09-14T13:52:35.201990+0000, chain.objs.size()=1 2024-09-14T11:58:37.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.600+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.667__shadow_.hhMWZ9Mv5aBRHrdFlfU1xGY5DmMBiIn_0 2024-09-14T11:58:37.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14202359905599590660', time=2024-09-14T13:52:35.459027+0000, chain.objs.size()=1 2024-09-14T11:58:37.598 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.667__shadow_.1Qc2ciRLSfhpBvUqVzVM4laY3wqDDla_0 2024-09-14T11:58:37.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2001943890333491298', time=2024-09-14T13:52:56.655884+0000, chain.objs.size()=1 2024-09-14T11:58:37.599 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.702__shadow:.4D.6TdTQSYSqGQee0ALx9s0K6CFZ9z_.rxZ8k4Ymunjd3pwo5CNkSGR8YOXK9-D_0 2024-09-14T11:58:37.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17017158229748742970', time=2024-09-14T13:53:16.670103+0000, chain.objs.size()=1 2024-09-14T11:58:37.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.716__shadow:JOa5ZfBAVfGq9z8fmU8tsc5z78KwrSL_.Cb6GKWZ-886OQB5zxTu2XQSJ4v-YkV__0 2024-09-14T11:58:37.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10065524565947611862', time=2024-09-14T13:55:02.178124+0000, chain.objs.size()=1 2024-09-14T11:58:37.600 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.601+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.760__shadow_.2EIRcgvmJ2yBg70W8rxF-CzwmUH0MIw_0 2024-09-14T11:58:37.604 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.606+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.606 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.608+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:58:37.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.610+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.608 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.611+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51994' 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17217003142289362427', time=2024-09-14T13:34:34.551975+0000, chain.objs.size()=3 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.NtEwB-uV1F4tOuNFahOdMXwXBNHy-Sm_0 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.NtEwB-uV1F4tOuNFahOdMXwXBNHy-Sm_1 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.NtEwB-uV1F4tOuNFahOdMXwXBNHy-Sm_2 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_i4ca7f-o2zAvRByUuxJZaiY3Q5XfVd0', time=2024-09-14T13:34:35.404808+0000, chain.objs.size()=3 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.q59podgL7DoiuKdqrqMeMq4k_mmxqWd_0 2024-09-14T11:58:37.610 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.q59podgL7DoiuKdqrqMeMq4k_mmxqWd_1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.q59podgL7DoiuKdqrqMeMq4k_mmxqWd_2 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11286198404707359609', time=2024-09-14T13:35:27.809213+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.205__shadow_.OCpq085l_iO-CSpYber4zaK6-0oUWyj_0 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4454446329456710544', time=2024-09-14T13:37:14.182326+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.256__shadow_.h4fQ4Mb8Bv0AibCOaje4eLun-G-hX89_0 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7972842345410433330', time=2024-09-14T13:37:58.729917+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.g6-8LyFNIVFXndS4gdkHPxt9XnhzQN8_0 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12493136310873786236', time=2024-09-14T13:37:58.731189+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LWAIk8EE2YWP1gRKNpsvRCgzCqHtWfC_0 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2604874764629425496', time=2024-09-14T13:37:59.504887+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.P6vizu7dQAJx6Qfij-ILX8X6hKOh7fO_0 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9764481580793791629', time=2024-09-14T13:37:59.782876+0000, chain.objs.size()=1 2024-09-14T11:58:37.611 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.612+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PmBAaYBJqeAVEDSrjmuPH3eD_IFhdmQ_0 2024-09-14T11:58:37.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.615+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7555600947585755766', time=2024-09-14T13:38:00.642052+0000, chain.objs.size()=1 2024-09-14T11:58:37.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.615+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.X8nbwqRCl6SIz0M1-aHfTW-GN-3r8mF_0 2024-09-14T11:58:37.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.615+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11590418810056635784', time=2024-09-14T13:38:00.676652+0000, chain.objs.size()=1 2024-09-14T11:58:37.613 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.615+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.B8YhW3J3QUvVIMuc_zYbuA1NHnP2wtf_0 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10854741228198107181', time=2024-09-14T13:38:00.722244+0000, chain.objs.size()=1 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DpKY-2el4sSJUJFDo4EdRNoeZ_w7SyQ_0 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11619069111821961704', time=2024-09-14T13:38:01.727360+0000, chain.objs.size()=1 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kxPPNPHTbY3UJzFumMjQo3p9vb3j8uH_0 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10298513807206809269', time=2024-09-14T13:38:02.006489+0000, chain.objs.size()=1 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3vWpbY8sM9CsRxqfcZboKJDaXlgN8vA_0 2024-09-14T11:58:37.614 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.616+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17277404957666894598', time=2024-09-14T13:38:02.888591+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fgb7DYbYqfU7Kpu2L5-p0gVRLVzdnBG_0 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12557019138585831765', time=2024-09-14T13:38:03.856643+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wcdEXexaZUWljSMJFx8juhiad8yECdb_0 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.337039142934172983', time=2024-09-14T13:38:04.093305+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1EA57cZLne-ILPax5v7Ge2eOJflpTaI_0 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8210406802025025691', time=2024-09-14T13:38:04.688697+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6UdjE5AoMAgok-Bi3tVlBO7ssy7JTEF_0 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14404055798173262072', time=2024-09-14T13:38:05.329828+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1grfXeVU7UOXzEMFI85m84HccY5HIjr_0 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10342978246473990159', time=2024-09-14T13:38:05.364081+0000, chain.objs.size()=1 2024-09-14T11:58:37.615 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.617+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WXOPDXv2T7nW55YjZQTbp3HhvG6C_a2_0 2024-09-14T11:58:37.619 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8472592847407363429', time=2024-09-14T13:38:05.606221+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.64Q2_S-DxKSP1U3UbY6lQNxDFDUP9nW_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13383943602377822984', time=2024-09-14T13:38:06.409391+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Z4VFKeOsvjvUBQA9aFvNvPobEv8Pm8o_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16401686704431691052', time=2024-09-14T13:38:06.495167+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PA4_2rxkafIIwKurebsqXA0PC9ZNN-H_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12889322559833235315', time=2024-09-14T13:38:06.780702+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.L1pMWXR8zUtGC3K7RDjCNnLCKy-fz7j_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7818505211609663860', time=2024-09-14T13:38:08.066703+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9k1kKeTiX7sSod1UrekpMXDWoiE39ep_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4924540971191165674', time=2024-09-14T13:38:08.164751+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6Dv6vVkdxp-NfB05c330WEm5gONvutW_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11521760199036886913', time=2024-09-14T13:38:08.230515+0000, chain.objs.size()=1 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MPHJEbHJl8RP3Yl3ANPRxpYCobEEl-t_0 2024-09-14T11:58:37.620 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13071338779729409225', time=2024-09-14T13:38:08.732792+0000, chain.objs.size()=1 2024-09-14T11:58:37.621 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.622+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7x3KdTG41wAv-Fxca19_LLuNaZDAZVQ_0 2024-09-14T11:58:37.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.624+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9365407003854885368', time=2024-09-14T13:38:08.983877+0000, chain.objs.size()=1 2024-09-14T11:58:37.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.624+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v8b0pPTu9DQTNVJRTV-YSAJupxqez69_0 2024-09-14T11:58:37.622 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8307601244445953770', time=2024-09-14T13:38:09.573334+0000, chain.objs.size()=1 2024-09-14T11:58:37.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7EF15CP1HGw7XZpmnLqeSJRII6T5IQs_0 2024-09-14T11:58:37.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4861358774091946819', time=2024-09-14T13:38:09.833879+0000, chain.objs.size()=1 2024-09-14T11:58:37.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PJNs9Ezf-qa9VtIB8N2akyuMTJB4-ep_0 2024-09-14T11:58:37.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5697673387627811783', time=2024-09-14T13:38:09.908793+0000, chain.objs.size()=1 2024-09-14T11:58:37.623 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.625+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2wxHR5UV0mAgmGOwKdGSUS2DMURF5JN_0 2024-09-14T11:58:37.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5646684232093884897', time=2024-09-14T13:38:10.044190+0000, chain.objs.size()=1 2024-09-14T11:58:37.624 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vCRJ2-6sSvRQWStpSuaRMBcPh_KvRlr_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7953212368040918701', time=2024-09-14T13:38:10.378975+0000, chain.objs.size()=1 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RCdsoaVb_6TzeCsOzy3WzZypt7WV6ev_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2295388731119083067', time=2024-09-14T13:38:14.581897+0000, chain.objs.size()=1 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.269__shadow_.7pVO2o7ZIeo9JrOFiZGFTWICWTCu5iU_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1377105365327465781', time=2024-09-14T13:38:24.576478+0000, chain.objs.size()=1 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.283__shadow_.d6sCwm_6NNcnKk6RBhrR0csUDCTGTej_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6261284469232094331', time=2024-09-14T13:38:33.535426+0000, chain.objs.size()=1 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.I5OdxeGy13Z2cffubNoDr3smdnQ2UbD_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15977834795549686495', time=2024-09-14T13:38:43.963727+0000, chain.objs.size()=1 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.626+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.305__shadow_.GmM9sPDCAgEQi4OtYcHDO1ZJ2JnVCVY_0 2024-09-14T11:58:37.625 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.627+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17929718599175281809', time=2024-09-14T13:39:38.544270+0000, chain.objs.size()=1 2024-09-14T11:58:37.626 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.627+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HXdy7nRbFSRmt-kZUTw2DAlAk51IcuM_0 2024-09-14T11:58:37.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.630+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1375242206819328057', time=2024-09-14T13:39:39.084084+0000, chain.objs.size()=1 2024-09-14T11:58:37.628 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.630+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HrvnvsNrAingAW1b1gDMQUJybTw_o9T_0 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4507227136028691160', time=2024-09-14T13:39:39.430577+0000, chain.objs.size()=1 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PVPOwwLTFC-_-ZJrIGOijlMrySwGRgF_0 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6505595053705154700', time=2024-09-14T13:39:39.629666+0000, chain.objs.size()=1 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mYM500s-1D_KcukUXlLOR-n7pvJGYw-_0 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13086147257801560242', time=2024-09-14T13:39:40.258623+0000, chain.objs.size()=1 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UkKos5H_6XGcJrrp5ScaJ86IzTMYQ2r_0 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2025914017658798695', time=2024-09-14T13:39:40.499745+0000, chain.objs.size()=1 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.orWrZb7af-FQ4FdpW5a_kaSxdaYQRBc_0 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7989142339857293185', time=2024-09-14T13:39:40.539928+0000, chain.objs.size()=1 2024-09-14T11:58:37.629 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZXI6ZgXzQJJLyhr9U53TvbvQzoJbXCk_0 2024-09-14T11:58:37.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5992594802479960416', time=2024-09-14T13:39:40.999731+0000, chain.objs.size()=1 2024-09-14T11:58:37.630 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.631+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.amjvQvNeUvWeB2GgCSSXxbOOJjAJ9Yu_0 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2968903033975893590', time=2024-09-14T13:39:41.188779+0000, chain.objs.size()=1 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TOhKEdzDYUtpwC0fjX-LkviJCnzrT9h_0 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16239084230084402395', time=2024-09-14T13:39:41.340053+0000, chain.objs.size()=1 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._NEdxAh1WIvFkmW_xIZ8QAunEsnhp7W_0 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2586104330758775894', time=2024-09-14T13:39:42.135356+0000, chain.objs.size()=1 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4bnya32yfa35TXSl4zhiTOtdPaxJTgx_0 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4057595106981956403', time=2024-09-14T13:39:42.489987+0000, chain.objs.size()=1 2024-09-14T11:58:37.632 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.634+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vUKno4IbNfy3ECRb9Z7gX_VVwvx-pjB_0 2024-09-14T11:58:37.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.637+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4366953954777969907', time=2024-09-14T13:39:42.607936+0000, chain.objs.size()=1 2024-09-14T11:58:37.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.637+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5Y-THamiLbUMZeVNPrt-jxq_EeM-sw5_0 2024-09-14T11:58:37.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.637+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10271549593947252605', time=2024-09-14T13:39:42.982022+0000, chain.objs.size()=1 2024-09-14T11:58:37.635 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.637+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.20Iy7iUKu3ENpnL5YqvkdQyQPqv6cTp_0 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.565991476334061199', time=2024-09-14T13:39:44.297484+0000, chain.objs.size()=1 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kMhF6zKo1UV2-aDVVIsDkXOY3fwFkuf_0 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17227974679154402607', time=2024-09-14T13:39:45.706531+0000, chain.objs.size()=1 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XhZFRCqJ0e_PotwbynEvy6U-dAEnyEC_0 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11394855957584555445', time=2024-09-14T13:39:47.699666+0000, chain.objs.size()=1 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OB-a0hwbCQyAARY0gkh41E6Erd5K3GS_0 2024-09-14T11:58:37.637 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8799187301910164787', time=2024-09-14T13:39:47.700993+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9caNe2xYXrpuTDTY2y4slcGbe9Vm_Pz_0 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1898640189230988668', time=2024-09-14T13:39:47.796821+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0VqyI_2l7gx25DZbE0k1NScnLszIO2x_0 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3855669393204789031', time=2024-09-14T13:39:47.886663+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.J9fI3rjfVSdOF-wSgttLvtBs2zci-5V_0 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14372377651766548919', time=2024-09-14T13:39:47.937328+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RugMjgj5RL8OljKtgKkkgY9tQFlA4gG_0 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.752226589720449685', time=2024-09-14T13:39:48.014642+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yORmBUI-BbrdqTy5mzw88TzWLQgz0q7_0 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6298571760119869683', time=2024-09-14T13:39:48.461383+0000, chain.objs.size()=1 2024-09-14T11:58:37.638 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.639+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.14dOmtkEKO_szE0PC77tlroOqMyM7FD_0 2024-09-14T11:58:37.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.640+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15070314558146630292', time=2024-09-14T13:39:48.618633+0000, chain.objs.size()=1 2024-09-14T11:58:37.639 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.640+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.n6S5PJnvFf0WAqNmzbXcx8NkwqJzKxz_0 2024-09-14T11:58:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.642+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5557202357160338834', time=2024-09-14T13:39:49.021556+0000, chain.objs.size()=1 2024-09-14T11:58:37.640 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.642+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2NYtMTcnvhGqirZ6G63NQeJ4MXT0qps_0 2024-09-14T11:58:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.646+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12802167819470716244', time=2024-09-14T13:39:49.190906+0000, chain.objs.size()=1 2024-09-14T11:58:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.646+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._TwdzlsTQdJieZ1qIc8uUJBldccNqZs_0 2024-09-14T11:58:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.646+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16340935492877939428', time=2024-09-14T13:39:49.336407+0000, chain.objs.size()=1 2024-09-14T11:58:37.644 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.646+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0ERQPcIHd2VbKh1I5PQ7PhBf42j423c_0 2024-09-14T11:58:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1298657014859535743', time=2024-09-14T13:39:49.613700+0000, chain.objs.size()=1 2024-09-14T11:58:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D1qtilx1O7TfdpLZ7LHwt2TT9lngaBC_0 2024-09-14T11:58:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.647+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2163750870382942459', time=2024-09-14T13:39:50.757898+0000, chain.objs.size()=1 2024-09-14T11:58:37.645 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.647+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xlx_6auGLBW83UJkIfb4pEZy5If5Qxm_0 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11208674301926960294', time=2024-09-14T13:39:50.846611+0000, chain.objs.size()=1 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ffeNLucXY0RpLjB5XGxd6VW-oQDf_2N_0 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9506094876033116345', time=2024-09-14T13:39:50.900773+0000, chain.objs.size()=1 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LD70_LUSBVifb87i38S_3Tqz8wy40DP_0 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12602944717833813808', time=2024-09-14T13:40:30.966014+0000, chain.objs.size()=1 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._r72ExXygtMYNNK1RLQjRNPPYZ97xdu_0 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12337501459729188460', time=2024-09-14T13:40:31.126083+0000, chain.objs.size()=1 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MlOvd3qJX7NkteJ94dewoq_av_PeolI_0 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8050020406410320778', time=2024-09-14T13:40:31.865438+0000, chain.objs.size()=1 2024-09-14T11:58:37.646 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MyHtTzu6PDldwvUNff6x-Gcjv8qHkLU_0 2024-09-14T11:58:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18114536364410106718', time=2024-09-14T13:40:32.940543+0000, chain.objs.size()=1 2024-09-14T11:58:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.88ugUlFRaTW3CgBTD6r2Gzo0XYv58Fb_0 2024-09-14T11:58:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11061534021969753090', time=2024-09-14T13:40:34.264668+0000, chain.objs.size()=1 2024-09-14T11:58:37.647 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.648+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AGTjQom5oRUc47I8o21M6_35zYzetcX_0 2024-09-14T11:58:37.649 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3940586936315252750', time=2024-09-14T13:40:34.736384+0000, chain.objs.size()=1 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6EUis2IzY4B4gfrmzpcFinHPxBE06_q_0 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5559483243161626824', time=2024-09-14T13:40:35.884892+0000, chain.objs.size()=1 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.skJGvdh11TIH09TErH8KWwwy6QdKQjx_0 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6406528407504180861', time=2024-09-14T13:40:36.229121+0000, chain.objs.size()=1 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3vnCSLtAypuoXlxk-Lc2LKuvdrZbajG_0 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3971455103533556116', time=2024-09-14T13:40:36.230359+0000, chain.objs.size()=1 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7UOlh6D2VzxyRHgwX8zNWFSeYbxEMdS_0 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3246664897997314623', time=2024-09-14T13:40:36.457972+0000, chain.objs.size()=1 2024-09-14T11:58:37.650 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.651+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1zmnfKBIKT3LznkC3DAvi1m6iYIT-Yg_0 2024-09-14T11:58:37.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.654+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6726089576830406798', time=2024-09-14T13:40:36.474587+0000, chain.objs.size()=1 2024-09-14T11:58:37.652 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.654+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ahneDKRn0rEV-_C9wzN9c7pnLYIlVju_0 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.692855991175512620', time=2024-09-14T13:40:37.516787+0000, chain.objs.size()=1 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TIbDzWJR_-Otnq_dW-icwbqYPRfjMPH_0 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15629673202303639210', time=2024-09-14T13:40:38.079162+0000, chain.objs.size()=1 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3FG01C-BH25sLEgBa3n6zN6VyModc4e_0 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3560311958450648284', time=2024-09-14T13:40:38.163919+0000, chain.objs.size()=1 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Es8fXgRW6A4pjdEcgyroC4JhIL7Muye_0 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12706487036301667886', time=2024-09-14T13:40:38.282238+0000, chain.objs.size()=1 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mChPl4habTgwu1FE2ivfT8J3CJ2BSZO_0 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11971920811697639443', time=2024-09-14T13:40:39.384808+0000, chain.objs.size()=1 2024-09-14T11:58:37.653 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.e5IuKXnLVZT8NZO-xxreg58TE2mpmUH_0 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3430919380305768573', time=2024-09-14T13:40:39.394838+0000, chain.objs.size()=1 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bn-TYCJFEiuub_z8lL6UV7k_7vc-XV-_0 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4774578974423552442', time=2024-09-14T13:40:39.935373+0000, chain.objs.size()=1 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UPfQiwi-XEoaghrtFId7av-C8d-JRqy_0 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.655+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2956694691469890802', time=2024-09-14T13:40:40.683135+0000, chain.objs.size()=1 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LzNtBI5gZ_zIMg2fR70BzG8z29NR1ui_0 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17170923767648921530', time=2024-09-14T13:40:41.906888+0000, chain.objs.size()=1 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Onq0Jy6ahSAcE8D5xOz3H1NzwetVNOE_0 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.656+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9646533672518789764', time=2024-09-14T13:40:42.190038+0000, chain.objs.size()=1 2024-09-14T11:58:37.654 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.656+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Os4_OAdY9vbBY1EFervIOfav6on5ag7_0 2024-09-14T11:58:37.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.659+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5564497587999669836', time=2024-09-14T13:40:42.247139+0000, chain.objs.size()=1 2024-09-14T11:58:37.657 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.659+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7yTGC0NXdZe9l8yeb1btLBBVYMJp6-x_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13474821180805883643', time=2024-09-14T13:40:42.359448+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kMGvwFtXiEQcqNOmEA7KltCt4bvw1jd_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18394937450653404227', time=2024-09-14T13:40:42.492520+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SQBBIt4HXrLhlp1zJIm55818sjjaI6J_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8823802321474024437', time=2024-09-14T13:40:42.935271+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.znFWf_LU1MnQhHvJOvJzTGtYsJLBUrR_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9097383092308204600', time=2024-09-14T13:40:42.952034+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZqZ8In-i1BMO2tmV3c-J2hahFWMPdn9_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1283129959513272331', time=2024-09-14T13:40:48.195553+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.333__shadow_.GmAF_8Km6b7BzlCmayBPKdiipsO7oEb_0 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4622395942492309942', time=2024-09-14T13:40:51.451767+0000, chain.objs.size()=1 2024-09-14T11:58:37.658 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.338__shadow_.-xDZDhZuI78bX49IbcVGRomGtQoUCs9_0 2024-09-14T11:58:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8521031528323134517', time=2024-09-14T13:42:14.227234+0000, chain.objs.size()=1 2024-09-14T11:58:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.660+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.463__shadow_.No8XIpIe2-UvpxwlQclffaCbc5WucMJ_0 2024-09-14T11:58:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.661+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17970454704923278690', time=2024-09-14T13:42:16.774366+0000, chain.objs.size()=1 2024-09-14T11:58:37.659 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.661+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.466__shadow_.CYz6Q3Pu3dwD-hOhAovyqv99b8O318x_0 2024-09-14T11:58:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.662+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7334883741548513480', time=2024-09-14T13:42:17.917243+0000, chain.objs.size()=1 2024-09-14T11:58:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.662+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.467__shadow_.RvHt2Sx-w0E3s-v-pg_j5kvo3zdCWXf_0 2024-09-14T11:58:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.662+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13934042843061071769', time=2024-09-14T13:42:34.743455+0000, chain.objs.size()=1 2024-09-14T11:58:37.660 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.662+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.491__shadow_.lTUIiBufnelCu--3LoL8WFcD1VpuUzm_0 2024-09-14T11:58:37.665 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.667+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/51994 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13934042843061071769', time=2024-09-14T13:42:34.949317+0000, chain.objs.size()=1 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.491__shadow_.lTUIiBufnelCu--3LoL8WFcD1VpuUzm_0 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5665329501048115041', time=2024-09-14T13:42:54.025350+0000, chain.objs.size()=6 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:37.668 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.897528203412185630', time=2024-09-14T13:42:55.322439+0000, chain.objs.size()=1 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.512__multipart_mymultipart.2~ASeDX0EKCHeadOoJW4iQfteHhFXh90N.1 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18294772699423225691', time=2024-09-14T13:43:51.805445+0000, chain.objs.size()=12 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.gJugtkmv7ruKHaZd3T7zWE_J0Ty6rKmP.1 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.gJugtkmv7ruKHaZd3T7zWE_J0Ty6rKmP.1_1 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.2 2024-09-14T11:58:37.669 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.670+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.2_1 2024-09-14T11:58:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.673+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.3 2024-09-14T11:58:37.670 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.673+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.3_1 2024-09-14T11:58:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.673+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.4 2024-09-14T11:58:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.673+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.4_1 2024-09-14T11:58:37.671 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.673+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.5 2024-09-14T11:58:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.5_1 2024-09-14T11:58:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.6 2024-09-14T11:58:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.6_1 2024-09-14T11:58:37.672 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~3T-cmSy0c6zgizpffi8vZa9D97-aH4g', time=2024-09-14T13:45:05.744575+0000, chain.objs.size()=2 2024-09-14T11:58:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__multipart_mymultipart.2~3T-cmSy0c6zgizpffi8vZa9D97-aH4g.1 2024-09-14T11:58:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.674+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.532__multipart_mymultipart.2~3T-cmSy0c6zgizpffi8vZa9D97-aH4g.2 2024-09-14T11:58:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.675+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17491320604563992846', time=2024-09-14T13:46:08.858656+0000, chain.objs.size()=1 2024-09-14T11:58:37.673 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.675+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.559__shadow_.xvXtYirmtZehbZnVgt1skHMie7NorCf_0 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7541871674391322593', time=2024-09-14T13:46:23.880613+0000, chain.objs.size()=1 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.567__shadow_.E5aMWA_uBPgTu8XxL_71NmVR7FcwJ2i_0 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16547285985308751392', time=2024-09-14T13:47:32.019769+0000, chain.objs.size()=1 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:weUlWkJQLGFUBEZsne6ZjOOPJK4XdJJ_.g3bDgT9iEPvvwdSIXMrjgmYSdY7UKCN_0 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9832831104220823857', time=2024-09-14T13:47:34.483052+0000, chain.objs.size()=1 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:6I7VYZIol-CIDyoPw0NNBG0yIUWx3ZK_.BOlvAPNbQmwgUdqRImkcIPGV74qjJua_0 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12626861144762776681', time=2024-09-14T13:52:36.689669+0000, chain.objs.size()=1 2024-09-14T11:58:37.676 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.669__shadow_.rm-EHzbclNFucs4CyWfJ2XGIygBTmFC_0 2024-09-14T11:58:37.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5950232843466417282', time=2024-09-14T13:53:05.427443+0000, chain.objs.size()=1 2024-09-14T11:58:37.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.678+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.714__shadow:AHlo4MZWi9K0kxlLJL3ftZkxJkXkAaV_.JjXbWvW186Xdg-MiRV89bZUElrsdqBJ_0 2024-09-14T11:58:37.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.679+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2875733338119209363', time=2024-09-14T13:53:52.711075+0000, chain.objs.size()=2 2024-09-14T11:58:37.677 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.679+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.741__shadow_.CXGb932nriD5JCS451To0aLCTGn-CPD_0 2024-09-14T11:58:37.678 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.681+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.741__shadow_.CXGb932nriD5JCS451To0aLCTGn-CPD_1 2024-09-14T11:58:37.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.681+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8474312488460227163', time=2024-09-14T13:53:58.263194+0000, chain.objs.size()=6 2024-09-14T11:58:37.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.681+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__multipart_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.1 2024-09-14T11:58:37.679 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.681+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__shadow_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.1_1 2024-09-14T11:58:37.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__multipart_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.2 2024-09-14T11:58:37.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.682+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__shadow_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.2_1 2024-09-14T11:58:37.680 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.683+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__multipart_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.3 2024-09-14T11:58:37.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.685+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.744__shadow_mymultipart3.2~S-jyTkZ2-o2UHtJRerONBou9J274cOK.3_1 2024-09-14T11:58:37.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.685+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17900878509909904755', time=2024-09-14T13:55:58.122567+0000, chain.objs.size()=1 2024-09-14T11:58:37.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.685+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.773__shadow_.y8qEUsLkGOcnDXaS5ZMRzSmfKHGi5zl_0 2024-09-14T11:58:37.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.685+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.295311482539464259', time=2024-09-14T13:56:10.315186+0000, chain.objs.size()=1 2024-09-14T11:58:37.683 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.685+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.776__shadow_.sSduDmFm3JE6WPbZ5E2lvMICYF4e0P5_0 2024-09-14T11:58:37.689 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.691+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.691 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.694+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:58:37.692 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.695+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.693 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.695+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52889' 2024-09-14T11:58:37.694 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16983471448858204967', time=2024-09-14T13:34:25.328416+0000, chain.objs.size()=3 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.gwqg9DePsVMETlMQWc_IDYUCPk5lhfT_0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.gwqg9DePsVMETlMQWc_IDYUCPk5lhfT_1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.gwqg9DePsVMETlMQWc_IDYUCPk5lhfT_2 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7353922061068171661', time=2024-09-14T13:36:54.749233+0000, chain.objs.size()=1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.231__shadow_.CLjfTNUpI-1hJgQJ_KvHOoCOXRLLLo9_0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7391942351843118562', time=2024-09-14T13:36:54.749822+0000, chain.objs.size()=1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.231__shadow_.ZE2G1YV7IT2M6ldto2fkUypKRcgbMB__0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18225160224537198774', time=2024-09-14T13:36:59.220555+0000, chain.objs.size()=1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.237__shadow_.65fGdTpUAJEA4uWiQyh9WHcZxHL1KLo_0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3244995012382463252', time=2024-09-14T13:37:03.988965+0000, chain.objs.size()=1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.243__shadow_.upYJO_uNg3DJyqgdjvadTw61QhJrV1n_0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14258128278294445235', time=2024-09-14T13:37:07.542104+0000, chain.objs.size()=1 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.247__shadow_.viivh0sv07m_flUJG6vJ_JXZTP4xuXN_0 2024-09-14T11:58:37.695 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10607332955926426660', time=2024-09-14T13:37:09.763056+0000, chain.objs.size()=1 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.250__shadow_.zqhIYnKuItVjVhmT1gyaucOz6sLXFI3_0 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6114262845117433542', time=2024-09-14T13:37:10.500926+0000, chain.objs.size()=1 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.251__shadow_.0XVh25gXAbg031b59AhGXAkETbIidh-_0 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15549963545362061481', time=2024-09-14T13:37:12.738708+0000, chain.objs.size()=1 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.254__shadow_.NLJGtiPr5AvsgEEHanNi6JmVrNysjnq_0 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.923530933473873810', time=2024-09-14T13:37:57.734060+0000, chain.objs.size()=1 2024-09-14T11:58:37.696 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.696+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Uqd2bJErG_vhkAzW9wYEz7A0arIChys_0 2024-09-14T11:58:37.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.699+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15861477828625383268', time=2024-09-14T13:37:58.032001+0000, chain.objs.size()=1 2024-09-14T11:58:37.697 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.699+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KdUNMn7Dkd_r4q1_LNWQTzTf70Uks3L_0 2024-09-14T11:58:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3435973187612152719', time=2024-09-14T13:37:58.318809+0000, chain.objs.size()=1 2024-09-14T11:58:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3Ppl5jAE74-cQSSdkHjmfVsZ1YLkwL4_0 2024-09-14T11:58:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14186676050507734647', time=2024-09-14T13:37:58.332757+0000, chain.objs.size()=1 2024-09-14T11:58:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.an_3AXtkGJUV-bmec0Dgi_mrdYEqhlL_0 2024-09-14T11:58:37.698 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16205264598373323647', time=2024-09-14T13:37:58.731770+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6x713m72Ef_fk07TTUi7l6Mi3WwxoWz_0 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16591973768918061994', time=2024-09-14T13:37:58.732865+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Cur2mRh2yfClHr2i6d9uXBxQ4j-BpqM_0 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3305210025285573959', time=2024-09-14T13:37:58.939803+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vSzZ65ljA9J3oxYdJ-e48rzOVCypNBf_0 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10681750967738933234', time=2024-09-14T13:37:58.962296+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LlHUzZeF5aBKtdeXHrlf3JVtUin1Wo9_0 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1037956526538149768', time=2024-09-14T13:37:59.860721+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TvVwZPhcHjw9Du1ud9N7TYvUaeqMefv_0 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15800856345426496921', time=2024-09-14T13:38:00.286768+0000, chain.objs.size()=1 2024-09-14T11:58:37.699 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.700+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.t5FYNT31x1GTS3A5e1Vco68e-jfN8qK_0 2024-09-14T11:58:37.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.701+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7685842142747195640', time=2024-09-14T13:38:00.462857+0000, chain.objs.size()=1 2024-09-14T11:58:37.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.701+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iqJRecQAbr3YzVnoQqgR4ESGraWdTz__0 2024-09-14T11:58:37.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.701+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10769426270801294929', time=2024-09-14T13:38:00.609027+0000, chain.objs.size()=1 2024-09-14T11:58:37.700 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.701+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fafNOIJ2WgMGNGRxX8CBdXN8V1vzIlG_0 2024-09-14T11:58:37.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.703+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.270587825222671439', time=2024-09-14T13:38:01.201768+0000, chain.objs.size()=1 2024-09-14T11:58:37.701 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.703+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nOHWeL716UCRi0-Y2gRQ2P777qbrjBN_0 2024-09-14T11:58:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.704+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13199684687628434042', time=2024-09-14T13:38:01.268996+0000, chain.objs.size()=1 2024-09-14T11:58:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.704+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wIBU51tANJGWmEPl3yX1P_e8Fe7ovI9_0 2024-09-14T11:58:37.702 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.704+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14592995368402804621', time=2024-09-14T13:38:01.336307+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.704+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ORcajn7382DsTc8kgEJKIwqR0W8gLbT_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18389894733039359373', time=2024-09-14T13:38:01.452017+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-lzElSdCeh3zUyxrUed4vCG-e28fOPL_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17621018621698302747', time=2024-09-14T13:38:01.711675+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dKkiyxk0tN-xJr3gKefC9dWJrUEno3R_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.163629475636511330', time=2024-09-14T13:38:02.006769+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dXVP1yqXJH-o67jiC--SRFsKc0Yo1ES_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9735387508797321912', time=2024-09-14T13:38:02.890191+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kMOjhUhz_TTi1TA7MoAm41uZDNTsJuD_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8481381727089353098', time=2024-09-14T13:38:03.141966+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PPB-TY-C43QDgyLT26k_KOdj43Us-sY_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13421413256856583449', time=2024-09-14T13:38:03.219340+0000, chain.objs.size()=1 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.p4-oqbyJeAQEbuiik3GMXcLsELcsNlu_0 2024-09-14T11:58:37.703 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3915781532246199226', time=2024-09-14T13:38:03.262134+0000, chain.objs.size()=1 2024-09-14T11:58:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hKzwkO1a1ZuvJAHiBCmaeeLJRUkREkU_0 2024-09-14T11:58:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16397678162905882344', time=2024-09-14T13:38:03.657297+0000, chain.objs.size()=1 2024-09-14T11:58:37.704 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.705+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.T48ejGf01WhhaiMBIfi8gkZXy-oprii_0 2024-09-14T11:58:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.708+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13433555441316130666', time=2024-09-14T13:38:03.714460+0000, chain.objs.size()=1 2024-09-14T11:58:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.708+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xSxqk3GEb96fqxs6xHEkkAQUatKM1Q0_0 2024-09-14T11:58:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.708+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9146764873817966492', time=2024-09-14T13:38:04.688727+0000, chain.objs.size()=1 2024-09-14T11:58:37.706 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.708+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kixl7BdbsoKx4VLo9mftD9CLpowzNwR_0 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14094607951515974889', time=2024-09-14T13:38:04.716817+0000, chain.objs.size()=1 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sCG8iTmg0qDjHVWzEO8Ynav-rCtnvaJ_0 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1993464347354287626', time=2024-09-14T13:38:04.888319+0000, chain.objs.size()=1 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.44KynB1-043OwY0NKFOo6AaouCEtQ1I_0 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7428828004311137524', time=2024-09-14T13:38:04.929117+0000, chain.objs.size()=1 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1PvaVYAWvBWnyx5aaFNnB0Mpr5GxRgE_0 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15763543346810798706', time=2024-09-14T13:38:04.977409+0000, chain.objs.size()=1 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gWgQWh53DehwhO8TfS4z8ZbPttqIqCX_0 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11632129339840230927', time=2024-09-14T13:38:05.199690+0000, chain.objs.size()=1 2024-09-14T11:58:37.709 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YTDDIvfhcpyZkouIXSYhlYx3k-5I_Ju_0 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13605671072085757261', time=2024-09-14T13:38:05.364059+0000, chain.objs.size()=1 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h9zfvQr7bqgjXapcPjcITLNqK1haZeq_0 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4810129648267399901', time=2024-09-14T13:38:06.577939+0000, chain.objs.size()=1 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6l_ANYtjxX5h9I9PCyXBZUrWfrMvwWN_0 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5984623944375577019', time=2024-09-14T13:38:06.772826+0000, chain.objs.size()=1 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TptiyjijqpReJOEKw6PkfzkUNu04CFf_0 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9639047662034198342', time=2024-09-14T13:38:06.831138+0000, chain.objs.size()=1 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.711+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HZS21FBmxuOIkXOZFBMsUgvXfJ8tEB1_0 2024-09-14T11:58:37.710 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.712+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16778208476426864863', time=2024-09-14T13:38:06.832436+0000, chain.objs.size()=1 2024-09-14T11:58:37.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.712+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2F5nZZUC7LjSMPe5Qckx70c-nE3Op-Q_0 2024-09-14T11:58:37.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.712+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12403436539806759722', time=2024-09-14T13:38:06.880879+0000, chain.objs.size()=1 2024-09-14T11:58:37.711 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.712+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AKD39_yibNRvHvK5DZap3g4yUnD2kmx_0 2024-09-14T11:58:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8520918419474258201', time=2024-09-14T13:38:07.201458+0000, chain.objs.size()=1 2024-09-14T11:58:37.713 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.pDxveEEHKG5-obbOlx3eWnf_PbzTrAR_0 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7514769982447765775', time=2024-09-14T13:38:07.898911+0000, chain.objs.size()=1 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W5sToA2jBUyONjbbda1_zNSgk81HNG4_0 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8519977376185701371', time=2024-09-14T13:38:07.979673+0000, chain.objs.size()=1 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6u-y7vajxmrwoNXLHAVhPf5agUComo2_0 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.745434619169811486', time=2024-09-14T13:38:08.641540+0000, chain.objs.size()=1 2024-09-14T11:58:37.714 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.715+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.puMW50xD407-c-kVxTWcXgf98kqJW8F_0 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5162251427771555693', time=2024-09-14T13:38:09.389185+0000, chain.objs.size()=1 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.j8gwtp9ZHuvW6PHLRd9DektULVVLtUu_0 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18318896804678513641', time=2024-09-14T13:38:09.772522+0000, chain.objs.size()=1 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ud7C9qD7e-wglTXWaA6mh1jqedlXHuO_0 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7102335472327369611', time=2024-09-14T13:38:09.930032+0000, chain.objs.size()=1 2024-09-14T11:58:37.715 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.717+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lDy1s8Qpy7VkJFi-MChUpOhQ8x-redh_0 2024-09-14T11:58:37.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3801240298430029671', time=2024-09-14T13:38:10.233090+0000, chain.objs.size()=1 2024-09-14T11:58:37.716 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ALIuTWSbrq2PKY1R53NXf1iTGwJUF1__0 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17600116282522825189', time=2024-09-14T13:38:20.159648+0000, chain.objs.size()=1 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.277__shadow_.pONkuC7j82kOnTctQtHaFin6zAivXn7_0 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4790114319121581240', time=2024-09-14T13:38:23.120653+0000, chain.objs.size()=1 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.718+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.281__shadow_.pEZy-5xP-8nA-Tghh6hRDo68jQ4se7f_0 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.719+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10788022319045142313', time=2024-09-14T13:38:26.093870+0000, chain.objs.size()=1 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.719+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.285__shadow_.3i5pLK9S8kw5uwEdhJ7Gopy7z6lFE4J_0 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.720+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17468482598675065666', time=2024-09-14T13:38:26.900203+0000, chain.objs.size()=1 2024-09-14T11:58:37.717 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.720+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.286__shadow_.MOHLb6VJSO4QIpKGwZbgmKEzVkSq3A8_0 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18281189374654579304', time=2024-09-14T13:38:36.460544+0000, chain.objs.size()=1 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.295__shadow_.xJpveN_s8fXPktlyqL6R4KSXzSBcRwQ_0 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14307598270532831361', time=2024-09-14T13:38:40.257472+0000, chain.objs.size()=1 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.300__shadow_.1dxKthOCS_Q8i6fyqEO_j4j3DWEjQZo_0 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.488618140970465202', time=2024-09-14T13:38:41.739263+0000, chain.objs.size()=1 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.302__shadow_.B-ioe-F1x4fIzxH_pHbl3uL0oVBgEjo_0 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17134150783792169213', time=2024-09-14T13:39:38.698021+0000, chain.objs.size()=1 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vMjZvWWSAsk3wYldd9PsDEdItHuHV_p_0 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2346798762381807511', time=2024-09-14T13:39:39.188801+0000, chain.objs.size()=1 2024-09-14T11:58:37.720 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yZsYooir512MgvSSGgbpA1so0w3iqkY_0 2024-09-14T11:58:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13337471140664446349', time=2024-09-14T13:39:39.189604+0000, chain.objs.size()=1 2024-09-14T11:58:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.722+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.eaSCz78xnp__LuWhmdLLD4DhtsqyyiW_0 2024-09-14T11:58:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.723+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14083617488729442420', time=2024-09-14T13:39:39.632289+0000, chain.objs.size()=1 2024-09-14T11:58:37.721 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.723+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-dyNtNehY7uUxM7_M1KXiZECjlWYl12_0 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.195756020137844495', time=2024-09-14T13:39:41.230858+0000, chain.objs.size()=1 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uy33tuLqaaofmmrGhQ5B32cJlVehKuR_0 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16571777396894036815', time=2024-09-14T13:39:41.518084+0000, chain.objs.size()=1 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.EdHFnww3pY_jJYKPd8EsTLR6C2-pqOn_0 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9630722588762578960', time=2024-09-14T13:39:42.175480+0000, chain.objs.size()=1 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.724+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._5Itc67R4AVRiT807CNqZYyau55Ze8A_0 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.725+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14992513271040244102', time=2024-09-14T13:39:42.539559+0000, chain.objs.size()=1 2024-09-14T11:58:37.722 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.725+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QMejeoaxZMJFmRIXOIOuAd8x_SMqChX_0 2024-09-14T11:58:37.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.726+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15010215192437914541', time=2024-09-14T13:39:42.607887+0000, chain.objs.size()=1 2024-09-14T11:58:37.724 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.726+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gTUsf0nbJMKD3iY7jzdY5F31yz5wwKz_0 2024-09-14T11:58:37.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.727+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6830976413119478217', time=2024-09-14T13:39:43.055986+0000, chain.objs.size()=1 2024-09-14T11:58:37.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.727+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sxsnBBOeBq2r61pts4JO2MNzkLCHdvs_0 2024-09-14T11:58:37.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.727+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16976009977861306782', time=2024-09-14T13:39:43.645845+0000, chain.objs.size()=1 2024-09-14T11:58:37.725 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.727+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1i6fxOyif_IPvJPJjv7R64iwOMkixVt_0 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13244769279928965431', time=2024-09-14T13:39:43.695661+0000, chain.objs.size()=1 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.djAlVZffy6ed3RM_n9tj_WgvUWVrmvT_0 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10084976068849461761', time=2024-09-14T13:39:43.793755+0000, chain.objs.size()=1 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4jtRlKOL-M6Om2by53UJKj1E5L_YvL-_0 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8553800654352549313', time=2024-09-14T13:39:44.020797+0000, chain.objs.size()=1 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ynIu5UlN_8Idd9RWdLrp4WRG0j3o6p4_0 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2764340808122421428', time=2024-09-14T13:39:44.191188+0000, chain.objs.size()=1 2024-09-14T11:58:37.727 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jsVfMeb72m5QZpHUYIEtHvWGnbq2F-X_0 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5462632379338191021', time=2024-09-14T13:39:45.434999+0000, chain.objs.size()=1 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sMNODI2ybxEksVb5IbT3brM3fnwnoE4_0 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6761116524706244364', time=2024-09-14T13:39:45.473463+0000, chain.objs.size()=1 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wbVwNrqAtOLeI9NBJeBalAQ1sfo7oSg_0 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3271871100813430608', time=2024-09-14T13:39:45.634352+0000, chain.objs.size()=1 2024-09-14T11:58:37.728 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.729+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.P1zhLrgXmHFUyq00b8EcVEkuO7Pp9st_0 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16066807457323284039', time=2024-09-14T13:39:45.864354+0000, chain.objs.size()=1 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WUrlhxrcfMwMCtKn6ineUDIxGF8rMoJ_0 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13022891712824385978', time=2024-09-14T13:39:46.471468+0000, chain.objs.size()=1 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TM0D7rLBss81TEDOLrg3uUSImqZ4GM-_0 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4855454715521174583', time=2024-09-14T13:39:46.891500+0000, chain.objs.size()=1 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.732+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RYlyKYA4_HdX1qxZESkMDjD8Kyy-IZ1_0 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13760671141423901896', time=2024-09-14T13:39:47.225433+0000, chain.objs.size()=1 2024-09-14T11:58:37.730 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RUeLwE4N1R8PZUnj4qy12D4AT5OFxU1_0 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3094563067353184153', time=2024-09-14T13:39:47.330888+0000, chain.objs.size()=1 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UR7M8WxO27Gdy6lmqYGFbnlAJP0PTtS_0 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16683527934543877539', time=2024-09-14T13:39:47.707302+0000, chain.objs.size()=1 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Rw89XgyPKn3VzZFbOv0bHNPRSb2fD-J_0 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.798808226061872740', time=2024-09-14T13:39:47.748085+0000, chain.objs.size()=1 2024-09-14T11:58:37.731 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.733+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gWSXKygvKCmY99P0bpMvw8UJQ_Yn4FH_0 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.789040367495807190', time=2024-09-14T13:39:48.621993+0000, chain.objs.size()=1 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WqlWji7cDyYXQnS_69P_cUd-IbJvXHp_0 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9640538740318831574', time=2024-09-14T13:39:48.853661+0000, chain.objs.size()=1 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ReiQJ97Cp1YfZTMOmU8_0E0KmKQDbaK_0 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8193741161266001726', time=2024-09-14T13:39:49.193170+0000, chain.objs.size()=1 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BAuSbfeJTSTIVmVX4xWGf50Bjwf99X2_0 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4911068897683503758', time=2024-09-14T13:39:49.400350+0000, chain.objs.size()=1 2024-09-14T11:58:37.733 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.735+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TGiMdH052k1-KMoeiNPiVeJR1wYucoH_0 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11003321411504135821', time=2024-09-14T13:39:49.613713+0000, chain.objs.size()=1 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ec-pdvAyPKzEziCCYsOTP-4Mt_djChK_0 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12612267856973535335', time=2024-09-14T13:39:49.948980+0000, chain.objs.size()=1 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ozKb0UrGDjUYbTrK80dhBRsNOSP2ri0_0 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4323087914364550626', time=2024-09-14T13:39:49.959984+0000, chain.objs.size()=1 2024-09-14T11:58:37.734 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.736+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._7LdnHDCriMgp0tNxGlo8ukjT0GCSJw_0 2024-09-14T11:58:37.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7405605499203602959', time=2024-09-14T13:39:50.151456+0000, chain.objs.size()=1 2024-09-14T11:58:37.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.686HR5ff-EjAqDD8mn0MMnKm4DUVT66_0 2024-09-14T11:58:37.735 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8198883836436131918', time=2024-09-14T13:40:30.776231+0000, chain.objs.size()=1 2024-09-14T11:58:37.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OwGUyGYdYPuj1CNc_pgt7dAwjX9yNlb_0 2024-09-14T11:58:37.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1586534774255455030', time=2024-09-14T13:40:30.967443+0000, chain.objs.size()=1 2024-09-14T11:58:37.736 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.738+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Dl7Elk785S33E7Axc0UI-jNsgAGVv5R_0 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15566588123764923633', time=2024-09-14T13:40:31.545246+0000, chain.objs.size()=1 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sqrJfhbJU1WCEu4caLTtcL3F4c5ifYw_0 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5120978947277897555', time=2024-09-14T13:40:33.401277+0000, chain.objs.size()=1 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.48sszJu9hSEemdthGvIszZc4eOnnW0M_0 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6300922532228399652', time=2024-09-14T13:40:33.697998+0000, chain.objs.size()=1 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yogARbK3YG2utvzQ6FCDKAlLz1rVDup_0 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1742690196689897242', time=2024-09-14T13:40:34.368668+0000, chain.objs.size()=1 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6yb2k57RZJPHoo5EGXEgT6y8V28LcxB_0 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17973435648154772403', time=2024-09-14T13:40:34.421423+0000, chain.objs.size()=1 2024-09-14T11:58:37.739 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.741+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9v5Sxz43X-43nJq_fKSrGG40rJ5WGLo_0 2024-09-14T11:58:37.744 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.746+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/52889 2024-09-14T11:58:37.746 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.389313145841696540', time=2024-09-14T13:40:34.631579+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Fr1AhRo1WJ_pZEe1okd2MNVzBAOQj-a_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16260005656243906217', time=2024-09-14T13:40:35.243767+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.p3kZBhhwkelEIOkqstDQ-1vRWhTYHk7_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11100743974308201084', time=2024-09-14T13:40:35.848316+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H71YVcBpyOQvb0Pi05CNqcwZk9H8np8_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4062122858282339151', time=2024-09-14T13:40:36.572927+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xt_MUBwJvK4A8zc3VrdAlrRGRaZ0dyT_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9127026928715676835', time=2024-09-14T13:40:36.692677+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hc0rPONVGhiweDS_v5UUojqrXJcsEE8_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14267617213059156980', time=2024-09-14T13:40:36.784219+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.52HBUVZZjGVZePrfWFzuKsf7P5RWFHJ_0 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12466968805249839819', time=2024-09-14T13:40:37.062798+0000, chain.objs.size()=1 2024-09-14T11:58:37.747 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3F9cAXvW4gu87yDW0XC5bc8rWm1lSRO_0 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.490635264523597567', time=2024-09-14T13:40:37.538085+0000, chain.objs.size()=1 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5tuRC49C53qvOgfLXezqaZrDsDgvr_s_0 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9334394659898652135', time=2024-09-14T13:40:37.680421+0000, chain.objs.size()=1 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4SnyiBowO9BR0WqqIjYsOV3hApzpVwc_0 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15249868153373196534', time=2024-09-14T13:40:38.004144+0000, chain.objs.size()=1 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ba0ZiauCqN1e7ru7YCWAfVXcyx8yanG_0 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11784133472098735809', time=2024-09-14T13:40:39.089194+0000, chain.objs.size()=1 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZA4r2Q-4itlaq3PwHaBd7JJwnNW_c9O_0 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5893134300400888665', time=2024-09-14T13:40:39.395776+0000, chain.objs.size()=1 2024-09-14T11:58:37.748 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.748+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.J_NBEHiMThjc2BdYAZn2ar7NcWuUmts_0 2024-09-14T11:58:37.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.751+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14326681109884380685', time=2024-09-14T13:40:40.926223+0000, chain.objs.size()=1 2024-09-14T11:58:37.749 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.751+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.F77EhlX_XoxzEV81Ybw2F6vYKyOmwwJ_0 2024-09-14T11:58:37.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9804823435523590440', time=2024-09-14T13:40:41.396239+0000, chain.objs.size()=1 2024-09-14T11:58:37.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OjDKtk7O_TO6s35wBNUK8CzIeBBxBaK_0 2024-09-14T11:58:37.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8952498841034525105', time=2024-09-14T13:40:41.429296+0000, chain.objs.size()=1 2024-09-14T11:58:37.750 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3P4rZr6ohr-FbDh8RX1d_9FQoFSbh8i_0 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.776725231939760359', time=2024-09-14T13:40:41.828536+0000, chain.objs.size()=1 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2cAk-K3Gpw_-HMhmKvs3wLVXQdqJs00_0 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6379095448583212010', time=2024-09-14T13:40:42.298635+0000, chain.objs.size()=1 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hzQDFBfLkg7GopaTFUvtWoSV2N9Yp-v_0 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17923528491396652714', time=2024-09-14T13:40:42.619781+0000, chain.objs.size()=1 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.752+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8WMtmdN9miU0XMdaRE25rI_xEMR2J6q_0 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6319860589246908169', time=2024-09-14T13:40:42.867843+0000, chain.objs.size()=1 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mF39rUeqoJr1tJme1th8Abl6LhVpZIL_0 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16683087784998497500', time=2024-09-14T13:40:42.936231+0000, chain.objs.size()=1 2024-09-14T11:58:37.751 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PiPP9FnDz3NCg75Xkz0xmd_26CFcdQj_0 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3825694008497362226', time=2024-09-14T13:40:43.157084+0000, chain.objs.size()=1 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.753+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.axag4W3to0Ufy8UWH8wdNR-CcXW17zC_0 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.754+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12318339989648535735', time=2024-09-14T13:40:46.196795+0000, chain.objs.size()=1 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.754+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.330__shadow_.P-xCTMsF_-kd9SLJuR4QC7WxmqGUMud_0 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.754+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4105616215024609841', time=2024-09-14T13:41:19.609248+0000, chain.objs.size()=1 2024-09-14T11:58:37.752 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.754+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.384__shadow_.mYpstGeIdlRRuXWi0FDoqS6paxHBAqg_0 2024-09-14T11:58:37.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.756+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9651165083666038822', time=2024-09-14T13:41:56.314310+0000, chain.objs.size()=1 2024-09-14T11:58:37.754 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.756+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.440__shadow_.NeCyiU7fR_LmPAX5kbTk6uIUuWVxmB5_0 2024-09-14T11:58:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7434129779199845480', time=2024-09-14T13:42:57.410693+0000, chain.objs.size()=1 2024-09-14T11:58:37.756 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.513__shadow_.Ev3vv9kT6qepahU1baQSPkN42ddEWYW_0 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7655406647477678161', time=2024-09-14T13:43:32.933113+0000, chain.objs.size()=3 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~fRWu7d83CWCHBRy1f5hxzGdGUT8plOE.1 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~fRWu7d83CWCHBRy1f5hxzGdGUT8plOE.2 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~fRWu7d83CWCHBRy1f5hxzGdGUT8plOE.3 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4172831969882414401', time=2024-09-14T13:44:37.310589+0000, chain.objs.size()=3 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~mOaiyfmN4aYBMiHFQkhx7nmtI8SdLW3.1 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__shadow_mymultipart.2~mOaiyfmN4aYBMiHFQkhx7nmtI8SdLW3.1_1 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~mOaiyfmN4aYBMiHFQkhx7nmtI8SdLW3.2 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1175708020414287688', time=2024-09-14T13:45:00.111908+0000, chain.objs.size()=4 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.529__multipart_mymultipart.2~uJu3gSUQN5ex9g9uhIxiQQa121SXXpH.1 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.529__shadow_mymultipart.2~uJu3gSUQN5ex9g9uhIxiQQa121SXXpH.1_1 2024-09-14T11:58:37.757 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.758+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.529__multipart_mymultipart.2~uJu3gSUQN5ex9g9uhIxiQQa121SXXpH.2 2024-09-14T11:58:37.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.761+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.529__shadow_mymultipart.2~uJu3gSUQN5ex9g9uhIxiQQa121SXXpH.2_1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14528402130360852650', time=2024-09-14T13:45:30.624631+0000, chain.objs.size()=1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.538__shadow_.-NVUyAY55wzOByt8hISgMBYjvdhpl6Q_0 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6575045854019560706', time=2024-09-14T13:46:02.825379+0000, chain.objs.size()=1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.557__shadow_.mHHunsDKxR1rnr9KXL06Rzylj2qfv3O_0 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7773787064491448291', time=2024-09-14T13:46:31.409608+0000, chain.objs.size()=1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:W-lLO3A4oe4pRTsPFd3HLScaryH.gox_.I3QSN5zPQO9OPVhumpRhs5NdfzoPs9-_0 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16957573506081120922', time=2024-09-14T13:46:36.532261+0000, chain.objs.size()=1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:AR15v1WXdOIPLdq7ZnLduvFZLRNVdx2_.d4DSSSoj9g2ctowMfNMRxOAwUdPdMc7_0 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10671185132364506520', time=2024-09-14T13:46:38.429502+0000, chain.objs.size()=1 2024-09-14T11:58:37.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.765+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.571__shadow:OW6NDXgWpQvWiGshUwwN-1iZvzG0wFP_.hHWrdhOHunR5OZypnZwwxNxbQfHfvoI_0 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15804174635209168304', time=2024-09-14T13:46:51.473703+0000, chain.objs.size()=1 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:mVGUQpYv-iyxEGJf6Q1HM0hFBmLUK6u_.jBRpZB2lfe49uMlJ7hO-KUxE78yGN7c_0 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9954147184419019389', time=2024-09-14T13:47:10.278634+0000, chain.objs.size()=1 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:jT9EcwpKvpN93ZN1JB-bZ4PbO-T4lJ._.frXk8EyBDWtTYkhfFD8X1-N1G0qSDvU_0 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10707245313575847753', time=2024-09-14T13:47:14.392361+0000, chain.objs.size()=1 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:1weJCFvUZAPuzIeyM6V-CF2rGyF7ef8_.OzaR2LS_saeztfuqtp48LQOdaOYqiR0_0 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7112781028348924248', time=2024-09-14T13:47:53.360058+0000, chain.objs.size()=1 2024-09-14T11:58:37.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.608__shadow_.OY07sdIZw5XyuHN3k5Bsr2_UdREM7LM_0 2024-09-14T11:58:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18403739913275759121', time=2024-09-14T13:51:44.817775+0000, chain.objs.size()=1 2024-09-14T11:58:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.629__shadow_.1hY6dklUmyVX7rlWlOcV6OrukrBkoT8_0 2024-09-14T11:58:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15492835317397771045', time=2024-09-14T13:52:35.201959+0000, chain.objs.size()=1 2024-09-14T11:58:37.765 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.766+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.667__shadow_.7CBWarcUdP1VPj3eCBPUrvQ6u3BXmWA_0 2024-09-14T11:58:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5108329596226316722', time=2024-09-14T13:52:57.470220+0000, chain.objs.size()=1 2024-09-14T11:58:37.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.703__multipart_file1.2~gPyQ0TpKvgjEMMEOi6SMp3eCRWExtc_.1 2024-09-14T11:58:37.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.773+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.776+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:58:37.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.777+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.775 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.777+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45306' 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8190835533022895176', time=2024-09-14T13:37:01.886549+0000, chain.objs.size()=1 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.240__shadow_._vnR-X2KrHP8WbDYz4FPcErCWd66NWo_0 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11486485768913827915', time=2024-09-14T13:37:05.013829+0000, chain.objs.size()=1 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.244__shadow_._Ctjcdnwi7Gsw9za-CLepHacXOYQj-i_0 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1031266225101474754', time=2024-09-14T13:37:08.292234+0000, chain.objs.size()=1 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.248__shadow_.56Go4hfaCt8tLleE9MIeUq3c85yQ-8j_0 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4097098717122383041', time=2024-09-14T13:37:10.479628+0000, chain.objs.size()=1 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.251__shadow_.ed2652ToTKUAV4Cm_Zc5OtZhqHIsOSg_0 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11640800134914811485', time=2024-09-14T13:37:11.964377+0000, chain.objs.size()=1 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.253__shadow_.IHpGprt8tqXwTYOx_WdHPGWRGzaTrxL_0 2024-09-14T11:58:37.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14184387706237390194', time=2024-09-14T13:37:11.972848+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.253__shadow_.-2m4aO4sGaewQUrn8a9EJXRcgDCJ3RA_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12500456469898375662', time=2024-09-14T13:37:57.860780+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MZDwWLVFPxuBcsvHexYtfoxqq1gZZCK_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12145976625374151513', time=2024-09-14T13:37:58.536162+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UTuT-JyJbUyVkQ8GwOHZF5-ZS8VLVc6_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14411026256076567719', time=2024-09-14T13:37:58.833882+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IXH9zFOzZGTs0pX5-vCrn6tiYCiq4ci_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6558952343888757254', time=2024-09-14T13:37:59.972732+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hAY-3AzM79Tr3xG0kBx5sVIlkQg7v6t_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15281152383771799091', time=2024-09-14T13:38:00.157218+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zZdD-McIDoeciKO85heNGjKofCv7hl9_0 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.252722103227931619', time=2024-09-14T13:38:01.195267+0000, chain.objs.size()=1 2024-09-14T11:58:37.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cJIHjhtptsUMnm-WKRcupDtU-iJ0A0s_0 2024-09-14T11:58:37.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.781+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10326680148270013497', time=2024-09-14T13:38:01.264454+0000, chain.objs.size()=1 2024-09-14T11:58:37.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.781+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mHFtwsRZkRdLbxsg9GCq991V1M6xneE_0 2024-09-14T11:58:37.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14602079316794553749', time=2024-09-14T13:38:01.817045+0000, chain.objs.size()=1 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0qAAs7ZZrPb7XNMOaK4beAMj7Id5MsM_0 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8265439992972248469', time=2024-09-14T13:38:03.000621+0000, chain.objs.size()=1 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.07DW-UANHhQmKscrKguPtPSM01zGKjK_0 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14485294567779979310', time=2024-09-14T13:38:03.554611+0000, chain.objs.size()=1 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.q--O7P7J2dukNBLB-jUtiwNQVPNT0eB_0 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8687951805736502024', time=2024-09-14T13:38:03.718983+0000, chain.objs.size()=1 2024-09-14T11:58:37.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZypIossJuB9GHl7Mbtvs-bRxUkvxx4g_0 2024-09-14T11:58:37.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12416604024735154030', time=2024-09-14T13:38:03.999801+0000, chain.objs.size()=1 2024-09-14T11:58:37.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XBOrfjajB_5DykHRJp3cV3Wc9YwzEfo_0 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10731146561971608822', time=2024-09-14T13:38:04.551328+0000, chain.objs.size()=1 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.P_R3iiGIuZ3duXYVumcyg2eHtkBm6p8_0 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15161942501150508652', time=2024-09-14T13:38:04.922053+0000, chain.objs.size()=1 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mWdFWrf5WVClUdiVmJxXnZjMqTbwfHK_0 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.769995109402185366', time=2024-09-14T13:38:05.444021+0000, chain.objs.size()=1 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.E4bckZx8lVmG8xeFSyGR4GGvFgKwSQt_0 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12498031198851630670', time=2024-09-14T13:38:06.163378+0000, chain.objs.size()=1 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2-Bh-HYaVJFSmCjxY4UmZkiLS8NW5sY_0 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.907431131166759874', time=2024-09-14T13:38:06.450075+0000, chain.objs.size()=1 2024-09-14T11:58:37.782 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zfAT57EtYnBOq3M-IZSTDzhYEhDDfl1_0 2024-09-14T11:58:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.786+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8751743347499291429', time=2024-09-14T13:38:06.596161+0000, chain.objs.size()=1 2024-09-14T11:58:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.786+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XDfh85g7LvPnCJXzX9-Hn-s7xjj_m_i_0 2024-09-14T11:58:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.786+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12009816976946402944', time=2024-09-14T13:38:06.729658+0000, chain.objs.size()=1 2024-09-14T11:58:37.784 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.786+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rB6Xyx4KRYUD9HmC0F_GV7P_Y7K9E62_0 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2452379565589799945', time=2024-09-14T13:38:06.985598+0000, chain.objs.size()=1 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nRL0U0QnKphW0sZozeb_o8WM3V0nfGT_0 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2960227935310422026', time=2024-09-14T13:38:07.018098+0000, chain.objs.size()=1 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6u86k7n41woq-P0W_UyuIpg2UkfBcF7_0 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12585110220495660608', time=2024-09-14T13:38:07.126718+0000, chain.objs.size()=1 2024-09-14T11:58:37.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vyK9otbOvQOIYKBU8MAYmm1S69-b3A5_0 2024-09-14T11:58:37.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7258321328126026137', time=2024-09-14T13:38:07.371562+0000, chain.objs.size()=1 2024-09-14T11:58:37.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gXN5neZUbRcQnhK8zY6LtZ3f09Jkk62_0 2024-09-14T11:58:37.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3558983533997842531', time=2024-09-14T13:38:07.728240+0000, chain.objs.size()=1 2024-09-14T11:58:37.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CPlEBxV5PbTlRSKXVtZ_KMKaUiscHTL_0 2024-09-14T11:58:37.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8737752828727233547', time=2024-09-14T13:38:07.903209+0000, chain.objs.size()=1 2024-09-14T11:58:37.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GSd6wS3IdosmeWUxO0UZ8TUoMWz2uKW_0 2024-09-14T11:58:37.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6456148237291674156', time=2024-09-14T13:38:07.904001+0000, chain.objs.size()=1 2024-09-14T11:58:37.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NDxl4buQ_DcnNoVjHxbx7bJDBO0hCH1_0 2024-09-14T11:58:37.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11649246166149446092', time=2024-09-14T13:38:08.274968+0000, chain.objs.size()=1 2024-09-14T11:58:37.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.788+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3MW5NR8K4VN9UtpfSV5tq8_2JnrmAwB_0 2024-09-14T11:58:37.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.790+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8769659394019646851', time=2024-09-14T13:38:08.594311+0000, chain.objs.size()=1 2024-09-14T11:58:37.788 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.790+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ljuxBRujypf2Nbt12zijae8qBmskQRQ_0 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6861158679430562036', time=2024-09-14T13:38:08.751382+0000, chain.objs.size()=1 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Bn78sxoL7LjtaQ03QmhKxnEwfTAPXpd_0 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4645292141348495710', time=2024-09-14T13:38:09.035431+0000, chain.objs.size()=1 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.R3tjRX3t5UrHCiEBqsnfw16375BdoUb_0 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.23768176382690471', time=2024-09-14T13:38:09.364515+0000, chain.objs.size()=1 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3yAuf7AJ4XdB0r348RZa45Kmce7Bxua_0 2024-09-14T11:58:37.791 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13657810714479938420', time=2024-09-14T13:38:10.043826+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jiCp8T401q5lGfWzxnXbG6ywmqt168X_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1666607032353520903', time=2024-09-14T13:38:10.218915+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8m17i5IeSUuzdl-xAFOLKST409N_rgQ_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2813544619827125045', time=2024-09-14T13:38:18.713896+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.275__shadow_.ZFLm4adzSxjKam7a9ms_8FruhINGFLO_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11926665991331182844', time=2024-09-14T13:38:22.399490+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.280__shadow_.UqOS2TI0fCe2fRqvGG1pRK5GEJWWZoC_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2553256522460263631', time=2024-09-14T13:38:30.598565+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.291__shadow_.nGDzVfDs_6iPbvV5NfMa-wgq11ZX91m_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14449319837759163400', time=2024-09-14T13:38:33.609586+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.GNDM2_hSt4idt5oljFJcutH3vfwZpvk_0 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10090226423987306279', time=2024-09-14T13:38:36.449926+0000, chain.objs.size()=1 2024-09-14T11:58:37.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.793+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.295__shadow_.5uOg5l8J2-s4bWHWpLgWTYKAlqIVqou_0 2024-09-14T11:58:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.794+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1374724139515028625', time=2024-09-14T13:38:55.719439+0000, chain.objs.size()=1 2024-09-14T11:58:37.793 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.794+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.320__shadow:P5KnpvS8dIr4--D7la7UzlTEnylYAge_.-mY3TWG0zGJ8kC_iH32sV4UzM7gwlR6_0 2024-09-14T11:58:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17088284866401772416', time=2024-09-14T13:38:57.855804+0000, chain.objs.size()=1 2024-09-14T11:58:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.323__shadow_.N55PjxyxGGTMs1DJTwusDYz-xQDtJLv_0 2024-09-14T11:58:37.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5384658272132832850', time=2024-09-14T13:39:38.860768+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vzFN9ldkCEqpHhAHXqRJZ-zKkRSW6ld_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6232236800425413038', time=2024-09-14T13:39:38.896875+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NC5IFAqMa_w03TEyAx9uGurN393QQ60_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17551922777438789011', time=2024-09-14T13:39:38.995403+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kIpu0iMTC4lVSyYZheFmnfif6InU9dr_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2502591660969761081', time=2024-09-14T13:39:39.318083+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.htjehcUuj1JYpxMw85leUC3nTt7hO1r_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12068718320872320461', time=2024-09-14T13:39:39.337013+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.i_7yxiHC_-f95Pq7fPNji8leQFHLM1H_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12029603687488979325', time=2024-09-14T13:39:39.463158+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NW-CHOUPDzLdj2yrkv2i0i0939cqv2t_0 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1264816258186500834', time=2024-09-14T13:39:39.687714+0000, chain.objs.size()=1 2024-09-14T11:58:37.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.h5JS7k_lMa0-Xn8S7bhzMWaJC1MgvJ7_0 2024-09-14T11:58:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12532873178218433634', time=2024-09-14T13:39:40.710785+0000, chain.objs.size()=1 2024-09-14T11:58:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3eXGLxR8gRGh-J6o3kcSYE8FiSa_73V_0 2024-09-14T11:58:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2196232922846801121', time=2024-09-14T13:39:41.479149+0000, chain.objs.size()=1 2024-09-14T11:58:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.798+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.v5dodRb-6mvLxlLcFPHDW7rzVNMvQr6_0 2024-09-14T11:58:37.797 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12582976590747952087', time=2024-09-14T13:39:42.173254+0000, chain.objs.size()=1 2024-09-14T11:58:37.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4uPmuA5vw_FPTNcALFppjNqo3MRv39I_0 2024-09-14T11:58:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.802+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7639974026316334971', time=2024-09-14T13:39:42.173893+0000, chain.objs.size()=1 2024-09-14T11:58:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.802+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xww-4hCcbdPU2vK4VxD_IjrMuuFo63j_0 2024-09-14T11:58:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4038556519024741597', time=2024-09-14T13:39:42.212406+0000, chain.objs.size()=1 2024-09-14T11:58:37.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Pbw-Xva2_aioWylqM7_qSbgGepIrxfq_0 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15502010362758753239', time=2024-09-14T13:39:42.495574+0000, chain.objs.size()=1 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MT7Vh1p-26AKlSVJDbl3PUihvRzh6Vo_0 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.915180253406852856', time=2024-09-14T13:39:42.543715+0000, chain.objs.size()=1 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.br8khStcue33KtRIDWfdzse40uNMV21_0 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15480587864613518221', time=2024-09-14T13:39:43.196517+0000, chain.objs.size()=1 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.81irBU3s97LCkzQZaPOhH05vOcHpeVS_0 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4187480740493376261', time=2024-09-14T13:39:43.819149+0000, chain.objs.size()=1 2024-09-14T11:58:37.801 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1VirOTdQZF5iy_Wg1QjX6XmNIoV-oA7_0 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4606726941661053717', time=2024-09-14T13:39:44.152681+0000, chain.objs.size()=1 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.46PZr_u4vGDjYTJhSxjeEmz7Eztrupq_0 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15698480510549771513', time=2024-09-14T13:39:44.334575+0000, chain.objs.size()=1 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lAzMaJ3bpQ8CcVmqaiiMInX-6Go1rZ-_0 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14476595376306925539', time=2024-09-14T13:39:45.570849+0000, chain.objs.size()=1 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wai6ZFTKt8ZBSNzA4UeV_jvVM6LtANS_0 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1190748334045359579', time=2024-09-14T13:39:46.433092+0000, chain.objs.size()=1 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kHOzZVFs_wIR80JpjOnoLEN9AdSc3VI_0 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3865856858326884416', time=2024-09-14T13:39:46.488124+0000, chain.objs.size()=1 2024-09-14T11:58:37.802 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.803+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.755ZGNL9mDzKVkYafl8vZ2z6ypoAE-Y_0 2024-09-14T11:58:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.807+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6140911150322834835', time=2024-09-14T13:39:47.017492+0000, chain.objs.size()=1 2024-09-14T11:58:37.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.807+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1JwmibdO43JngiKYWKYdTrTYQ1sSyuu_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10763030028749166464', time=2024-09-14T13:39:47.259512+0000, chain.objs.size()=1 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0oyVj7vnNa1rP5778IbR6niSxsMaduf_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14321222526660095122', time=2024-09-14T13:39:47.857112+0000, chain.objs.size()=1 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qHjAiWNRExfMLINsJh5I9R5S0DG5UH4_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17353876471690207357', time=2024-09-14T13:39:48.404739+0000, chain.objs.size()=1 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.o-tDCgBPdW7HfDtUdymSLE3VDDvHdKu_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9497477573047319564', time=2024-09-14T13:39:48.405596+0000, chain.objs.size()=1 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pbiecgWtKjjy4NGqUDyHFieeW-CNyfn_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5535100379134238739', time=2024-09-14T13:39:49.060445+0000, chain.objs.size()=1 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sQTtUCbDOf6X5Pi8hHFBOirJvLX4BkD_0 2024-09-14T11:58:37.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5745218830762610274', time=2024-09-14T13:39:49.499197+0000, chain.objs.size()=1 2024-09-14T11:58:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fPULKd3akc0Djpgbt0RZJ477ftUWVJ9_0 2024-09-14T11:58:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16343900091483485358', time=2024-09-14T13:39:50.098206+0000, chain.objs.size()=1 2024-09-14T11:58:37.808 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cvzRUbA3UcnAYhLYKLbU_bRn2SJKmIO_0 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10167481277455892554', time=2024-09-14T13:39:50.146074+0000, chain.objs.size()=1 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QqMgvHs6cYf2xMKsoZ43yzbs2PL4ujC_0 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2892840670328921815', time=2024-09-14T13:39:50.272975+0000, chain.objs.size()=1 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LE9narC5ZN1XIH0OE_D5S0jUfzkOOoB_0 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7954386765171233482', time=2024-09-14T13:39:50.667387+0000, chain.objs.size()=1 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D03ymhkMQekMKPV2fb1yQDPvOt_H4jZ_0 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.724823060145688746', time=2024-09-14T13:39:50.868894+0000, chain.objs.size()=1 2024-09-14T11:58:37.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QvRJ7fZpHs5HX4uegrkBDsN9H1SUoTu_0 2024-09-14T11:58:37.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.814+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8617796653190984295', time=2024-09-14T13:40:30.787629+0000, chain.objs.size()=1 2024-09-14T11:58:37.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.814+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qVRlXCEytHw2hIpP0PzvrAYg6hwgOEH_0 2024-09-14T11:58:37.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.814+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.108761814024205792', time=2024-09-14T13:40:30.967559+0000, chain.objs.size()=1 2024-09-14T11:58:37.812 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.814+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1Q-IgyxdxrHjnxWNfarKcO4dDopmzrp_0 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15041045069723157723', time=2024-09-14T13:40:31.084022+0000, chain.objs.size()=1 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.R51vThsSSh47nulP_eg7oXrEzzb0PHB_0 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11324587764910175896', time=2024-09-14T13:40:31.382224+0000, chain.objs.size()=1 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Vto8d-jFe4fchkBG4JEjVG27XibTnyX_0 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2511682429822948937', time=2024-09-14T13:40:31.969382+0000, chain.objs.size()=1 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xksfg2dGVQExhno7qUrLIPi23FnFAAq_0 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6802057139069880888', time=2024-09-14T13:40:33.039919+0000, chain.objs.size()=1 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.d7h_mI2qCxCZBZXlz7OezcbOfBJ0oXH_0 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14594131840675102616', time=2024-09-14T13:40:33.110216+0000, chain.objs.size()=1 2024-09-14T11:58:37.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EcPaJt4kbE3uaxeC72KRFyxb6Nvfviu_0 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6770133505443867140', time=2024-09-14T13:40:33.731428+0000, chain.objs.size()=1 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6sD5gro1RE-aFeVVnhREra4xVH2tiU4_0 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16958552628847727154', time=2024-09-14T13:40:34.411101+0000, chain.objs.size()=1 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Hj11SP2PoAlHMeVjBci2UKM8r9LIkpE_0 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3117971500902472617', time=2024-09-14T13:40:34.588426+0000, chain.objs.size()=1 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bfre1u9tbV7hRKPuS8Jd6CypNRsuxPl_0 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5485019858959532460', time=2024-09-14T13:40:34.861095+0000, chain.objs.size()=1 2024-09-14T11:58:37.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.crYHg_wP8OAEQ4QAjm1uuL7Paxn1e3V_0 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.819+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6086535025794232367', time=2024-09-14T13:40:34.998702+0000, chain.objs.size()=1 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.819+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZGH5z8PW8a2vEaCxTy8EYliQ-uC7amr_0 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.819+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1676224954585441640', time=2024-09-14T13:40:35.137968+0000, chain.objs.size()=1 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.819+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lVzaWbzUbIa00es5xtuev_3eChKWt9H_0 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6202849147936997791', time=2024-09-14T13:40:35.405338+0000, chain.objs.size()=1 2024-09-14T11:58:37.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wJ-P6eMiJVqQyCqUaGmDaOFpzRqGING_0 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2095609132657257958', time=2024-09-14T13:40:36.178469+0000, chain.objs.size()=1 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TSUwe1H0hzNabqEnOPhHLfsQ_BHwlax_0 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10106681186644330197', time=2024-09-14T13:40:36.932197+0000, chain.objs.size()=1 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XW17ipTOfIeyAWeXaG3OEjCdQv1uN4L_0 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.104971445659419166', time=2024-09-14T13:40:37.002339+0000, chain.objs.size()=1 2024-09-14T11:58:37.818 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.820+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.g4SVV_ljm1bMeHrfdoLYsmuGgtsCaGN_0 2024-09-14T11:58:37.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4551789181338961353', time=2024-09-14T13:40:37.687098+0000, chain.objs.size()=1 2024-09-14T11:58:37.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nGkmaXcqNVHuejbJH9vM9NHb3LZzk3b_0 2024-09-14T11:58:37.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.892349993552076453', time=2024-09-14T13:40:37.738387+0000, chain.objs.size()=1 2024-09-14T11:58:37.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nJyCYd0IAJf47HoYK6m5UACVKHytL54_0 2024-09-14T11:58:37.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7115358101907690904', time=2024-09-14T13:40:39.319652+0000, chain.objs.size()=1 2024-09-14T11:58:37.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._voY-ZOyGEQf2-NYA1pwPkPTUSRooEP_0 2024-09-14T11:58:37.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7597077309624954883', time=2024-09-14T13:40:39.732274+0000, chain.objs.size()=1 2024-09-14T11:58:37.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KAS6HoW9NkVlzgzd8uuMMlPXK8Y5sFR_0 2024-09-14T11:58:37.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.828+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/45306 2024-09-14T11:58:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T11:58:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17624064294888450786', time=2024-09-14T13:40:39.934791+0000, chain.objs.size()=1 2024-09-14T11:58:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vZKWzsNN4H0VZFNrawhr5Rqv6BeR94g_0 2024-09-14T11:58:37.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17687783358510951441', time=2024-09-14T13:40:40.084967+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.47QYKlrA087jrEv6Atsf6o2Z5xEWadf_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11725043785940572027', time=2024-09-14T13:40:40.852938+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FfIpznz-fW6ygmJ2WOqNK5goYSjHWHv_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6757320246420211082', time=2024-09-14T13:40:40.974384+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MCbLpqV4B66yaxsLx0CQ73pX2L5ERih_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17232665286151638610', time=2024-09-14T13:40:41.082225+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.r6cE5n_2YZ3NsSao6u_vMSFU0TPsc08_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15207136828576704694', time=2024-09-14T13:40:41.492332+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lab-xfNndSz-Hxw2jCJYcQDU35uqhm9_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.124615572909418612', time=2024-09-14T13:40:41.893532+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KcF2FRUXGjrh5ECoJmSgEutCnCa_8E0_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.23304052142253140', time=2024-09-14T13:40:41.916986+0000, chain.objs.size()=1 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pQJwaeQNj6Kv25ZUgSKIi9tAYOGDfzy_0 2024-09-14T11:58:37.829 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7795039023183192414', time=2024-09-14T13:40:42.245988+0000, chain.objs.size()=1 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zwr-Qf7RNyPGc9fKMVCP3u0y18PNv3Y_0 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16889244486988413938', time=2024-09-14T13:40:42.540482+0000, chain.objs.size()=1 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gF_NV-pza3Oxvg6qinx9c7GDJmLTT3C_0 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6528080143664603154', time=2024-09-14T13:40:43.138774+0000, chain.objs.size()=1 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9TUaf7R-iMpm5sYWoGBRnP-73WOdJS-_0 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14878966271951351734', time=2024-09-14T13:40:56.976686+0000, chain.objs.size()=1 2024-09-14T11:58:37.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.347__shadow_.J90XBNYeusNAIJuPwHRQfRXJpqdOZWE_0 2024-09-14T11:58:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.833+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.718871857497454995', time=2024-09-14T13:41:07.895389+0000, chain.objs.size()=1 2024-09-14T11:58:37.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.833+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.368__shadow_.bV_IjDwtGLFH-dT_F_Oe3al9fHqpK18_0 2024-09-14T11:58:37.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.290639702678699707', time=2024-09-14T13:41:13.857273+0000, chain.objs.size()=1 2024-09-14T11:58:37.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.376__shadow_.VnD2QWm_r4LsllzT_2guPDsvFB2crHf_0 2024-09-14T11:58:37.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3452522646449152125', time=2024-09-14T13:42:09.498434+0000, chain.objs.size()=1 2024-09-14T11:58:37.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.458__shadow_.BiozN9tRCr2iSb6nKg-GlT8RkHqK6Te_0 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9934465847428670812', time=2024-09-14T13:42:14.228259+0000, chain.objs.size()=1 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.463__shadow_.0bRsZpX1-XwDUP2OlCDdQWekeCkDcyJ_0 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6114887325364196836', time=2024-09-14T13:42:17.147177+0000, chain.objs.size()=1 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.466__shadow_.DSGNG_R3vdXmjGdrIhUiSyIxkDX3M67_0 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18336042592178837964', time=2024-09-14T13:42:27.445633+0000, chain.objs.size()=1 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.Y_ac3mfhReBRZXgSYcOwL5Fmiv5KXs5_0 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16757483617426325490', time=2024-09-14T13:42:28.762914+0000, chain.objs.size()=1 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.486__shadow_.JlpcGEo7JHyK4-NMzrrX950bgX3LSzz_0 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9316036200367439212', time=2024-09-14T13:42:53.479614+0000, chain.objs.size()=6 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:37.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.835+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:37.834 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.836+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:37.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.839+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17650615580318386445', time=2024-09-14T13:43:07.022196+0000, chain.objs.size()=2 2024-09-14T11:58:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.WY9WLk2YlePaJN2iihdZ1OVCIz1wjq1_0 2024-09-14T11:58:37.837 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.839+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.WY9WLk2YlePaJN2iihdZ1OVCIz1wjq1_1 2024-09-14T11:58:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv', time=2024-09-14T13:43:39.775250+0000, chain.objs.size()=2 2024-09-14T11:58:37.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__shadow_mymultipart.2~WyC_wqQgxQazIyM75eDfhpF_a-Odvpv.1_1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4545642783784552620', time=2024-09-14T13:44:16.530191+0000, chain.objs.size()=6 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.2 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.yLmgW7BlmzLSoaGuAFGorbBP7SyZJrfk.3 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.4 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.5 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~K4n4OlFMP6m87zrir2PE0QaW1Stpukm.6 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6699292267306074100', time=2024-09-14T13:47:03.882197+0000, chain.objs.size()=1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:nBAxLgdkw7Zmt-zPuiWdu5-W90zNI87_.v4pmFLIuhMGF_P554EH0LIl7JmY4Mr3_0 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.499941073334663384', time=2024-09-14T13:47:10.021823+0000, chain.objs.size()=1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:yBI4HpKrBH8JTk3EZXWuznLDPpY30OI_.BvPeYqzSFTpf5mnzDhQhkjclXCSpbyd_0 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1034395156884185603', time=2024-09-14T13:47:52.713688+0000, chain.objs.size()=1 2024-09-14T11:58:37.842 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.844+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.607__shadow_.tIl_-yNtW0iuFS6jc1aY6QyAu6mGcvD_0 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8408006365401853402', time=2024-09-14T13:51:46.372709+0000, chain.objs.size()=1 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.631__shadow_.zXW83T1pPvnB2ZFIWAmUZAtU0SBYgyc_0 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16036539409106605135', time=2024-09-14T13:52:00.224011+0000, chain.objs.size()=1 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.646__shadow_.VhciSk4OqZlW81vjoupNyqWZCRnlNvp_0 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8840717050810608678', time=2024-09-14T13:53:37.646542+0000, chain.objs.size()=1 2024-09-14T11:58:37.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.849+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.735__shadow_.HL4n2rmah9OClFEW0T-_jcl-2-Vz1KN_0 2024-09-14T11:58:37.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.852+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.855+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:58:37.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.856+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.855 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.857+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47840' 2024-09-14T11:58:37.856 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1145095109394845614', time=2024-09-14T13:36:57.725849+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.235__shadow_.MXrdS0aFPLrxqq-7ZNmW__nRw1kkA4J_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13182370791645131620', time=2024-09-14T13:37:06.817164+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.246__shadow_.zWqa8Y6IxBndQbaxlGX1JfNsN9yBVEy_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8012699852888028909', time=2024-09-14T13:37:18.586043+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.262__shadow_.EjNr19luRpKLzjcIrbuX41X5wEfZlUn_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13919005291115582436', time=2024-09-14T13:37:18.586594+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.262__shadow_.MgYUuPpKtlWjgT1p8jf3NnW_J0AvsWW_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7139370358896868449', time=2024-09-14T13:37:57.855706+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Yo1E6wHJlL4TQNhpmOB1hE1Lv7dfeVe_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17901926988351141075', time=2024-09-14T13:37:57.888598+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.F_SH4TtkCTtbdee1M9aiXFUGotD9h0q_0 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5623916651334847011', time=2024-09-14T13:37:58.793039+0000, chain.objs.size()=1 2024-09-14T11:58:37.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5oDmClpbW-8CnVH0gtf_qMCBskb7HdW_0 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15392206328109631169', time=2024-09-14T13:37:58.921142+0000, chain.objs.size()=1 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._pkLZgLyK26AFmaPGypSBcQLdSg0gPD_0 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13356806502446797102', time=2024-09-14T13:38:00.506793+0000, chain.objs.size()=1 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ssLqcZb93lxqo5bCBBC4R4sN2inFx7N_0 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5352063881772777305', time=2024-09-14T13:38:00.677956+0000, chain.objs.size()=1 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CcSl-Jv4_Qg_v6s5NFghPGUagTwstKb_0 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10828517634157312504', time=2024-09-14T13:38:02.062427+0000, chain.objs.size()=1 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wW3ERZGSbH4WwWO2xuASk2-XHTIwBOB_0 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14968731460177177534', time=2024-09-14T13:38:02.423171+0000, chain.objs.size()=1 2024-09-14T11:58:37.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.858+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.agYtujtgzTd22uYN_DHEUJA07Lm_wOd_0 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8480331844182837322', time=2024-09-14T13:38:03.714443+0000, chain.objs.size()=1 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fRTFUMGIxABHD7nmx3p4PMJh3_-Uv6c_0 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3974792860407833944', time=2024-09-14T13:38:03.734392+0000, chain.objs.size()=1 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.s9lQiSSi_MBP3GrijFDTQ8c9IwSy7p4_0 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3870885593565479787', time=2024-09-14T13:38:04.845277+0000, chain.objs.size()=1 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bRpVKy9Zjaa2no84a7eNtSwxMqKwEjr_0 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.496099594459095358', time=2024-09-14T13:38:04.947011+0000, chain.objs.size()=1 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1YHttonE9ILz8N6GiGHGxiShLUSiVil_0 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1820381085092995608', time=2024-09-14T13:38:06.166758+0000, chain.objs.size()=1 2024-09-14T11:58:37.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.djMJkAU3O9b5GgoMLwo56ke-ememp9k_0 2024-09-14T11:58:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9106963905732297497', time=2024-09-14T13:38:06.203117+0000, chain.objs.size()=1 2024-09-14T11:58:37.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.861+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zIR2T8ZXRM_OKqE76UXM58BLAC_lB7M_0 2024-09-14T11:58:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.863+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11401495096970454993', time=2024-09-14T13:38:06.460366+0000, chain.objs.size()=1 2024-09-14T11:58:37.861 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.863+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3HU7ocx3Om7Y8vPpmjVspddCCtoZze3_0 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13872281176709104643', time=2024-09-14T13:38:06.655314+0000, chain.objs.size()=1 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YxP277PxuNcQMeoHiYEIAwfJ--CgdZD_0 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2665499701009040267', time=2024-09-14T13:38:07.136551+0000, chain.objs.size()=1 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.A5JojKjCTE9i2WLsoE0yNauP0n-Y83m_0 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18174972827559947591', time=2024-09-14T13:38:07.384749+0000, chain.objs.size()=1 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JsPrYQfl-xzUoJWk2usyH3OAPlLuvo4_0 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1310677386650887441', time=2024-09-14T13:38:07.745362+0000, chain.objs.size()=1 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4zDqHNSPQfyl5d-g4GKsO8XhUQWWPsi_0 2024-09-14T11:58:37.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15692370513128024324', time=2024-09-14T13:38:07.761907+0000, chain.objs.size()=1 2024-09-14T11:58:37.864 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.865+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Y3sgcvxPLdCh07PhhJqH_sbiKihaw3__0 2024-09-14T11:58:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3733605813196363294', time=2024-09-14T13:38:08.257150+0000, chain.objs.size()=1 2024-09-14T11:58:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uH72JxDHlBjOn2eeYFPrWw0sVRmd0dT_0 2024-09-14T11:58:37.865 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6078689549503814181', time=2024-09-14T13:38:08.318070+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rONK_qcr__IaLrDViXMO7T3JLWJpjps_0 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11114118708062829869', time=2024-09-14T13:38:08.392726+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-n5hJ8bcV0GgdU__Av06wEiWmiLguOf_0 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17807208377727623420', time=2024-09-14T13:38:08.946069+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tsEINdkw53dBuMl8pYlH5NdMnl8GDJ-_0 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11861692257011467880', time=2024-09-14T13:38:09.908789+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mjX38CGd6-elDhtx6eCt2NWrOrVyUnq_0 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9242843217303410994', time=2024-09-14T13:38:10.044172+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.867+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aezdUKLLIYlXb4VOcJtkK0mMj6Ma55F_0 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.868+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7541028862068486889', time=2024-09-14T13:38:21.676394+0000, chain.objs.size()=1 2024-09-14T11:58:37.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.868+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.279__shadow_.ciciC_H1BVK_LxwE-4bsQ75rnZfdMZL_0 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.870+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6200710067833156362', time=2024-09-14T13:38:24.584125+0000, chain.objs.size()=1 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.870+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.283__shadow_.to59pKw2xrGx3vZxYDg_0_x9Ta6PuKX_0 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.870+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8369468095370125642', time=2024-09-14T13:38:27.692611+0000, chain.objs.size()=1 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.870+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.287__shadow_.XVNWVE8xAtrdT4WdL0e929vwMZuIIIh_0 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.870+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12719434335861115651', time=2024-09-14T13:38:33.475734+0000, chain.objs.size()=1 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.871+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.AH1NkgRfyuNbcjS77SOzNZAredJtYd__0 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.871+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16661302576174234429', time=2024-09-14T13:38:33.476475+0000, chain.objs.size()=1 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.871+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.2jLM7UYAanZ6aN8vOSzYXIc7p8Xg9AL_0 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.871+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1615512260599815024', time=2024-09-14T13:38:35.707209+0000, chain.objs.size()=1 2024-09-14T11:58:37.869 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.871+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.h1wKfIXJSpSWIxzsr2ntRKKZ6TtkB6T_0 2024-09-14T11:58:37.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16314048121479592010', time=2024-09-14T13:38:44.677066+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.306__shadow_.Y4t0EBSoJ4UV3l6z5QOzuLh28v6ake6_0 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3373777120573518235', time=2024-09-14T13:38:46.911060+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.308__shadow:SC7GptBVae9FBmn8T.v-U61Q.9HZpRm_.qScc1AH8Y_DIQtvRnvrKYnootIN6Hvx_0 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9232937843545837589', time=2024-09-14T13:39:40.862465+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AXq0qH3ZfDwCP0Ho1axhQKtF8nwMjIP_0 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16331265332697499466', time=2024-09-14T13:39:42.007426+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WQvCh9Rypzu2NRsN7kdlvoE3nyq32AN_0 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12445107871264586256', time=2024-09-14T13:39:42.008503+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ga7_zMItDyhSsa1cdpYNRkDFVtahwz9_0 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13165463636542645110', time=2024-09-14T13:39:42.212806+0000, chain.objs.size()=1 2024-09-14T11:58:37.871 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.873+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.avKmFAwf21g73z-K-0YdVSt63Pe0CQQ_0 2024-09-14T11:58:37.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.875+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4233834297254153933', time=2024-09-14T13:39:42.533224+0000, chain.objs.size()=1 2024-09-14T11:58:37.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.875+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ybVuQ2Qt6Cet-lQh2VIXJy9hqr1FMh__0 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6179075669375705669', time=2024-09-14T13:39:42.794899+0000, chain.objs.size()=1 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.noIJVhp4kpHb6c-hPAvZBe6WSqKARn3_0 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3966226259907749299', time=2024-09-14T13:39:42.805405+0000, chain.objs.size()=1 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BY-Rw4OZtLoLFeSj3JTJEiIdmO31Bly_0 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10014692381959297011', time=2024-09-14T13:39:44.703228+0000, chain.objs.size()=1 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zsN9XFZio5cwD3PFmuBxxMB4tX4tfyq_0 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.877+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13752143058491942259', time=2024-09-14T13:39:44.704543+0000, chain.objs.size()=1 2024-09-14T11:58:37.874 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.877+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xQWQ1s9i4Y5Omvf1t2z6dUvDpBCRrpv_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4599319336418018131', time=2024-09-14T13:39:45.302456+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.swtJJ8Bbkv-gUMGMtFE0tTrGByJsBjl_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9011797322219249524', time=2024-09-14T13:39:45.303015+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dmJQkI318sFoIM7-AR8strB8QrUgwF2_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5877412490386009524', time=2024-09-14T13:39:45.793794+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.G-9gAG1zT8R7jZSQpMgiB2le_NKabBK_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15628811214949258669', time=2024-09-14T13:39:45.984584+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rh5wuXLWDNwNnhSvMz2dwZ1SXjPLSmb_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6517863539108844206', time=2024-09-14T13:39:47.498792+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KVFgHQnZVBgHxLnCWBC0bmyJ2CVGogL_0 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.758440932041707691', time=2024-09-14T13:39:47.626884+0000, chain.objs.size()=1 2024-09-14T11:58:37.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.878+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._szl70DCF1UjxhGWUeMS20Q-FjUHNNp_0 2024-09-14T11:58:37.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2069462846485287634', time=2024-09-14T13:39:47.796797+0000, chain.objs.size()=1 2024-09-14T11:58:37.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.g2s7vXOTVMRookodNsbFLy-BtxKWouO_0 2024-09-14T11:58:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.476331693872969998', time=2024-09-14T13:39:48.470955+0000, chain.objs.size()=1 2024-09-14T11:58:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dePv7t-EN8OZ_9zxN9oT9burAMXn_sR_0 2024-09-14T11:58:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8797400126263055109', time=2024-09-14T13:39:49.456081+0000, chain.objs.size()=1 2024-09-14T11:58:37.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-bH6MtDF5UjSRQAvxslRLDpRmu72UHb_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18046050949301892297', time=2024-09-14T13:39:49.912233+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JcXuvrTbZuKbnyHv4BP5z4EeGNi1ttc_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2203984433107397839', time=2024-09-14T13:39:49.965483+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zqbwiJFqB_Py-iw8UqJZOa6znwwg08k_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4030894999770627844', time=2024-09-14T13:39:50.050920+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.smDywcxX_QM66ybY7mao0SpP5SamsKr_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3601855696169043017', time=2024-09-14T13:39:50.582104+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ncwJ_z4Vd33JHx9TxqqliIM84_JyDB1_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2649910104007067330', time=2024-09-14T13:40:30.842812+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gOR_YL2OZkBYmIm_SqyS8qL5bZ4IdKD_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.368579750526873298', time=2024-09-14T13:40:31.349065+0000, chain.objs.size()=1 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UsbYAlRrBo8YJZWEcRRVUXEC0J30eMk_0 2024-09-14T11:58:37.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3788767721025754792', time=2024-09-14T13:40:31.664495+0000, chain.objs.size()=1 2024-09-14T11:58:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VP_Veg579TMwpkXm8HD_221esWYAHXa_0 2024-09-14T11:58:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13251714970709546629', time=2024-09-14T13:40:32.717883+0000, chain.objs.size()=1 2024-09-14T11:58:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2G4yhv1LLcOQY_5E4KpkXqBkMXph7-V_0 2024-09-14T11:58:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15681383533587226621', time=2024-09-14T13:40:32.873442+0000, chain.objs.size()=1 2024-09-14T11:58:37.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XH0bCMQR5I18yHNY3v_l8dMztHfw7Y5_0 2024-09-14T11:58:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7677920138130617540', time=2024-09-14T13:40:32.937618+0000, chain.objs.size()=1 2024-09-14T11:58:37.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0sdMzxk8VLPAlrCWmYR335NuTGuNNND_0 2024-09-14T11:58:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12264646016491378682', time=2024-09-14T13:40:32.954563+0000, chain.objs.size()=1 2024-09-14T11:58:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ogRISAxX11ze9Tt2AkjnHtUgNQUvvvO_0 2024-09-14T11:58:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12612917334125571549', time=2024-09-14T13:40:33.364920+0000, chain.objs.size()=1 2024-09-14T11:58:37.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bpt753BX065BLIY2Ev2yGSN6KomUoGP_0 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13046114610924503442', time=2024-09-14T13:40:33.365678+0000, chain.objs.size()=1 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mqpAMcZo4cS5hp8x9gcLgbMsCT_keeQ_0 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14468638612248015181', time=2024-09-14T13:40:33.703232+0000, chain.objs.size()=1 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JtBlIXtWBlFQthdxRU6C4Z1Emkkg20Q_0 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13452745941307907045', time=2024-09-14T13:40:34.538167+0000, chain.objs.size()=1 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rINrSdGw5yiLB0EG84WooiFxE8LchnT_0 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4194077256290267859', time=2024-09-14T13:40:35.031092+0000, chain.objs.size()=1 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jjIrJg7tC0aeYZKJ5o1xm8TJjRRGteK_0 2024-09-14T11:58:37.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16555319977778952536', time=2024-09-14T13:40:35.424570+0000, chain.objs.size()=1 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cPbcSydleS5hYbFS1pinrYM_r2VYLTZ_0 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12820548746151668453', time=2024-09-14T13:40:35.885581+0000, chain.objs.size()=1 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lIT-QBfMXKlxpVGQKGfRKY3KoQC-SzO_0 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12867676386630800823', time=2024-09-14T13:40:36.745496+0000, chain.objs.size()=1 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3guk_uYn7SjSI8kTsgPFJp-mKAdLRrg_0 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4417416107258178816', time=2024-09-14T13:40:37.018229+0000, chain.objs.size()=1 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.893+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pFstRro1QqzR9luSJDVbSV48MvSfZaP_0 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17705777799535343628', time=2024-09-14T13:40:37.083813+0000, chain.objs.size()=1 2024-09-14T11:58:37.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.q11Kz3gUHSwSaQEgdDaMlDzrqXJ6L02_0 2024-09-14T11:58:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15344373568741725355', time=2024-09-14T13:40:37.700657+0000, chain.objs.size()=1 2024-09-14T11:58:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XXyT17t-ykmZrm30gGUevxr8Cf8v8ab_0 2024-09-14T11:58:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17125107459666489486', time=2024-09-14T13:40:37.844472+0000, chain.objs.size()=1 2024-09-14T11:58:37.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fGZnunUYujdggIPI3tyGkh5lXUSK730_0 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.642609731210827901', time=2024-09-14T13:40:38.414843+0000, chain.objs.size()=1 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1fUPR5FCLhAEWAr4AO5P3tadJM3dvyh_0 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8548270009603062882', time=2024-09-14T13:40:38.731695+0000, chain.objs.size()=1 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xT-f3KzZMaShWLcmBE_Ibz9-SekvUhn_0 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4509868248050966276', time=2024-09-14T13:40:38.746303+0000, chain.objs.size()=1 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hVxNaFbLWPVjzOjplBDWe7MOd1uCWdO_0 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9219340476271729034', time=2024-09-14T13:40:39.380489+0000, chain.objs.size()=1 2024-09-14T11:58:37.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.897+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0AC5Qx0cEGfzBO6D3UvtleVvjgyziZc_0 2024-09-14T11:58:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1235383149555996936', time=2024-09-14T13:40:39.471711+0000, chain.objs.size()=1 2024-09-14T11:58:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.RZosq_ec9eji9sAp_6mAogex8dZLB_R_0 2024-09-14T11:58:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2425239557943143895', time=2024-09-14T13:40:39.705681+0000, chain.objs.size()=1 2024-09-14T11:58:37.897 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EDgG27tgGw5gkTG4_N4-n2cThmJN7Jx_0 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4343771004481262343', time=2024-09-14T13:40:40.189714+0000, chain.objs.size()=1 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ER7tn83wPyQ83PjrmE-szESPH9Gf518_0 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15646333188693970426', time=2024-09-14T13:40:40.213345+0000, chain.objs.size()=1 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.899+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1p7SEOm72RJxqPTCkkQLou9ZkM12ls9_0 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.900+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7870724182670578839', time=2024-09-14T13:40:40.651361+0000, chain.objs.size()=1 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.900+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EvhizsVbAqnoXdbYVplB6p0p2Z7TEbi_0 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.900+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7489618068443101630', time=2024-09-14T13:40:41.494746+0000, chain.objs.size()=1 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.900+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nBVb8YQbN3-l-hE7cusauakIAIvSQsn_0 2024-09-14T11:58:37.898 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10120592028854564067', time=2024-09-14T13:40:41.620467+0000, chain.objs.size()=1 2024-09-14T11:58:37.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fIJf_igQOD7o0DoSwQ4kLncdJubkF1B_0 2024-09-14T11:58:37.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6547718588628387156', time=2024-09-14T13:40:41.807328+0000, chain.objs.size()=1 2024-09-14T11:58:37.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jS3tpaAZ-SBN_eIhSe_9JfdtkjEZOrV_0 2024-09-14T11:58:37.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11899019399065149553', time=2024-09-14T13:40:41.863540+0000, chain.objs.size()=1 2024-09-14T11:58:37.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._q_FAJ6v6GmaNbu8TmN-cxLQEqhG4KM_0 2024-09-14T11:58:37.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3204368137097524569', time=2024-09-14T13:40:43.019145+0000, chain.objs.size()=1 2024-09-14T11:58:37.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.I1eqPPA-xR2SRxQUSN9tO5rgQ5SlQuo_0 2024-09-14T11:58:37.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8265373566488236273', time=2024-09-14T13:40:43.157069+0000, chain.objs.size()=1 2024-09-14T11:58:37.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qU85ZEyOR7WZwbkHiUSzUYeBN86yMYz_0 2024-09-14T11:58:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11812570705311616428', time=2024-09-14T13:42:09.495645+0000, chain.objs.size()=1 2024-09-14T11:58:37.902 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.458__shadow_._MCxD3jpHkDW3yGdZH2SZcxqG5peqxy_0 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2980347697403270077', time=2024-09-14T13:42:32.824429+0000, chain.objs.size()=1 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.488__shadow_.2tj3fo5n1Dq5I-KRzI_-YGDdtSiU0Vx_0 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.995045578361267649', time=2024-09-14T13:42:41.175583+0000, chain.objs.size()=1 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.904+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.501__shadow_.H2biTRdq506opi4bHfnMAkmQP6KmLGV_0 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17775521381471526648', time=2024-09-14T13:46:05.436347+0000, chain.objs.size()=2 2024-09-14T11:58:37.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.MbysQ1QHWnejblfk8DWnTgIuniYZplu_0 2024-09-14T11:58:37.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.MbysQ1QHWnejblfk8DWnTgIuniYZplu_1 2024-09-14T11:58:37.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6829393898560557151', time=2024-09-14T13:46:38.032145+0000, chain.objs.size()=1 2024-09-14T11:58:37.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.571__shadow:59HLbwxcCz6HvaRWLRAiL5ZhZy132qR_.YOLcAhtRL9pzCkKNIWBYz1cONQIg-9n_0 2024-09-14T11:58:37.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.907+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1363323716744484391', time=2024-09-14T13:46:47.251751+0000, chain.objs.size()=1 2024-09-14T11:58:37.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.907+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.576__shadow_.kzmPv_GrC2ZxnDx0vL_ziSljj7hntTJ_0 2024-09-14T11:58:37.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47840 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5972725874882540930', time=2024-09-14T13:46:50.207013+0000, chain.objs.size()=1 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:yt.wzbkbfM7b4WdiQqNpjN32wDAmq6o_.9miTHaFptd0TOkge2xne0fEjp21iHxX_0 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12013227725213577789', time=2024-09-14T13:47:04.854097+0000, chain.objs.size()=1 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:GZyl.F9cDVQNfcLlR5r1hnXylGdPu.x_.vV5vlh9bu3FDojKpJ3m_fTwXSs958LW_0 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8068682125218020902', time=2024-09-14T13:47:12.479046+0000, chain.objs.size()=1 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:G8-95eCw2AXFz153mmQIWgP0IQiN52p_.SCaI0vFeo5uL9jGbD4O_Q10r2zfvE3J_0 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3257368263595769169', time=2024-09-14T13:47:34.140007+0000, chain.objs.size()=1 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:6I7VYZIol-CIDyoPw0NNBG0yIUWx3ZK_.BOlvAPNbQmwgUdqRImkcIPGV74qjJua_0 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11225139649613717049', time=2024-09-14T13:47:54.026499+0000, chain.objs.size()=1 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.609__shadow_.7qsv6P4ohfCiwxSzBz7La1t6MKJQYvI_0 2024-09-14T11:58:37.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6356535651377987786', time=2024-09-14T13:51:48.326844+0000, chain.objs.size()=1 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.634__shadow_.ftdCpERI0Fqw4GTMCFOuAyujszyYxkM_0 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18279446087474244393', time=2024-09-14T13:52:30.584645+0000, chain.objs.size()=6 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.1 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.2 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.3 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.4 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.5 2024-09-14T11:58:37.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.661__multipart_bar.2~Ym6QM9GkpwlDBudkDBT5OxLSK8RsBUb.6 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9240928213839336944', time=2024-09-14T13:52:32.057013+0000, chain.objs.size()=1 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.664__shadow_.S0whrMWQcb0sFbEr3dTiBkDLRz8fdhv_0 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15940107286396516608', time=2024-09-14T13:53:59.366202+0000, chain.objs.size()=1 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.745__shadow_.v60OYQxbxAhX359aP9oMer6xnCnaeuz_0 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12280525060046925124', time=2024-09-14T13:55:30.499397+0000, chain.objs.size()=1 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.764__shadow_.AWgYHKogWCedgfo7soTHxmJ9OEwGYrT_0 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4771694806152489527', time=2024-09-14T13:56:12.612491+0000, chain.objs.size()=1 2024-09-14T11:58:37.919 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.921+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.777__shadow_.-tvoR0oOcuooYVqUFPBwGEjTMoA36E8_0 2024-09-14T11:58:37.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.925+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:37.928 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.930+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:58:37.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.931+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:37.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46977' 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17273305868931968792', time=2024-09-14T13:34:29.442728+0000, chain.objs.size()=5 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-LUKEWARM.2~tj8Jfzz-8jvSpFJJ_PBdbn7TMHjlkcw.1 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__shadow_mymultipart-LUKEWARM.2~tj8Jfzz-8jvSpFJJ_PBdbn7TMHjlkcw.1_1 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-LUKEWARM.2~tj8Jfzz-8jvSpFJJ_PBdbn7TMHjlkcw.2 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__shadow_mymultipart-LUKEWARM.2~tj8Jfzz-8jvSpFJJ_PBdbn7TMHjlkcw.2_1 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.160__multipart_mymultipart-LUKEWARM.2~tj8Jfzz-8jvSpFJJ_PBdbn7TMHjlkcw.3 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16710549361510503029', time=2024-09-14T13:37:09.021851+0000, chain.objs.size()=1 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.249__shadow_.lpse3eeZwNAAEvZJRIT7_Y6aHkV658l_0 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6621453192781700116', time=2024-09-14T13:37:11.975741+0000, chain.objs.size()=1 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.253__shadow_.3Dpjdg8yed8Ggkga9ehCyKusVSWgexE_0 2024-09-14T11:58:37.931 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2987460800876665796', time=2024-09-14T13:37:14.177870+0000, chain.objs.size()=1 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.256__shadow_.8w-jRboBblBek1XLp0K8x9QgJBMRJc0_0 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13436548165735109537', time=2024-09-14T13:37:58.040363+0000, chain.objs.size()=1 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Miz66oboMquac8bptcn_OMJVklfpnbN_0 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1288863128587996639', time=2024-09-14T13:37:58.094253+0000, chain.objs.size()=1 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RLvw8lwgnhRdIfnZcdfoyjji7CECWsI_0 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17706675443987245781', time=2024-09-14T13:37:58.178520+0000, chain.objs.size()=1 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MoN8LMG5zWDjdSo3DsQt4kKSytN8y76_0 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12063106195660646304', time=2024-09-14T13:37:58.621104+0000, chain.objs.size()=1 2024-09-14T11:58:37.932 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.933+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iWVqQMKe7QuMqTqlwJf_Aje9J35KcFX_0 2024-09-14T11:58:37.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2066615441274462820', time=2024-09-14T13:37:58.873117+0000, chain.objs.size()=1 2024-09-14T11:58:37.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Pwhoh4n_kDJyM4A27YwC5RLw4g7HY0N_0 2024-09-14T11:58:37.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9762564962409376923', time=2024-09-14T13:37:58.912471+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nuc1q51BTu5jAMjSfaZK8TXiFsE5DKF_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14080822201207128269', time=2024-09-14T13:37:58.913358+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rOGgYPAJSPOs1JeObnAAAbO6nSv8HnK_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3553054180019217602', time=2024-09-14T13:37:59.520461+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WhaXA_73l19mbSVL3WbPkylFiKpjH25_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2381098489294192551', time=2024-09-14T13:37:59.630307+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6vKDEA6jn-6g41zrI_uiY_ameAwb6iB_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8904314870852517053', time=2024-09-14T13:37:59.651055+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dySQm3NDbJ2c4zj0zfgaQ1RjQnQ-VJm_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11003182206229771455', time=2024-09-14T13:37:59.824260+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UedhLaZXaHfwbFWlnTyw6BBCzUBsnww_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.847496315532754795', time=2024-09-14T13:37:59.825045+0000, chain.objs.size()=1 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sgQsVpnD6xLBhl6IIkhp1MdUYXFruSV_0 2024-09-14T11:58:37.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16962820801030819915', time=2024-09-14T13:37:59.884995+0000, chain.objs.size()=1 2024-09-14T11:58:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0KJbIVEXtyFo2DWaXxL8BsZ7LiSj-Bi_0 2024-09-14T11:58:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12229708413224404534', time=2024-09-14T13:38:00.234149+0000, chain.objs.size()=1 2024-09-14T11:58:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.937+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LtFtTQ5mb13R5DvC5pfmeuPI-Ijltfi_0 2024-09-14T11:58:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.938+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4845686070969943235', time=2024-09-14T13:38:00.321840+0000, chain.objs.size()=1 2024-09-14T11:58:37.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.938+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2O14WYFWb2H4mClEtQRXN4ME0MQrUfO_0 2024-09-14T11:58:37.938 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.941+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4054504469427323450', time=2024-09-14T13:38:01.966170+0000, chain.objs.size()=1 2024-09-14T11:58:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.941+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1WLcCK8ZXpVBRnYzjgfI4QjIlVFlL86_0 2024-09-14T11:58:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.941+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3828812417527853375', time=2024-09-14T13:38:01.967068+0000, chain.objs.size()=1 2024-09-14T11:58:37.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.941+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mmIMgCJ4Kwy6rgx54Rz7eT_PrcxReYx_0 2024-09-14T11:58:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.942+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4257610541796046325', time=2024-09-14T13:38:02.067804+0000, chain.objs.size()=1 2024-09-14T11:58:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.942+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SBiXtx1QGauvmK_SrkrNqKbd5JAivTU_0 2024-09-14T11:58:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.942+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5132011580530825585', time=2024-09-14T13:38:02.391588+0000, chain.objs.size()=1 2024-09-14T11:58:37.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.942+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TE-H18P51S-bTSU8M4YyPUl4Y040QT2_0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17217804544360962932', time=2024-09-14T13:38:03.656420+0000, chain.objs.size()=1 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EPS4JeDei8d5JvVdVbjhH7Bs6NiBpjn_0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2766933354421951949', time=2024-09-14T13:38:04.045074+0000, chain.objs.size()=1 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XVVf7qrREvf-HPRVEDxxiA83jTm80w4_0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10896545812059042365', time=2024-09-14T13:38:04.106474+0000, chain.objs.size()=1 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v4mYd8XMiDLBaiszrZJKHcN92Oirznq_0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6545156569047796030', time=2024-09-14T13:38:04.509738+0000, chain.objs.size()=1 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XP80x_4qnkWVNIUIvSS3_tEq3eFuYjd_0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9055480833684165617', time=2024-09-14T13:38:05.374317+0000, chain.objs.size()=1 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.acxxEBs8-MQ59t9mcQKoweGTnB26-0__0 2024-09-14T11:58:37.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16226052812932210620', time=2024-09-14T13:38:05.458107+0000, chain.objs.size()=1 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.onLcJDBVZCqNkVh5_gY66nc3xzxvlSN_0 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15354386633204532157', time=2024-09-14T13:38:07.723067+0000, chain.objs.size()=1 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1mkXul3r7Z608EoSRotJquGdyFxKAp0_0 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.946+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11023051052222173727', time=2024-09-14T13:38:07.762191+0000, chain.objs.size()=1 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.946+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.69CKUgqD7sdi0rQQcfGZxmr9Pz4zO1d_0 2024-09-14T11:58:37.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.946+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15313371148385085435', time=2024-09-14T13:38:07.804442+0000, chain.objs.size()=1 2024-09-14T11:58:37.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.946+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mrjci1T342irGaOII2VO8l6Cx9BzDUk_0 2024-09-14T11:58:37.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.947+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5558117222418390400', time=2024-09-14T13:38:08.468179+0000, chain.objs.size()=1 2024-09-14T11:58:37.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.947+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.r-tu5kZih1dy12G9_e4CeAyfRheDQ7F_0 2024-09-14T11:58:37.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.947+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11692850449880132850', time=2024-09-14T13:38:09.053359+0000, chain.objs.size()=1 2024-09-14T11:58:37.945 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.947+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.N09w0ZuRX8WNTl6cHgCjf5WeHETcqRi_0 2024-09-14T11:58:37.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.949+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13055466825072858136', time=2024-09-14T13:38:09.399761+0000, chain.objs.size()=1 2024-09-14T11:58:37.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.949+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Nw3_ncpN79WSHyeRm-0QIQFfB1FUUqv_0 2024-09-14T11:58:37.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.949+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6303321577999612608', time=2024-09-14T13:38:09.530003+0000, chain.objs.size()=1 2024-09-14T11:58:37.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.949+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JoxXSJmNCJ8mmPweSO-6lB9qThiZ1Cd_0 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14487344161539961035', time=2024-09-14T13:38:09.570818+0000, chain.objs.size()=1 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ba21yUVx171icC5-FQhjy3P-9Gio47t_0 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6296779750449257108', time=2024-09-14T13:38:09.580398+0000, chain.objs.size()=1 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7eN7Proxx187kpLkzV0_RfPDc0EwShg_0 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15429073327388732179', time=2024-09-14T13:38:09.626726+0000, chain.objs.size()=1 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b3LzCrciN1hPmRore8R7UeHNwgwWDsm_0 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5843892553100665997', time=2024-09-14T13:38:09.862393+0000, chain.objs.size()=1 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4XhAjuJ7bFlQSCHuZhpTWNYjoWt6idl_0 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6882548331556368419', time=2024-09-14T13:38:14.577259+0000, chain.objs.size()=1 2024-09-14T11:58:37.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.269__shadow_.c-eZVWgJIIEWi7hgYYhqJDNFal7k6yO_0 2024-09-14T11:58:37.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6160772503686156590', time=2024-09-14T13:38:18.707017+0000, chain.objs.size()=1 2024-09-14T11:58:37.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.275__shadow_.Kse1zYYvwIP55aruLwaxweq7RI4_9CM_0 2024-09-14T11:58:37.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7643390802617281387', time=2024-09-14T13:38:23.125961+0000, chain.objs.size()=1 2024-09-14T11:58:37.949 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.281__shadow_.tbenjcE2lRHF6ojWXU57NDbPozHbK_P_0 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14134824321351803551', time=2024-09-14T13:38:24.583519+0000, chain.objs.size()=1 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.283__shadow_.Oq5hyuXYl_x93SLCwYreKild7_yahOv_0 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13178901392993068086', time=2024-09-14T13:38:33.472972+0000, chain.objs.size()=1 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.uQ77KDe8XF5gEdy8DVps77oVRPWJmtg_0 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15226823751215731524', time=2024-09-14T13:38:35.594707+0000, chain.objs.size()=1 2024-09-14T11:58:37.950 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.952+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.Zkw3-Rbk3AKzov7Lk24cgusARBSeVnQ_0 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13372899329672439694', time=2024-09-14T13:38:35.596230+0000, chain.objs.size()=1 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.roHrP_-nDqV2Vyii_3MVt-ELCZtaDX2_0 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6258790946325952093', time=2024-09-14T13:38:36.455025+0000, chain.objs.size()=1 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.295__shadow_.i7CWrRt28aEBrvgz_N8bO6HpHT_qPZe_0 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6324530281737232405', time=2024-09-14T13:38:42.505554+0000, chain.objs.size()=1 2024-09-14T11:58:37.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.303__shadow_.GXcP03c8Ww5ovKn3D35-TbazNlLc-aS_0 2024-09-14T11:58:37.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15945672974058411899', time=2024-09-14T13:39:39.283349+0000, chain.objs.size()=1 2024-09-14T11:58:37.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nwEsxUQSn3AxDPy2fRNghVfN__EBc8F_0 2024-09-14T11:58:37.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15795730850259990729', time=2024-09-14T13:39:39.707895+0000, chain.objs.size()=1 2024-09-14T11:58:37.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UTE2R540N01EFDN0J8sI-WAA1YkKRvO_0 2024-09-14T11:58:37.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.957+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1306538244885012732', time=2024-09-14T13:39:40.481564+0000, chain.objs.size()=1 2024-09-14T11:58:37.955 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.957+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CwgvgRSQGLS3fHMre9uN7uROx_aTP1m_0 2024-09-14T11:58:37.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13912447889891958586', time=2024-09-14T13:39:40.856500+0000, chain.objs.size()=1 2024-09-14T11:58:37.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UO6nZVYWEmS0tfTq4Krmk-2LONmbNR4_0 2024-09-14T11:58:37.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.958+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10877261307382436364', time=2024-09-14T13:39:41.229991+0000, chain.objs.size()=1 2024-09-14T11:58:37.956 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.958+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Z5FApH-f6TYHb-acBjyDfI620bHgcZy_0 2024-09-14T11:58:37.957 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17154184894976949812', time=2024-09-14T13:39:41.480518+0000, chain.objs.size()=1 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Dy5gq-dJ_j-vmltZatGm8mX05iQiruK_0 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2717438401785817410', time=2024-09-14T13:39:41.487020+0000, chain.objs.size()=1 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BhdWAPAVIyvuHw3EEJGb__LU6D-AqJz_0 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12636428916416618509', time=2024-09-14T13:39:42.618682+0000, chain.objs.size()=1 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.g7QL8GU6NkGwdtu4NErLr8L-NjP35b4_0 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5430061920723183708', time=2024-09-14T13:39:42.977194+0000, chain.objs.size()=1 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gY3yEEl_k5LTS8dRrEZ4FbgKS-J4DDs_0 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5721189170429744811', time=2024-09-14T13:39:43.193186+0000, chain.objs.size()=1 2024-09-14T11:58:37.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Nd7iquLsOpJ2HUvrdWeWwhM6E4pfmsb_0 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11571992790161171481', time=2024-09-14T13:39:43.701246+0000, chain.objs.size()=1 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xNngOhAZBi8wI1KiwIBVgMB-adaBUs1_0 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4393242362529919771', time=2024-09-14T13:39:43.976213+0000, chain.objs.size()=1 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.eqOngsDDazFTDpAcTSsvPihnNtPUUQH_0 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10942701835285651738', time=2024-09-14T13:39:44.138989+0000, chain.objs.size()=1 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vK0r27aQ4w3CJ3s-U3g9B-GDOtKtaW1_0 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.961+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7163505704169527401', time=2024-09-14T13:39:44.139707+0000, chain.objs.size()=1 2024-09-14T11:58:37.959 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.961+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sSLh3oXJtas9kTa-uOnbHiD02mMe3x5_0 2024-09-14T11:58:37.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11187635166972609830', time=2024-09-14T13:39:44.300631+0000, chain.objs.size()=1 2024-09-14T11:58:37.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TU-QqN7siR-SVNOqxBbkJTmYwhzOUjH_0 2024-09-14T11:58:37.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11913046416754906623', time=2024-09-14T13:39:44.345695+0000, chain.objs.size()=1 2024-09-14T11:58:37.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vKTgPMptthB_fZQ4F40QWC_o2C-Z2Bn_0 2024-09-14T11:58:37.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17986600023502510767', time=2024-09-14T13:39:45.299262+0000, chain.objs.size()=1 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.f0tlwJzeVCWVGEYT7wbUvGFvfdpA0b0_0 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14570285076513334610', time=2024-09-14T13:39:45.418347+0000, chain.objs.size()=1 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4lqEDzWvqc-sXe-QAsZH11Hl6hPekWE_0 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7549008552842233475', time=2024-09-14T13:39:45.604995+0000, chain.objs.size()=1 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.X2t2aDTp4LY3hZozrR6Wb67CJ2u6y9G_0 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10610353383101249231', time=2024-09-14T13:39:46.309659+0000, chain.objs.size()=1 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XX80AT5x1KDyRSKFUUoMFPynuPrPi_9_0 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16412096629125729513', time=2024-09-14T13:39:46.311218+0000, chain.objs.size()=1 2024-09-14T11:58:37.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PEp8rZMWDKfjlowO7W32jJdxfB5yhPp_0 2024-09-14T11:58:37.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.965+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7403846187374870956', time=2024-09-14T13:39:46.466143+0000, chain.objs.size()=1 2024-09-14T11:58:37.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.965+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.g0kGWF6iP09SAUXEDsLgyEiEUKtUMaY_0 2024-09-14T11:58:37.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.965+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.993355108954574273', time=2024-09-14T13:39:47.377301+0000, chain.objs.size()=1 2024-09-14T11:58:37.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.965+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.u97AikVmcSBhhkklQDomgFSwDyJ4IaS_0 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15086219676652677060', time=2024-09-14T13:39:47.578808+0000, chain.objs.size()=1 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Dru5A1SentltiFN9doELaKLbGDZIYZQ_0 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8371213109140824765', time=2024-09-14T13:39:47.784458+0000, chain.objs.size()=1 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.B_pnIjxNTKi3m6iEUb9s6VIFnl25KI3_0 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7231921501608056468', time=2024-09-14T13:39:47.934058+0000, chain.objs.size()=1 2024-09-14T11:58:37.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C8CVXwnGjKr6cFyDqpRAW22lnvr8wcv_0 2024-09-14T11:58:37.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1214800901765557193', time=2024-09-14T13:39:49.256618+0000, chain.objs.size()=1 2024-09-14T11:58:37.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5y28I5ZN6sakbZSTXZQJzvIkiXKn-hB_0 2024-09-14T11:58:37.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.223308994269129704', time=2024-09-14T13:39:49.426257+0000, chain.objs.size()=1 2024-09-14T11:58:37.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gHK3HNzD-Jhmoa3U2MuKl-vldLkXLcy_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16938085081203982594', time=2024-09-14T13:39:49.572956+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Lh1gxyL5aNH0ljK65tcT5bwiCCAY_v5_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12165986044598723518', time=2024-09-14T13:39:50.616121+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YWTS9VsdLEIsjGrzPkNEsWBC5C62WwM_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8612343262622794086', time=2024-09-14T13:39:50.808695+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vVszBcnT2MlL91vmQ_hP3ojYg4l8nVu_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6829952594425943696', time=2024-09-14T13:40:31.154592+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VZ2PTivHRSQyuDlb21uQmy5qxvFxOc4_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.970+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16825063622720982904', time=2024-09-14T13:40:31.706914+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.970+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SIsjSsXsxknu-1LuaIsUnqI97B_X2sA_0 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.970+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6592427952469749955', time=2024-09-14T13:40:31.852034+0000, chain.objs.size()=1 2024-09-14T11:58:37.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.970+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XV1MRQ76jluWQnAdJEVU8JVCEHQakrY_0 2024-09-14T11:58:37.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1689003771996832484', time=2024-09-14T13:40:31.852799+0000, chain.objs.size()=1 2024-09-14T11:58:37.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7D4go-2WLcXoyU4pka9vuMeyD8G2WnG_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11903990836844141625', time=2024-09-14T13:40:31.941159+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Azx1eoIEMmu4vEdPxUosKOrSgw421Si_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11444823974505513154', time=2024-09-14T13:40:31.970448+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NLOIO8fSI9B5562fmuNO6usUomH9A6s_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5562282720457324778', time=2024-09-14T13:40:32.539662+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gdaIn9pfZqsfvu7StTw2sMmreEqSQeW_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4032695904388116745', time=2024-09-14T13:40:34.725730+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.t4j0_WEzT4uZTgE0Cgk1ZVStwz_IBfv_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14794580059108001981', time=2024-09-14T13:40:35.858470+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.uhSQnngNMHsg4gCzDxLcTa158yBr6-o_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11548480516374978655', time=2024-09-14T13:40:36.375474+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GQIF0WNPW7RQF67vlH3vnHIoXzQ6vA7_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7894541706466178797', time=2024-09-14T13:40:36.569777+0000, chain.objs.size()=1 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8kqQp4MwvPfyMNvWMmele9lRPkxaDxZ_0 2024-09-14T11:58:37.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18311406436915503082', time=2024-09-14T13:40:36.659590+0000, chain.objs.size()=1 2024-09-14T11:58:37.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pcQYMQxqSmp9k1DQHV2dxGGlGNjtisI_0 2024-09-14T11:58:37.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6053673851452900632', time=2024-09-14T13:40:37.108586+0000, chain.objs.size()=1 2024-09-14T11:58:37.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.l3i5AQzsdDYf_DS87mYEh0E4NJBIRyc_0 2024-09-14T11:58:37.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17917432981012961463', time=2024-09-14T13:40:37.697491+0000, chain.objs.size()=1 2024-09-14T11:58:37.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7aHNirHvOqZ67-oTB5U44Iw2mwoVElk_0 2024-09-14T11:58:37.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11400276721178363225', time=2024-09-14T13:40:37.811543+0000, chain.objs.size()=1 2024-09-14T11:58:37.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gC8bhl24vpMApSi5gkJjygU7ZBjL29n_0 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5875233578443749045', time=2024-09-14T13:40:38.314778+0000, chain.objs.size()=1 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Awviep7srF8AUkcbnUluTXuGJz0J-VX_0 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3835527632117300448', time=2024-09-14T13:40:38.315433+0000, chain.objs.size()=1 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.B9ENvOOdiew3NQ9UEin21HC7ZRMKatt_0 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6531893035014140844', time=2024-09-14T13:40:38.377400+0000, chain.objs.size()=1 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YhZXbHnh0kqkIz6pY5ZVeAE1ludqMyp_0 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2020899007095615253', time=2024-09-14T13:40:38.682376+0000, chain.objs.size()=1 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LYccZrn6WU0S6yE34_Cm0Sn_aFbBHIF_0 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9619393570382113782', time=2024-09-14T13:40:38.711140+0000, chain.objs.size()=1 2024-09-14T11:58:37.980 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SY6ERsesYzg8rfztX98IqcStsMODY_l_0 2024-09-14T11:58:37.985 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.987+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/46977 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.483378151817307315', time=2024-09-14T13:40:39.268298+0000, chain.objs.size()=1 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.01bdh7nmmsirlPzXgJUrQy78dMu__ta_0 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.953936121069498100', time=2024-09-14T13:40:39.457869+0000, chain.objs.size()=1 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.C8wT5AX37K2mJoHYBndgaHxIpA5IdXU_0 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11228654622520394149', time=2024-09-14T13:40:39.762538+0000, chain.objs.size()=1 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WBRhi_rtMolCEg1gNSyHdCy_gC7cFVK_0 2024-09-14T11:58:37.990 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15694504958925904985', time=2024-09-14T13:40:39.843075+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zqKGmSctEAEFpFOepMkCOC4j3bVyrrk_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16085380989024881718', time=2024-09-14T13:40:40.691422+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ORE9yRv4-SymMPBDHxt3jqrpyBTci59_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1843478143961568178', time=2024-09-14T13:40:40.771643+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mESRLPP6kOZntAZYqMXzaqqG7MXwF6-_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3959625848545035959', time=2024-09-14T13:40:40.880845+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ybZYOsBVeOcZ3PtjmtayzAAAEHu3tuO_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1089997781199076732', time=2024-09-14T13:40:40.976285+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iM9HDTJCh6XBaXxXwy3G6XuoNO9Cs9A_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3040947381325058021', time=2024-09-14T13:40:41.136747+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CQv08Tq4yQs7hE2OvooNpbejXQKI4lU_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12455152136761474695', time=2024-09-14T13:40:41.168357+0000, chain.objs.size()=1 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5k8Z3LPmHIVS3J25OHZ_0Q-wYFE-i7s_0 2024-09-14T11:58:37.991 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10723576051639209562', time=2024-09-14T13:40:41.521687+0000, chain.objs.size()=1 2024-09-14T11:58:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eNqPIgxZWkCNVF4-YcWsap6Qraxo9_w_0 2024-09-14T11:58:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.908403280999378409', time=2024-09-14T13:40:41.647340+0000, chain.objs.size()=1 2024-09-14T11:58:37.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.992+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yxbg8GGbsch6sE41yedChJqiHZcBi5H_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7985203871271265867', time=2024-09-14T13:40:41.864527+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LUXTtl1iYbvU_FiR_8tIJTz8VisVwMl_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5248064987528578191', time=2024-09-14T13:40:42.423066+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ussM7f7BX1vCtfAoo8RI8wTOGMaafYC_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10303778494762677109', time=2024-09-14T13:40:42.564988+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Z7P_3TeruMKScY5LnR3zsDaVM3u8Nzn_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5510091308269723148', time=2024-09-14T13:40:42.895686+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.995+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LAUPH_AAxP1dyVsmA6Q8smIbVzv19rA_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8718456276573069410', time=2024-09-14T13:41:18.188299+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.382__shadow_.MFuwlcfdudYWpjcbTwfPOX6eeLuhcs6_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4137073795954796270', time=2024-09-14T13:42:02.253742+0000, chain.objs.size()=1 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.448__shadow_.FXIASnWSjrYeDhXamdx3rGUQ7Nxozgz_0 2024-09-14T11:58:37.994 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9199353272939343314', time=2024-09-14T13:42:08.526174+0000, chain.objs.size()=1 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.457__shadow_.eGBPXYogDw7By0-yZeWHpgI8DtWIzu-_0 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17736685448549492205', time=2024-09-14T13:42:11.361167+0000, chain.objs.size()=1 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.460__shadow_.-BuXU2Pdjvtw3ZBwnQX76FWtWm-ds2X_0 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12174302839256096585', time=2024-09-14T13:42:16.156714+0000, chain.objs.size()=1 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.465__shadow_._CfSnYjz9YgfOR7s0BYM6WTBrfttQSp_0 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9206232846475960742', time=2024-09-14T13:42:27.447090+0000, chain.objs.size()=1 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.1rmiSRaLY4XS8XzNI5qY97KY0vGCovF_0 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15641972068396254113', time=2024-09-14T13:42:27.463900+0000, chain.objs.size()=1 2024-09-14T11:58:37.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:37.996+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.pBltQnR-C_G-hYlB9_8D3XwhKRg5WmF_0 2024-09-14T11:58:37.997 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12887506060067439922', time=2024-09-14T13:42:38.505346+0000, chain.objs.size()=1 2024-09-14T11:58:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.497__shadow_.IE7oKHy-26LVHexsZnQmu_xyomKgGBy_0 2024-09-14T11:58:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.000+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13958308487923733302', time=2024-09-14T13:45:29.923708+0000, chain.objs.size()=1 2024-09-14T11:58:37.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.537__multipart_mymultipart.2~yDGbkd29i3EgZ5K-CI_lCHXWyzvvjY8.1 2024-09-14T11:58:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9148312691212068437', time=2024-09-14T13:46:04.326158+0000, chain.objs.size()=1 2024-09-14T11:58:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.SGj9N5TvUIUP-3TsBAKKiDzrBvgh71L_0 2024-09-14T11:58:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16128670251619083388', time=2024-09-14T13:46:11.017173+0000, chain.objs.size()=1 2024-09-14T11:58:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.559__shadow_.znVjtIKnm5jhveEU7btnsWR8hIo4gNI_0 2024-09-14T11:58:37.999 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2283400069319420367', time=2024-09-14T13:46:33.323155+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:0cSn0-4LjP8mMxxFRFhQHQ0cIlaxqEV_.PUSZ1f-_2eDIi8R7sI_ANwaw2_2ovDa_0 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6375623238853055499', time=2024-09-14T13:46:47.367332+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.576__shadow_.kzmPv_GrC2ZxnDx0vL_ziSljj7hntTJ_0 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2668168378347130091', time=2024-09-14T13:46:56.866150+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:.2npUDD7a.X1o9-YuJ7TzjRdOpOYvpW_.8Zwi4Aba5WfotcxEuo7ffoF4jpsXADo_0 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11394172998752956508', time=2024-09-14T13:47:15.832690+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:8.k5z.NOoJmKw9YOqrHaZjee5Riq.IT_.-mFv82mUKzJ6HrYceGCehhJPImqiQ2H_0 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15861706180938552570', time=2024-09-14T13:47:39.496916+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.587__shadow:v5AiU-DHY4sBU0D2noSzDc6H7yEwPgz_.tMM6FFIuKianu-ckosematD2OTY2RFs_0 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2261127128782240136', time=2024-09-14T13:51:53.407331+0000, chain.objs.size()=1 2024-09-14T11:58:38.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.001+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.642__shadow_.E03GyS_08eukUpz3qk-pnfHMKHJ0v1f_0 2024-09-14T11:58:38.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.002+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.779947403897156368', time=2024-09-14T13:52:01.758900+0000, chain.objs.size()=1 2024-09-14T11:58:38.001 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.002+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.647__shadow_.tYhpk2d1CcBNAK1_RHBNB38OVarft72_0 2024-09-14T11:58:38.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8644316159909199654', time=2024-09-14T13:52:03.375195+0000, chain.objs.size()=2 2024-09-14T11:58:38.003 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.648__shadow_.CVI0frav9dQb9yFgXL-SJ7CKGH_Dlkn_0 2024-09-14T11:58:38.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.007+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.648__shadow_.CVI0frav9dQb9yFgXL-SJ7CKGH_Dlkn_1 2024-09-14T11:58:38.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.008+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7586927165913232185', time=2024-09-14T13:52:10.376459+0000, chain.objs.size()=1 2024-09-14T11:58:38.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.008+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.654__shadow_.RSSLHRr2RjFvNcljYX8HH8yfocMjroj_0 2024-09-14T11:58:38.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.010 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.013+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:58:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.014+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.014+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46290' 2024-09-14T11:58:38.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_DsqGVAQ1CosMtOrMw6eqXGnod7JjPgH', time=2024-09-14T13:34:42.722188+0000, chain.objs.size()=3 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.E5wrq6wXDM9OFqmvO_98Nx7PhLQqoJ__0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.E5wrq6wXDM9OFqmvO_98Nx7PhLQqoJ__1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.E5wrq6wXDM9OFqmvO_98Nx7PhLQqoJ__2 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14544179159054879780', time=2024-09-14T13:36:55.506257+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.232__shadow_.H5Q3MpoLmUNq6JhFwntjajNq4L210IU_0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3557394149584972318', time=2024-09-14T13:36:56.993943+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.234__shadow_.f13zKpO4kFuu5SE1vF8xkHdNiMApbDF_0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14169978175766911152', time=2024-09-14T13:36:57.732775+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.235__shadow_.raMcp7KtdLGmxZn05e3f0iQcJIGGGZT_0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1829153115486431039', time=2024-09-14T13:36:58.449948+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.236__shadow_.t3_MUf2l0yzSoy8cTYIRvxWhRhiVT5s_0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14671675187207061264', time=2024-09-14T13:37:12.733044+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.254__shadow_.aBjJyVN0LLL5WHNk5zd4GQ92qY1BHq7_0 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.451523850243418672', time=2024-09-14T13:37:14.905107+0000, chain.objs.size()=1 2024-09-14T11:58:38.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.257__shadow_.NeeIAz7dYVH7tXD6RZykRB7MLbwlumN_0 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.332945919022984320', time=2024-09-14T13:37:16.937503+0000, chain.objs.size()=1 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.260__shadow_.3P8aR_bmTesFwPx9c3uu1VxyTny30kP_0 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8823174263491506445', time=2024-09-14T13:37:57.747039+0000, chain.objs.size()=1 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SNad5VKWUF8DLzPPvh9inpUZUzpKaOQ_0 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11437178653847333186', time=2024-09-14T13:37:57.747556+0000, chain.objs.size()=1 2024-09-14T11:58:38.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.y78GIF0KpwQ-bFJY29dG9ohNjsepIph_0 2024-09-14T11:58:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15523033354952181696', time=2024-09-14T13:37:57.930471+0000, chain.objs.size()=1 2024-09-14T11:58:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.r0jc49MqkDzouBXMILmMx0Gt8uuONaL_0 2024-09-14T11:58:38.018 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17121494373906616175', time=2024-09-14T13:37:58.614881+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.or94MsZGqvhWTzBG7tofrQq9KP4yYj3_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17453778502009949973', time=2024-09-14T13:37:58.935309+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PQpdxG8Fk_Fj4KjFlnhJlYUaNX5xVXa_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9714522113072120507', time=2024-09-14T13:37:59.690038+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.020+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GLCvO2cn9p0elFGJd5XFSQOq4rU0hrT_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1723665636205624626', time=2024-09-14T13:38:00.462483+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RnfjTG1852sFTCv74PHP_icEQDt8jkt_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1513695295536012854', time=2024-09-14T13:38:01.203351+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mmOCrsm6CdMXcWkKd1JvT2NtgatSSkx_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3676798449717273753', time=2024-09-14T13:38:01.542244+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NAVw8pt1NmqpcqofuCo6bwmdcjzRAry_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11037178697488174277', time=2024-09-14T13:38:01.564575+0000, chain.objs.size()=1 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RTTzwiuoabOwJWXJOI0N2tV2YtdODtB_0 2024-09-14T11:58:38.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7591308732562761511', time=2024-09-14T13:38:02.137942+0000, chain.objs.size()=1 2024-09-14T11:58:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4EMt5rjchVClWQuT-tVWFdl8ysQx_bG_0 2024-09-14T11:58:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9121774939329987584', time=2024-09-14T13:38:02.138602+0000, chain.objs.size()=1 2024-09-14T11:58:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AF_hMS3BY6hhomD8K4OkvoG79k_eYfn_0 2024-09-14T11:58:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17971173045972341255', time=2024-09-14T13:38:02.245133+0000, chain.objs.size()=1 2024-09-14T11:58:38.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PwYgVid60FseFa5VGiJtsA4LY9wKzou_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2548391811158784753', time=2024-09-14T13:38:02.399254+0000, chain.objs.size()=1 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hdUmsMQwjz0tZteMXQVv20tALeIjwjE_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15654947289756574978', time=2024-09-14T13:38:03.068175+0000, chain.objs.size()=1 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9mLuSiRdKcuWIL1GNKbiFRj8T5qJJvD_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16107923198201379066', time=2024-09-14T13:38:03.221233+0000, chain.objs.size()=1 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lMllKlAv8XjjYj32hKhN1-1-RoD2Huo_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15720195951379317520', time=2024-09-14T13:38:03.427093+0000, chain.objs.size()=1 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.t0EPoTSYp9tszT0v8j9XA3oda-Zz67G_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6076994080716066221', time=2024-09-14T13:38:03.427679+0000, chain.objs.size()=1 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Z8FVosrINnFXb580HYSYvDIhj6Kbb6m_0 2024-09-14T11:58:38.023 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16415802574952707803', time=2024-09-14T13:38:03.903915+0000, chain.objs.size()=1 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.cbzttVHuWdEBFDiOyrIK4oE1ythf35r_0 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14308918025526291547', time=2024-09-14T13:38:04.564479+0000, chain.objs.size()=1 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.025+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.yNVKlnw1uhjO-kObaXvwag7XsTLJZOc_0 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17692187291377698762', time=2024-09-14T13:38:04.675426+0000, chain.objs.size()=1 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VaV8mo2KdXXCM6VBOlY1sgOTtgtENmG_0 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5973772951005981441', time=2024-09-14T13:38:04.919518+0000, chain.objs.size()=1 2024-09-14T11:58:38.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZhbivX8vAPnDjtt6Wa0EhVX4e46qtrp_0 2024-09-14T11:58:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14171508164612252291', time=2024-09-14T13:38:05.550502+0000, chain.objs.size()=1 2024-09-14T11:58:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9U-ndhL0cDZ4o4qixw11Cmxal2NfmyU_0 2024-09-14T11:58:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3360005258150101166', time=2024-09-14T13:38:05.716398+0000, chain.objs.size()=1 2024-09-14T11:58:38.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W8wUzvDuOUalegg0kqSPBuqETbFNRuu_0 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10181762589264307972', time=2024-09-14T13:38:05.740124+0000, chain.objs.size()=1 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.enNGesVbVfijKi6gRSgedxlQpJOmMoV_0 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.658308545790856318', time=2024-09-14T13:38:06.351638+0000, chain.objs.size()=1 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AI6G8qv5Jgi479KIkYIvgD1KsC_-98o_0 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.590033042409438094', time=2024-09-14T13:38:06.546929+0000, chain.objs.size()=1 2024-09-14T11:58:38.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YSnnUhjz6ktuZpqoIcRYReSVbWrywq2_0 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12797338956394316101', time=2024-09-14T13:38:07.174164+0000, chain.objs.size()=1 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.F3c3K9ahVOItDUVLuXRpvrJyTcnGC3I_0 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7545837843585709964', time=2024-09-14T13:38:07.227031+0000, chain.objs.size()=1 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aSNq5NqJ9e03iY_jj3macLvcyvOwaJF_0 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9201817467431798931', time=2024-09-14T13:38:07.953972+0000, chain.objs.size()=1 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.q_gm-tw6iSed-LlQxcmyzW7rG7XyPXq_0 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6161940612935128181', time=2024-09-14T13:38:08.550461+0000, chain.objs.size()=1 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Eo6Q7vzR3nRcdCBGDeqN8IRqQc4lUSO_0 2024-09-14T11:58:38.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4691650177795235146', time=2024-09-14T13:38:08.587535+0000, chain.objs.size()=1 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W_8H8YBTYZYjp2cS28--2m_FrJmSpVN_0 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7770819684872815726', time=2024-09-14T13:38:08.994268+0000, chain.objs.size()=1 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1LuRD7BtRLRZ9VPM4JvwgNZLJs67szp_0 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10837968032026395164', time=2024-09-14T13:38:09.071214+0000, chain.objs.size()=1 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.638z5aMxNy_QtXeNJwT2vXLT4xrHKzq_0 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11361606910301371050', time=2024-09-14T13:38:09.585405+0000, chain.objs.size()=1 2024-09-14T11:58:38.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.031+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UQCjrtUQOGX9FBDkjKuYyg1vC2b4HH1_0 2024-09-14T11:58:38.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3493052319421086669', time=2024-09-14T13:38:09.645910+0000, chain.objs.size()=1 2024-09-14T11:58:38.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zBN8rj7sEtydLMpFtzmO19NH-bUwpae_0 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11947541591978536905', time=2024-09-14T13:38:09.759316+0000, chain.objs.size()=1 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YUxzgkGo7fOYXyABlDHrYQJD67BBYRw_0 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16662239622964448226', time=2024-09-14T13:38:09.833172+0000, chain.objs.size()=1 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mCalBvXFOOuJfeHEodinAw8UbNtEDid_0 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14801610535353968072', time=2024-09-14T13:38:12.538663+0000, chain.objs.size()=1 2024-09-14T11:58:38.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.266__shadow_.JFCbTTmW2jVZatV7q7IgY6qAUbYgr-5_0 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8651363859108798805', time=2024-09-14T13:38:15.256023+0000, chain.objs.size()=1 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.270__shadow_.GM1SLtDh5IC60S4eY9tusJYT-60fWau_0 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7312590492099549228', time=2024-09-14T13:38:25.306093+0000, chain.objs.size()=1 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.284__shadow_.VmWQXQ5Z7HHe-DvuR0PXhn05DdctCuB_0 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13134092870465788465', time=2024-09-14T13:38:37.180410+0000, chain.objs.size()=1 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.296__shadow_.BVhrkkCIrvKulvZFm37pKJGx2GSbnyA_0 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2621995018349363649', time=2024-09-14T13:38:45.664718+0000, chain.objs.size()=1 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.307__shadow_.Av76nQemo1UDv5qmWA4T0sbUTqt2QZ7_0 2024-09-14T11:58:38.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13424515432931150371', time=2024-09-14T13:39:38.699276+0000, chain.objs.size()=1 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KCncBt_FG-WxOl_d9dQKxnZU3ZsXEUp_0 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13990991670985019038', time=2024-09-14T13:39:38.795545+0000, chain.objs.size()=1 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b6jM4X8g_87Ubn_JNPzRlTeJ50_NQ-3_0 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2755542073560852942', time=2024-09-14T13:39:38.948822+0000, chain.objs.size()=1 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZqmFtYr44Ql0xjmfFw9l9S_gHiqlUn0_0 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2215363494690919276', time=2024-09-14T13:39:39.121082+0000, chain.objs.size()=1 2024-09-14T11:58:38.037 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.038+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._zIWfb_YnDcdLmx87_UpgdlU2sGrJyU_0 2024-09-14T11:58:38.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.041+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7321302173435254453', time=2024-09-14T13:39:39.489963+0000, chain.objs.size()=1 2024-09-14T11:58:38.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.041+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.M4p_a2uBvuxNM1FrzGQOJw4yoPb4zid_0 2024-09-14T11:58:38.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.041+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2647788916876983491', time=2024-09-14T13:39:40.301732+0000, chain.objs.size()=1 2024-09-14T11:58:38.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.041+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yKiu8_IeHWQATFNwA8krs4eRKvDRpEZ_0 2024-09-14T11:58:38.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.043+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10615756861463910814', time=2024-09-14T13:39:40.859744+0000, chain.objs.size()=1 2024-09-14T11:58:38.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.043+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aZmatnnvRhvk5sNaS7ILAMokMLgT0-2_0 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1620086234699948144', time=2024-09-14T13:39:40.905177+0000, chain.objs.size()=1 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.eh1dWzTL27IlUVbxNV5RQlbSS0mHT75_0 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6006749433236653364', time=2024-09-14T13:39:41.083102+0000, chain.objs.size()=1 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AHHZZa1CwKL4duewgfIyfrQQHl1F948_0 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12497344808314291033', time=2024-09-14T13:39:41.137113+0000, chain.objs.size()=1 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HGLquE_fvWeCTWALZQQJNR99vK__9sz_0 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14198259300729345036', time=2024-09-14T13:39:41.280473+0000, chain.objs.size()=1 2024-09-14T11:58:38.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0V1j3rFbLfC9lydwHv9Uh6dRtQqpOak_0 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10767474706142008554', time=2024-09-14T13:39:42.713217+0000, chain.objs.size()=1 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7N3prSpd-3lSitanNUiZsQklMiMNtNR_0 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14857679955399843258', time=2024-09-14T13:39:42.862985+0000, chain.objs.size()=1 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C6m2Ff5hZm2DDE62trUry4XEbT6xMZe_0 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.399363538157377388', time=2024-09-14T13:39:43.648959+0000, chain.objs.size()=1 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.k0murNV69eliaNgvzx47D-L_a0RVuSc_0 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3905194571909816351', time=2024-09-14T13:39:43.963627+0000, chain.objs.size()=1 2024-09-14T11:58:38.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.R2FObyFqm19d6WWTFcErKh1FN0z4nLc_0 2024-09-14T11:58:38.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11880340218931266086', time=2024-09-14T13:39:44.515383+0000, chain.objs.size()=1 2024-09-14T11:58:38.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._zK_KDJXGe1BL9fkEJiius6iYSWI2B2_0 2024-09-14T11:58:38.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10045551014275605863', time=2024-09-14T13:39:44.702408+0000, chain.objs.size()=1 2024-09-14T11:58:38.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tLhx1dmUePvRHUoOp6b2Lrt8RBCNnzC_0 2024-09-14T11:58:38.044 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7010069431776338678', time=2024-09-14T13:39:44.802197+0000, chain.objs.size()=1 2024-09-14T11:58:38.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.046+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XGG9YHIicyPTQHieoGvxuY1G_OeXWgQ_0 2024-09-14T11:58:38.047 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16498844074552315798', time=2024-09-14T13:39:44.825663+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.W2c8SGsGnLWfX-Rt2XDLcUm9WGr-ACC_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10117671681643369461', time=2024-09-14T13:39:45.706839+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NOPGoTRJfxLI3jNhGNKeCXIse5UCsfT_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6291128366781784852', time=2024-09-14T13:39:46.197133+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.felY7xra7tAe8xELBULSmCZkSG3ZdDD_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9796207715245627520', time=2024-09-14T13:39:46.198668+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uQ__w_aaVKihMH5szrM3wcomELx1ipU_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1213928148991405763', time=2024-09-14T13:39:46.487384+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.w06HI93gURE2pWvtFQjtv0d4eRiwjj-_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9475447282881341515', time=2024-09-14T13:39:47.567868+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1hUbMoP4xzmP_xXnXk1OMbKMyZv4cwp_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8114453153153401441', time=2024-09-14T13:39:48.455688+0000, chain.objs.size()=1 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FCMkZKQOot4_AkJM7m0Tk4UEEbSzel7_0 2024-09-14T11:58:38.048 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10234060571161906533', time=2024-09-14T13:39:48.814239+0000, chain.objs.size()=1 2024-09-14T11:58:38.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.050+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jCv75dzMUyKzoCziClC548NMXNIpXzQ_0 2024-09-14T11:58:38.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.052+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1734617351641483616', time=2024-09-14T13:39:48.934372+0000, chain.objs.size()=1 2024-09-14T11:58:38.049 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.052+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lEU9v4ZVIf2E5tKjwbQ4ew89pH3U1dp_0 2024-09-14T11:58:38.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.053+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14872249822549144186', time=2024-09-14T13:39:48.935058+0000, chain.objs.size()=1 2024-09-14T11:58:38.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.053+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oOWOatxgmJXDydO-A3KNrrwAbhsKtim_0 2024-09-14T11:58:38.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.053+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14985741940116459686', time=2024-09-14T13:39:48.964078+0000, chain.objs.size()=1 2024-09-14T11:58:38.051 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.053+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zl82rKIOyErvozJU6Mz-B-wrNGtgePk_0 2024-09-14T11:58:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2824545680528393069', time=2024-09-14T13:39:49.181017+0000, chain.objs.size()=1 2024-09-14T11:58:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cQzJ3UiANbr_KBZD3q3xcq_MIl0FV5-_0 2024-09-14T11:58:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9207331456167771894', time=2024-09-14T13:39:49.911962+0000, chain.objs.size()=1 2024-09-14T11:58:38.052 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PypIpk--6RzIurrwFb4Ss80L_bcJTyT_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18097356386555053376', time=2024-09-14T13:40:30.783136+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NkUmqQyF0_Nxk5OT1SNWzQG2XrCQEV9_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7855717936986693340', time=2024-09-14T13:40:31.023994+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.R_Gc5op27HhDXxQI2AbfNNNPCpQUlb5_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5420229617816024081', time=2024-09-14T13:40:31.154700+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2Cw4DPa6Ir_75AgwsrKMF6gskyTcrvH_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16362632613381120892', time=2024-09-14T13:40:31.540743+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9N8AKSuDMd12Yvkq5QUokPbAmCpOluq_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8384734540798898433', time=2024-09-14T13:40:31.760184+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.g6a9wWPj8fiJMp-cMJYbxRpkQlYmSDh_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10228669404419341999', time=2024-09-14T13:40:31.853501+0000, chain.objs.size()=1 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.o1D69hSpb70bEJ5dxK-jGXXAFtVw5sQ_0 2024-09-14T11:58:38.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.821160795915850211', time=2024-09-14T13:40:32.719729+0000, chain.objs.size()=1 2024-09-14T11:58:38.055 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.056+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7hBSBKiSp5enzCscB6sZq2tRnrqTaAa_0 2024-09-14T11:58:38.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.058+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.60816869232618452', time=2024-09-14T13:40:34.535403+0000, chain.objs.size()=1 2024-09-14T11:58:38.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.058+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iuXAWdJIO5mJpPBVXZzdPGFpJD2LwOx_0 2024-09-14T11:58:38.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.058+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5950506525219165314', time=2024-09-14T13:40:34.717295+0000, chain.objs.size()=1 2024-09-14T11:58:38.056 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.058+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.D7zG1-f9xpaiFysbRg5XMCz2JYRjcY4_0 2024-09-14T11:58:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.059+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16372245293564435856', time=2024-09-14T13:40:34.733855+0000, chain.objs.size()=1 2024-09-14T11:58:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.059+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MOKKDFlc3M5J3_txE59JOK9bRz_uguF_0 2024-09-14T11:58:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13147726992210150114', time=2024-09-14T13:40:35.189657+0000, chain.objs.size()=1 2024-09-14T11:58:38.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JTz7A_ePuFc7fVB1UJdoUlG4ZyJmEbo_0 2024-09-14T11:58:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.060+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16558312154585315892', time=2024-09-14T13:40:36.174378+0000, chain.objs.size()=1 2024-09-14T11:58:38.058 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.060+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Yu7vEC04o2MBZ9xErjpSSKrEBgPalVZ_0 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14239286386346238864', time=2024-09-14T13:40:36.413497+0000, chain.objs.size()=1 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9uRIF-437ihqCRw8EWI-PZKB3eCf7C8_0 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11798477027060280979', time=2024-09-14T13:40:36.634889+0000, chain.objs.size()=1 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.A6Q66bw6ZdeF-SESRVN0wOQWnJxe1aE_0 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.304316033544465071', time=2024-09-14T13:40:36.654942+0000, chain.objs.size()=1 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.e9Ek2bmKbWCFo7EnK9mmUIXtaoiRZQC_0 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9649958514831437648', time=2024-09-14T13:40:36.971629+0000, chain.objs.size()=1 2024-09-14T11:58:38.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ASTzvOLkl5xC8C6MxmXKVdmlmMrqpCI_0 2024-09-14T11:58:38.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3534298325529160223', time=2024-09-14T13:40:37.517595+0000, chain.objs.size()=1 2024-09-14T11:58:38.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.huE3hWiZk5jslV9eVw6ZI-nOFkNpvlT_0 2024-09-14T11:58:38.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1208085212578510007', time=2024-09-14T13:40:37.545069+0000, chain.objs.size()=1 2024-09-14T11:58:38.060 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.061+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ErBNE3Y8cgsNxLAkVt6qUowbuMeV31H_0 2024-09-14T11:58:38.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/46290 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=44, truncated=0, next_marker='' 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15737902373937937447', time=2024-09-14T13:40:37.563065+0000, chain.objs.size()=1 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eE9n3T48mrKTDh7LdNp8qqXE7U3dzPA_0 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4249292669093445852', time=2024-09-14T13:40:37.650510+0000, chain.objs.size()=1 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TKl3aePevZ79k7-tLNm1haYzHhWYIIH_0 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3723017474164689593', time=2024-09-14T13:40:37.875540+0000, chain.objs.size()=1 2024-09-14T11:58:38.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IH82Zu3oXRSHOsgs-GweM5qo888C7uW_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8368641928323284335', time=2024-09-14T13:40:38.555850+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iJTrnvvLSMlIqkBmGkLeXpnAD31kWoK_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1863605942001111355', time=2024-09-14T13:40:39.164683+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nNaaL4aoOiKLAon0AOOXw6ETKMgIlE__0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7927685320067105898', time=2024-09-14T13:40:39.373326+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-tGOK-sMWeT-xzMucAqQw3C9YZzdbii_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9012141710424429387', time=2024-09-14T13:40:39.610553+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Ag-jpweuipdox0C7A6dZJ0K5cdW4zsB_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8992178088794518060', time=2024-09-14T13:40:39.711464+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fdSCnwRZUwveZGJ9Di_Gu9525O698Pc_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1976611055858163262', time=2024-09-14T13:40:40.159419+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5ZzMHNoWU-m_CCIbhTz8S1qeaBVoOBN_0 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16308673754633071295', time=2024-09-14T13:40:40.236881+0000, chain.objs.size()=1 2024-09-14T11:58:38.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.n4KoTyfybzMfCbqF4pKReLXirtsEfJR_0 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9603708729587549842', time=2024-09-14T13:40:40.322613+0000, chain.objs.size()=1 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YH0jYJNnDjN8zZt0aYpXL9_l1XS8yr9_0 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15315546214154034591', time=2024-09-14T13:40:40.818720+0000, chain.objs.size()=1 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7RWNf1roWgSkiWjehjrLyeSxk0Z_Ecb_0 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.071+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4422850853227436079', time=2024-09-14T13:40:40.848885+0000, chain.objs.size()=1 2024-09-14T11:58:38.069 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.071+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YVvy4hclj0hBatfVvS-ECejqOHku2Of_0 2024-09-14T11:58:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.073+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1145274913165273945', time=2024-09-14T13:40:41.191472+0000, chain.objs.size()=1 2024-09-14T11:58:38.071 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.073+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8uzqlQ8jK7uY76kGG9bDLIt0wi7DLmj_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7184103190623198438', time=2024-09-14T13:40:41.624305+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7ybDC-AHTNX2svDg919UMkPOQQUC2En_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4816867899094189499', time=2024-09-14T13:40:41.902637+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rXNbhxgdAaG2i4_SXhjNDNGJ8GX04Os_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8473453301446420528', time=2024-09-14T13:40:42.384733+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nVcA2m-O3eURCUllZHQXdxMySwR93rY_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9712825503961632004', time=2024-09-14T13:40:42.568455+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1l9vPxMIe2i7wWaG4Dq7qdNwleVmtAB_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5940935349777105481', time=2024-09-14T13:40:42.630596+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DGeSn9FAOcoD7VPG0veG7T4HOgSzTVd_0 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.605897691269448077', time=2024-09-14T13:40:42.678573+0000, chain.objs.size()=1 2024-09-14T11:58:38.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eG_dA4vnY7L8LOpCHBDQHakc_C0q0Ok_0 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2646839670136696201', time=2024-09-14T13:40:42.912735+0000, chain.objs.size()=1 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bueqru2C_mn0UXz1CHKr9L2fFxr0Mvw_0 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.803630307331842309', time=2024-09-14T13:40:43.087794+0000, chain.objs.size()=1 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GvTo2lgnJOnm8YSiWjgk2s4CW9pXip3_0 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6374199220565084904', time=2024-09-14T13:40:43.134983+0000, chain.objs.size()=1 2024-09-14T11:58:38.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0hgtrMCOr9uSInRuRz9b7YKBtuiKijw_0 2024-09-14T11:58:38.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.077+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2364693864330244824', time=2024-09-14T13:42:18.177954+0000, chain.objs.size()=1 2024-09-14T11:58:38.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.077+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.467__shadow_.p1RxHWI9ZokA-WPohJDOIqv9V1s97P9_0 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4898520169913165499', time=2024-09-14T13:42:28.302078+0000, chain.objs.size()=1 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.485__shadow_.OTdLH8Kho22w64SKMOUuPzZjDqUdpBF_0 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12738907674547571654', time=2024-09-14T13:42:53.468644+0000, chain.objs.size()=6 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:38.076 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:38.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.078+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:38.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.079+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:38.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.079+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.821232677051013027', time=2024-09-14T13:43:06.555949+0000, chain.objs.size()=1 2024-09-14T11:58:38.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.079+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.519__multipart_mymultipart.2~GX7H8Ta3j4RoizQRNycOX7nrdAjM4SD.1 2024-09-14T11:58:38.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.082+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9979121184453637037', time=2024-09-14T13:43:34.101044+0000, chain.objs.size()=4 2024-09-14T11:58:38.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.082+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:JtVSANW-2HXzuQB5cqF297J0IgDnmM5_.oViqBIlFWLE24I7YGf5W8eUjdV9XAiD_0 2024-09-14T11:58:38.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.082+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:JtVSANW-2HXzuQB5cqF297J0IgDnmM5_.oViqBIlFWLE24I7YGf5W8eUjdV9XAiD_1 2024-09-14T11:58:38.080 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.082+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:JtVSANW-2HXzuQB5cqF297J0IgDnmM5_.oViqBIlFWLE24I7YGf5W8eUjdV9XAiD_2 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:JtVSANW-2HXzuQB5cqF297J0IgDnmM5_.oViqBIlFWLE24I7YGf5W8eUjdV9XAiD_3 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.179608+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.183453+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.2 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.187035+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.3 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.190944+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.4 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.194524+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.5 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5', time=2024-09-14T13:44:29.198108+0000, chain.objs.size()=1 2024-09-14T11:58:38.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~InjqDVAfQ1TiYl36gB8Ow8CN5gkFfN5.6 2024-09-14T11:58:38.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3056390207408553867', time=2024-09-14T13:44:40.552859+0000, chain.objs.size()=5 2024-09-14T11:58:38.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~3Tp02Bp7UCiMyNt3XX9TsAqNy6XT1KQ.1 2024-09-14T11:58:38.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.086+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__shadow_mymultipart.2~3Tp02Bp7UCiMyNt3XX9TsAqNy6XT1KQ.1_1 2024-09-14T11:58:38.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.088+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~3Tp02Bp7UCiMyNt3XX9TsAqNy6XT1KQ.2 2024-09-14T11:58:38.086 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.088+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__shadow_mymultipart.2~3Tp02Bp7UCiMyNt3XX9TsAqNy6XT1KQ.2_1 2024-09-14T11:58:38.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~3Tp02Bp7UCiMyNt3XX9TsAqNy6XT1KQ.3 2024-09-14T11:58:38.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13898631982234233681', time=2024-09-14T13:46:52.459546+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:zYzIHXqp-WYdoYRemQITM6GxqmUiKNk_.pg2_kDuu1ylb6MaE6tvVEtxulDALeP6_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8952677240339673980', time=2024-09-14T13:47:05.523758+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:WGwZzfb9NTtNQNSqixUfi-xSZtRtqdY_.TwiaIH744gZ-a8SrTFmgRaCYqfTZU2V_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4477950281678647995', time=2024-09-14T13:47:06.320026+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:ilGv.EjhqkqCNU5VHeT8qsNtbp9V1Vx_.TmTWS634v0Pd2e3ghJwz8QdkulfB2cJ_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2421177601638550912', time=2024-09-14T13:47:32.082290+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:OEkNsEDuuDawf8tHyzTVtQvjThHhLLq_.kLFoW3LjrKKV66TTRbYdj32J7_vISZc_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13731888873608238673', time=2024-09-14T13:47:41.228218+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:6Iq8KHMorgFtii6kI2rjSftq1NnbrfT_.EbkSSad7oEDVLMdCiTTlFxqgwAX2ufM_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4697931021763021203', time=2024-09-14T13:47:46.574013+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.597__shadow_.3AZpFssHk-B5bOdbyGLUxA7sSY4uU-4_0 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10902829561594941331', time=2024-09-14T13:51:47.011886+0000, chain.objs.size()=1 2024-09-14T11:58:38.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.632__shadow_.Y6Qc4Hbvhcha4ZdqBGKh_Yc4hbaMcyZ_0 2024-09-14T11:58:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.091+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17250168078422304171', time=2024-09-14T13:52:55.973706+0000, chain.objs.size()=1 2024-09-14T11:58:38.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.091+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.701__shadow:PdecrtdwRylo.ODMOlatzIpAXLMlskl_.RJ4KYQmr2v6YLDZ-6q4krZatvjCoy0W_0 2024-09-14T11:58:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.092+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12298088817707950902', time=2024-09-14T13:55:50.239088+0000, chain.objs.size()=1 2024-09-14T11:58:38.090 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.092+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.771__shadow_.PMAbTVJutef_mHulMIj8_016q54ZyOG_0 2024-09-14T11:58:38.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.099 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.101+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:58:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.102+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.102+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/56470' 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6389636106662327752', time=2024-09-14T13:37:00.239413+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.238__shadow_.ZndDp9gnEsahH8Ljh87KcFaljUzUYM2_0 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5565305771877700915', time=2024-09-14T13:37:01.298023+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.239__shadow_.WWhJ6qwASSB_Iej4TbUJpaL88UdHbLQ_0 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11344249016328787564', time=2024-09-14T13:37:06.807973+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.246__shadow_.wiqeM12PQzOYRby5Osm4OzHBDbQmpXC_0 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10719045033990637801', time=2024-09-14T13:37:14.898652+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.257__shadow_.iHK3gGX-M0oI0g-ArwoMSROydHklqtZ_0 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8226242234141372609', time=2024-09-14T13:37:16.260546+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.259__shadow_.PtD8i7E4NjOtpRiDk4fofjuIUBVzM0F_0 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16284992884881314345', time=2024-09-14T13:37:57.931319+0000, chain.objs.size()=1 2024-09-14T11:58:38.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.A2q6et04zbaraWReyGPpz-RYFG3VRLC_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7037107463216483570', time=2024-09-14T13:37:58.095258+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aL6gO7HxRHewwHBgboeIzgjGYuq65kb_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15689063293710188156', time=2024-09-14T13:37:58.179427+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jjNDNcvAhiRPLbKt6Q0hb4MBm45bOXr_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.804275605448013791', time=2024-09-14T13:37:58.695371+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mqRkhbxCZxS2BAWkJR7XHH50vqGKrIE_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16113707920171978092', time=2024-09-14T13:37:59.480801+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WWfXseVDHCdAkIuh19NRUfhymGn0Tnh_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5426681892449989028', time=2024-09-14T13:38:00.059535+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qQnXEBQmDrAYDsnIaR18EHYtq9dqyjy_0 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4455263459821628821', time=2024-09-14T13:38:00.060289+0000, chain.objs.size()=1 2024-09-14T11:58:38.103 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IfMQIAL_nBVo2LMFJjdi2ASE3uy3v3K_0 2024-09-14T11:58:38.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.146808959292317458', time=2024-09-14T13:38:00.136164+0000, chain.objs.size()=1 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ny05kAiR3Oosvkb8qsObfuaYDDK8sYx_0 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11092262846473663098', time=2024-09-14T13:38:00.173580+0000, chain.objs.size()=1 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zdD4VgfQuqHZHy963K9JYxmU33jnYtK_0 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12035614790367348605', time=2024-09-14T13:38:00.549481+0000, chain.objs.size()=1 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7-RYmwPEm97HGfHSud4P_qzQzsMfMH4_0 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10717153792619076196', time=2024-09-14T13:38:01.206986+0000, chain.objs.size()=1 2024-09-14T11:58:38.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.irs9ppCwkaMuKsLt_uml_bGfS4H8z-m_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4588467582833262191', time=2024-09-14T13:38:01.411584+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oJwbgoYePIOWA-82wAjexq7Vsw2Ianz_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14606785544710084874', time=2024-09-14T13:38:01.524310+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JVqk449K9OrcXzT-TqJJX_-R3bK8qg9_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11333356859670492076', time=2024-09-14T13:38:01.773413+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.T32fJmT_PQCm7fdAHUnB1DENoGCRobx_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10622413831546054815', time=2024-09-14T13:38:02.224885+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.K__2Qr4G-cnHUgjP21qJiLA7in5Z3Yq_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3562153405729206178', time=2024-09-14T13:38:02.227244+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sT89hkqQbblOdzjs4rvEHEwGZ4yRIc1_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16611338918679179504', time=2024-09-14T13:38:02.227744+0000, chain.objs.size()=1 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.24eoZ50QDEiS-Lbj-uk0FHL-33LcEba_0 2024-09-14T11:58:38.106 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3825149206959906591', time=2024-09-14T13:38:02.376930+0000, chain.objs.size()=1 2024-09-14T11:58:38.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3VB3jjvMUBSD6KxYnfWxJ7eGioxO6NP_0 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10742476551022295562', time=2024-09-14T13:38:03.047116+0000, chain.objs.size()=1 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EnMgr1x5LJXfmBRZi88Rqa5CXWB8dVl_0 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1279849414198562876', time=2024-09-14T13:38:03.119083+0000, chain.objs.size()=1 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rG0w2toZrvFHcMaAXdmibUfGZDeTGsB_0 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5401472672395736578', time=2024-09-14T13:38:04.112565+0000, chain.objs.size()=1 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.j4lU-w_W5wb0y43udIzrXvG5EE6tABe_0 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.112+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4004830443170897794', time=2024-09-14T13:38:04.668444+0000, chain.objs.size()=1 2024-09-14T11:58:38.110 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.113+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Q_u3rY-297mH7iAentbSAbhgnPaWkrq_0 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15745729377429475733', time=2024-09-14T13:38:05.065670+0000, chain.objs.size()=1 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Di8CgSKj2MvpUhliEm7-RroFliVQ93X_0 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14576857336292609573', time=2024-09-14T13:38:05.293339+0000, chain.objs.size()=1 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EUVpLOwbwxpdQksmHqz2p8VmawXtHeM_0 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.678778152887518499', time=2024-09-14T13:38:05.610446+0000, chain.objs.size()=1 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Aih8ZdTXaSWq2t3Si4S90jGBEm6fMiW_0 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8102625916815307104', time=2024-09-14T13:38:06.329463+0000, chain.objs.size()=1 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xLJ5aKn9jpyRxS3GpXFA0CZVdIeX7uZ_0 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7655953837035637532', time=2024-09-14T13:38:07.069105+0000, chain.objs.size()=1 2024-09-14T11:58:38.112 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MhryNYWapzgae56ZcnAGPy2DY1ZeJnW_0 2024-09-14T11:58:38.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.747370137705713045', time=2024-09-14T13:38:07.288175+0000, chain.objs.size()=1 2024-09-14T11:58:38.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.114+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gF6IeZMSRr0WLWt4AU7V8T2ZzH2wXt0_0 2024-09-14T11:58:38.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15895508686333535449', time=2024-09-14T13:38:08.001425+0000, chain.objs.size()=1 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h_G26o8lTo8N4eKr5mt2wdxEu3CEHLF_0 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.189364135364135167', time=2024-09-14T13:38:08.461204+0000, chain.objs.size()=1 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oR5gNXLiovTz-65YaWWGgwvrM8H6pr8_0 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10293023026508231877', time=2024-09-14T13:38:08.552166+0000, chain.objs.size()=1 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MGfMMyZ9lOkM58rmShfpq4JUREmcuKv_0 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9456489140291096089', time=2024-09-14T13:38:09.055361+0000, chain.objs.size()=1 2024-09-14T11:58:38.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.116+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xoar2l0knY_d_Vs9I2Vt98jKNU0iCDP_0 2024-09-14T11:58:38.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2804375462912401783', time=2024-09-14T13:38:10.086929+0000, chain.objs.size()=1 2024-09-14T11:58:38.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JsZfKEAReHrHBOGYtsMXMX5ZI3GZNVQ_0 2024-09-14T11:58:38.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.119+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15539090254495262404', time=2024-09-14T13:38:10.221551+0000, chain.objs.size()=1 2024-09-14T11:58:38.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.119+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eCRvR45gLcp8YAXlTTtg1A3y-48YfHW_0 2024-09-14T11:58:38.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.119+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13398402828156284899', time=2024-09-14T13:38:10.270859+0000, chain.objs.size()=1 2024-09-14T11:58:38.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.119+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0A7EivovDESoehSZvOpO1XT5GfIHbGC_0 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14462279232041145655', time=2024-09-14T13:38:10.274490+0000, chain.objs.size()=1 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xn9rxSTTLgLSPk7srFZyWJPKVZ_-3c7_0 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1686102782354704414', time=2024-09-14T13:38:10.299557+0000, chain.objs.size()=1 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._92oCsivhUXDmKJz-Oj7E-6dzzhe462_0 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13204847927262902162', time=2024-09-14T13:38:11.097589+0000, chain.objs.size()=1 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.264__shadow_.lCwruvMar2rh8ge7UmenauLkZUAlOza_0 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7451102469573656191', time=2024-09-14T13:38:12.536191+0000, chain.objs.size()=1 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.266__shadow_.K2ce4eg3oHFeA9ahnP04Qn7vg8y06XC_0 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11457385774111108824', time=2024-09-14T13:38:18.031638+0000, chain.objs.size()=1 2024-09-14T11:58:38.118 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.120+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.274__shadow_.9bzSooClCUsyNZEG3VrUYbWD0av7de7_0 2024-09-14T11:58:38.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.122+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11257187088788363506', time=2024-09-14T13:38:21.675164+0000, chain.objs.size()=1 2024-09-14T11:58:38.120 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.122+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.279__shadow_.b6oEoOT5lpKYUVOK8zWH7y4c9Dewj4l_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10994964540193308868', time=2024-09-14T13:38:22.397331+0000, chain.objs.size()=1 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.280__shadow_.QaYyLNIgQ3cmJOs9YAcLSLrFR7nzn2J_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.43039652174048121', time=2024-09-14T13:38:33.551742+0000, chain.objs.size()=1 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.99ZKvY1Pv7N5J2Vl7rTOhI_OEP2fY0d_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16876845820107246766', time=2024-09-14T13:38:35.559338+0000, chain.objs.size()=1 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.497CnrvRbAd9jNWaqyDjfwZ258srbEl_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16620800642465651286', time=2024-09-14T13:38:50.306224+0000, chain.objs.size()=1 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.314__shadow_.1LMlwT0OrXnx97L7mgk1vJQ5DPDWh5-_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.455477179532580750', time=2024-09-14T13:39:38.847994+0000, chain.objs.size()=1 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZpzgNlr8-OqLqO68ZHINbFP6aTyr-Nm_0 2024-09-14T11:58:38.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14555940218019014469', time=2024-09-14T13:39:38.897603+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.feEICRyO2Cf6EpXFyOcpSoqpbokAMtq_0 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10943846111574612741', time=2024-09-14T13:39:40.313795+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TXPUHDhtTom-y4HKGNjBhiD79Q8EaLC_0 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8476227786131863274', time=2024-09-14T13:39:40.618638+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FdRVEa37xDhhpMhFN8NfKOeoWhC4MF5_0 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5058878809084498581', time=2024-09-14T13:39:40.725796+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9odTZ9xsqzRo6VYt6AzQu1MlZraV4TO_0 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18188895330697658057', time=2024-09-14T13:39:40.776514+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.125+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lun8zNBg5ik_X3wrOIJSDd1HogVr0n6_0 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15158724645669039979', time=2024-09-14T13:39:41.368518+0000, chain.objs.size()=1 2024-09-14T11:58:38.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4EEyg12omoZDUH9XTfiHIsz6pIMj9OY_0 2024-09-14T11:58:38.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.129+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2156481083128995407', time=2024-09-14T13:39:42.684956+0000, chain.objs.size()=1 2024-09-14T11:58:38.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.129+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GaAhk_1NqyOzjxNzcuxZfQSWK8kPx6S_0 2024-09-14T11:58:38.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.129+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3619382220467214681', time=2024-09-14T13:39:43.068603+0000, chain.objs.size()=1 2024-09-14T11:58:38.127 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.129+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.x-5yyXQA9TwFkMuQB1mHNCA7xo3Yg_Z_0 2024-09-14T11:58:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3573691287856246489', time=2024-09-14T13:39:43.210326+0000, chain.objs.size()=1 2024-09-14T11:58:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JK15tw7NnEYnjD_woJk32-9N0kGSdib_0 2024-09-14T11:58:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8626167867666765', time=2024-09-14T13:39:43.814449+0000, chain.objs.size()=1 2024-09-14T11:58:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SeIR1u2eBQG1Fu4Rz-Wc5hFArmC6bFD_0 2024-09-14T11:58:38.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17537759996917893734', time=2024-09-14T13:39:43.963960+0000, chain.objs.size()=1 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MgvX2Tf7g-KX59vkq645jB-ONV0HC81_0 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14738548203140050671', time=2024-09-14T13:39:44.045756+0000, chain.objs.size()=1 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.w3K5hdB7I0uK1NZuqV7MsygM83fuahb_0 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11226072446500534359', time=2024-09-14T13:39:44.140874+0000, chain.objs.size()=1 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nklZzn3b6t8_rR1taVFjSXbOyV0MULj_0 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11508709993403231841', time=2024-09-14T13:39:44.452432+0000, chain.objs.size()=1 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VJUgaMm2TvboCiz1t5FEhwKbmZ-tFvs_0 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14342747909404549723', time=2024-09-14T13:39:45.274043+0000, chain.objs.size()=1 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NpU_Gz7UQRkU3OyDfzYg4dXFYjjqzZQ_0 2024-09-14T11:58:38.129 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15363231229785774911', time=2024-09-14T13:39:45.550737+0000, chain.objs.size()=1 2024-09-14T11:58:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KsRTf9sQ2W3JC1pl8hXjQoDwn6oj0Fv_0 2024-09-14T11:58:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.573478335081331556', time=2024-09-14T13:39:46.166797+0000, chain.objs.size()=1 2024-09-14T11:58:38.130 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.131+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MD-GliQ32rG6lolYWbh0Q1qerDBserm_0 2024-09-14T11:58:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.133+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9423300908073240201', time=2024-09-14T13:39:46.266497+0000, chain.objs.size()=1 2024-09-14T11:58:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.133+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jMyHfrS2sm5QMNuwT_Kg007uuqxJC2f_0 2024-09-14T11:58:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.133+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1420503677994687597', time=2024-09-14T13:39:47.258072+0000, chain.objs.size()=1 2024-09-14T11:58:38.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.133+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iNXDPBU8u6Uw5LNbX5oXM6H2uh8GLUO_0 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7888755811960332433', time=2024-09-14T13:39:48.546072+0000, chain.objs.size()=1 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fBpTZJVZLf1Af9O3e1sbeleRszrPz12_0 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13645624821943654488', time=2024-09-14T13:39:48.983653+0000, chain.objs.size()=1 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gCU_iAVrZ9ISLdVqnhmjMkmMFFJEPwr_0 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14007704825191565628', time=2024-09-14T13:39:49.054345+0000, chain.objs.size()=1 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9SMLjEtW5lDg8fsTEqeP4tBzhWvwTpK_0 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15799621700170973225', time=2024-09-14T13:39:49.263391+0000, chain.objs.size()=1 2024-09-14T11:58:38.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.135+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6Ys6KzFpHJtSteGHJ8poKHq5MylZIoi_0 2024-09-14T11:58:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.136+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2981641551393783436', time=2024-09-14T13:39:49.545534+0000, chain.objs.size()=1 2024-09-14T11:58:38.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.136+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bp-XzeoJGmP8B43QO0j3dS9KgTsDbQ3_0 2024-09-14T11:58:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.137+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14384426660476441372', time=2024-09-14T13:39:49.612598+0000, chain.objs.size()=1 2024-09-14T11:58:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.137+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qRtCzgsOZ5q-VlQ8i7L9zMxtB6x3FUB_0 2024-09-14T11:58:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.137+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.961554247929458535', time=2024-09-14T13:39:50.648757+0000, chain.objs.size()=1 2024-09-14T11:58:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.137+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XEi9pInea9YXApWkACi_dhp7Kw_HM44_0 2024-09-14T11:58:38.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14300000514862168084', time=2024-09-14T13:39:50.759238+0000, chain.objs.size()=1 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.52uVjpp-W2wLseq32F3rpuJwNtyCa9x_0 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7993657798865082961', time=2024-09-14T13:40:30.796568+0000, chain.objs.size()=1 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Kf9pZ7oQ47yllxIa9gmJzGR-d6aR-Tl_0 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9025524849495814408', time=2024-09-14T13:40:31.198783+0000, chain.objs.size()=1 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.I4mREtSD4uE0xURc_cDpoWElDgAHBzm_0 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3837763034058977092', time=2024-09-14T13:40:31.234204+0000, chain.objs.size()=1 2024-09-14T11:58:38.136 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rYsvXy9WXxofFFs6E6pjPHoTnySlHSL_0 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15091598076505048509', time=2024-09-14T13:40:31.278182+0000, chain.objs.size()=1 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tX-McSJXx16t2WEFuCDMZOOHSE1kiFK_0 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17940681771526057554', time=2024-09-14T13:40:31.537046+0000, chain.objs.size()=1 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ccmOLv2NRnqRPinKLKgcOByPmgHHnvm_0 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16656862588922364885', time=2024-09-14T13:40:32.527205+0000, chain.objs.size()=1 2024-09-14T11:58:38.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.139+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zovILMt4nFr4H2vTf4iXnzLbgrYtBjM_0 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5608438412968864389', time=2024-09-14T13:40:32.527965+0000, chain.objs.size()=1 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QLbSLEWVG1AhHeJEYUoti9UDeQS7fyH_0 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.502305656018589790', time=2024-09-14T13:40:32.528585+0000, chain.objs.size()=1 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-uPgesMkY4oBa89aTpST84zaDyizdXy_0 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3283013509994515092', time=2024-09-14T13:40:33.603129+0000, chain.objs.size()=1 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vxegN7FFeU3s5dcFkHPAMMVlQtTrz_0_0 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1051832233493488911', time=2024-09-14T13:40:33.707180+0000, chain.objs.size()=1 2024-09-14T11:58:38.139 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.141+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.niXIaS_b1h9ykhCOrphIAqLsAILfpjB_0 2024-09-14T11:58:38.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15516050527446283575', time=2024-09-14T13:40:34.233803+0000, chain.objs.size()=1 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2HVO9uOvz9owpjbC8QUBz1EUKD3qHmS_0 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11123245320846078748', time=2024-09-14T13:40:34.234987+0000, chain.objs.size()=1 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tEHIV6qfHj47f_fBtTL7IztA3abON_l_0 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13936247037526165417', time=2024-09-14T13:40:34.608747+0000, chain.objs.size()=1 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._iFRPek4cxKnX3akxKb-_SDUYY8naow_0 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.171966965755749958', time=2024-09-14T13:40:34.858521+0000, chain.objs.size()=1 2024-09-14T11:58:38.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CoCNk6jKOjApuJPdlC0QFAucqmP6gBP_0 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2302477978009946409', time=2024-09-14T13:40:35.184957+0000, chain.objs.size()=1 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vd2wzNDbfD7W6uF4H_UAxmOjEZBuKBl_0 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13366340534721005041', time=2024-09-14T13:40:36.287074+0000, chain.objs.size()=1 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dRB_0SlgoZE__-2gOUoksSrVSjtvFUD_0 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12934818714153116407', time=2024-09-14T13:40:36.332597+0000, chain.objs.size()=1 2024-09-14T11:58:38.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.143+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eOuczIzZNS_jjAliVLXWuQO02vp7rBL_0 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4321980072568292027', time=2024-09-14T13:40:36.799423+0000, chain.objs.size()=1 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.f4pUo_co1eJOB1oR26Mj026Yw_3yfpK_0 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3987144993101685059', time=2024-09-14T13:40:37.059647+0000, chain.objs.size()=1 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.atWYUIbpCPrIbjFxTOijEz0ccpdNiHB_0 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6247891748013688024', time=2024-09-14T13:40:37.588117+0000, chain.objs.size()=1 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZtuwlF1W6MWi-Q1HBhWdZ0b_TRIg3ij_0 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12629573349787565168', time=2024-09-14T13:40:38.006706+0000, chain.objs.size()=1 2024-09-14T11:58:38.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xzzZQil22R1S0HX1NhLHrfTf0aUEJrg_0 2024-09-14T11:58:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13906118256861364016', time=2024-09-14T13:40:38.212659+0000, chain.objs.size()=1 2024-09-14T11:58:38.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8B5IfUHhYDN52AUVhRaap28h7o5NBm7_0 2024-09-14T11:58:38.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/56470 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2534495228351541997', time=2024-09-14T13:40:38.356271+0000, chain.objs.size()=1 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2FP4Mw-6at9hEpd0jWXI9Zpj6MCYTEf_0 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11221750099323496961', time=2024-09-14T13:40:38.727224+0000, chain.objs.size()=1 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EUGQGVVpLws5K7dFNBgDgquQSiSstx6_0 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11936081488022903348', time=2024-09-14T13:40:39.835872+0000, chain.objs.size()=1 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qYswfmoGze339wTn6mJHTrv3Cuaq30m_0 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8528447199577871571', time=2024-09-14T13:40:39.840780+0000, chain.objs.size()=1 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yXzfh8VAXMrlcGfrpLEYv0CeDvC0qqz_0 2024-09-14T11:58:38.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10182055141103536515', time=2024-09-14T13:40:39.841280+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5QX9BpmGvStNwe03nShD9QP2Skd0bHx_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4100063335055433048', time=2024-09-14T13:40:40.040465+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZxYIkCKubWlhTtKVEh8xKl-SPqJbbd1_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9661596277204563795', time=2024-09-14T13:40:40.277976+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GCQvwhlmaNPI3P_VT-8lya1_8LNlotY_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15530141695269572661', time=2024-09-14T13:40:40.697240+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nLvC_4XQmEaXeMqYHL4FHGBm3RVS_2o_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7980360592024307929', time=2024-09-14T13:40:40.741553+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nDzDXAgntpi39ovz5F9Qrqt8eUuuujz_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3492886867396168931', time=2024-09-14T13:40:41.234231+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Rrn1JMOyvr4DuEvZ8420sBSEDK1C-fu_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3651797880807051589', time=2024-09-14T13:40:41.603310+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.u0rIkwkwynD-MKNSfkB3oUEYM6lovFl_0 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6893419004620115289', time=2024-09-14T13:40:41.689970+0000, chain.objs.size()=1 2024-09-14T11:58:38.153 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JYw65hI3ZZhoKmC671jn5XHnB71GExL_0 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10084495816880622400', time=2024-09-14T13:40:42.370697+0000, chain.objs.size()=1 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bHg1j6CB4X-wW8KXzmwzBHC6tQCisdq_0 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17698307944696676931', time=2024-09-14T13:40:42.887264+0000, chain.objs.size()=1 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gQ21ibPLoSkWHWZicyeA-zv6QCh25Co_0 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12091600872363144220', time=2024-09-14T13:40:42.921940+0000, chain.objs.size()=1 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.R-BdYt7hxuii5YLy6u-OSmnG315IhGz_0 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10000210637491101744', time=2024-09-14T13:40:43.137232+0000, chain.objs.size()=1 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bo2G_Z9QQXq7fWkRVs-ppVfD8RPaMHt_0 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18060877848632929148', time=2024-09-14T13:40:47.518605+0000, chain.objs.size()=1 2024-09-14T11:58:38.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.332__shadow_.eDmUwJpzdLA4L7ie-vwuQ79gc6gwos-_0 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4806662506638312470', time=2024-09-14T13:40:50.127021+0000, chain.objs.size()=1 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.336__shadow_.ypBAAsCqzyMwRYUZvDriljdjbWGMgwn_0 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6972830444616269461', time=2024-09-14T13:41:24.076481+0000, chain.objs.size()=1 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.391__shadow_.7URVIwUsx-7vb_PWYhmkCVCu3PdJiI1_0 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16064253355576863124', time=2024-09-14T13:42:53.480150+0000, chain.objs.size()=6 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.158+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.159+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:38.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.159+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:38.158 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.159+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11935253467683187908', time=2024-09-14T13:43:03.189882+0000, chain.objs.size()=1 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.519__multipart_mymultipart.2~dU5RbsT2ZFgwM5LB5laSLVR_0H40H7_.1 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5280359604005364948', time=2024-09-14T13:44:42.047087+0000, chain.objs.size()=3 2024-09-14T11:58:38.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~SZQivPIyyGEMrmcK6Db6-EQq64v20xq.1 2024-09-14T11:58:38.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.162+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~SZQivPIyyGEMrmcK6Db6-EQq64v20xq.2 2024-09-14T11:58:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.164+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~SZQivPIyyGEMrmcK6Db6-EQq64v20xq.3 2024-09-14T11:58:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.164+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13192391258541983107', time=2024-09-14T13:44:51.867195+0000, chain.objs.size()=3 2024-09-14T11:58:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.164+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~tbdAejFpRHt3m9IJPoQv0Mau2gGXv5b.1 2024-09-14T11:58:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.164+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~tbdAejFpRHt3m9IJPoQv0Mau2gGXv5b.2 2024-09-14T11:58:38.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.164+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~tbdAejFpRHt3m9IJPoQv0Mau2gGXv5b.3 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8218057188636791092', time=2024-09-14T13:46:01.414520+0000, chain.objs.size()=1 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.556__shadow_.RiV4pnKIldRVQGy9Lbv_cwKOoVKrfZr_0 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13621622724779120086', time=2024-09-14T13:46:13.875937+0000, chain.objs.size()=1 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.561__shadow_.1Xp3ok8dkYQIjVebnBXYFB3vRhDSOSg_0 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11160314369852817522', time=2024-09-14T13:46:14.969876+0000, chain.objs.size()=1 2024-09-14T11:58:38.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.562__multipart_mymultipart.lO1yZ-OCSycDPs9xlf7wPTgrdkKR_FmH.1 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9398153065729434944', time=2024-09-14T13:46:38.269008+0000, chain.objs.size()=1 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.571__shadow:jjbElxF647TgB4hVyFFo5qZtjxM8Pfr_.1K8KFYUU1rkh_8Ev44B_ejqErZLa2NZ_0 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3415635716218363628', time=2024-09-14T13:52:33.094890+0000, chain.objs.size()=1 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.665__shadow_.01tBXLIq0yvnBSeDV86At4xg5fkTBsq_0 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13973497387111148263', time=2024-09-14T13:54:24.917208+0000, chain.objs.size()=1 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.751__shadow_.hBB4NE6YOgvVmqgnKBzJS4Brnjs5ON3_0 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.166+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.158103699270551850', time=2024-09-14T13:55:53.669546+0000, chain.objs.size()=1 2024-09-14T11:58:38.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.166+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.772__shadow_.Sdf1_Mz34s9Kb-SId5VMUPXe8p1ZBgL_0 2024-09-14T11:58:38.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.168+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12497829990944170482', time=2024-09-14T13:56:18.193954+0000, chain.objs.size()=1 2024-09-14T11:58:38.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.168+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.779__shadow_.0qxMR3q-tDtTt4AVZfhWd_rspBG9Brc_0 2024-09-14T11:58:38.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.172+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.175+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:58:38.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.176+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.174 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48784' 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_Yii14UhpocyowmRqUvl4k_ybTX__ajA', time=2024-09-14T13:34:33.165273+0000, chain.objs.size()=3 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.kFWDAnSX_X06W49txFcMqkTT6u989jk_0 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.kFWDAnSX_X06W49txFcMqkTT6u989jk_1 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.kFWDAnSX_X06W49txFcMqkTT6u989jk_2 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14380431311045898637', time=2024-09-14T13:37:01.297189+0000, chain.objs.size()=1 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.239__shadow_.UDivnbLWGF-LUJCxuzlGtw1XUbzMbXW_0 2024-09-14T11:58:38.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.177+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17194660111632380376', time=2024-09-14T13:37:13.458202+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.255__shadow_.bc8I5mM_bmRWKKFCJBqzBuUDYPuD0PI_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4187852316054274298', time=2024-09-14T13:37:58.033272+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NsS0I-aUJkxjiCnUXaF4AhJiv9AvBNU_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8336995567070776035', time=2024-09-14T13:37:58.859893+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vNCIYSktjG1uOOONEWVBFue1w79q75Q_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7550067478873173640', time=2024-09-14T13:37:58.921157+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TKjx_DDSkneehCoUn4hcIaTpRIfaliz_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6857938994278690601', time=2024-09-14T13:37:59.466625+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._XeyOXK5PHrBh5HfdXIv9IvZySsDMk__0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11599982711914661306', time=2024-09-14T13:37:59.742465+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wG2cgyfcRDexHRWGvn0PFnIRTTY1Jah_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18216664886692146481', time=2024-09-14T13:38:02.006039+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DBYI8dyb1A9KP4ohHwmdIYfEbBzL3oC_0 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2656357505962487614', time=2024-09-14T13:38:03.500263+0000, chain.objs.size()=1 2024-09-14T11:58:38.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AT9wu2wNWlGc78DK239-HY6q9dvcSxC_0 2024-09-14T11:58:38.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.180+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12249256227226570577', time=2024-09-14T13:38:05.485540+0000, chain.objs.size()=1 2024-09-14T11:58:38.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.180+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EaXG83rhjm8CY5grvhBZX7M8ZXGsNRl_0 2024-09-14T11:58:38.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.182+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7044501541354165709', time=2024-09-14T13:38:05.549199+0000, chain.objs.size()=1 2024-09-14T11:58:38.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.182+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gaJvr6VNbBG1jEn8SVqwn14tfHfxLIQ_0 2024-09-14T11:58:38.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.182+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16295107352168011354', time=2024-09-14T13:38:05.606513+0000, chain.objs.size()=1 2024-09-14T11:58:38.180 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.182+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xXqqsWHX7h1wTH1-jJrbB8FWhaPL53l_0 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10962130971970283642', time=2024-09-14T13:38:06.139138+0000, chain.objs.size()=1 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jIbclwNs5hz82JvXtDnr48R-H2cVd43_0 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11675786971777171111', time=2024-09-14T13:38:06.449611+0000, chain.objs.size()=1 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0nbl1UXl13SmuIqECahCCQKHI3qD8XI_0 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7412506135424663411', time=2024-09-14T13:38:06.913885+0000, chain.objs.size()=1 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aQ6JXVEofq7fs7Y8PI4tAKZrfZShSYm_0 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9358757844231888928', time=2024-09-14T13:38:07.097331+0000, chain.objs.size()=1 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5Tlm193Lk7P1BZ-TL9OkyM8G8B_D3ve_0 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14878310773208045308', time=2024-09-14T13:38:07.902880+0000, chain.objs.size()=1 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Glkp61bsFQmPxQuSCDJhCjrjll9CfJr_0 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7643918896601212682', time=2024-09-14T13:38:08.105109+0000, chain.objs.size()=1 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.q3wf5QDxVefQVy_MaeSbFANbmn9nf-D_0 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1405425725123175975', time=2024-09-14T13:38:08.118222+0000, chain.objs.size()=1 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oQDT51OCXI6guwmS0OPnpru00NVJRFN_0 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15990827291403651292', time=2024-09-14T13:38:08.230549+0000, chain.objs.size()=1 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.X6tHezi-f4gHwJhp9EvpGQVJrgwu5Em_0 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3231540977878606536', time=2024-09-14T13:38:09.053986+0000, chain.objs.size()=1 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PM2AH2ZKj3KXVZdhGr0Ovm-ps44e6xu_0 2024-09-14T11:58:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.187+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9741717019420373855', time=2024-09-14T13:38:10.300966+0000, chain.objs.size()=1 2024-09-14T11:58:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.187+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qvdASQrsAHhF8M6C-TzrInKPNMnKppB_0 2024-09-14T11:58:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.187+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3894266139673868787', time=2024-09-14T13:38:19.435411+0000, chain.objs.size()=1 2024-09-14T11:58:38.185 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.187+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.276__shadow_.1UwtWna7FZzWL0Bcb4dRVpnk6-w1ySf_0 2024-09-14T11:58:38.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.188+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9038498941270913801', time=2024-09-14T13:38:20.946824+0000, chain.objs.size()=1 2024-09-14T11:58:38.186 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.188+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.278__shadow_.fvVpfljeB_S68IcaCF5Ap4Hq0TmJvF6_0 2024-09-14T11:58:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6383896192288680571', time=2024-09-14T13:38:22.402599+0000, chain.objs.size()=1 2024-09-14T11:58:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.280__shadow_.DqJuR5E2Uzf1YsnJbQeYOoTL8Jn3hAE_0 2024-09-14T11:58:38.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9436354753720163108', time=2024-09-14T13:38:33.536727+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.Cix3FtrAhHYE9vt3Zyn5PbaCE80U0Ju_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10935577085917316206', time=2024-09-14T13:38:35.714150+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_._2Dol1JZztrWYeA0Gq2j3SAKO9trBqf_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2487796497400418664', time=2024-09-14T13:38:43.241229+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.304__shadow_.lK3HoOwQlKMYS3xnQ1pSHCzZfgMIQk2_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16686017499606684898', time=2024-09-14T13:38:57.862071+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.323__shadow_.RT7WVpIBPQlR8LZaTAYk9BB7aKthFtP_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10317856161250618184', time=2024-09-14T13:39:38.544241+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VoZJTImULcW5KwYXpTPCzWxyUvvVV5N_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.172916964121212604', time=2024-09-14T13:39:39.132546+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hO1ZdbOJElXsbISV_0QWaZO3fRyuXOc_0 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8814502806986786363', time=2024-09-14T13:39:39.521273+0000, chain.objs.size()=1 2024-09-14T11:58:38.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TbvDhOP8-QxG9ApEe0dFMB8oxqfh9HV_0 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11639206874263623607', time=2024-09-14T13:39:39.631081+0000, chain.objs.size()=1 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WP8WUV1VUnRn_qhSSmrGhZYFJOpxsxc_0 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11171888682177542525', time=2024-09-14T13:39:39.720053+0000, chain.objs.size()=1 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uQNw6BaXjZYE6O9k_bbwbf5INX3zc2I_0 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16715605172434793018', time=2024-09-14T13:39:40.656864+0000, chain.objs.size()=1 2024-09-14T11:58:38.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.193+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uiAuEQR4AxdydX527cYdwlBEdDd0fT2_0 2024-09-14T11:58:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.194+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17201038535873267106', time=2024-09-14T13:39:40.862414+0000, chain.objs.size()=1 2024-09-14T11:58:38.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.194+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hyFxj85_DlwNUHj-YRTkSybBx_A8sPb_0 2024-09-14T11:58:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13461313065798102222', time=2024-09-14T13:39:42.213664+0000, chain.objs.size()=1 2024-09-14T11:58:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AEAoPg4PXNCkN1Kim-NqBinUWDc6D_I_0 2024-09-14T11:58:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12037009018529035184', time=2024-09-14T13:39:42.235292+0000, chain.objs.size()=1 2024-09-14T11:58:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.f-INefEwF7ZgC40Q-J86brM7b5wTCPR_0 2024-09-14T11:58:38.193 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4967486678810380051', time=2024-09-14T13:39:42.309593+0000, chain.objs.size()=1 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Zl40pkHcVYftMY2dVSmqn6br1PZmBhy_0 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3073797045063978482', time=2024-09-14T13:39:42.858413+0000, chain.objs.size()=1 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.F14SErMgdO1hm0yXnuLQ-pNjIjL0HI6_0 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5580499414893616553', time=2024-09-14T13:39:43.154159+0000, chain.objs.size()=1 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Nx8vYuyMKJ8aasuGGDJrP940Jnpmjs6_0 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1079331324690907897', time=2024-09-14T13:39:43.180601+0000, chain.objs.size()=1 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VHdjsSWYiOEsOogz8y-3C--P9xSCE2w_0 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10207906255485742442', time=2024-09-14T13:39:43.822996+0000, chain.objs.size()=1 2024-09-14T11:58:38.194 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.195+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cw6PXKar05ZjrRfg3yTG3qz-23Wslr1_0 2024-09-14T11:58:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10344940065447939609', time=2024-09-14T13:39:44.449914+0000, chain.objs.size()=1 2024-09-14T11:58:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.twPiXSpgY7uTt9fTwZa7d4Z8187zNRR_0 2024-09-14T11:58:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1304461077219231293', time=2024-09-14T13:39:44.504841+0000, chain.objs.size()=1 2024-09-14T11:58:38.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XXFd7FA-N3eSMIWM22K2_fXGV0V9JmA_0 2024-09-14T11:58:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4683480660866429272', time=2024-09-14T13:39:44.533796+0000, chain.objs.size()=1 2024-09-14T11:58:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.F6FGZj0NSTyPoe31jBj4ABKWfmzjnSM_0 2024-09-14T11:58:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.198+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3675737322498369263', time=2024-09-14T13:39:44.605340+0000, chain.objs.size()=1 2024-09-14T11:58:38.196 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.198+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WFtDIUufWvMZ3-qLu0jH-BtILeltJs9_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10339677572637534735', time=2024-09-14T13:39:44.665705+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ONCyJrzZh2-FpEnkKY_JHToG0SI167t_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1440154544101108557', time=2024-09-14T13:39:45.302938+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TzuryDPaRK23_v7fhNo2Qeu2MOqGJME_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12261062592007762207', time=2024-09-14T13:39:45.413994+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.EUjyHnNelOybHR1tLmrMLlv7lKtdHtZ_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8972496073194026335', time=2024-09-14T13:39:45.629928+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CbDYxvkt7TaU_6cY3Ree4GoNJxCVdQW_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4436699151634493583', time=2024-09-14T13:39:45.765164+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LMTAaNEMazSIY8_lpNnxWB7I0Uz_0cK_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8575554793140275186', time=2024-09-14T13:39:45.793841+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OKdyLIh5TSLqzv0FoJX-AtGFzaSPWbE_0 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2681532297289477568', time=2024-09-14T13:39:45.896419+0000, chain.objs.size()=1 2024-09-14T11:58:38.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.J3WLF0v0dsknvwKhRK5PVhmoDmtUbxf_0 2024-09-14T11:58:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5544079589633894151', time=2024-09-14T13:39:46.017757+0000, chain.objs.size()=1 2024-09-14T11:58:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.200+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zxFgoqbnA0Cc0m7FHSxeAch7ThZdq9p_0 2024-09-14T11:58:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.301654195995301246', time=2024-09-14T13:39:46.374001+0000, chain.objs.size()=1 2024-09-14T11:58:38.200 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-TkdKz4RYhFtJpo3YYdT4Wi-Z_pHwXv_0 2024-09-14T11:58:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17437203960367642721', time=2024-09-14T13:39:46.446830+0000, chain.objs.size()=1 2024-09-14T11:58:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QFlkRmgv6pBQJhNdXg3jRvf-zhyAlZN_0 2024-09-14T11:58:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10127302606990533113', time=2024-09-14T13:39:46.889096+0000, chain.objs.size()=1 2024-09-14T11:58:38.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.a0AJzgkL6nadJ2CPRkcrzYcIX67uGCy_0 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.659351391338387613', time=2024-09-14T13:39:47.622967+0000, chain.objs.size()=1 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lH7SVg4iOdv9GNpW9wXUlSZ5-C7T2ni_0 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8070477985356962512', time=2024-09-14T13:39:47.705612+0000, chain.objs.size()=1 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PagcjrP8FpcF-B76gEhvBtM_vraMRGc_0 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9546578347680288241', time=2024-09-14T13:39:48.405625+0000, chain.objs.size()=1 2024-09-14T11:58:38.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.204+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.w9tCWERH0Ui-cVk-NcW7RwTucezD4Nx_0 2024-09-14T11:58:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.205+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.603908558237220114', time=2024-09-14T13:39:48.462010+0000, chain.objs.size()=1 2024-09-14T11:58:38.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.205+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WdyR3Sk-r6b266G4JO2dJ2wWaXNg3K8_0 2024-09-14T11:58:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10794778778528272898', time=2024-09-14T13:39:48.790184+0000, chain.objs.size()=1 2024-09-14T11:58:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4zjt9KzeCYV-L5v61HNalgD0npIconn_0 2024-09-14T11:58:38.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5162157697966784055', time=2024-09-14T13:39:49.191950+0000, chain.objs.size()=1 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Y4fmoUkNNF0enbswlHpFd-awwTTuZ76_0 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8122001855618717292', time=2024-09-14T13:39:49.402897+0000, chain.objs.size()=1 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.yMcWLEHY8bhvE9sfqGoOEtWRAk7WpJS_0 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14048946005866121291', time=2024-09-14T13:39:50.621972+0000, chain.objs.size()=1 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hnFryg3yFwKnnyL9Hv5pWqa0p1UaSte_0 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10187119982267248175', time=2024-09-14T13:40:30.782625+0000, chain.objs.size()=1 2024-09-14T11:58:38.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rDfdlWgAtEgXtTg4l-RqNGGrhhLM9zt_0 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12041032781538054756', time=2024-09-14T13:40:31.122043+0000, chain.objs.size()=1 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0LqpP9-aWFGaBMGLHbLLP9qUj7xqaHF_0 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16978862616530718751', time=2024-09-14T13:40:31.349338+0000, chain.objs.size()=1 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eQHQ5mDe8qmeG5fTQCSkEPTdefwfMm__0 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7039830210320995834', time=2024-09-14T13:40:31.459380+0000, chain.objs.size()=1 2024-09-14T11:58:38.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nzGZfSdjGDdgLFgaMQ1F60xwldT-K3M_0 2024-09-14T11:58:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16639880503234072299', time=2024-09-14T13:40:31.626593+0000, chain.objs.size()=1 2024-09-14T11:58:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.25pG8gqx5xjnzI_K1lC-xKMtnHL6m_H_0 2024-09-14T11:58:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15401981941299832502', time=2024-09-14T13:40:31.712115+0000, chain.objs.size()=1 2024-09-14T11:58:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gGnViObf5CGHhKM5wQBPtijK7W0TWXc_0 2024-09-14T11:58:38.207 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14025564748935082348', time=2024-09-14T13:40:31.908338+0000, chain.objs.size()=1 2024-09-14T11:58:38.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.209+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.87tkY0eiMk17_bpIc4W_Sz9nF9PKw9d_0 2024-09-14T11:58:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.211+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16290227924045928067', time=2024-09-14T13:40:33.111737+0000, chain.objs.size()=1 2024-09-14T11:58:38.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.211+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Gvgopa90SVU9WHuDG81hDopqcClnT7a_0 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10531533938112522628', time=2024-09-14T13:40:33.208065+0000, chain.objs.size()=1 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8EorRSRU5VxhCE6Gxyn0ebvJzb9WxNA_0 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14610478994231910351', time=2024-09-14T13:40:33.492191+0000, chain.objs.size()=1 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nH7fgj8KTtYLlXJJA9Ie1WusWbrBecU_0 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11770304153300698725', time=2024-09-14T13:40:33.590623+0000, chain.objs.size()=1 2024-09-14T11:58:38.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AhXDXwmHWH_cjnhvPGGSC-C5xyRGBwH_0 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12995817208236547334', time=2024-09-14T13:40:33.704169+0000, chain.objs.size()=1 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4UtCQNdgnZrbpVNjrkpJfFdb1O9Upyu_0 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16481003912107950778', time=2024-09-14T13:40:33.749408+0000, chain.objs.size()=1 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yjwVktrAKjAytyz6R3ZKj5pKiko4iG4_0 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4417343079357774098', time=2024-09-14T13:40:34.420064+0000, chain.objs.size()=1 2024-09-14T11:58:38.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.213+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3bQQoHEep_1QD8loebubufWNWOqoUOK_0 2024-09-14T11:58:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.214+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5525675495718038172', time=2024-09-14T13:40:34.780591+0000, chain.objs.size()=1 2024-09-14T11:58:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.214+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mr9Z1yVlnO7kttMQ_GHfh_PMawr00mH_0 2024-09-14T11:58:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.214+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14978271823282737723', time=2024-09-14T13:40:35.382797+0000, chain.objs.size()=1 2024-09-14T11:58:38.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.214+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XABRR2Pf_BLt_UiQXWiQQFAxVsTXuuZ_0 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11754634385811814392', time=2024-09-14T13:40:36.021817+0000, chain.objs.size()=1 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pwamirHvDxG4exZHcp6CFCihpVIzAoz_0 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12053626542392892425', time=2024-09-14T13:40:36.889956+0000, chain.objs.size()=1 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jdd-C9pfm8A1O7fMMi5nR8gOjK6HDrX_0 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.386834801468756106', time=2024-09-14T13:40:37.516668+0000, chain.objs.size()=1 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.216+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LgmodXGRQt_RngwNWOwjGLtAM6LQunn_0 2024-09-14T11:58:38.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16500888583031208013', time=2024-09-14T13:40:37.679669+0000, chain.objs.size()=1 2024-09-14T11:58:38.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xZYrANq8HyqmmcBCpuH-eD2L9ohAerh_0 2024-09-14T11:58:38.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11798269209146443263', time=2024-09-14T13:40:38.288212+0000, chain.objs.size()=1 2024-09-14T11:58:38.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ckw8bouF1hBXALhdMtSYbBm3uo-dh51_0 2024-09-14T11:58:38.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16820300380815925082', time=2024-09-14T13:40:38.321828+0000, chain.objs.size()=1 2024-09-14T11:58:38.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dYJx1Yi2ELq7dT5Ew966wkvHZt9nEHP_0 2024-09-14T11:58:38.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11861383291826277058', time=2024-09-14T13:40:38.399115+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xrMH0ROBksI-IKcSQo1C6R6IfJg4ufS_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6662385453368574470', time=2024-09-14T13:40:38.641989+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0Rjc8kDfgyZHeISl6SyY4cMxpxB_9lH_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1597884775862846471', time=2024-09-14T13:40:38.711791+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WIBlhxK4peVAFnUcX6IwJQmkiWSOdDb_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10348884761785280627', time=2024-09-14T13:40:39.609556+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cOUnbJ9IfFJsjH8mlgaFBznVLdmmJUx_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10771380105368560125', time=2024-09-14T13:40:39.705839+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.W9OwAks32ujZGqiZROrKzuQ0jpu93-S_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16232318465481792155', time=2024-09-14T13:40:40.238693+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4fE6VvfhEyuuF9G4KE3ugDvf2w04Wip_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8061777331436083442', time=2024-09-14T13:40:40.321125+0000, chain.objs.size()=1 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nfnwyoXJFeL1-1FtSfs7Vjk49F1xlbV_0 2024-09-14T11:58:38.218 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5497635337486451318', time=2024-09-14T13:40:40.731160+0000, chain.objs.size()=1 2024-09-14T11:58:38.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.220+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0ex5HT0T8j7rp_avPkt1a60zMQWHVHP_0 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6382286125298947515', time=2024-09-14T13:40:40.808571+0000, chain.objs.size()=1 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.W3p3tVtD0sJHiprjor4mSbe4RxvQb2Q_0 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15640601054714464464', time=2024-09-14T13:40:40.988576+0000, chain.objs.size()=1 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5WVzoUqFWct24n1K3CPuwYUrIidEkO9_0 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1861732421803287906', time=2024-09-14T13:40:41.214441+0000, chain.objs.size()=1 2024-09-14T11:58:38.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.223+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HQf3_FjJftoQaB7PvO_WtiIS448lEhy_0 2024-09-14T11:58:38.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/48784 2024-09-14T11:58:38.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:58:38.227 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9245063668346950658', time=2024-09-14T13:40:41.484320+0000, chain.objs.size()=1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.37ve4-XVeKTX8N8aBbmIBamwWKNvQec_0 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14541177805979080755', time=2024-09-14T13:40:42.206610+0000, chain.objs.size()=1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lc7_-tDpRkXwGkMMs1MI9c0e27IEu5G_0 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15010722223737402812', time=2024-09-14T13:40:42.447188+0000, chain.objs.size()=1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jnUcmlFkI-5lQbERLvyA6OwhXaNS23P_0 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5143521959619564325', time=2024-09-14T13:42:34.223993+0000, chain.objs.size()=1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.490__shadow_.MVA7ttsXPfFxkfj65zWBlgr056ZO9pZ_0 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4506212699764635796', time=2024-09-14T13:42:40.933612+0000, chain.objs.size()=1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.500__shadow_.SR76uI-_axL6PPaJAQXqH0ebhh_sI35_0 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14571672215776025836', time=2024-09-14T13:44:33.911906+0000, chain.objs.size()=6 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.Hll-3ZO9ecj5TkHDgJYUi9j0or8S8kEV.1 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.zq8w5xaqIX4MIS2DpNASopptkwmMkj3I.2 2024-09-14T11:58:38.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.UWBycUZ5q0_0A7fzOx6mBZaybXrIh6nE.3 2024-09-14T11:58:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.y-8zNIAnWjH-MF6MjUuPxmiHf9yryAQH.4 2024-09-14T11:58:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.8TxjOdwnF6Ku_ai_P4mv1t1UDUY9STqi.5 2024-09-14T11:58:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.szOflMQgYjiUKg-JbDRKJ4p9t3CW_gmf.6 2024-09-14T11:58:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj', time=2024-09-14T13:44:53.807834+0000, chain.objs.size()=10 2024-09-14T11:58:38.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.229+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.1 2024-09-14T11:58:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.232+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.2 2024-09-14T11:58:38.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.3 2024-09-14T11:58:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.4 2024-09-14T11:58:38.231 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.233+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.5 2024-09-14T11:58:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.6 2024-09-14T11:58:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.7 2024-09-14T11:58:38.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.8 2024-09-14T11:58:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.9 2024-09-14T11:58:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.527__multipart_mymultipart.2~q6fMjLQ5OWvcPH4TIKzsLfqd43tJNlj.10 2024-09-14T11:58:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15015458087159185337', time=2024-09-14T13:45:48.469633+0000, chain.objs.size()=1 2024-09-14T11:58:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.551__shadow_.GySmhZH3z5U7WMoTIrXoXKrlNbtfsCz_0 2024-09-14T11:58:38.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6281458724148954063', time=2024-09-14T13:47:11.752147+0000, chain.objs.size()=1 2024-09-14T11:58:38.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:sqXqsyPUEHojDFlgh8VdQpEHgEYVLBU_.Ba3fL6yyY53570rAYlP3toGroRKFzcw_0 2024-09-14T11:58:38.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.236+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3548188083579963345', time=2024-09-14T13:47:46.577271+0000, chain.objs.size()=1 2024-09-14T11:58:38.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.236+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.597__shadow_.xBlYts-tjXxFTn89y731O9VNXJgeB6s_0 2024-09-14T11:58:38.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.236+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17928062191273273466', time=2024-09-14T13:51:06.181585+0000, chain.objs.size()=1 2024-09-14T11:58:38.234 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.236+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.619__shadow_.zAydLOxU4XXkJxIzIDTpLqMvUnNrHMn_0 2024-09-14T11:58:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q', time=2024-09-14T13:51:36.039919+0000, chain.objs.size()=12 2024-09-14T11:58:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.1 2024-09-14T11:58:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.1_1 2024-09-14T11:58:38.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.2 2024-09-14T11:58:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.2_1 2024-09-14T11:58:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.3 2024-09-14T11:58:38.237 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.3_1 2024-09-14T11:58:38.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.240+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.4 2024-09-14T11:58:38.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.240+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.4_1 2024-09-14T11:58:38.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.5 2024-09-14T11:58:38.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.5_1 2024-09-14T11:58:38.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.242+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__multipart_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.6 2024-09-14T11:58:38.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.625__shadow_multipart_enc.2~oJX1KqAX1hr_tQxo0q5L_4Fz_m2Ql8q.6_1 2024-09-14T11:58:38.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1701600393322273549', time=2024-09-14T13:51:58.171377+0000, chain.objs.size()=1 2024-09-14T11:58:38.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.645__shadow_.yUC-majxGDTd9R-13fSvTsVDVssftJ7_0 2024-09-14T11:58:38.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14379005291287505846', time=2024-09-14T13:52:06.630353+0000, chain.objs.size()=2 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.650__shadow_.CvDMZILrlWvQZNQrM3DRUUYziOEyfU3_0 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.244+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.650__shadow_.CvDMZILrlWvQZNQrM3DRUUYziOEyfU3_1 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.244+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12490913589922284557', time=2024-09-14T13:52:35.208856+0000, chain.objs.size()=1 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.244+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.667__shadow_.1Qc2ciRLSfhpBvUqVzVM4laY3wqDDla_0 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.244+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17382136366463162883', time=2024-09-14T13:53:03.297435+0000, chain.objs.size()=1 2024-09-14T11:58:38.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.244+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.711__shadow:Ly7aA55krIyCRAG14XfD-tRCPYelTyC_.SkWfE4AL7hV021oGaWlv_IQTuRSLYcT_0 2024-09-14T11:58:38.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.249+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.249 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.251+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:58:38.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.253+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.251 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.253+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47916' 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3953263884895138280', time=2024-09-14T13:34:21.960401+0000, chain.objs.size()=1 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.158__shadow:jji7Y.j-HLpqnTWieut9w4ZMTFSJDgS_.bzoqWOw9HskwbIG-ODQOJ2b8Bpbt128_0 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8721622869071241326', time=2024-09-14T13:36:59.219163+0000, chain.objs.size()=1 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.237__shadow_.NTZfhxmiDkO-cZ1Q6U-4ENDuJoTIlLt_0 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13873101792467258139', time=2024-09-14T13:37:02.483279+0000, chain.objs.size()=1 2024-09-14T11:58:38.252 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.241__shadow_.sjofvfMSmoc5kEFEalZ4qzhEuiDVogh_0 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10578220567898593306', time=2024-09-14T13:37:03.223923+0000, chain.objs.size()=1 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.242__shadow_.8jhhOoFVdNEmHovLkw9LIiy03G5t_BT_0 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6182529255981916958', time=2024-09-14T13:37:09.761250+0000, chain.objs.size()=1 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.250__shadow_.g9xIDkl-BAvAJHiX1jOmONtV7FkgqqV_0 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2255891123242422564', time=2024-09-14T13:37:11.233762+0000, chain.objs.size()=1 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.252__shadow_.i_A8-lOJ71i0D9kHaUqioBWmc_W1kFS_0 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8994433999365520854', time=2024-09-14T13:37:14.903630+0000, chain.objs.size()=1 2024-09-14T11:58:38.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.257__shadow_.7hbQrYSYoXvQ_D3cmdOQK_ULuXXW7KQ_0 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8450151822009726888', time=2024-09-14T13:37:57.932842+0000, chain.objs.size()=1 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.czotlDG69m1ULrKoJGMR37hYadrpOPl_0 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8283982237739746391', time=2024-09-14T13:37:58.248243+0000, chain.objs.size()=1 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PEyYhRLgqVL4qSUpPKRzrHmYu4TGVMp_0 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10376105755969037019', time=2024-09-14T13:37:58.621201+0000, chain.objs.size()=1 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PTCdYpMejNYpD477RCIPmfbbx9cd3VK_0 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1446359037985289105', time=2024-09-14T13:37:58.728817+0000, chain.objs.size()=1 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zEF5ib7d723aEfWptwPprdbheu5W-pv_0 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1577838153340426694', time=2024-09-14T13:37:59.465154+0000, chain.objs.size()=1 2024-09-14T11:58:38.256 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.254+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ux4m78iB-2LLCuHD2KyEb4lUXLI5JyP_0 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.257+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4818596192426378370', time=2024-09-14T13:37:59.734576+0000, chain.objs.size()=1 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.257+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oqw0DsuCPjearCDPhrDsXpA5aFbhgW8_0 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.257+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4458556857926549481', time=2024-09-14T13:38:00.006367+0000, chain.objs.size()=1 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.257+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7Ii76yi-bxNPr0v4EGcYpypwkkqTWtc_0 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11347679886675207019', time=2024-09-14T13:38:00.234157+0000, chain.objs.size()=1 2024-09-14T11:58:38.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rxh9rwxlf0uPCm4mS5qoKFek0t-S4eS_0 2024-09-14T11:58:38.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7972807916683170834', time=2024-09-14T13:38:00.268874+0000, chain.objs.size()=1 2024-09-14T11:58:38.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.G1N2ylsQ67wta6hCdnUEBKOlkmwFnN6_0 2024-09-14T11:58:38.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4364087155490554050', time=2024-09-14T13:38:00.364017+0000, chain.objs.size()=1 2024-09-14T11:58:38.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9R10t-lYfN0F1U7MVUHu4Ldc6UpxAJf_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5645989492074800802', time=2024-09-14T13:38:00.722718+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MyZcnQ3uo5UXO31OGUyYwb-XfnzMYiZ_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12134562419945699925', time=2024-09-14T13:38:01.267403+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZW_XnQiTnfOuegv5WbtuW-3QYv6Z_mE_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3473091684964305465', time=2024-09-14T13:38:03.102610+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6n0qPrDzuRMk6Tqa1ZqwKkldRtxHuwm_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6502163375898548111', time=2024-09-14T13:38:03.103357+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AoKFb4SOzUgDytMCfsLBxyAmSYrhQYa_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10809006649787915411', time=2024-09-14T13:38:03.656220+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._Sc6EYtpQw3HMmN94S8pGtLi6fO2Xzk_0 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6435066931870928131', time=2024-09-14T13:38:03.731826+0000, chain.objs.size()=1 2024-09-14T11:58:38.259 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.260+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.D4pnmLb6VdIaazw3gWnEMzj8kmFTTZH_0 2024-09-14T11:58:38.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.261+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10224759978629441053', time=2024-09-14T13:38:05.287415+0000, chain.objs.size()=1 2024-09-14T11:58:38.260 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.261+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.s3JaJzm9O6XtDJA6V7PX3w2pdSS_ueT_0 2024-09-14T11:58:38.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.263+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6976764493646364505', time=2024-09-14T13:38:06.488333+0000, chain.objs.size()=1 2024-09-14T11:58:38.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.263+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iM2iD1d2gPk5Je-ZiShJZVDQQZNk_TW_0 2024-09-14T11:58:38.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.264+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9322229136404181714', time=2024-09-14T13:38:06.740948+0000, chain.objs.size()=1 2024-09-14T11:58:38.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8vxgW6Rsb5TCXCROmWiSVh096R01od0_0 2024-09-14T11:58:38.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.264+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1661277559003986959', time=2024-09-14T13:38:06.983323+0000, chain.objs.size()=1 2024-09-14T11:58:38.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iD7O2E44-tOgP2KZKWtITWneYw_c38O_0 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2395132950220519719', time=2024-09-14T13:38:07.361806+0000, chain.objs.size()=1 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Hl1SBH5p6WF0afejy51q2Bac1q1H_RC_0 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4028055791569032131', time=2024-09-14T13:38:07.378149+0000, chain.objs.size()=1 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wks6PXm2M-QvML9s7diuQIcm_yReRU6_0 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13344157065495198149', time=2024-09-14T13:38:09.053432+0000, chain.objs.size()=1 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v_qoEJdCP0fojnmFPUR4U5VB2a5etMN_0 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10512739222454267761', time=2024-09-14T13:38:09.905934+0000, chain.objs.size()=1 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.w2QlsrC0RrZwb9HKG8XnUu7VOKt4Iqp_0 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8218388500711695832', time=2024-09-14T13:38:10.134244+0000, chain.objs.size()=1 2024-09-14T11:58:38.264 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-miG170moczC-mY3aEYCdpwgip3_8Y1_0 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2653085960822193488', time=2024-09-14T13:38:10.245914+0000, chain.objs.size()=1 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9J6151J5PXuibncDnTozcUuGSEvVDoP_0 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3284430029210903811', time=2024-09-14T13:38:10.299048+0000, chain.objs.size()=1 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v479kZlDyuBXAjpbWeI3U_4wSrT_X6S_0 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12102854618705231295', time=2024-09-14T13:38:10.337109+0000, chain.objs.size()=1 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.266+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.--VpQ_BZlnSL8f4zu8Vk83v3N4WJfBe_0 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10617574825825015153', time=2024-09-14T13:38:11.857156+0000, chain.objs.size()=1 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.265__shadow_.YrxKnnNjyCcaiF9cWH0HWk6iuC4TvFF_0 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3977998595396762691', time=2024-09-14T13:38:22.402619+0000, chain.objs.size()=1 2024-09-14T11:58:38.265 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.280__shadow_.PfwCybh7egXXsltmNEMV214D_2yJZ0k_0 2024-09-14T11:58:38.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12926063938925820831', time=2024-09-14T13:38:27.689833+0000, chain.objs.size()=1 2024-09-14T11:58:38.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.268+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.287__shadow_.Yn-xd7AHlACKhRXuIZGtpZ9SCi7paZd_0 2024-09-14T11:58:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.269+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5253516408838852999', time=2024-09-14T13:38:37.180909+0000, chain.objs.size()=1 2024-09-14T11:58:38.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.269+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.296__shadow_.tmrequ0wPMZQEmvtx9iF_jEk1UZdPKi_0 2024-09-14T11:58:38.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.270+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18027169955665420896', time=2024-09-14T13:38:39.472673+0000, chain.objs.size()=1 2024-09-14T11:58:38.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.270+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.299__shadow_.rCVdVQKEsPcouOLfjiYekIXIpZlRvNg_0 2024-09-14T11:58:38.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.270+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5404623970395665422', time=2024-09-14T13:39:38.481245+0000, chain.objs.size()=1 2024-09-14T11:58:38.268 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.270+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dCzmimRnr_t2PIvZdCO0FKhSudIBddx_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14344827881705922780', time=2024-09-14T13:39:38.692214+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.MNc6MdeJTOv00VOKdV_NaDxi4D84Y0U_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12470064710623083981', time=2024-09-14T13:39:39.178294+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dgTuJVqkNnQwOSu9SzW0E48ez7iiErz_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12357395197399341455', time=2024-09-14T13:39:39.283285+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nscODWWLpjN8peBAdzpaDCBJe5a3ENq_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10484701304065636580', time=2024-09-14T13:39:39.461124+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.I0yTV8ZaTDSitjC09f_duVH3MmPR_u2_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6312089605452203647', time=2024-09-14T13:39:39.517891+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zwJq2wwVhsFN7bTN_GgY2SuIPokyzWv_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9440018363723194150', time=2024-09-14T13:39:39.707793+0000, chain.objs.size()=1 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UhVjoTKFOfERgvynoSNfpjs5VZJ_W2F_0 2024-09-14T11:58:38.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11160049870812006518', time=2024-09-14T13:39:40.277334+0000, chain.objs.size()=1 2024-09-14T11:58:38.271 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BSz1qMZFAWu1WbNR2FkQCxewvCkQ_XS_0 2024-09-14T11:58:38.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2123435191536165265', time=2024-09-14T13:39:40.584426+0000, chain.objs.size()=1 2024-09-14T11:58:38.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oxKL2OhTYoAyvK16EBuZoSZh6eRzCSd_0 2024-09-14T11:58:38.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4791934330050600482', time=2024-09-14T13:39:41.342862+0000, chain.objs.size()=1 2024-09-14T11:58:38.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RH6WpkY6K0aezxqlTns6e-atyUWZ6fP_0 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9600512976180726639', time=2024-09-14T13:39:41.483677+0000, chain.objs.size()=1 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.A4MDwE2ThVdyFKrZvSfhsimQdb0Ib8h_0 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.275+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5429210168355962165', time=2024-09-14T13:39:42.403548+0000, chain.objs.size()=1 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.275+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AL5wkLT0bPAyQ5T1jDJ0HSJj-oAwEGa_0 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.275+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6777042351559159411', time=2024-09-14T13:39:42.977298+0000, chain.objs.size()=1 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.275+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.01HQM8KD4nB4NtcBfZ6KU-VSR1n3G_y_0 2024-09-14T11:58:38.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.276+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9420898422006301539', time=2024-09-14T13:39:43.160828+0000, chain.objs.size()=1 2024-09-14T11:58:38.274 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.276+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Pp1M-jYXcdHOlH-GpqZvnQhTf-Axsct_0 2024-09-14T11:58:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.277+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15007966220440875390', time=2024-09-14T13:39:44.016142+0000, chain.objs.size()=1 2024-09-14T11:58:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Bd_ihgzug1pMGOrpBZ7bzkPOmn830b4_0 2024-09-14T11:58:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.277+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.886669723856010894', time=2024-09-14T13:39:44.300692+0000, chain.objs.size()=1 2024-09-14T11:58:38.275 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.277+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gofMJZuZCnnLr9a4ZFQGLa43RVLwGCh_0 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12954756555040072663', time=2024-09-14T13:39:44.508988+0000, chain.objs.size()=1 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.A-jXUSvkxulZUsVFGsNGFaf26Ss-3UA_0 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15538019770616884193', time=2024-09-14T13:39:45.299223+0000, chain.objs.size()=1 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FT-cpBVHPNV6wE0WDlSyPJ20CQPv4l-_0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9709869965660514087', time=2024-09-14T13:39:45.528722+0000, chain.objs.size()=1 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.278+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ng_F48s07XZxmyXZYtfvnm8ClAQg4Aj_0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.279+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14006846422015441144', time=2024-09-14T13:39:46.050260+0000, chain.objs.size()=1 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kkSwUbTcTvn-ymEobi6XAvGW5je-D6C_0 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13211082737410960905', time=2024-09-14T13:39:46.496121+0000, chain.objs.size()=1 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.V9mkomeTBOvK740NP2FSz3n5Y6_S7NB_0 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13267646252213612296', time=2024-09-14T13:39:47.193028+0000, chain.objs.size()=1 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cDE098BFDOLnFhHSSZDp_Ws4ynGAtkl_0 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14351889052175863600', time=2024-09-14T13:39:48.045195+0000, chain.objs.size()=1 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Nei04P3lBcOacPqS62JZ-6Nw255KdMs_0 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3361306752947226299', time=2024-09-14T13:39:48.616565+0000, chain.objs.size()=1 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bHWzJVVwQO6CF4IeA4Rveia8BbJ59Md_0 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5758652167657100976', time=2024-09-14T13:39:48.768669+0000, chain.objs.size()=1 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.280+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GLgRe6sxs2lvjyFnBg_C77eXqRARuIJ_0 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.282+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15357869685664459059', time=2024-09-14T13:39:48.944084+0000, chain.objs.size()=1 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.282+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b3L55qUM6ocl3S8qFC_qj-V8lynbYJ8_0 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.282+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5466020568113107101', time=2024-09-14T13:39:49.451302+0000, chain.objs.size()=1 2024-09-14T11:58:38.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.282+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dLNs1hdEbUHEmdDmkb1tTSuuYS_DhAA_0 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8858795950880333708', time=2024-09-14T13:39:49.612953+0000, chain.objs.size()=1 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.S4dUlwss2VXKxgw5AO6985B_u0az2-R_0 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3174235871039487949', time=2024-09-14T13:40:31.802587+0000, chain.objs.size()=1 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HR4ReRh5lHCG93vcn0ODIgkor1yjOEL_0 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12192135423171346162', time=2024-09-14T13:40:33.617330+0000, chain.objs.size()=1 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ajdvGORoTh3nM0Y9cA8PS-tJTEzGClx_0 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2336455667901883216', time=2024-09-14T13:40:33.660703+0000, chain.objs.size()=1 2024-09-14T11:58:38.281 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.283+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hczVp_kv6i3_UUPVI2NeQ5O-Lftn_Ju_0 2024-09-14T11:58:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.284+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1109862132473030875', time=2024-09-14T13:40:34.193417+0000, chain.objs.size()=1 2024-09-14T11:58:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.284+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.A6QG-5KzIXDi3PCcWW8ssWadSXmL2L2_0 2024-09-14T11:58:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.284+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4804965285490194862', time=2024-09-14T13:40:34.861027+0000, chain.objs.size()=1 2024-09-14T11:58:38.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.284+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.y_i23dgn2zkflBvggR0O4ECJcovqsB5_0 2024-09-14T11:58:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.285+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4411770463859434235', time=2024-09-14T13:40:35.332527+0000, chain.objs.size()=1 2024-09-14T11:58:38.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.285+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Jfj65xiBQYBrZe6SkfWy5IpB-ahzZ28_0 2024-09-14T11:58:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8682181452691434021', time=2024-09-14T13:40:35.430304+0000, chain.objs.size()=1 2024-09-14T11:58:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.g84yshS9-nWXe1puDxSDeB5KkKmLsQG_0 2024-09-14T11:58:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9739070822117009229', time=2024-09-14T13:40:36.420447+0000, chain.objs.size()=1 2024-09-14T11:58:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0qJkXunW_yHAGkCvuBpEplGen3N3mVe_0 2024-09-14T11:58:38.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13356118073931527568', time=2024-09-14T13:40:36.743869+0000, chain.objs.size()=1 2024-09-14T11:58:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.286+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9mMTzVaHnU_RmkF0k7xGQJMmr22erxW_0 2024-09-14T11:58:38.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.288+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7755587165656182623', time=2024-09-14T13:40:36.800866+0000, chain.objs.size()=1 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.288+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0tymTv93DC3Ev7uAaJtXzMu-3kf6Awz_0 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.288+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17834469313272288353', time=2024-09-14T13:40:36.971989+0000, chain.objs.size()=1 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.288+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5toYc-IZ2Q8BfmAG2_FDlE33kX-y2SW_0 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17965295161137090183', time=2024-09-14T13:40:39.181618+0000, chain.objs.size()=1 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9JD1kWiJC8PhzGCofGhmcAl5ejkM3Eq_0 2024-09-14T11:58:38.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10123095776010363038', time=2024-09-14T13:40:39.314232+0000, chain.objs.size()=1 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dStC5k8i4Zk8LozgC9ZmXDJHTGwHw2n_0 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4245226267462915159', time=2024-09-14T13:40:39.520705+0000, chain.objs.size()=1 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WX86Y9wdM52W457jFJH9X6cs_RA7CxW_0 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7859726794195085445', time=2024-09-14T13:40:39.715457+0000, chain.objs.size()=1 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.En3pG22YDiEFx88h5sH7vdP8rI_Sv7I_0 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4875621729066489993', time=2024-09-14T13:40:39.876963+0000, chain.objs.size()=1 2024-09-14T11:58:38.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.289+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oSWzBUSb0mYDZ6puLk5ZGGnmDroMIj0_0 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7566454356893377775', time=2024-09-14T13:40:40.330107+0000, chain.objs.size()=1 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.d3Wf7euqN62O9kp7HUF3mIgt8SO47PQ_0 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9985828915003988599', time=2024-09-14T13:40:40.691343+0000, chain.objs.size()=1 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.d22bkf3-vVpfIrHEcepJXCLR8c734tp_0 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2743491905200715869', time=2024-09-14T13:40:41.306675+0000, chain.objs.size()=1 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.L7WOAV6ZNSv47g2vFuMjkxUl8fDGEHi_0 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11248875482492068081', time=2024-09-14T13:40:41.309102+0000, chain.objs.size()=1 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HCUlEZgR4rV_qcre_5KyXuG3RtCp81i_0 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16696296892780671854', time=2024-09-14T13:40:41.535033+0000, chain.objs.size()=1 2024-09-14T11:58:38.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.292+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZheuHOra02UAc8BH17kkYEj1oilZ8bq_0 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7278314645392201548', time=2024-09-14T13:40:41.713834+0000, chain.objs.size()=1 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Z-MxdfT7aM4JBlDZfQPc9wk7FZVO48N_0 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12376040378306053026', time=2024-09-14T13:40:41.888916+0000, chain.objs.size()=1 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DLPtKpW5ibcov8jVFLdpxf3b_rllcYi_0 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14251399397012132076', time=2024-09-14T13:40:42.564932+0000, chain.objs.size()=1 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iWtOtpWppO_mL0Q0aeR4pFi5TAIu15A_0 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17722850778180309439', time=2024-09-14T13:40:42.633252+0000, chain.objs.size()=1 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JvlKDRgrKr2mHHiYXsofU42Q5RYZ_Et_0 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15948455084517946442', time=2024-09-14T13:40:42.636333+0000, chain.objs.size()=1 2024-09-14T11:58:38.293 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KBPG_oeEGbyYIeYfuAR4GMYa0BjrZSg_0 2024-09-14T11:58:38.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15525513756630556104', time=2024-09-14T13:40:42.759549+0000, chain.objs.size()=1 2024-09-14T11:58:38.294 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.295+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.33TIYjD4iE9M2hTtyWk4CARtGIN7Aie_0 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9208960966626606412', time=2024-09-14T13:40:43.198288+0000, chain.objs.size()=1 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DBgkGfNAVHsaI9DgvS4_t0vn0cB0kfs_0 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6065829438462775022', time=2024-09-14T13:41:36.600332+0000, chain.objs.size()=1 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.409__shadow_.JNyfbFpXpFdpQxN0aKSh_1B3uCNAKSZ_0 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8197754450915328823', time=2024-09-14T13:42:10.430712+0000, chain.objs.size()=1 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.459__shadow_.UfvqSKw4yc4QXlA9Rg3RyItgl8_X8t-_0 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17683655321469902389', time=2024-09-14T13:42:17.149295+0000, chain.objs.size()=1 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.466__shadow_.mqsImhFJdXjacUosdtAlkmMHnTed0k4_0 2024-09-14T11:58:38.295 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5982142445324471128', time=2024-09-14T13:42:27.447054+0000, chain.objs.size()=1 2024-09-14T11:58:38.296 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.297+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.OD5SZOWWmIZce0yq6irgb7DCBAGDOwq_0 2024-09-14T11:58:38.300 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.302+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47916 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.304+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.304+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3470484155554097557', time=2024-09-14T13:42:27.448082+0000, chain.objs.size()=1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.304+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.HA_ily41c9rCqGnify0P-RLgo8j9ypV_0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8559965071583275975', time=2024-09-14T13:42:43.858375+0000, chain.objs.size()=1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7591682234431565889', time=2024-09-14T13:42:57.672738+0000, chain.objs.size()=1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.514__multipart_mymultipart.2~sgwGGneSbYmETCyjPdp4gJp_UdQ8YQ7.1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5581022548151501418', time=2024-09-14T13:43:34.052663+0000, chain.objs.size()=1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.521__shadow:Fr0xJY.x1pDq9ZyxBdw2tG3hklf0A3F_.tJa0ItxiArlakdwFSA78nBkHnf6Qc0L_0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12729144890525076543', time=2024-09-14T13:44:36.022294+0000, chain.objs.size()=1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~apWSydnNDvDZQmNB2KIRWDJJM_NlfPq.1 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1102946891101389570', time=2024-09-14T13:44:46.273324+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~UxNV3mL5BcwzKYhMg_iSf1dw8xPtBn6.1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2796000591252760978', time=2024-09-14T13:45:53.288000+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.553__shadow_.TlEjRyW_528TfdyxiDlCkNzKA8kZF4q_0 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1280309400205627276', time=2024-09-14T13:46:04.924050+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.RfP45U1O_M-S9wXg3RzDS8IT_EZPgtw_0 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2961691295806691581', time=2024-09-14T13:46:11.544942+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.559__shadow_.UOgJqDMFqmTtWcD-0RiILKNyi7CxPj3_0 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15964250910283421875', time=2024-09-14T13:46:14.473958+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.562__multipart_mymultipart.2~AinTYC6h_3MSk9OCUm8aZk09lm_xtrU.1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.915471445878294650', time=2024-09-14T13:46:28.088378+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:wXTkPHj.qUa8.DyqeQjIBqzjwDaeOr7_.PGInZWP9t8aNbflONf7siN1S-6zMwZR_0 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16943362320900015025', time=2024-09-14T13:46:29.513901+0000, chain.objs.size()=1 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.305+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:mGS4cstO.uX9CiQJDLv9WTyq1lmFezf_.UTWaFKMk-M_aeCdIWwi6aDn31W4DXNk_0 2024-09-14T11:58:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.307+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15236718464781056237', time=2024-09-14T13:46:59.430942+0000, chain.objs.size()=1 2024-09-14T11:58:38.305 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.307+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:uVshFaFULf8g285iYnjSyCMdP1Cp.gb_.n6l7LRKRt7MX9Q9GYIF6lvVQqW7cvYi_0 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14515441563543623057', time=2024-09-14T13:47:34.130030+0000, chain.objs.size()=1 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:3TjB7yNFWMF9pW9aAc4lDUNSexm2KYa_.7NlRIqk6lSqq8GxP3QdZSxuT9sj5Jug_0 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7031046467460089741', time=2024-09-14T13:47:34.173563+0000, chain.objs.size()=1 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:6I7VYZIol-CIDyoPw0NNBG0yIUWx3ZK_.BOlvAPNbQmwgUdqRImkcIPGV74qjJua_0 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18435856632962519811', time=2024-09-14T13:51:44.173652+0000, chain.objs.size()=1 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.628__shadow_.cF5xRwfbm69cT-5R84vvkaDXvZLpEfP_0 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17844103766962696284', time=2024-09-14T13:54:09.431829+0000, chain.objs.size()=1 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.748__shadow_.Yx3DtshmJsrEjjpcPhvXKj-qgYJ0xhz_0 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14039397570306358275', time=2024-09-14T13:54:57.638339+0000, chain.objs.size()=1 2024-09-14T11:58:38.307 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.309+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.758__shadow_.ZayT-dye81zh5wX5UF5paeiXu6NFl0g_0 2024-09-14T11:58:38.311 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.313+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.313 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.316+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:58:38.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.317+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.315 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.317+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45959' 2024-09-14T11:58:38.316 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16241231200104924952', time=2024-09-14T13:36:54.749954+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.231__shadow_.K3a-Orx2dFmg3GtPYlDYrARsnjJRCMp_0 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3370700184071775422', time=2024-09-14T13:37:05.024343+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.244__shadow_.T0WWqBTTHthEpl1ve6jfxedvQ5B-9sV_0 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6967816488475791636', time=2024-09-14T13:37:57.931329+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sRsXJ6KP-e7Wat8XtdvnEMelJSrz6ph_0 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11112823097416945956', time=2024-09-14T13:37:58.238523+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SiSXdRsSrjVywVAbQ3Ff8j3HOIqrzDk_0 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3217110620948734300', time=2024-09-14T13:37:58.834593+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4A8Wt73wxoUcprUEFWeCk5vfWEsehkC_0 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2408909492047440681', time=2024-09-14T13:37:58.954458+0000, chain.objs.size()=1 2024-09-14T11:58:38.317 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DOdRKvkL54uh1hqGav4PXqoq2QUxzmw_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4010956269818467240', time=2024-09-14T13:37:59.460653+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lwZOTYg8ayrFjATF8So4LpW6gruY7bB_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14247223021883403253', time=2024-09-14T13:37:59.462768+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QvczHbqrnktFt3CcFcmg9_XGHRtoiJT_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3313890101857112383', time=2024-09-14T13:38:00.641408+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MjQaQdXhiWqrg8hpl4_SucIdXKUZVdW_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17393015285928649273', time=2024-09-14T13:38:01.389534+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Nwy8_B4YBI3oEAgcpH8YMpNEXNHvf4Z_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14038121450374602596', time=2024-09-14T13:38:01.569913+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CYgz5Wo1Sp-72JI7OKYuxFfvTIKd13X_0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8213570965700168458', time=2024-09-14T13:38:01.616182+0000, chain.objs.size()=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.318+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uY1UMfuTLShBtH8d5kETGD7KRvyltDx_0 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.321+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3087651852544892223', time=2024-09-14T13:38:03.119102+0000, chain.objs.size()=1 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.321+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HAhe1PyPUOrNhG3Z40nM95Usg8zIm0P_0 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.321+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17805337988585460445', time=2024-09-14T13:38:03.644215+0000, chain.objs.size()=1 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.321+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.k_soxZkAom7jRXl0JuIORqWcZ78ZFSn_0 2024-09-14T11:58:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13776432897094707290', time=2024-09-14T13:38:03.705410+0000, chain.objs.size()=1 2024-09-14T11:58:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qY1M9cQEPhOuMYdUyYWFD870uh0kOAL_0 2024-09-14T11:58:38.320 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7406919748005918459', time=2024-09-14T13:38:03.860699+0000, chain.objs.size()=1 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.B1zOMZpWa-xZz_3M8UgDLjikwEy5fPv_0 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10711198043712400250', time=2024-09-14T13:38:03.957260+0000, chain.objs.size()=1 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RYklHPwLqteqfMChDwWbbKEn29QmaQD_0 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1554109828123642544', time=2024-09-14T13:38:04.050049+0000, chain.objs.size()=1 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.322+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kAfk2wsr8jGAVk1rMdSjx-AISFRXh-R_0 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8652078822139648801', time=2024-09-14T13:38:04.562973+0000, chain.objs.size()=1 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b93XgtgHwweHJXgN5ccRwQdKe4RDxAb_0 2024-09-14T11:58:38.321 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17431340601225455741', time=2024-09-14T13:38:04.887378+0000, chain.objs.size()=1 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9XX6PvQriU2MbSP_XlQ0pJoCFvq_sej_0 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16318025373923817314', time=2024-09-14T13:38:06.201939+0000, chain.objs.size()=1 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-g_D5CW3oAJEOBTJ5-jkf4bTmIpg64r_0 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15273196835198145131', time=2024-09-14T13:38:06.619107+0000, chain.objs.size()=1 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9xE_BZOhndSUafFPoFQKwUSdyQlQitk_0 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3332415312651000303', time=2024-09-14T13:38:06.787670+0000, chain.objs.size()=1 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.323+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.T3qDB2pm9wA4Ds_5oYhcGJ2nZ30DOpT_0 2024-09-14T11:58:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.325+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9839535493260470551', time=2024-09-14T13:38:07.037296+0000, chain.objs.size()=1 2024-09-14T11:58:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.325+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.u1HgNLp-Mb0k1RyW1-m3kTAt1iJNWKH_0 2024-09-14T11:58:38.323 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.325+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15802100126148930873', time=2024-09-14T13:38:07.324281+0000, chain.objs.size()=1 2024-09-14T11:58:38.324 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.325+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jSdDjxb9aZoDj4aTF_tPVt1Vpqe9nPc_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18044201105296563173', time=2024-09-14T13:38:08.392142+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lB5qnTVZ64Q1PwZndLPagL5aJXm-IGt_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12606734476308471782', time=2024-09-14T13:38:08.769196+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.e8GqtnwUc9mixJ28ptSvlhjzSzwHhlg_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1680751179013002305', time=2024-09-14T13:38:09.010791+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YqB8SdYg04q4inmcvai-jc1hzOpy-H0_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12259410184899097803', time=2024-09-14T13:38:09.379266+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qglnAyWCBhLnyEsYE33X__-AiLh--7f_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18374028331818979742', time=2024-09-14T13:38:09.758806+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-4YGKcn7cT1F8FBcPOCOwUPGpdcFRT-_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.651135518464820087', time=2024-09-14T13:38:10.101815+0000, chain.objs.size()=1 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Q0X2elZYyvVi2OctLmgdTWUzfM1CNnd_0 2024-09-14T11:58:38.326 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3530152264516825948', time=2024-09-14T13:38:13.901644+0000, chain.objs.size()=1 2024-09-14T11:58:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.268__shadow_.K7rIWgwEV3dR6Zqna7BoyJZ2p1-uUO2_0 2024-09-14T11:58:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10422367627345474309', time=2024-09-14T13:38:29.142064+0000, chain.objs.size()=1 2024-09-14T11:58:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.289__shadow_.jyK-zq7fwfb-Wnx2GaGpOY4I-2X_ndk_0 2024-09-14T11:58:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3723510024868623285', time=2024-09-14T13:38:33.608366+0000, chain.objs.size()=1 2024-09-14T11:58:38.327 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.328+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.yF3N6cyBHh9xg_cpp2HeNLxXDvWmexs_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6023163260240042196', time=2024-09-14T13:38:35.673697+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.qPZWKsbZQqIuVtEB51G8MDdpoEJAWlh_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14027463626818254821', time=2024-09-14T13:38:38.671249+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.298__shadow_.4zC58YTz6NlQufn39sS3ma1CzoS4yWC_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12193632475802222834', time=2024-09-14T13:38:42.516316+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.303__shadow_.Q_W7M2-7QHfTguWQ7w2yKl1961uZbPg_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15353980375511301364', time=2024-09-14T13:38:43.236254+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.304__shadow_.j8YeQZ90nU_UF_qcxYSJNpbjx0I5xQw_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9487898503393611309', time=2024-09-14T13:38:55.748033+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.320__shadow:dgi5URaWbK09YlgRO4XvAXXfPZFZesj_.g7qb77d296cVL19Uf_UE0ZFLcBKhXmG_0 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18396384135808656237', time=2024-09-14T13:39:38.487523+0000, chain.objs.size()=1 2024-09-14T11:58:38.331 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.333+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FqTSIUleyZGem5Zl30Ns7I8dKBE87tR_0 2024-09-14T11:58:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.334+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15498848582809096496', time=2024-09-14T13:39:39.468624+0000, chain.objs.size()=1 2024-09-14T11:58:38.332 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.334+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pKBvCNWMAHET4bE3HXoVnojCE5QgNNw_0 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15432076050569820218', time=2024-09-14T13:39:40.266334+0000, chain.objs.size()=1 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cjae_mmCX6fh2KLqCG4wQqxrQW8Qgnr_0 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13581782100950069187', time=2024-09-14T13:39:40.313718+0000, chain.objs.size()=1 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KmWyalYV0-AhPrBS04fVtoUQFTgXCrJ_0 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11303605392687815934', time=2024-09-14T13:39:40.975679+0000, chain.objs.size()=1 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PVjRl8U1TZU-oHL-lBHFplQcRYW-eSs_0 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16169344681154070109', time=2024-09-14T13:39:41.415218+0000, chain.objs.size()=1 2024-09-14T11:58:38.333 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.335+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kKlkF3mNXkGMTOHsluZ3sVQaBMLNQcY_0 2024-09-14T11:58:38.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10598950907320288735', time=2024-09-14T13:39:42.004831+0000, chain.objs.size()=1 2024-09-14T11:58:38.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JrcP3e2aFuho38AnOAwz5MfATc2NzEt_0 2024-09-14T11:58:38.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17718309409579571024', time=2024-09-14T13:39:42.344684+0000, chain.objs.size()=1 2024-09-14T11:58:38.335 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CEQTbOLcoRKSULBI1xWTDb1RZLbgEB7_0 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3859545438247648545', time=2024-09-14T13:39:42.962461+0000, chain.objs.size()=1 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b4aKDuQ0XzYFK8DAgJ1R14orJBUSjfl_0 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13090184565095953691', time=2024-09-14T13:39:43.005185+0000, chain.objs.size()=1 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.337+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.So6EgihYVWqAC5vh9t-CeEl7T7H_xrV_0 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14819934297720361874', time=2024-09-14T13:39:43.005849+0000, chain.objs.size()=1 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mKrB51GuJY_1H55ncY3B_BPOul-_c88_0 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1266332120773862139', time=2024-09-14T13:39:44.114201+0000, chain.objs.size()=1 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.P0B8lL3E86CMVZ_I2fOOMaBF8y-GbvN_0 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12334376900257383113', time=2024-09-14T13:39:44.262269+0000, chain.objs.size()=1 2024-09-14T11:58:38.336 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.338+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-UQT_NODcoz9ux-n6JN8NZyjizmbU-q_0 2024-09-14T11:58:38.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3102845581460842787', time=2024-09-14T13:39:44.643953+0000, chain.objs.size()=1 2024-09-14T11:58:38.337 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Lj2Wkxe02gs_gPeK3UACBxB-AHg80Bf_0 2024-09-14T11:58:38.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2276831393718401461', time=2024-09-14T13:39:45.276907+0000, chain.objs.size()=1 2024-09-14T11:58:38.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.V-4Lz7GNSM-2HT4CvLSzpyoGZfrRLlr_0 2024-09-14T11:58:38.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14058919713088109156', time=2024-09-14T13:39:45.458848+0000, chain.objs.size()=1 2024-09-14T11:58:38.338 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.340+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.md_ALdgFteD2uZ171uMK47ncpyGKw6t_0 2024-09-14T11:58:38.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.341+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18385831254156962019', time=2024-09-14T13:39:46.462231+0000, chain.objs.size()=1 2024-09-14T11:58:38.339 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.341+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7zCJqlzIMJ5aHp9ZAkn9KcmPXH_6-h__0 2024-09-14T11:58:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.342+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18276097850797755925', time=2024-09-14T13:39:47.004126+0000, chain.objs.size()=1 2024-09-14T11:58:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.342+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZdVQgMwk0-wu2iaQyNK-ydwycjIwmf3_0 2024-09-14T11:58:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.342+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6159951271595373083', time=2024-09-14T13:39:47.416623+0000, chain.objs.size()=1 2024-09-14T11:58:38.340 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.342+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BVz9hq10HWfTX5irpZ2KAkDag7BxJOE_0 2024-09-14T11:58:38.342 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17851553162564547250', time=2024-09-14T13:39:47.790409+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ajvc3egQcwypoXMapqWU2BKub3nc9Ut_0 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5479124676008132473', time=2024-09-14T13:39:47.868066+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.V_cLMANq5qlYmIib-cYl5TTGXcJVQCD_0 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17961101176504646760', time=2024-09-14T13:39:48.040642+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.a341TC5b2eVRcd0mMGJIOY98QLcYNG-_0 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8701475163702482033', time=2024-09-14T13:39:48.823415+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.e_K3s1puib821uTw5Aq3K2mDi5g89rw_0 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9461496497162665039', time=2024-09-14T13:39:50.254679+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qMl1ak0UP_u9d4BrGOFlROKkBQtRuH8_0 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9869115596149498652', time=2024-09-14T13:39:50.427773+0000, chain.objs.size()=1 2024-09-14T11:58:38.343 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2JiZHnptLVljC7mJw8U5Kn307EUZWQV_0 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5719710064460153860', time=2024-09-14T13:39:50.496667+0000, chain.objs.size()=1 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.345+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JJGzCBVOLZQFOdXNkCEs-Le8UScQRbw_0 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.346+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16326404486896835988', time=2024-09-14T13:39:50.781993+0000, chain.objs.size()=1 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.346+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1kvAD_WwxRWbmGf8TPkY2Iud0YCnnzq_0 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.346+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11599898725319444929', time=2024-09-14T13:40:30.969541+0000, chain.objs.size()=1 2024-09-14T11:58:38.344 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.346+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mq99Bw53NB7FxGZie8-S7DQN3Rs92rh_0 2024-09-14T11:58:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.347+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4730529831679009022', time=2024-09-14T13:40:31.131880+0000, chain.objs.size()=1 2024-09-14T11:58:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.347+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.v43k2-jXc7uPMOyHiaU6f7QtS9yfDkn_0 2024-09-14T11:58:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.347+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10104626874825853231', time=2024-09-14T13:40:33.256445+0000, chain.objs.size()=1 2024-09-14T11:58:38.345 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.347+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hc_ry86p3rt76Eem6jKZz-vCfx4lwBs_0 2024-09-14T11:58:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.348+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.445430755797753852', time=2024-09-14T13:40:34.383073+0000, chain.objs.size()=1 2024-09-14T11:58:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.348+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1LgmjdSvPdDqOBmilmtN9gWSPUwRICU_0 2024-09-14T11:58:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.348+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5098847902833149299', time=2024-09-14T13:40:34.543111+0000, chain.objs.size()=1 2024-09-14T11:58:38.346 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.348+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1baWuSvXAd9krJouSeWP48pwmchTg4d_0 2024-09-14T11:58:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.349+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10135496727832029008', time=2024-09-14T13:40:34.543837+0000, chain.objs.size()=1 2024-09-14T11:58:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.349+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ULZHeeI5e1-Nn8Aao0o6anPhkQFdKNT_0 2024-09-14T11:58:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.349+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14077589736280061031', time=2024-09-14T13:40:34.752168+0000, chain.objs.size()=1 2024-09-14T11:58:38.347 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.349+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-uR5hFmJmas6CneT-N8_zcYQ8tmEvL2_0 2024-09-14T11:58:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14117937301213564369', time=2024-09-14T13:40:34.858530+0000, chain.objs.size()=1 2024-09-14T11:58:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZQYL54MjbfV3k1yIm4dqjNJ3kF2rjok_0 2024-09-14T11:58:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.350+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10317094470757411361', time=2024-09-14T13:40:34.900009+0000, chain.objs.size()=1 2024-09-14T11:58:38.348 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.350+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ST1mDOxuOITk8V2wABKQiQhlH-uzayv_0 2024-09-14T11:58:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3793776035682542586', time=2024-09-14T13:40:35.035441+0000, chain.objs.size()=1 2024-09-14T11:58:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JZq8a_8_-gDuAJY-aMXkZVle-CeK8-x_0 2024-09-14T11:58:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7603510860202453317', time=2024-09-14T13:40:35.186044+0000, chain.objs.size()=1 2024-09-14T11:58:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gixhzmMIhkNGBWHNkhQsvlwi6BeBlDy_0 2024-09-14T11:58:38.349 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.464920527157676211', time=2024-09-14T13:40:35.284103+0000, chain.objs.size()=1 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.91I4EsjcYyYJ_oljYqfP7ih1oyTdYjW_0 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3439712299436110335', time=2024-09-14T13:40:35.333440+0000, chain.objs.size()=1 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Km79YqNnbk8Mvao04CWf6q-ptmnvsCl_0 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1145045931634471914', time=2024-09-14T13:40:35.380688+0000, chain.objs.size()=1 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5OOEd8fpxuFVw_-3982vbDzhNxwyG42_0 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6267379474953179127', time=2024-09-14T13:40:35.422462+0000, chain.objs.size()=1 2024-09-14T11:58:38.350 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.351+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Ga9YkPiWGBF0zneOltGaKLCif6Z0ukN_0 2024-09-14T11:58:38.351 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.354+0000 7efe25ccb640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.29:6816/4274424687,v1:172.21.15.29:6817/4274424687] conn(0x7efcf00885c0 msgr2=0x7efcf008a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18111737404662017937', time=2024-09-14T13:40:35.880505+0000, chain.objs.size()=1 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0fxxfyh2RFdCfQoj0HMrtH-x3gAV9g3_0 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16452574948919331468', time=2024-09-14T13:40:36.047586+0000, chain.objs.size()=1 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2YlmNLbQyaVgcujyGIDDRFsaDHztKW9_0 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3338283383409197971', time=2024-09-14T13:40:36.048511+0000, chain.objs.size()=1 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.izuUjFnkJ5D_bZ5jUpD1GgNDO-v70Gx_0 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11889020690642871056', time=2024-09-14T13:40:36.156769+0000, chain.objs.size()=1 2024-09-14T11:58:38.353 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZcU4lzXDeJoLieiK_HTMpj-pJ38Iw8z_0 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1920744396362575783', time=2024-09-14T13:40:36.435425+0000, chain.objs.size()=1 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vAzK0-HD-hWT4jDqZNff-MGX2CAR3UX_0 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15413823314633408938', time=2024-09-14T13:40:36.577648+0000, chain.objs.size()=1 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eBFHd8zBVPbS9GivQVcbP24JJe8m70o_0 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7287871116898659690', time=2024-09-14T13:40:37.026657+0000, chain.objs.size()=1 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LAV7bD0R_wtnYWz8wV9PiK87-XkYzlJ_0 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11936571955651397630', time=2024-09-14T13:40:37.109842+0000, chain.objs.size()=1 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.355+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1KFbKY8VdI52NMRiOSxZfVDMJ1SBxcx_0 2024-09-14T11:58:38.354 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5678267375228074589', time=2024-09-14T13:40:40.093360+0000, chain.objs.size()=1 2024-09-14T11:58:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.v_NCYD4TdnzPH1qVcCapMJVQeVTTHyA_0 2024-09-14T11:58:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3791985417592206749', time=2024-09-14T13:40:40.324835+0000, chain.objs.size()=1 2024-09-14T11:58:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2wmqqU5VgNFv321LWsScYRaJUYmDOD9_0 2024-09-14T11:58:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10514803236679774575', time=2024-09-14T13:40:40.745434+0000, chain.objs.size()=1 2024-09-14T11:58:38.355 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.357+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SPMq0yCqALay9dVIcAd6_JLF_9tZ52z_0 2024-09-14T11:58:38.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.359+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10256994583206068725', time=2024-09-14T13:40:41.232770+0000, chain.objs.size()=1 2024-09-14T11:58:38.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.359+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZLmBt7wVOHVYRnaTcRksJ9AUdvOGEex_0 2024-09-14T11:58:38.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3978276539937909928', time=2024-09-14T13:40:41.518194+0000, chain.objs.size()=1 2024-09-14T11:58:38.357 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.u1Z7p81OCEj18T3RH0nxQQwJdrIH4-Z_0 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11396960115036046994', time=2024-09-14T13:40:42.652163+0000, chain.objs.size()=1 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.n1rRv1YtWXOzI0LWdSpbgD7FTd6XMpK_0 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2652407138076450223', time=2024-09-14T13:40:48.664395+0000, chain.objs.size()=1 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.334__shadow_.PtQZ9Ml52Z88VLF4lq8OxdnyBVnIBtb_0 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13249948434689290734', time=2024-09-14T13:41:52.250035+0000, chain.objs.size()=1 2024-09-14T11:58:38.358 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.360+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.434__shadow_.GAVhuAZr4oU0_tCP-ZU0d8h492lTQ1V_0 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16654521663103428727', time=2024-09-14T13:42:18.181667+0000, chain.objs.size()=1 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.467__shadow_.kM1KHCHaT-a-RNnlLFQjXshIMRqrMO-_0 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.939630497408454269', time=2024-09-14T13:42:43.859108+0000, chain.objs.size()=1 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16009067964830018071', time=2024-09-14T13:45:57.008868+0000, chain.objs.size()=2 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.555__shadow_.1bYG0uRnNcyHOw2rzVI4vlT-tdw1QRZ_0 2024-09-14T11:58:38.359 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.361+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.555__shadow_.1bYG0uRnNcyHOw2rzVI4vlT-tdw1QRZ_1 2024-09-14T11:58:38.362 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.365+0000 7efe1ffff640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.73:6816/3705727448,v1:172.21.15.73:6817/3705727448] conn(0x5609185dd540 msgr2=0x5609185df930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.364 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.367+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/45959 2024-09-14T11:58:38.367 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10747631829872584411', time=2024-09-14T13:46:05.751740+0000, chain.objs.size()=2 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.qNFqr3B7HW0aLRfqijwIqbtxasMEx-D_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.558__shadow_.qNFqr3B7HW0aLRfqijwIqbtxasMEx-D_1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15687258579426895633', time=2024-09-14T13:46:22.585228+0000, chain.objs.size()=1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.565__shadow_.JVzQ14WCD3Gg4cWVAULu1ad5hOKE6iB_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.973524290900176919', time=2024-09-14T13:46:31.878315+0000, chain.objs.size()=1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:.gjl-PeoLoy4UXC3.1u0vQRHrEdYJkB_.dQOtGYRWY7BroH8C9MG-m6qbHHyd0h-_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12217508744472714607', time=2024-09-14T13:47:39.474616+0000, chain.objs.size()=1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.587__shadow:y6KEzWhls7sP0KwtGpRdxpcRyV1e8Rm_.SSgY0-FvGTJ9FhLQXB7L4Xg3P-0mJZq_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14033987129747228066', time=2024-09-14T13:47:41.012820+0000, chain.objs.size()=1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:02TyjqW9q9Iq03K-UUowS1gD1KizWRX_.soblbSYzMS3F0saBgBBujZeLLSNE_9u_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10125307899047145968', time=2024-09-14T13:51:45.734427+0000, chain.objs.size()=1 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.630__shadow_.H7kfpTeuHKGBgGdJ9ve62Yx1xgF0aUl_0 2024-09-14T11:58:38.368 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15596550705074649652', time=2024-09-14T13:52:11.916066+0000, chain.objs.size()=1 2024-09-14T11:58:38.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.655__shadow_.AmomKvC0SOeMWyZByH60VP1KvrF0o4w_0 2024-09-14T11:58:38.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.52378195334519017', time=2024-09-14T13:52:48.903804+0000, chain.objs.size()=1 2024-09-14T11:58:38.369 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.369+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.691__shadow:T3C15ePLOgYD3ZQvpXhyL6jxIUePKaG_.rdlNHMeZT4Arj13QehRGB63-F1hFVZ__0 2024-09-14T11:58:38.370 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.372+0000 7efe1ffff640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.73:6816/3705727448,v1:172.21.15.73:6817/3705727448] conn(0x7efcf008b4e0 msgr2=0x7efcf008a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.371 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.373+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.373 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.376+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:58:38.374 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.377+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.375 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.377+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53859' 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3606767439877943048', time=2024-09-14T13:34:15.122608+0000, chain.objs.size()=1 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.149__shadow_.t7FOZy5jjUhYT8ZVAfYHBbL-nFD0ie3_0 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18134531283711620067', time=2024-09-14T13:34:16.219402+0000, chain.objs.size()=1 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.152__shadow_.UgtfZ71IPCvbrrI66LDfoJxXsjB_o5f_0 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3448198884069316200', time=2024-09-14T13:34:48.262397+0000, chain.objs.size()=1 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.167__shadow_.4Vvsoq94BMZnIqgjHwN74om7bxapd2p_0 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16341383235984921275', time=2024-09-14T13:34:48.647885+0000, chain.objs.size()=1 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.167__shadow_.j5xd5sdwmlOjt-I0x8-rxb-pRE-Aubq_0 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1754623878182945430', time=2024-09-14T13:35:22.607043+0000, chain.objs.size()=1 2024-09-14T11:58:38.377 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.200__shadow_.woaL920iIy5zWSVb3ODort0ws6KC4ly_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14817625928008276390', time=2024-09-14T13:37:07.537007+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.247__shadow_.lOlAhZmOv6MYBpvR6j0-sTm8Ez4Opjy_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16298438484003391677', time=2024-09-14T13:37:11.234132+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.252__shadow_.d1mvf1d4DlN1Uj4vy6aSqsl57TPZGuo_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2940392502277567981', time=2024-09-14T13:37:12.742399+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.254__shadow_.es3yZxtO0IYoDVcqrlzBXu6p-G2IWBG_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5223965941456076298', time=2024-09-14T13:37:13.458247+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.255__shadow_.bjwbj22nQxHpfUsf6upYkW2tFpiCWAC_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1969485136102064039', time=2024-09-14T13:37:57.931253+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.T5oPEgL0zlwASfBt-8uvdS886INbaZS_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13297666644235533075', time=2024-09-14T13:37:58.470519+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ycKOi5im5CwS8dFHG-e7hP4erIjfbth_0 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10478514237147648933', time=2024-09-14T13:37:58.727683+0000, chain.objs.size()=1 2024-09-14T11:58:38.378 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.378+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bfQG_ZHg5FBfiIW5cWyBWWunwzxJarm_0 2024-09-14T11:58:38.379 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.382+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13408753095287739020', time=2024-09-14T13:37:59.529352+0000, chain.objs.size()=1 2024-09-14T11:58:38.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.382+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7fFud_FgK2v6Ejvm_9zFxyjDpkEZmPT_0 2024-09-14T11:58:38.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.382+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13775691955750860547', time=2024-09-14T13:37:59.630630+0000, chain.objs.size()=1 2024-09-14T11:58:38.380 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.382+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LA2tZlPSI1hd5KIIIpdmDaQB32tt2zs_0 2024-09-14T11:58:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6879943046284133896', time=2024-09-14T13:37:59.734299+0000, chain.objs.size()=1 2024-09-14T11:58:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TfxO75yCXCisnXI-a3_IDZzUIYMF3Y8_0 2024-09-14T11:58:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5624943837309075030', time=2024-09-14T13:37:59.879390+0000, chain.objs.size()=1 2024-09-14T11:58:38.381 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rB60ocp7DW7dMa7FB0YgYbNJHi0Tz23_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15585127432899302304', time=2024-09-14T13:37:59.914109+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GDnUusx7IMrNtNW_J62-ciBtpejGuww_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11943715635236243163', time=2024-09-14T13:38:00.200927+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lj37KnYujTD1Zn20PPehrmM7vf4lkbs_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9244907192873926460', time=2024-09-14T13:38:01.263695+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-eB1kn16hMtbXTWeMQLqEJagGjI9T9Z_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5315342193111845346', time=2024-09-14T13:38:01.542834+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jioIY3Bi30SxhEwj3FLtWTYIrsm8JNG_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1305326549966847053', time=2024-09-14T13:38:02.073108+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vHG8NYCfZzXSEoRNt67jwfyVmQmCO8__0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17779227258578490442', time=2024-09-14T13:38:02.409873+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b0jdsnUCd4LxJE29lzvXxfggqWxPbFf_0 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5949802679798143693', time=2024-09-14T13:38:03.067247+0000, chain.objs.size()=1 2024-09-14T11:58:38.382 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.383+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tJexwFbwSdNS9NNEoAgVcyy52korcBN_0 2024-09-14T11:58:38.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10616727694878751660', time=2024-09-14T13:38:03.317994+0000, chain.objs.size()=1 2024-09-14T11:58:38.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jeWsVJUIbS2V1m-ve_GoDR_S9x4160r_0 2024-09-14T11:58:38.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14598032558350666647', time=2024-09-14T13:38:03.353494+0000, chain.objs.size()=1 2024-09-14T11:58:38.385 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.U4TO8pbJF2HmP2ZDPkb1Wmb5UdOBM9N_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9637057891194352644', time=2024-09-14T13:38:03.354156+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qlqoPp7fNT6g8zmjOorlPHpxljUSJqQ_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3451039782353768424', time=2024-09-14T13:38:03.816095+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SFEsS7Q32zBs828367rIURperXfRmoM_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9330936673064012649', time=2024-09-14T13:38:04.043977+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0V_QISUW1E3lYfZFCBcBhtd1zcUbZ8z_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17222045350945783114', time=2024-09-14T13:38:04.508068+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KVZbEliHi6orGvqUfL3IZk3i-QKjjAe_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15236345888484930296', time=2024-09-14T13:38:04.565023+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3JWKob-cbGXcXv5xKxZes130Aiah4gM_0 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17046903866267706023', time=2024-09-14T13:38:04.821207+0000, chain.objs.size()=1 2024-09-14T11:58:38.386 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.387+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.f8nUqM5Z0SepCy9-oVQO2iKgI-HEyTI_0 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11689782247262732388', time=2024-09-14T13:38:04.918685+0000, chain.objs.size()=1 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jmv89apzk2hgKDs9A8olF9Z3oqqN9nU_0 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4866968691673172098', time=2024-09-14T13:38:07.234874+0000, chain.objs.size()=1 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PAFFD-QVqN01aLZ-n0Xm1uO6BbA8uxz_0 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7107864839314086507', time=2024-09-14T13:38:07.749506+0000, chain.objs.size()=1 2024-09-14T11:58:38.388 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.390+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zf1L_XY2iWrVn99qUAn1uvbAeRBXkx8_0 2024-09-14T11:58:38.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.391+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16280016248003725560', time=2024-09-14T13:38:08.586857+0000, chain.objs.size()=1 2024-09-14T11:58:38.389 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.391+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4FLUDinQePbd27wpmGk_c5HUUA4wSxn_0 2024-09-14T11:58:38.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12122016028655854530', time=2024-09-14T13:38:08.628749+0000, chain.objs.size()=1 2024-09-14T11:58:38.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EmCLkKXADiH9Johb3hymbFkB83g1zKj_0 2024-09-14T11:58:38.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17176866698125410325', time=2024-09-14T13:38:09.584663+0000, chain.objs.size()=1 2024-09-14T11:58:38.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Y-LboUsrtjCCGe3yINmlIBwZ9lJzwfa_0 2024-09-14T11:58:38.391 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2981609622357048232', time=2024-09-14T13:38:09.710404+0000, chain.objs.size()=1 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zd1oVbrUxalIy3b_mqp7JrSgyy64A_P_0 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.946460998412220194', time=2024-09-14T13:38:10.184705+0000, chain.objs.size()=1 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NxrsnmuHCqGrLe7M_DLZtbe1AbeZIew_0 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12693599662742394698', time=2024-09-14T13:38:20.153973+0000, chain.objs.size()=1 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.277__shadow_.FRI_w0GypHunvmvkRrKDXCjaAaAYkFT_0 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7306453558579620060', time=2024-09-14T13:38:25.311196+0000, chain.objs.size()=1 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.284__shadow_.VgdbYgCCiYyD_URs3hYGYZoB8hUouN-_0 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13265675239790206747', time=2024-09-14T13:38:26.096058+0000, chain.objs.size()=1 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.393+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.285__shadow_.gO9tD-DiAfsmzb9slh8cLlDMmrDaAtT_0 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16670305482193871437', time=2024-09-14T13:38:29.863197+0000, chain.objs.size()=1 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.290__shadow_.aWWO2Sg1kc8V9lvpLtQLDJRXooEP1h5_0 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18043446490817348985', time=2024-09-14T13:38:29.863821+0000, chain.objs.size()=1 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.290__shadow_.mFAMtoHhcvR5OLkFovosCWKP1--5bOD_0 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10664768270013028349', time=2024-09-14T13:38:29.868269+0000, chain.objs.size()=1 2024-09-14T11:58:38.393 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.394+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.290__shadow_.qRkXOffCyJZ8jgo7lxmtP74l8G5WwKg_0 2024-09-14T11:58:38.394 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.397+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7969155503747501734', time=2024-09-14T13:38:30.592277+0000, chain.objs.size()=1 2024-09-14T11:58:38.395 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.397+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.291__shadow_.Rq0G-hnY86e0lrJqEgqQt_FpPJDQeTx_0 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6689774663410314805', time=2024-09-14T13:38:37.181085+0000, chain.objs.size()=1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.296__shadow_.BhK7eh9VfqQNUwOUyx9y9Z4fzlK49-C_0 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10371179374897049340', time=2024-09-14T13:38:41.016108+0000, chain.objs.size()=1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.301__shadow_.9h6bBUb53TmZ4oLGfzCHv0uFCSMtfDa_0 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17424816950118934433', time=2024-09-14T13:38:42.511286+0000, chain.objs.size()=1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.303__shadow_.E8VvbNwlCKZi7cJJ7oTe2mhSdpvKHGe_0 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16859906854080549967', time=2024-09-14T13:38:56.985021+0000, chain.objs.size()=1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.322__shadow_.YnflI0MG_7FTlXv8Qik12IE9X82nRyj_0 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13173326015809145665', time=2024-09-14T13:39:38.452438+0000, chain.objs.size()=1 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3R7z2rT13Wm28km14dP-5BTaBmd9wYK_0 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10954323216525322401', time=2024-09-14T13:39:38.493203+0000, chain.objs.size()=1 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Jssq2XTuVRvUSG_2WcaM5qIkX8dLo9b_0 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10905321682183287760', time=2024-09-14T13:39:38.698267+0000, chain.objs.size()=1 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wgIYBn9fbMFGDvRz0ywmDCFs1-RfRY6_0 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3797652746450542530', time=2024-09-14T13:39:39.175954+0000, chain.objs.size()=1 2024-09-14T11:58:38.398 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PmAH-HaZEI7FNtH9EgxbWmlTcCoPXPc_0 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10663133773058141965', time=2024-09-14T13:39:41.058786+0000, chain.objs.size()=1 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XdVm-Im6WwhQ5yIu5PhYVZ99jnhk7d__0 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16312866105017686791', time=2024-09-14T13:39:42.459163+0000, chain.objs.size()=1 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.399+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HZlnJX23mtu2vMB7PPU5WSYyTnX-9XL_0 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.400+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18230711302753495500', time=2024-09-14T13:39:42.493815+0000, chain.objs.size()=1 2024-09-14T11:58:38.399 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.400+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GW3uGUP_V3ho2Diy3U337TcI7gvxW4P_0 2024-09-14T11:58:38.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.404+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10791163860950513178', time=2024-09-14T13:39:42.644992+0000, chain.objs.size()=1 2024-09-14T11:58:38.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.404+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xsEdKwWaR6MO4cEGQaiNwZJ4dQLcPPB_0 2024-09-14T11:58:38.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.404+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.75869898213872556', time=2024-09-14T13:39:43.649677+0000, chain.objs.size()=1 2024-09-14T11:58:38.402 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.404+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PjSrLM8Xshfbw2kn_KoJhbqoCH65X9a_0 2024-09-14T11:58:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11055804050523203299', time=2024-09-14T13:39:43.671777+0000, chain.objs.size()=1 2024-09-14T11:58:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Oyl7l6lMzIgIbkjnlbeQetmT7xEYfnA_0 2024-09-14T11:58:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12459896731920099118', time=2024-09-14T13:39:43.814485+0000, chain.objs.size()=1 2024-09-14T11:58:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Zp7RvXeBj42DHSAc_HEGspFjTzoFpuh_0 2024-09-14T11:58:38.404 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8881679470893844964', time=2024-09-14T13:39:43.931421+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vTHP3Clbhc7mdfDCfkbaM7CTKhdLFcg_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11789269139974887862', time=2024-09-14T13:39:43.964827+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cyrvdUNPMq7ypV_psSxBg2yYp7w0Fo5_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6311203639107748102', time=2024-09-14T13:39:43.995892+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.r-JMV8jpO-m9aCJ6x7hHRvsYi5lKzk4_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11493627260195711841', time=2024-09-14T13:39:44.069171+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fRbMlqkbs8NUdBNgbAzTIdHBOIgrzji_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5729023748155380828', time=2024-09-14T13:39:44.230716+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BiyX1J5b5Q2bK4ICOl4chmy8ucHrkOq_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16589843854346137163', time=2024-09-14T13:39:45.846429+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.HlDh8HhBg3PBwcTpJX9b3WZfaMVWbdg_0 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.829316087801655413', time=2024-09-14T13:39:46.011440+0000, chain.objs.size()=1 2024-09-14T11:58:38.405 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.406+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OmQ_D0x4kE7jVFpLs0KR-oy_VbNkg08_0 2024-09-14T11:58:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.407+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16318749717236646014', time=2024-09-14T13:39:46.051312+0000, chain.objs.size()=1 2024-09-14T11:58:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.407+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BsSEtM2I6dxxuqdriqhhji-0PnfyoXy_0 2024-09-14T11:58:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.407+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17873715169670826860', time=2024-09-14T13:39:46.985648+0000, chain.objs.size()=1 2024-09-14T11:58:38.406 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.407+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.G0RWf25SC4P1psHT1lgg6MboTKL8ZYR_0 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1449107286657680744', time=2024-09-14T13:39:47.067360+0000, chain.objs.size()=1 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C3vrubDyNOBhNrhaNip_LXTUvWcA0mw_0 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10384385559931107161', time=2024-09-14T13:39:47.223479+0000, chain.objs.size()=1 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kt7tpcjVmITYekxbIJKeNuqoyXbSJyg_0 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1409527358646138586', time=2024-09-14T13:39:47.815260+0000, chain.objs.size()=1 2024-09-14T11:58:38.408 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TTcK7MsVC6z4C8OQhJ1tRUteJK2CEh6_0 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17636280340478595291', time=2024-09-14T13:39:47.977391+0000, chain.objs.size()=1 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.G2iQH7PALC3uU5Re8b85GN_IA_Zhhu2_0 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5346211320262851203', time=2024-09-14T13:39:48.454996+0000, chain.objs.size()=1 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.As2ZiD2ExbrVDVlUKBeOTMbOBXc830__0 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3499926723924113726', time=2024-09-14T13:39:49.283441+0000, chain.objs.size()=1 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hoPN-1JdPXUH2Qq4IYgrJYoJD9IhUOY_0 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12829950473070467515', time=2024-09-14T13:39:49.389056+0000, chain.objs.size()=1 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.410+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vPHI7_QDqfUyllH3W7yrm3_MFQhI1pM_0 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2970797174473066745', time=2024-09-14T13:39:49.535761+0000, chain.objs.size()=1 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nLdV3frxDbFkTw8hkfDgDrVMCddd4IX_0 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.411+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5405660517324384874', time=2024-09-14T13:39:50.144266+0000, chain.objs.size()=1 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.411+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3JB1hzOrKUwdBl6bHnJFm8EePMZuk5O_0 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.412+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.277807661616081711', time=2024-09-14T13:39:50.285024+0000, chain.objs.size()=1 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.412+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xQQPpOwP0xZGoinkbrBoHIpVFVbZ7vD_0 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.412+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16221632372229481088', time=2024-09-14T13:40:31.665130+0000, chain.objs.size()=1 2024-09-14T11:58:38.410 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.412+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hMXKzNjQ5xmMjCSqbBZ6z24xS7dEuMo_0 2024-09-14T11:58:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.413+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2451867822674317792', time=2024-09-14T13:40:31.759480+0000, chain.objs.size()=1 2024-09-14T11:58:38.411 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.413+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mdYAe6TIyGiCSZzl6rihkXR96Z-qVru_0 2024-09-14T11:58:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.414+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13471091260283848061', time=2024-09-14T13:40:32.718895+0000, chain.objs.size()=1 2024-09-14T11:58:38.412 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.414+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AyRZOB7KiO4sz4JI1BFsXws4UGr4MVZ_0 2024-09-14T11:58:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.416+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2630454761374407467', time=2024-09-14T13:40:33.110929+0000, chain.objs.size()=1 2024-09-14T11:58:38.414 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.416+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IyR85Hv2L1E0NoeMnDpVKH5Vk8TLtFA_0 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7396354127381520239', time=2024-09-14T13:40:33.610265+0000, chain.objs.size()=1 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.txEoVqJdp7Nor3m_mD7w15LAOEv3FQd_0 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16303791824672977069', time=2024-09-14T13:40:34.411287+0000, chain.objs.size()=1 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Nej3vp-uJu5LpXj9xOQRTGy9jBm08NI_0 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5412896786391261502', time=2024-09-14T13:40:36.455499+0000, chain.objs.size()=1 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5_0EnjWjkD1jl6Dd51wdpMIY3pmT_I-_0 2024-09-14T11:58:38.415 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9285725084029175393', time=2024-09-14T13:40:36.784703+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.m4kY2_SBTwycDYEO_T4rabWYn422aIn_0 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7378652336981377433', time=2024-09-14T13:40:36.936515+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DOSBsnTC72qGYRAmLvzZw-l0qWgYuIX_0 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14100235416323401631', time=2024-09-14T13:40:37.088707+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zOA9bKUn9O6UuCt9aPks0YsAUI-c_HJ_0 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12462156881656996134', time=2024-09-14T13:40:37.677824+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2FNKE1LMkt_jem40K3NBtu3pKweckYu_0 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18406758764185249190', time=2024-09-14T13:40:37.876207+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HTtwDT5w9zdJcD8p8XgVosK9uqQOPVF_0 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1243306562932872204', time=2024-09-14T13:40:38.162749+0000, chain.objs.size()=1 2024-09-14T11:58:38.416 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.417+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.87ircKaVxOe8FHRFDXFl9bbu2suE_4l_0 2024-09-14T11:58:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.420+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7625864645541687186', time=2024-09-14T13:40:39.660964+0000, chain.objs.size()=1 2024-09-14T11:58:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.420+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8353kG6qzO5IoUkpV7B1d54rpUcTmXS_0 2024-09-14T11:58:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.420+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13845602121444716843', time=2024-09-14T13:40:40.237746+0000, chain.objs.size()=1 2024-09-14T11:58:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.420+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.k09cxxhvdmo7TzHxWhkzwW1K0NqtbCd_0 2024-09-14T11:58:38.418 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.421+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14364809437112117110', time=2024-09-14T13:40:40.924864+0000, chain.objs.size()=1 2024-09-14T11:58:38.419 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.421+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6EPVGMUc0t9yaiWIWwrG3Y7kki0TxOF_0 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8218513966278161904', time=2024-09-14T13:40:41.660067+0000, chain.objs.size()=1 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.I5EYNzcJb2qNwp8z4QsZs-_54yu15Av_0 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15044376263836051183', time=2024-09-14T13:40:41.845110+0000, chain.objs.size()=1 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.71NXwht-YyaM1wh8T1rSJ2PdouRNSWt_0 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10257617646102549845', time=2024-09-14T13:40:42.249983+0000, chain.objs.size()=1 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HyYRIe-WP5jy8Z9L4D3t1o8ut6aU6Mj_0 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1085838336963919361', time=2024-09-14T13:41:15.083624+0000, chain.objs.size()=1 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.422+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.378__shadow_.SuzfqpfTzq8NtmBoL0pN3LprbvOYeDj_0 2024-09-14T11:58:38.425 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.427+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/53859 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11562724214712959778', time=2024-09-14T13:41:28.334034+0000, chain.objs.size()=1 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.395__shadow:V-d-dMXZb7tUEmJ6toYhUfkceOLHzft_.wyVv2yrXu1ZZYegzM0OMVCRnKUx4eVZ_0 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1694256066327586061', time=2024-09-14T13:41:51.610280+0000, chain.objs.size()=1 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.433__shadow_.ReFP7zczEoSPgVR71a6SUOUagfAbH1W_0 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17673803218608582908', time=2024-09-14T13:42:18.177282+0000, chain.objs.size()=1 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.467__shadow_.1QZUx5EMxKKUW185WGeMqsRtlpPpwU1_0 2024-09-14T11:58:38.428 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13992045417244866567', time=2024-09-14T13:42:32.078973+0000, chain.objs.size()=1 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.487__shadow_.EnT9xWkXtigTAEg6ehc6gJJ1PNPX4Cs_0 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16710250420857426811', time=2024-09-14T13:42:39.594299+0000, chain.objs.size()=1 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.498__shadow_.RFQpWmtc0GJ-ICEa0jSlKmIY_R5l-fZ_0 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14020901677188654711', time=2024-09-14T13:42:39.860901+0000, chain.objs.size()=1 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.499__shadow_.L1RGOpjurXSZqE_enYYjTrmuDtm9uUT_0 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1159826066995627431', time=2024-09-14T13:42:53.757610+0000, chain.objs.size()=6 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.1 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.2 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.3 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.4 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.5 2024-09-14T11:58:38.429 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.430+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.508__multipart_srcmultipart.2~lyMOqTPpdgIKCNpyC5LhtifpymTKi9I.6 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7952663209225043929', time=2024-09-14T13:46:02.618905+0000, chain.objs.size()=1 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.557__shadow_.6hjzl8Yq37WljfiEs-qtV1ZYQQMLdrx_0 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16463507126396069064', time=2024-09-14T13:46:40.181293+0000, chain.objs.size()=1 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.573__shadow_.6lD51hFpmNQudErMlgosj45tV-OsUr1_0 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2644834871088663603', time=2024-09-14T13:52:38.496667+0000, chain.objs.size()=1 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.673__shadow_.PcZUa6tyesHQ1i-OecpYkfbBAMtPGRZ_0 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3855688306241278602', time=2024-09-14T13:55:59.917939+0000, chain.objs.size()=1 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.433+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.774__shadow_.fb-y_WV0KW6rM6OyPgvYyHJJeca4-bK_0 2024-09-14T11:58:38.435 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.437+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.437 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.440+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:58:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.441+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.439 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.442+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.442+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47236' 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.442+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15533699500072784846', time=2024-09-14T13:36:58.447618+0000, chain.objs.size()=1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.236__shadow_.SUS7wXmebTgCNnfpk0YC4h0iOpLjm23_0 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12834874472564452817', time=2024-09-14T13:37:57.847879+0000, chain.objs.size()=1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wOkoBTxhX1l4mzBp8HQmWmlevzQ8Snl_0 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2837775986287555792', time=2024-09-14T13:37:58.398672+0000, chain.objs.size()=1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.34mkcMspjP3935WDYC16libYYNquDRR_0 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11220204075092290077', time=2024-09-14T13:37:58.526742+0000, chain.objs.size()=1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sJMcmc1MTrmKxMBFE4jdzRymEE12aF1_0 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1379407110000653760', time=2024-09-14T13:37:58.557493+0000, chain.objs.size()=1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TPhzfUz8taL3fmv3jNfFURQAiipgF5D_0 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4527506927707813124', time=2024-09-14T13:37:58.613543+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xd3GO9oW9mW9rRjlmkTaq1Pg1tI9_X7_0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6474688514948740324', time=2024-09-14T13:37:59.534251+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CGlDGNrR_iCRJq7wm_dCatPXaCA8uAJ_0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1082281318145872974', time=2024-09-14T13:37:59.984503+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VPGmpYMOF4y1qsrGoWw_N6WfTO6IDp__0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13961971773654195941', time=2024-09-14T13:38:00.467190+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2q-F0bKRYLErq4le-z8RYhX7qmUTV8J_0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1058740237788603606', time=2024-09-14T13:38:00.673048+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hHZXM7fmNt5RQ__cpvyh0pHSMAc_DQw_0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16050646573660768618', time=2024-09-14T13:38:02.950080+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1ss-DwdHg3QIG4FylWzff4CShJN-auz_0 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15519975642874494139', time=2024-09-14T13:38:02.986962+0000, chain.objs.size()=1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.443+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2eccr2vIUOTiSxqh0URvX_p3BQYLD60_0 2024-09-14T11:58:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.445+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8056101861403530338', time=2024-09-14T13:38:03.067943+0000, chain.objs.size()=1 2024-09-14T11:58:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.445+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4bC0QnfwTzlOl1QuKf8z2CYtI1R5xyH_0 2024-09-14T11:58:38.443 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.446+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9429308987270971657', time=2024-09-14T13:38:03.187354+0000, chain.objs.size()=1 2024-09-14T11:58:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.446+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2A_Zn-H00uuzJ_V6JKDIZ9O18utrXdK_0 2024-09-14T11:58:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.446+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13482188462432896442', time=2024-09-14T13:38:04.669105+0000, chain.objs.size()=1 2024-09-14T11:58:38.444 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.446+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7wTbS-bw5S1z09cDoP7M_JtwWKLvyAN_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6921250247565132944', time=2024-09-14T13:38:04.715417+0000, chain.objs.size()=1 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W5Irg-W6me5hDFSN4RBrpe9ySToaEUx_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1132271183736439505', time=2024-09-14T13:38:05.375367+0000, chain.objs.size()=1 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Wy7yDw_duOgS7jE-5jBCH6Ne_iLZMCl_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10130100705590940241', time=2024-09-14T13:38:05.403642+0000, chain.objs.size()=1 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.v3abpgQkTXR4JgCSTojxcN_IQOKj9vV_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5838534554502614854', time=2024-09-14T13:38:05.762839+0000, chain.objs.size()=1 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.srRrcX4FgEhMGbLqI6JYv1lctypPcwm_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16673935022102232440', time=2024-09-14T13:38:07.179713+0000, chain.objs.size()=1 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.72yRqWS4qSw-1nv3y6N0lVWhCG_x_G9_0 2024-09-14T11:58:38.446 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16082164059116091482', time=2024-09-14T13:38:07.288939+0000, chain.objs.size()=1 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xBafu5KspYV3fxSNrBAPn-ouQhwmAP-_0 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14866597352246459518', time=2024-09-14T13:38:08.056999+0000, chain.objs.size()=1 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.L87GsIS2usr1RnN_Ql3dSf0ls1FmR75_0 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17399108142001763810', time=2024-09-14T13:38:08.226003+0000, chain.objs.size()=1 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tnPkfqjXAX6Mk8SO9E_JW-Ya-GeE5Cz_0 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5018668134419888081', time=2024-09-14T13:38:08.518591+0000, chain.objs.size()=1 2024-09-14T11:58:38.447 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.448+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.m-vCJGtC_lqdQSyoMh4roslsfBnX22Z_0 2024-09-14T11:58:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.450+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11768019988066219004', time=2024-09-14T13:38:08.687809+0000, chain.objs.size()=1 2024-09-14T11:58:38.448 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.450+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZcQ588IkcCyPSU_2SIH75T1iJxGkQs2_0 2024-09-14T11:58:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18244972574087683522', time=2024-09-14T13:38:08.936005+0000, chain.objs.size()=1 2024-09-14T11:58:38.449 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HutDbNKkik3pAzWsWDzVQ_oy3WCAnVg_0 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.235796133873976376', time=2024-09-14T13:38:09.062803+0000, chain.objs.size()=1 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.TOzGzSCTXZfq20e9qr4Z7wAb52Kn1HG_0 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9995956050395857855', time=2024-09-14T13:38:09.404229+0000, chain.objs.size()=1 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.04HX4zLOdHUWvoqxctuIteioISHqfoJ_0 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2378651232137809745', time=2024-09-14T13:38:09.758992+0000, chain.objs.size()=1 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uQtx9fuef13x4awx6bHCjJP8LgBX2AC_0 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15304269171727033372', time=2024-09-14T13:38:09.802830+0000, chain.objs.size()=1 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.452+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gg9YfywcBTWh33NaVel8VhCpW_wFVAq_0 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.453+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10353103167792892372', time=2024-09-14T13:38:09.865249+0000, chain.objs.size()=1 2024-09-14T11:58:38.451 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.453+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WjmzHCUnQENqQFWzLmjRm0KWLVLA8ed_0 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11796894218293814658', time=2024-09-14T13:38:09.921577+0000, chain.objs.size()=1 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RazSMhDGtm_aMKZ6WLyQrjgvLqal6n8_0 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10999669372233545543', time=2024-09-14T13:38:09.954354+0000, chain.objs.size()=1 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.EB2-XE0AV1MMrmg5VUaETgyvTnxh1QU_0 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5428926294566064195', time=2024-09-14T13:38:10.101833+0000, chain.objs.size()=1 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6LTSiGH0fDqLexwFar-LyeVyqPrfqB9_0 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11411982250075784240', time=2024-09-14T13:38:10.362260+0000, chain.objs.size()=1 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Gw3nwfNJRKArpKTyGQQ9VeeWSqhq3xr_0 2024-09-14T11:58:38.453 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7965131629068441800', time=2024-09-14T13:38:13.214752+0000, chain.objs.size()=1 2024-09-14T11:58:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.267__shadow_.xwNsxoMc061a6USPfLTZTbCtg0dzV3T_0 2024-09-14T11:58:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14724834295311358713', time=2024-09-14T13:38:15.965215+0000, chain.objs.size()=1 2024-09-14T11:58:38.454 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.455+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.271__shadow_.DC12P3qI-YNEEmkYqXu9WhpYQbP0yfX_0 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.457+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12535458186791374125', time=2024-09-14T13:38:27.686274+0000, chain.objs.size()=1 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.457+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.287__shadow_.sjQ9gmXkpYrwZ_u3nk4EouxeoBmlO8l_0 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15402860086447621415', time=2024-09-14T13:38:33.584756+0000, chain.objs.size()=1 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.7tyd_IHy3-jNtQIaHxTXmjSE7CmA_2d_0 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13602798968472222494', time=2024-09-14T13:38:39.472369+0000, chain.objs.size()=1 2024-09-14T11:58:38.456 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.299__shadow_.yJIlAm48di-BSzWYj2VSRdE2Zl7zfsJ_0 2024-09-14T11:58:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.312885526727659907', time=2024-09-14T13:38:43.241430+0000, chain.objs.size()=1 2024-09-14T11:58:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.304__shadow_.tGnoI4HLJ-SXgi8ktiC-vYphJOeP1fa_0 2024-09-14T11:58:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8509820306785017748', time=2024-09-14T13:39:38.707864+0000, chain.objs.size()=1 2024-09-14T11:58:38.457 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.458+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.enF7iqsvna0DEz7oMLQRuOgei14Y7CR_0 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11650720401588026445', time=2024-09-14T13:39:38.899690+0000, chain.objs.size()=1 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7OFiS97PhXdZNKuqQgBnpqGVSW2c8AW_0 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10546206548125996435', time=2024-09-14T13:39:39.279334+0000, chain.objs.size()=1 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uWcht1bfutmnoRntKAglfr-2KuvDPZ7_0 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8363690438676000180', time=2024-09-14T13:39:39.353012+0000, chain.objs.size()=1 2024-09-14T11:58:38.460 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.460+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ANQxgE5j3A7ZWsDa5YUNvobxDsHYwq8_0 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.461+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17426774824134551722', time=2024-09-14T13:39:41.004910+0000, chain.objs.size()=1 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.461+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UDGatbl1eF40STTDFX_YBTCMvuIfvj4_0 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.461+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5736363415074068500', time=2024-09-14T13:39:42.340843+0000, chain.objs.size()=1 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.461+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xIxb6quZ_SzvLQ2MNmr-x02exl4dO83_0 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.462+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13271977833642580788', time=2024-09-14T13:39:42.398648+0000, chain.objs.size()=1 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.462+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3nfINjncYhYtx8t0qFaO5XQT8bEUb9s_0 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5942776578010617169', time=2024-09-14T13:39:42.869175+0000, chain.objs.size()=1 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.T7NeKBeRSYI_Slyo_zsj1D51REn9z1P_0 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12909766233714427068', time=2024-09-14T13:39:43.647931+0000, chain.objs.size()=1 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AtPenUMZqZR0W05QyA_FQbFq-Z8nu27_0 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10621098191163445771', time=2024-09-14T13:39:43.796660+0000, chain.objs.size()=1 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uCCL4tEKl5T2N1CUN5Pc1WscjZzpVLR_0 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5453302327394511287', time=2024-09-14T13:39:44.469513+0000, chain.objs.size()=1 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IcLdHfkvSEGv2QDRCpU0NS2e6jNCEZ6_0 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9352489387046715775', time=2024-09-14T13:39:44.758765+0000, chain.objs.size()=1 2024-09-14T11:58:38.462 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.464+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LZhWoteKAP0y3XQ4wjwn-HH1f-TZsFo_0 2024-09-14T11:58:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12517802979971057795', time=2024-09-14T13:39:45.271964+0000, chain.objs.size()=1 2024-09-14T11:58:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uVwm6ESkpZ4g1epryQNAMSKRV0noBXJ_0 2024-09-14T11:58:38.464 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10749521166411227399', time=2024-09-14T13:39:45.771048+0000, chain.objs.size()=1 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.douBhgsQldHQrA9u69wB9ek79cvsq1Y_0 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13965378263427972487', time=2024-09-14T13:39:45.839848+0000, chain.objs.size()=1 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.466+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.aoxtkw-Wp3aGL37Tkn1M7oIQpibbEDR_0 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2866899071015145539', time=2024-09-14T13:39:46.112977+0000, chain.objs.size()=1 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fBopEB6PDRZ356vGmtEOxV-h0fmrrX3_0 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6510281116591432155', time=2024-09-14T13:39:46.246118+0000, chain.objs.size()=1 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Z9crCurZaXyhGyC-X3tUPjmTDeIAnKV_0 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12560550469003459366', time=2024-09-14T13:39:46.462203+0000, chain.objs.size()=1 2024-09-14T11:58:38.465 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.467+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.U1_ZITXUzFOclNPFDRuPMZOd4JrscfR_0 2024-09-14T11:58:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.468+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3778903053139268002', time=2024-09-14T13:39:46.879475+0000, chain.objs.size()=1 2024-09-14T11:58:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.468+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sgJaxKz67-kpcfvvob5cReEdeE8sfM7_0 2024-09-14T11:58:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.468+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2091238331427499521', time=2024-09-14T13:39:46.880666+0000, chain.objs.size()=1 2024-09-14T11:58:38.466 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.468+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Qc2G8b7UcxiqyyLw2otIWc6ZSQIoAsd_0 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15581192937189096230', time=2024-09-14T13:39:47.083330+0000, chain.objs.size()=1 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.h2ivtj3ySQoBEAH9SCS7Q74u8XEoGSF_0 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8872517918278225775', time=2024-09-14T13:39:47.237276+0000, chain.objs.size()=1 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.X0DUfzx7_BdVTzpjxUa12a2imyU1akE_0 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13175593583012607343', time=2024-09-14T13:39:47.544776+0000, chain.objs.size()=1 2024-09-14T11:58:38.467 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.469+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qyrcWU8vrmDAsizDEiSLY5CaqLxIPGu_0 2024-09-14T11:58:38.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.470+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17098415716969425362', time=2024-09-14T13:39:47.868451+0000, chain.objs.size()=1 2024-09-14T11:58:38.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.470+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ak9nED9aH6EwxyzOkEqBi9CA5ANJHTy_0 2024-09-14T11:58:38.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.470+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3211911013394094625', time=2024-09-14T13:39:47.900380+0000, chain.objs.size()=1 2024-09-14T11:58:38.468 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.470+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.B2E-uAlZKsmZYpDexr-_u40qu64dbH2_0 2024-09-14T11:58:38.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.471+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10461918420218353810', time=2024-09-14T13:39:48.385582+0000, chain.objs.size()=1 2024-09-14T11:58:38.469 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.471+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.A7alRWDw0NwpEIKs9GsnNFrAs5AgfRP_0 2024-09-14T11:58:38.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.472+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3148994672555989876', time=2024-09-14T13:39:48.414118+0000, chain.objs.size()=1 2024-09-14T11:58:38.470 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.472+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cSvzwm_QwRJOiFuiFu4P_PURaRcyzQE_0 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2973541308534590436', time=2024-09-14T13:39:48.472140+0000, chain.objs.size()=1 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.O4zllZyCOgHHlkQivoghvrtRBz1m2UG_0 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16362601719439604034', time=2024-09-14T13:39:48.566036+0000, chain.objs.size()=1 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.31MGnZLQtbdBLICUUTIRwIWJSyOjbFq_0 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1410964491719392458', time=2024-09-14T13:39:48.627777+0000, chain.objs.size()=1 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7awKe6muMVmKc19jSzwMHxB9JC33mod_0 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5069511822568112847', time=2024-09-14T13:39:49.132332+0000, chain.objs.size()=1 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ld7JGAFcI0jfyz9DfxNv6_pR_lys6Pd_0 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.381044936234572145', time=2024-09-14T13:39:49.939467+0000, chain.objs.size()=1 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IDhMq9pJF1IDv-k8WYp_nJVq1F20NF6_0 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16928686289918302783', time=2024-09-14T13:39:50.426276+0000, chain.objs.size()=1 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.475+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7SUDc9O1kHnmuAj9YHX3x4L0AJzMQi__0 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3023412460300115127', time=2024-09-14T13:40:30.919913+0000, chain.objs.size()=1 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.A6aoV3PKuH3kP5EnCb9RfinH9o2PnSO_0 2024-09-14T11:58:38.474 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14478910437630405765', time=2024-09-14T13:40:31.453063+0000, chain.objs.size()=1 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QNPG_fR2Iq5_SUF4f5EyODJjYQWlpA6_0 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14225021238773733177', time=2024-09-14T13:40:31.569836+0000, chain.objs.size()=1 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JQLiQaOH1pje9X37Srwysgb1OSciYo2_0 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8899108979711551900', time=2024-09-14T13:40:31.713493+0000, chain.objs.size()=1 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wAXPIPFK5Cqy7W2WD2_k1F1HQQ1cKMO_0 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3280227684359196859', time=2024-09-14T13:40:32.541656+0000, chain.objs.size()=1 2024-09-14T11:58:38.475 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.476+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9ZEtvR7FR6PTaKbCALDuBp22PJnz0bS_0 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13477060471870880670', time=2024-09-14T13:40:32.865092+0000, chain.objs.size()=1 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NoNbt-1mWlCDRdirdFqCoDHb2AcY2hq_0 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11602973061198139159', time=2024-09-14T13:40:33.213518+0000, chain.objs.size()=1 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.U4bCKtF7z7qMmcVMiOj3t69wbPrHzLc_0 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9417994705038614965', time=2024-09-14T13:40:33.214045+0000, chain.objs.size()=1 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7LMSttAqeUSQtkUoXhgTOIGV4MeULo6_0 2024-09-14T11:58:38.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.515736430945040063', time=2024-09-14T13:40:33.319157+0000, chain.objs.size()=1 2024-09-14T11:58:38.478 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.479+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LG7kaAoyHKdfTnV3-njXxxvQafzUPtS_0 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3243267217270379477', time=2024-09-14T13:40:33.469890+0000, chain.objs.size()=1 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XwwiyfAovfRDf3byGUQiScdTHMVDhJR_0 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12609341202553493462', time=2024-09-14T13:40:34.416734+0000, chain.objs.size()=1 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Di1K1DJI1kvcX_rzMcprhtEeQvI0cEJ_0 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6545331989769816594', time=2024-09-14T13:40:34.562592+0000, chain.objs.size()=1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SyMoX6r4hx-3hghIJL54g3b2eOUgzlL_0 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11822143233678961651', time=2024-09-14T13:40:34.752169+0000, chain.objs.size()=1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.I1YCDrV5y3yNGesEJGFJye4u83BMdtJ_0 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17817256989765411925', time=2024-09-14T13:40:36.286359+0000, chain.objs.size()=1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XLMYXnioaN0TxCsxYXaeYZHHRKvsqOg_0 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13232779376874057703', time=2024-09-14T13:40:36.495365+0000, chain.objs.size()=1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.l3JM1Ii6IBZ9w8EzyjOziE2JXRSjg-Q_0 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.55297687840550135', time=2024-09-14T13:40:38.007316+0000, chain.objs.size()=1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.481+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sXPnYJ1oKwSQX7KnzvHqPVundBLCnC1_0 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10996137324550766640', time=2024-09-14T13:40:38.040845+0000, chain.objs.size()=1 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AffpjOnDERJPkCtYnoOQiUko8mNpQWo_0 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14136982786942251017', time=2024-09-14T13:40:38.454408+0000, chain.objs.size()=1 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CEBZYMkBMS8BydHJowERWTSJuYu2T16_0 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17885659247213584827', time=2024-09-14T13:40:39.315582+0000, chain.objs.size()=1 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.RRVdOncj_aqikfB_Kkwf7bir_sV_C1T_0 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7284103046031076563', time=2024-09-14T13:40:39.531745+0000, chain.objs.size()=1 2024-09-14T11:58:38.481 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.483+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zR0e_LIiASvWBcGjlIP1Hmnmis27QHF_0 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5965320913212562987', time=2024-09-14T13:40:39.667309+0000, chain.objs.size()=1 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qKPAkkTeGUqaxR_Si-3QHa7aGuhLYup_0 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2751143258187685120', time=2024-09-14T13:40:39.800811+0000, chain.objs.size()=1 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.23rtNI7BJrf7ECIL99FR7RBQJDh9agz_0 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12282336970604252456', time=2024-09-14T13:40:40.087135+0000, chain.objs.size()=1 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.00o9YhJSsg-Sl_BFcCvXQTheYb8yNeb_0 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7045279829878390575', time=2024-09-14T13:40:40.235759+0000, chain.objs.size()=1 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-DvlFYDe2qVfpyoZguKggfaPF7gmDrG_0 2024-09-14T11:58:38.484 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16523643446292580039', time=2024-09-14T13:40:40.324835+0000, chain.objs.size()=1 2024-09-14T11:58:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EGIgUt_4AAPw_kXV0gAdWWGPQroc4Br_0 2024-09-14T11:58:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1859408976638039168', time=2024-09-14T13:40:40.698117+0000, chain.objs.size()=1 2024-09-14T11:58:38.485 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.486+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dKu4TQSyK3qSpNl25vB6TLfU_gCQSt2_0 2024-09-14T11:58:38.487 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.490+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47236 2024-09-14T11:58:38.490 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5409781106833846116', time=2024-09-14T13:40:40.875162+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AxxLtgZtyhfdcbZv5bqnVwwR5nRzofg_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3065863259259915224', time=2024-09-14T13:40:40.875663+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FNnGBsBs1cRxxfdXABuj91l8Mn7rvaE_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6225215373746372695', time=2024-09-14T13:40:41.648241+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QKN_kSWYQa8zF690nPzi7rAauFvmGhX_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5158880730387829298', time=2024-09-14T13:40:41.691137+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.moI5vbJNLwC4t6ZrbKIuBYD0FTRCEuJ_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2771639655352515282', time=2024-09-14T13:40:41.744825+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.r_hjAQZX7mSsoRSASQ0qdj7-fS4f7PU_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16234029574515339314', time=2024-09-14T13:40:41.880601+0000, chain.objs.size()=1 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ihd48YmgCL-kyebryImETX40olQM595_0 2024-09-14T11:58:38.491 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4606937693060527037', time=2024-09-14T13:40:42.188278+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AycdKMJXnz5cL7_jeWhAxMB-ZtSjJUc_0 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2050433262997455451', time=2024-09-14T13:40:42.219207+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0mAihTlXdGc_UUyt4ZrmdHD55GxDoST_0 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14502458505954149195', time=2024-09-14T13:40:42.393360+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jGmz1I70eIL_QjiK5E0EWo761Wt-8Q5_0 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16854952920577750298', time=2024-09-14T13:40:42.774833+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bt-uySAcI0PBHq5ItJ7BqA9yTuDTE_W_0 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16384796265472747500', time=2024-09-14T13:40:43.034297+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bWD7ieXFdBtsqSUlOZHpieq6eYXNn8s_0 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2279691041829308828', time=2024-09-14T13:41:20.426932+0000, chain.objs.size()=1 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.493+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.385__shadow_.kfVF0a3UA3llVYlJIwGvWbSxwQxqaVg_0 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13336615486288901705', time=2024-09-14T13:41:24.075772+0000, chain.objs.size()=1 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.391__shadow_.UsGHvqt8DCsgGpfRr8ZMuvhI18aFOxu_0 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4458706695475673456', time=2024-09-14T13:41:50.950251+0000, chain.objs.size()=1 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.432__shadow_.IY_C0j2Zg05onQoujNnq6I1OToiy9dr_0 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3304012804520461500', time=2024-09-14T13:42:16.156089+0000, chain.objs.size()=1 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.465__shadow_.JNupn0XeX0OD8MiYQue3cSgSPKbck97_0 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2830554681003818862', time=2024-09-14T13:42:43.859123+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.760215394486118803', time=2024-09-14T13:46:30.441478+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:kbjFddCv2yZLB2AfjsrMCEqu4bWb1UU_.CkZDE9s0gRy0b7zhu3sZmHIBA_G8OKB_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17301022194832728705', time=2024-09-14T13:46:43.723034+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:3Fbj9fF8FD6mF7Yh7atpKxGsMwFDeZe_.Wix4S7cxYOjOX784xlGKPzWpOZLWCiy_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11916683700549884338', time=2024-09-14T13:46:53.435322+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:Oa5m5RlXBCdxYGfsjdrR40saYLgWZw3_.CbPgC_6xL-UZCZV5g4gmrxS_-XR7Mlx_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1815312554523505694', time=2024-09-14T13:46:57.459007+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:2L0kuzNo-5E3NUwuV15J.9KvpXyigjC_.r5krfoYXLf2dz1AXfIFv8tlRGOp1-mJ_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16251697264755805739', time=2024-09-14T13:47:09.697417+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:.kHjTfR-6JiTFHl3lcVZsQVxMzKCEcA_.tpBpnB5Mrq9i1QdauWDWFaUkynhXwGj_0 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14074366602242478884', time=2024-09-14T13:47:15.243434+0000, chain.objs.size()=1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:5Xu7OTI.KOChTfH5NfWsYTgpw4ClEgd_.O5NFtbGx0OS0zLH8GF7ORZKwZvADzjc_0 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8866606261850834019', time=2024-09-14T13:47:34.477683+0000, chain.objs.size()=1 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.497+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:Clhbha0t-LTYzzaKp7RT3h9xWnRM-1t_.SBkEheLedA9NMyls-q896g99eEuNuKT_0 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.314946143607450075', time=2024-09-14T13:50:04.999190+0000, chain.objs.size()=1 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.618__shadow_.NZB07ahTxz7CaeTsZFbYe50MgrNPIN7_0 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1809686034616295078', time=2024-09-14T13:52:32.056773+0000, chain.objs.size()=1 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.664__shadow_.SlROyN6x2VTribxLoX3suair7ahEXsC_0 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1373942934685188585', time=2024-09-14T13:52:42.789837+0000, chain.objs.size()=1 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.680__shadow_.Xlvzr6lk91SOJPSkwdR6jstfVazpc2o_0 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18385405896594702244', time=2024-09-14T13:53:28.540353+0000, chain.objs.size()=1 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.720__shadow_.m_9I9-oplyDuDL2vGMlJA7m77lBaopN_0 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~JjYejnEBJv2AQ9VbfifMuJmfpr6zK_5', time=2024-09-14T13:53:54.705627+0000, chain.objs.size()=1 2024-09-14T11:58:38.500 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.743__multipart_mymultipart2.2~JjYejnEBJv2AQ9VbfifMuJmfpr6zK_5.1 2024-09-14T11:58:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3154955955571350009', time=2024-09-14T13:55:39.335407+0000, chain.objs.size()=1 2024-09-14T11:58:38.501 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.502+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.767__shadow_.EwL3WWt6xXWtdULl2-e2cgiA5qVNM94_0 2024-09-14T11:58:38.505 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.508+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.508 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.510+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:58:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.511+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.509 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.512+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46953' 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1706768104052684815', time=2024-09-14T13:34:25.296263+0000, chain.objs.size()=3 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.A6kz6lIQd1zkesnZfBYMgbVFO3EqbPQ_0 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.A6kz6lIQd1zkesnZfBYMgbVFO3EqbPQ_1 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.A6kz6lIQd1zkesnZfBYMgbVFO3EqbPQ_2 2024-09-14T11:58:38.511 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5430852314707462135', time=2024-09-14T13:34:25.355975+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.159__shadow_.U_hNT4kP6hsTPHQglg00TUlc6zO5Ec5_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_ndmr2ej5IRPwyUlrQopBSdLFf7xMK6M', time=2024-09-14T13:34:42.750466+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.JYRPnZU7WxsMgYz1bPVIfs3hUYRNbIR_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4422783728805776658', time=2024-09-14T13:37:08.292540+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.248__shadow_.aPSd_zbESTZ5-yhDkwaa3G6ljfqpwBq_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.355322532292033579', time=2024-09-14T13:37:09.761992+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.250__shadow_.6iO9hAefT3zokAdxkL6H81EFULdDQGW_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14157990250559903831', time=2024-09-14T13:37:17.752031+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.261__shadow_.cx8RrOao0jtwx3-dlmJL-Mr9NwAsfWB_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3555508225424532341', time=2024-09-14T13:37:57.702271+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WGXJRB2fHI4VVRk9SUaik-jUXFGUUFf_0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5238563255808667019', time=2024-09-14T13:37:58.201526+0000, chain.objs.size()=1 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RDY_6_eYbwhIHZrJhtjkIJIecX-eNQu_0 2024-09-14T11:58:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8055916845649502576', time=2024-09-14T13:37:58.557509+0000, chain.objs.size()=1 2024-09-14T11:58:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dTNeozmXQmmApxoh2833WeW7HkUudHb_0 2024-09-14T11:58:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7470521278928592812', time=2024-09-14T13:37:59.462425+0000, chain.objs.size()=1 2024-09-14T11:58:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.513+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xnUOAdIMWbipUyZ1DgU51m1ToE1w2Z8_0 2024-09-14T11:58:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.516+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16028676132184915226', time=2024-09-14T13:37:59.781463+0000, chain.objs.size()=1 2024-09-14T11:58:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Tw1cp21HNVsTFugqf_dUUAqfr092eLZ_0 2024-09-14T11:58:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.516+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18144681758138412527', time=2024-09-14T13:38:00.263337+0000, chain.objs.size()=1 2024-09-14T11:58:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.516+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HLHoy6UXlXCV628G-poR7bKk50w_SzS_0 2024-09-14T11:58:38.514 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16906853340011452263', time=2024-09-14T13:38:00.357811+0000, chain.objs.size()=1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vquvzMlluSshoDRHOKm4Ow-LX2pw6PB_0 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8435424948954789871', time=2024-09-14T13:38:00.400360+0000, chain.objs.size()=1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nROI0LMc2i0IYOPJ-ydsHq7YC5ViGn-_0 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.649016929810284378', time=2024-09-14T13:38:00.466124+0000, chain.objs.size()=1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.yJ_Zj7_Zqihs0RdcvunlbHGqu__WGpn_0 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3138846792319156', time=2024-09-14T13:38:00.597722+0000, chain.objs.size()=1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BDomWaXx9kluK2VuAanfun9VWsCxX8I_0 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.439576933705078645', time=2024-09-14T13:38:00.695244+0000, chain.objs.size()=1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SUyV9ZvIJeoOJvERfIUDV68lAPDL7tS_0 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.866838386106520720', time=2024-09-14T13:38:00.700221+0000, chain.objs.size()=1 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-sqHb8fco9L0ka5yw4EIeSPubXyumhC_0 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13434655060333154728', time=2024-09-14T13:38:02.377852+0000, chain.objs.size()=1 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YIjo03MR5aJgfcKS-i6T0EcKnElp_hR_0 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11814391613895825024', time=2024-09-14T13:38:02.872486+0000, chain.objs.size()=1 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.keDaSKxM8xLzEYlbjar1Wp_Z1w3tqnm_0 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12749646254858454494', time=2024-09-14T13:38:03.047129+0000, chain.objs.size()=1 2024-09-14T11:58:38.516 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.517+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.P0IthQjxKqXp6HMPtvExaNtl5ljfevR_0 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17431251147094086026', time=2024-09-14T13:38:03.770944+0000, chain.objs.size()=1 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WZpKhx4WoAc6vhVD7HYaEybuECf22sO_0 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17676205762658016995', time=2024-09-14T13:38:03.978024+0000, chain.objs.size()=1 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.N4m01hZ0-Q5OeGBvPOEQX8ZjqeCuXre_0 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7199498348639139043', time=2024-09-14T13:38:04.049586+0000, chain.objs.size()=1 2024-09-14T11:58:38.519 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1wnNByEZJr8AGHJ_kSHv1QLDMAMIv-9_0 2024-09-14T11:58:38.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15193132445541722244', time=2024-09-14T13:38:04.108443+0000, chain.objs.size()=1 2024-09-14T11:58:38.520 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.521+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mGFihsQZaRcF-To3hp8m0t-LocjZcUb_0 2024-09-14T11:58:38.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10186417650834045919', time=2024-09-14T13:38:04.519180+0000, chain.objs.size()=1 2024-09-14T11:58:38.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DkSpEEB8bl1tfpXQEsClWkeM7qhH7QU_0 2024-09-14T11:58:38.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12946625852034471117', time=2024-09-14T13:38:04.562862+0000, chain.objs.size()=1 2024-09-14T11:58:38.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jVuJ2oM7r6B0bJOWZR1wLvCN3oQ0Oiz_0 2024-09-14T11:58:38.521 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8412874654439086978', time=2024-09-14T13:38:04.779515+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.K8mpQvA5DUuNbX0ZijMPKTM6Rp3KgwR_0 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4643621121853405155', time=2024-09-14T13:38:04.784103+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Sy7RKrgP4bQQ56ad_SdxkHy8qSQkN8C_0 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10788081383897601625', time=2024-09-14T13:38:05.182009+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qE4fcuwBTfaz6jtSbyVNccl1kY9CLqm_0 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15239313933828703291', time=2024-09-14T13:38:05.207230+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-r87onxDm5xS2ZoxsjZM39UznqlTohE_0 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16927242841046233444', time=2024-09-14T13:38:05.325672+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.523+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aGwq6aQXjDT7UgnzVeT-FlKyXFma_yi_0 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.525+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4935197778979799180', time=2024-09-14T13:38:05.753674+0000, chain.objs.size()=1 2024-09-14T11:58:38.522 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.525+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xZKfq0m0mcCdq1dNDVv5ngTpRE9j-wd_0 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.220032451895264641', time=2024-09-14T13:38:06.313111+0000, chain.objs.size()=1 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uDHUIGlLlvteHjzMIZ_zk4eMMoGG8Gt_0 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6839545893417670335', time=2024-09-14T13:38:06.329480+0000, chain.objs.size()=1 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.htntpa1hna11FxKAOKnEuSdGrHCg1v7_0 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5415717891164038425', time=2024-09-14T13:38:06.403668+0000, chain.objs.size()=1 2024-09-14T11:58:38.524 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.526+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.M5ar8il2i9on30i6XYyLgiHktOMiC32_0 2024-09-14T11:58:38.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1560943670638113337', time=2024-09-14T13:38:06.550968+0000, chain.objs.size()=1 2024-09-14T11:58:38.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AS1eDu0mE0E0rwo6-WIxRNbg3YmCYz0_0 2024-09-14T11:58:38.525 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14648134448302380729', time=2024-09-14T13:38:06.551466+0000, chain.objs.size()=1 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aDiJ22vhN4FrhVYUSXf5jACm-2L2CzV_0 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14308811230328763857', time=2024-09-14T13:38:06.577689+0000, chain.objs.size()=1 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ywgEYGidagpcpzLK8jfaLalBE2-dYAD_0 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11331386038374643650', time=2024-09-14T13:38:06.715840+0000, chain.objs.size()=1 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.527+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tNAySFXL6pxtXP-3IVl-NIlBjA2flPK_0 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1979499847697718292', time=2024-09-14T13:38:06.785996+0000, chain.objs.size()=1 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.R8wn8gMgXUnPhMgdNg_jijSPTp5goyW_0 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7511726209795518641', time=2024-09-14T13:38:07.201488+0000, chain.objs.size()=1 2024-09-14T11:58:38.526 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FL5RvBTZeN_O_XnI6ssyHXGqN5Glo-K_0 2024-09-14T11:58:38.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4464470988274463093', time=2024-09-14T13:38:07.289079+0000, chain.objs.size()=1 2024-09-14T11:58:38.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.528+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lD-J6REWsvNXYzN365ft_CFiZWQXt5q_0 2024-09-14T11:58:38.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.529+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10487891622148813240', time=2024-09-14T13:38:07.301905+0000, chain.objs.size()=1 2024-09-14T11:58:38.527 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.529+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Sy8zGfQErGgDD2YmFIUWhReA5oQxjS4_0 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11125868290784543726', time=2024-09-14T13:38:08.055935+0000, chain.objs.size()=1 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0oDSLvtdrxW4bvtxcoW9ZP3-D01prNx_0 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14579736734965166375', time=2024-09-14T13:38:08.111445+0000, chain.objs.size()=1 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HP_uRQveUgPnGFSIpyGzrcdvTepJpvc_0 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.366261124352624286', time=2024-09-14T13:38:08.769174+0000, chain.objs.size()=1 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.530+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.BkGL1jYF00WwGN6YcLlCeixxPOmpJdn_0 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8009251085272834152', time=2024-09-14T13:38:08.937291+0000, chain.objs.size()=1 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.P7se3OiMhNmvqbCoHUzGeEMrUs9Oz8C_0 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11988951856101259523', time=2024-09-14T13:38:09.377476+0000, chain.objs.size()=1 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NWCk-qtmSs6Opy0BgRlMCimHEci_-z4_0 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17044427310762642938', time=2024-09-14T13:38:10.087837+0000, chain.objs.size()=1 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0ggTcA7JTfN4AQvHx0vXxCvWolp--lM_0 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13186770124565908615', time=2024-09-14T13:38:10.381373+0000, chain.objs.size()=1 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.u5tMg-CkX0Eq6MzNhcnl0XQqI4DOL6s_0 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11641016456930443081', time=2024-09-14T13:38:11.102783+0000, chain.objs.size()=1 2024-09-14T11:58:38.530 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.532+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.264__shadow_.6iu4bed059IncCmmc8ttUlWA628J4YE_0 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9347240021906580090', time=2024-09-14T13:38:11.859263+0000, chain.objs.size()=1 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.265__shadow_.x2fFuwatejugIXFYup4NNF5yXX0L4-M_0 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12467889258304053285', time=2024-09-14T13:38:13.211014+0000, chain.objs.size()=1 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.267__shadow_.a9uevbB8k3JfRs9S2gEtNVvjeIZou_N_0 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2364342610566133526', time=2024-09-14T13:38:15.960209+0000, chain.objs.size()=1 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.271__shadow_.xw0WhbIOU9y9-jIb6ZHzl6ZSLs5WEYV_0 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16382138817414509607', time=2024-09-14T13:38:16.676529+0000, chain.objs.size()=1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.272__shadow_.1IAEVduoqn0N-6iB1scy5MNxEqbTKh-_0 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9419765868922330269', time=2024-09-14T13:38:33.491737+0000, chain.objs.size()=1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.2UXs_BsjS48GoXe8FDNJ-jBlyrnev5O_0 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16962345591393061004', time=2024-09-14T13:38:33.594577+0000, chain.objs.size()=1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.535+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.PJmj2_7Ayn-XIXaFz-bEvddIjqW-dzs_0 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.536+0000 7efe1ffff640 0 -- 172.21.15.29:0/465069235 >> [v2:172.21.15.29:6808/1395949130,v1:172.21.15.29:6809/1395949130] conn(0x7efe2003e920 msgr2=0x7efe200223f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9411620766926191358', time=2024-09-14T13:38:35.710921+0000, chain.objs.size()=1 2024-09-14T11:58:38.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.uSNnd-5JAGDoVLuJKIMCaAt5OSDDI2v_0 2024-09-14T11:58:38.536 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9541763385374320367', time=2024-09-14T13:38:37.936625+0000, chain.objs.size()=1 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.297__shadow_.Zf_yXr03Btsogv42EN-n219mIo-dmr1_0 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10117270859273785211', time=2024-09-14T13:38:37.944544+0000, chain.objs.size()=1 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.297__shadow_.VjiHThNhi8Vmxjwl6s4xWAzUnfpBddU_0 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1994631552505568504', time=2024-09-14T13:39:38.996093+0000, chain.objs.size()=1 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3zqKLstx5q2dvbS3f4QeTd9qkiUBckJ_0 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7975852475320583766', time=2024-09-14T13:39:39.205136+0000, chain.objs.size()=1 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RJruy_pYakLCImcdfKpHYwSlv7URJeD_0 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.538+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10243015794081501935', time=2024-09-14T13:39:39.226252+0000, chain.objs.size()=1 2024-09-14T11:58:38.537 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.539+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gjqAjETYr3dW8MF0-bCG2OV_hQxA5aI_0 2024-09-14T11:58:38.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.541+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.462904911149878658', time=2024-09-14T13:39:39.529331+0000, chain.objs.size()=1 2024-09-14T11:58:38.539 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.541+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1tT4mutDYvvWHoAAu0zz4kDMniVHVHs_0 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3321527085918550611', time=2024-09-14T13:39:39.725559+0000, chain.objs.size()=1 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iYA__V3XK0uH6xwOJ9a_fEgmeuj8GGO_0 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2135212513521230523', time=2024-09-14T13:39:40.422491+0000, chain.objs.size()=1 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mfED1Tn9LNsfwEg489DLBOwlRo3rEX0_0 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2880737359922574804', time=2024-09-14T13:39:41.331702+0000, chain.objs.size()=1 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mQaZWwU1dqmpqvL8gERIUEaL92fAPKT_0 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1768496387510110056', time=2024-09-14T13:39:42.162334+0000, chain.objs.size()=1 2024-09-14T11:58:38.540 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.542+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6nZw9bhKf4yeZvbQzLuEO-DKHhVCjQZ_0 2024-09-14T11:58:38.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.260216456751766140', time=2024-09-14T13:39:43.054046+0000, chain.objs.size()=1 2024-09-14T11:58:38.541 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.odQpiTdnXnLC5QPViAnA8uawHf1di3C_0 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9538158535278684311', time=2024-09-14T13:39:43.147470+0000, chain.objs.size()=1 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ARYo0-xHgLXzbziGNt_ckQG4wV3C6Rh_0 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11966880205076556694', time=2024-09-14T13:39:43.150315+0000, chain.objs.size()=1 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JgrM7ImjP2iJipluiaDa28Z57-UMioQ_0 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16537519535502983010', time=2024-09-14T13:39:43.207660+0000, chain.objs.size()=1 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CI8uogZchvDGccRs6fIk5qU5HGKBGNr_0 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8646636892781393059', time=2024-09-14T13:39:44.617824+0000, chain.objs.size()=1 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UMl-C4foH79OL6c98Ss6580iORL7sg__0 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1173838528927314067', time=2024-09-14T13:39:44.713836+0000, chain.objs.size()=1 2024-09-14T11:58:38.542 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.544+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8Ej1qDiP_G4DONd9RASEwGB9iCVZKC0_0 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.255060591633853622', time=2024-09-14T13:39:44.836544+0000, chain.objs.size()=1 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b3wMUhOMsXwTRQ55lnRdCXBZ8Db3CQz_0 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1428087906559997427', time=2024-09-14T13:39:44.847971+0000, chain.objs.size()=1 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fMrbp5T6Z7yD6bcyAwubVoUmEQjA_JX_0 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13244227265847097790', time=2024-09-14T13:39:45.681625+0000, chain.objs.size()=1 2024-09-14T11:58:38.544 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xxz-PoqGASp1RRRtrPrVlECFAQ3KtVm_0 2024-09-14T11:58:38.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11557067780124438872', time=2024-09-14T13:39:45.887557+0000, chain.objs.size()=1 2024-09-14T11:58:38.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.D3Nbn8hQHovvFKftBFIvH3cMLMQ2S2d_0 2024-09-14T11:58:38.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9432342905043639974', time=2024-09-14T13:39:45.935679+0000, chain.objs.size()=1 2024-09-14T11:58:38.545 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.546+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BbGMGZAsjS5zvminhfuQmjQW4ZA7bWM_0 2024-09-14T11:58:38.547 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1926128210063572439', time=2024-09-14T13:39:45.936892+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ttsz4bK_qY8kxB3uwfKxT_4A9Jd5usF_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11045790835735364787', time=2024-09-14T13:39:46.342905+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iRGdPoXdSlgoODZ2wQBMlYf-YlUqI3w_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.930869189484780667', time=2024-09-14T13:39:47.081844+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8EEvlO4YTTw2B0N8VW98AI4hHRv-5uX_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4733023580072698825', time=2024-09-14T13:39:47.157516+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CRHaR5B0hWyuvkJ409_HRgQE1C7l2TQ_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8312324010262473448', time=2024-09-14T13:39:47.414797+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.O4QdCKq1uc0rtQVk8yz9kJS1TPrsNvG_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8657742790159775637', time=2024-09-14T13:39:47.483715+0000, chain.objs.size()=1 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fr5Do30PmOa92CLNlvf57_9KtES-Tek_0 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2660507735273217968', time=2024-09-14T13:39:47.978931+0000, chain.objs.size()=1 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.z8P_dy5D5wIoYMVT3ULr1Y06k6ixWvJ_0 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13884613436433763696', time=2024-09-14T13:39:48.425034+0000, chain.objs.size()=1 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.W7qQ2vNk7HiaFfs7UCVu8AjpwwIHNuY_0 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8405921949922026282', time=2024-09-14T13:39:48.826045+0000, chain.objs.size()=1 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.550+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iG4Fpd539xcu8DB1FSToglgNalj9eS__0 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.551+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11791489518003395318', time=2024-09-14T13:39:49.270442+0000, chain.objs.size()=1 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.551+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._cbCy77aeTBaRG10cejOrXH_UvexlsQ_0 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.551+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5407889616352231963', time=2024-09-14T13:39:49.461992+0000, chain.objs.size()=1 2024-09-14T11:58:38.550 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.551+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iv8o6S89iR5Jk2Tvah36remd5XMvxM-_0 2024-09-14T11:58:38.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.553+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4814686244793850539', time=2024-09-14T13:39:49.544410+0000, chain.objs.size()=1 2024-09-14T11:58:38.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.553+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SA2WoNfM1e3W1nJqHO4ndZSUejDdBR6_0 2024-09-14T11:58:38.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.554+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7675393769205046667', time=2024-09-14T13:39:49.975369+0000, chain.objs.size()=1 2024-09-14T11:58:38.551 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.554+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.3sVTlpizjx84KjsdhHlLkYTQjgPpfvY_0 2024-09-14T11:58:38.553 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9615602821909746975', time=2024-09-14T13:39:50.340099+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2n97jwCJBWXPvka0l_sTzf7jnBfmY8Z_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1266116206783299807', time=2024-09-14T13:39:50.803201+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tIdCCXPL9DYPlHPBvf0qpWZO6pYjCUT_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15585048840825207057', time=2024-09-14T13:39:50.864018+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wsHuZaG9TwHMqWzNhLgFoF9g3NLAYQY_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16023665354345124647', time=2024-09-14T13:39:50.889227+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4tWrnDroljXU3BKNO5VfoNOjRIO5k4Q_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16451513841027931055', time=2024-09-14T13:40:30.796552+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.p19Ioc1wnk3l2dwbXtJXmCmVYJry2pr_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16220418383780831605', time=2024-09-14T13:40:30.900126+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MhN3aziYY6kFc3cbVvXh_0eIs5ZiBjg_0 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1267818601260008692', time=2024-09-14T13:40:31.017900+0000, chain.objs.size()=1 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.556+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.evSEgrejE1_GxZHawARBxvE02nXL1AI_0 2024-09-14T11:58:38.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-14T11:58:38.759 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.761+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/46953 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=57, truncated=0, next_marker='' 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10691356571908255563', time=2024-09-14T13:40:31.339074+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.h1mZ6sxvR1Ho95o7tfkswoU3BO45_Ut_0 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15193872845715454831', time=2024-09-14T13:40:31.540234+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FLN3pbX5uZA9NbhWUxTRuFRnfme7eyY_0 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12148887336750813508', time=2024-09-14T13:40:31.715767+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.lTceRrIjFm23Kfp6g1qNV4aUyhkTnsF_0 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4813668707539157849', time=2024-09-14T13:40:31.945758+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qB-zIOFKV2df_fdRRa3WrE-cxeg4SOX_0 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10088095019050067066', time=2024-09-14T13:40:32.698940+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.RG99OTPuM5xw8rbBfHRIP0oZqQRvFbl_0 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.682011146099697175', time=2024-09-14T13:40:33.108800+0000, chain.objs.size()=1 2024-09-14T11:58:38.763 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mrGjS06OL5Y0db841JSVASdjXV0XD1Z_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6590633181113554822', time=2024-09-14T13:40:33.257277+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jq3Q4n-UuiMbB0p5OLxX7QLnBBDXnOE_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16664177542405856239', time=2024-09-14T13:40:33.469227+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EUw8QHMCk7_aa-RlMDp_GxJUqbNCxUY_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.79059393804375717', time=2024-09-14T13:40:33.469855+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SPE7k1CL6d9AAwqXDUwi_2xB4SoeYau_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1826740909832442099', time=2024-09-14T13:40:33.512569+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._wqNMPYBIPZractj7q47dxwMzqJJgk0_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5730392124706614193', time=2024-09-14T13:40:34.289147+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tmV7miW9r0ImSsb_i24KY-BAR9sULgX_0 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12039265912655245452', time=2024-09-14T13:40:34.383154+0000, chain.objs.size()=1 2024-09-14T11:58:38.764 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.764+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bRdGd8URQZQ2dO7QqdZisKvNwzZnkz4_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1758743209257141214', time=2024-09-14T13:40:34.608763+0000, chain.objs.size()=1 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DzYmuuM8WBzucE5gZhvNexgL-zyOfS2_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3754358250397720093', time=2024-09-14T13:40:34.982937+0000, chain.objs.size()=1 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.m-cN6B6qYGEJgvv7sQ52Aa9Guzvwn_i_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.862669119204274521', time=2024-09-14T13:40:35.096334+0000, chain.objs.size()=1 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-kOSXzS6O8qDFw1NBAWHl0oMuEnNmWj_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11114524349423430651', time=2024-09-14T13:40:35.258260+0000, chain.objs.size()=1 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.079-n-IUb2rDN4E8YvvyaLGgWjfNiAb_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8216196330101638531', time=2024-09-14T13:40:35.284090+0000, chain.objs.size()=1 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zlWqWPuLVwEGG1_k4yogJuFO8gRT8Hz_0 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16743259038284877426', time=2024-09-14T13:40:35.334879+0000, chain.objs.size()=1 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.768+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.h7KxvGRyuvpqNwO-9WGoteyi1KddwPa_0 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8852423365693195491', time=2024-09-14T13:40:36.094618+0000, chain.objs.size()=1 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XbhNmlRQpOLIj112ozBB_mMxzgmpwJb_0 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4638391387014910343', time=2024-09-14T13:40:36.095356+0000, chain.objs.size()=1 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ubfmxiaCQFSjocT-c-it1S6wUX6O6NS_0 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2123460070328913270', time=2024-09-14T13:40:36.287982+0000, chain.objs.size()=1 2024-09-14T11:58:38.767 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PRho5Ul9ub9QC_JYapxEJQ9NcJXan6o_0 2024-09-14T11:58:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2078265764377738564', time=2024-09-14T13:40:36.433655+0000, chain.objs.size()=1 2024-09-14T11:58:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.769+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YyHumUxVo39JSU79RE9YGjxYi0LJDbO_0 2024-09-14T11:58:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.770+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8363774335076214337', time=2024-09-14T13:40:36.518422+0000, chain.objs.size()=1 2024-09-14T11:58:38.768 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.770+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PkSRhFPh50lH8z9Ug40ZFpIVqA2rrU8_0 2024-09-14T11:58:38.771 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.135732935792719757', time=2024-09-14T13:40:36.577655+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xvbkvNaX9fWoxhbQ58JK2rzok2Vzys__0 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13826629476783895501', time=2024-09-14T13:40:36.647185+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YKNdi4ocnQIlvoSGetnSCW35bJj07UW_0 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3554426041963686186', time=2024-09-14T13:40:38.097146+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Q3RT_bOg8x55r3tzJVJd4EWydXI7WSv_0 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8206949852433088198', time=2024-09-14T13:40:38.130805+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.773+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XRsq3KnboKMJnspU6Td9HK-XgaqcEWz_0 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12714430135815195805', time=2024-09-14T13:40:38.280146+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kfXsZooHTs1TtGqjd_zxjvsf_3LbYnE_0 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16347038871703273665', time=2024-09-14T13:40:38.586379+0000, chain.objs.size()=1 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UqsXN5vYK0PmeK4wmKPXaQukoHsGzw3_0 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5314085774349228683', time=2024-09-14T13:40:38.746460+0000, chain.objs.size()=1 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yCzKozp5WsJnBxWxVejFzsPlFrLY3gD_0 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3245206951349670275', time=2024-09-14T13:40:39.244067+0000, chain.objs.size()=1 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eMFOZAmLE7INt74mbRpzGcI8cq2rObp_0 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1151167375233616787', time=2024-09-14T13:40:39.364978+0000, chain.objs.size()=1 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DLDkYMch35vJo1VSv_tMaGitmKt_Xe3_0 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8017352588714776257', time=2024-09-14T13:40:39.498422+0000, chain.objs.size()=1 2024-09-14T11:58:38.773 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.774+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cXJb-9mhH85ZzIwdOHrWkRPHjEA63gC_0 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.776+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15250956908185428869', time=2024-09-14T13:40:39.537756+0000, chain.objs.size()=1 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.776+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dpoT_Uu1KUpKoObWUIVQF7IFT8Q_SKc_0 2024-09-14T11:58:38.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6315138478418026656', time=2024-09-14T13:40:40.036554+0000, chain.objs.size()=1 2024-09-14T11:58:38.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Hj5hKgLGahXmsxkKMZDg_4-utrHg7I8_0 2024-09-14T11:58:38.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.778+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13311851552601112870', time=2024-09-14T13:40:40.038041+0000, chain.objs.size()=1 2024-09-14T11:58:38.776 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.778+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Vb6tRwlIVlK_z_b4V58l5cjfcuRJC4m_0 2024-09-14T11:58:38.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5681899311746924334', time=2024-09-14T13:40:40.323748+0000, chain.objs.size()=1 2024-09-14T11:58:38.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PGaKn8daxG4Hcx7NfgleRcNZLWJN9O2_0 2024-09-14T11:58:38.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.779+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16836098940349493990', time=2024-09-14T13:40:41.086828+0000, chain.objs.size()=1 2024-09-14T11:58:38.777 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.779+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6bU287Ei6uL4pEETduwNx4fhnVqqoLq_0 2024-09-14T11:58:38.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16883145452556496120', time=2024-09-14T13:40:41.203160+0000, chain.objs.size()=1 2024-09-14T11:58:38.778 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LGKEl-b0cx-FiZXZDC6ms3R3OuhFLa6_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7203104551660060489', time=2024-09-14T13:40:41.357445+0000, chain.objs.size()=1 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Qs9h23QY_4Vpgot3TE8RlphfDYxZp4u_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6580328157521644505', time=2024-09-14T13:40:41.419090+0000, chain.objs.size()=1 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oVGXWwuBPPXptDD6FAfAzlfARHKyLp0_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2942052900235417998', time=2024-09-14T13:40:42.370428+0000, chain.objs.size()=1 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.o2xQTJeMFgyPki_NXVGhHq-lwyke-CH_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17509593795442202145', time=2024-09-14T13:40:43.060984+0000, chain.objs.size()=1 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.780+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Gsn4cRwBa4cIWNRG0pugDLy-p2f2m57_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.781+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11308353934952272971', time=2024-09-14T13:42:27.476997+0000, chain.objs.size()=1 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.781+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.aTHB63qDrgzBNABT9hN2-gN0Q3bj6Ik_0 2024-09-14T11:58:38.779 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.781+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17564163040391541997', time=2024-09-14T13:44:38.859000+0000, chain.objs.size()=2 2024-09-14T11:58:38.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.781+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~kUvfGmjm4il4WHrOXm5kZv1wrprYUkm.1 2024-09-14T11:58:38.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.782+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.524__multipart_mymultipart.2~kUvfGmjm4il4WHrOXm5kZv1wrprYUkm.2 2024-09-14T11:58:38.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3961149940354133160', time=2024-09-14T13:44:48.481432+0000, chain.objs.size()=2 2024-09-14T11:58:38.780 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~TBKr-0C7YoKfyvuQzL7NeuHjdy3hoFo.1 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~TBKr-0C7YoKfyvuQzL7NeuHjdy3hoFo.2 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.783+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13233973573958532338', time=2024-09-14T13:44:49.831692+0000, chain.objs.size()=3 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.783+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~kSKSiK9sALucQRGqRAWBFio52ottu4K.1 2024-09-14T11:58:38.783 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.785+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~kSKSiK9sALucQRGqRAWBFio52ottu4K.2 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~kSKSiK9sALucQRGqRAWBFio52ottu4K.3 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~_gWVCRT1Zvv7o_GrrGdJ8d7ijjG7MRv', time=2024-09-14T13:45:12.879158+0000, chain.objs.size()=1 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.536__multipart_mymultipart.2~_gWVCRT1Zvv7o_GrrGdJ8d7ijjG7MRv.3 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3262865933475799785', time=2024-09-14T13:46:26.178267+0000, chain.objs.size()=1 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:-LKSKAFKcJa0rw1aPp6HDBcZgz8T8Zm_.e5OnFouc4ojuIreDT5jUm4_9LqZMTcC_0 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6496981672055185097', time=2024-09-14T13:46:30.829216+0000, chain.objs.size()=1 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:YyHH6MuMnuQUFYOr2yEhZ11zhHRFZ50_.0RxtoEjE48nVlgfa3DUI5mIV_t04bUi_0 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17369837493928046621', time=2024-09-14T13:46:31.151066+0000, chain.objs.size()=1 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:LbuAnUbo4hXSsayw-nB6-JXTAsImbWu_.qUI9IzB03owu27H44zRiaU3ZIInryE0_0 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1877716095875922220', time=2024-09-14T13:46:54.673282+0000, chain.objs.size()=1 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:ybOAevqAsXm3Mqqdtxwv-xTgz1cr0rI_.aF8TW_MqSAXD7oVluY-5YU_3SuyOPiP_0 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4096139396457470728', time=2024-09-14T13:47:31.826510+0000, chain.objs.size()=1 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:qbSTPdRMiEqXxBnhKgv.XjmU8b4ejAl_.DNaeGCQysUVAzLhRF-gecQggfADoOv4_0 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13874665187829646146', time=2024-09-14T13:47:50.501892+0000, chain.objs.size()=1 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.604__shadow_.pLn980rc7FNJJj6OiSkFPF2DoBwe70s_0 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6117081166729606571', time=2024-09-14T13:50:05.146423+0000, chain.objs.size()=1 2024-09-14T11:58:38.786 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.787+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.618__shadow_.7BH61Xkhz12bNJ_vitzeReBZUAGZnt4_0 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.789+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.456032759374809992', time=2024-09-14T13:52:09.067390+0000, chain.objs.size()=1 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.789+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.652__shadow_.f-tvKnvsfHmXwOQr5bKTlNzRvfoIoEA_0 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.789+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5705574739732533382', time=2024-09-14T13:55:33.438412+0000, chain.objs.size()=1 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.789+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.766__shadow_.SIlbQBu08E441-annig3VndLvf5LQcx_0 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.794+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.795 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.797+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:58:38.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.798+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.796 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.799+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/90513' 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3473564979031677106', time=2024-09-14T13:36:55.500174+0000, chain.objs.size()=1 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.232__shadow_.eU4wW5W73zqedBInoUCaURPDcqUL_oW_0 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11999498868634232498', time=2024-09-14T13:36:56.999313+0000, chain.objs.size()=1 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.234__shadow_.O4meEkj1Gx8KdT4giFDNWZTsyhfYCBL_0 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3599623287842997855', time=2024-09-14T13:36:57.721775+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.235__shadow_._GBiKJtHPY7Y7PB_rzia4Kh715bXo41_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17633995464421465627', time=2024-09-14T13:36:57.722344+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.235__shadow_.T4if7pAgzddXEUNbEtDgrsnJvO6MYkR_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17561163426791109902', time=2024-09-14T13:37:57.770256+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Zy-2OQgQHyqQ8XyiUid3jqXXUTCMyh9_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12135764343736821260', time=2024-09-14T13:37:58.180589+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.62C4Ds5-CpeVDk_DIvqsdw9jOX46hkn_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7892663330769831115', time=2024-09-14T13:37:58.278192+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Xcq7IBvYaJ4WBcztd0X_0eSZZKERGmR_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17713538814632945324', time=2024-09-14T13:37:58.318615+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wSBemVyhttn2LO4nR43_nHUorHhQ0gj_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13316453087722042986', time=2024-09-14T13:37:58.608576+0000, chain.objs.size()=1 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.H5GGMpt8b6Hl82QcrTz-MScRfN7i-nm_0 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2771114975894304257', time=2024-09-14T13:37:58.707629+0000, chain.objs.size()=1 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rIlY5euc5u5jrBKs-PyOGyuPt8Q-IFs_0 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3266245811423962755', time=2024-09-14T13:37:58.784084+0000, chain.objs.size()=1 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QhRVMjAIsEj3TvRotLUDDvGCKA0hmeh_0 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17154532102850207658', time=2024-09-14T13:37:59.658044+0000, chain.objs.size()=1 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.800+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iujJomBUlmHqgK5KVajWXsjZ46UlAQG_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2818574022938361299', time=2024-09-14T13:38:01.209406+0000, chain.objs.size()=1 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vrLMexvA8WBz2dHq32P6HbHcJ3YQFDH_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7621625945654811397', time=2024-09-14T13:38:01.389038+0000, chain.objs.size()=1 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Mr1faHSXxUlAQrCckqOYgnaQlUV-u_Y_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4475162978563018098', time=2024-09-14T13:38:01.452589+0000, chain.objs.size()=1 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oBu4k0gbPitH66pQkRUUyxruEd8P4kl_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3879503648176418312', time=2024-09-14T13:38:01.566917+0000, chain.objs.size()=1 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GQWVp016bXme4shsIJtyF8pktSevLZQ_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18189056440476643023', time=2024-09-14T13:38:01.615035+0000, chain.objs.size()=1 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jBwg0kD9ThTskxYb1ohnzgsY4aG42rv_0 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7521106274877248292', time=2024-09-14T13:38:01.615798+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aK7tZnXiS5g9B6RTdW3hR3AMUAilzJI_0 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.417681092099961567', time=2024-09-14T13:38:02.227064+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XNyDTAAnlOx77fIJbEY6PHEbHgA3x0X_0 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14143846239192967774', time=2024-09-14T13:38:02.373059+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.l44mG3UWsgPg8Q8OiWnD0d2rWFaC1rb_0 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15665934892072504051', time=2024-09-14T13:38:02.862164+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1BmY2UX-scryWNuZWuOeu3sPZZ0_XMP_0 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6604577361120821064', time=2024-09-14T13:38:03.029214+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MVuEJTj4PdzxMi8T0IIULVMzPSq8H-c_0 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12323439216589500831', time=2024-09-14T13:38:03.226926+0000, chain.objs.size()=1 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.805+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hV-4vm3qHfDQN0wQF3loBM_jBdDNxO0_0 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.807+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17898860986921704938', time=2024-09-14T13:38:03.373909+0000, chain.objs.size()=1 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.808+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.t-BCJVVHUht1DTFfdK2aY3vfDjjcQGX_0 2024-09-14T11:58:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.808+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18036934410443268441', time=2024-09-14T13:38:03.804764+0000, chain.objs.size()=1 2024-09-14T11:58:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.808+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CM7Y8209TGhhju3-051eRRGnx5R3znQ_0 2024-09-14T11:58:38.806 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.809+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1577988753252194678', time=2024-09-14T13:38:03.860243+0000, chain.objs.size()=1 2024-09-14T11:58:38.807 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.809+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.evY9Dob8PXVRSWhd0yv45U1Ey_RTkE4_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2195348371705144103', time=2024-09-14T13:38:04.006640+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eYReWBOQ1GEZvRRf4hJMScLR4718VAz_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3685935675447778164', time=2024-09-14T13:38:04.551329+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.QjdC34ZOv56VJJzS6XUTlYBlpgtxyS6_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10520233812203152112', time=2024-09-14T13:38:05.065909+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Pb15FyD7ZlSqhZLYEWSo_6LrVluUcvX_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6519730543790293253', time=2024-09-14T13:38:06.361038+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.De-OQt0xysxboubts9pSe8pjyyUhkQV_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6054571246794750237', time=2024-09-14T13:38:06.361817+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.A2ruRdq9ofYc_BTeCTulxuvJByg1iYK_0 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17029103535661760053', time=2024-09-14T13:38:06.397829+0000, chain.objs.size()=1 2024-09-14T11:58:38.809 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Dh9LpDvXDjM27SDoDGeVC4zKKuTF5a8_0 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1645391422254444258', time=2024-09-14T13:38:06.910219+0000, chain.objs.size()=1 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mrtUlZGr1dLooGPUDOQKEPj7dwE8ucf_0 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7663756266679492139', time=2024-09-14T13:38:07.136404+0000, chain.objs.size()=1 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.811+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.62R9FHEKuAskv6n92DNVeDM9C-13JIW_0 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.812+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11832442955092236705', time=2024-09-14T13:38:07.253931+0000, chain.objs.size()=1 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.812+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.mSgVD1ao-oZQFPyBbcHgeIocAca4Ldr_0 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.812+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15997555610040862571', time=2024-09-14T13:38:07.349738+0000, chain.objs.size()=1 2024-09-14T11:58:38.810 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.812+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Y-mZqoVj8KfpM7Zdjpbt6JZqqAORzRU_0 2024-09-14T11:58:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.813+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1100580927574655079', time=2024-09-14T13:38:07.728360+0000, chain.objs.size()=1 2024-09-14T11:58:38.811 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.813+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IKGyXq2-UqkFhRGEmWzzjEFcN03oMjt_0 2024-09-14T11:58:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11123855878847422049', time=2024-09-14T13:38:07.738547+0000, chain.objs.size()=1 2024-09-14T11:58:38.813 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JhbxjL-SCbyHO8M4bWDA_HDarjSQaqS_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5943309591918086287', time=2024-09-14T13:38:08.154851+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4nvWd8Hrmc0VViPq1Q_IdFPH-x__C2e_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10999861049533995317', time=2024-09-14T13:38:09.951597+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0jWzcf0przxNvvB7Bka8o23WQHSusJh_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2687576413692310817', time=2024-09-14T13:38:10.134564+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4kxpGQKSrDAFUhB4XH0JNDOruFoKedP_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1686679667548927869', time=2024-09-14T13:38:10.363490+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.H1NkJuuvuLSf2psFff3D1wheQa7dCtI_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17054188838497356238', time=2024-09-14T13:38:15.965310+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.815+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.271__shadow_.Q3d3UTfMp0gtU9lFRBffo04UpirvPit_0 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.816+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6857844431243726393', time=2024-09-14T13:38:20.945255+0000, chain.objs.size()=1 2024-09-14T11:58:38.814 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.816+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.278__shadow_.QNAjcTFEmEYP6gHwWEpfHm9vjtmbRb__0 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6821240837927722616', time=2024-09-14T13:38:23.120986+0000, chain.objs.size()=1 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.281__shadow_.-G0NV-9BG-hYZzR4ujLc6pBaYuijf4G_0 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16806462553621093212', time=2024-09-14T13:38:28.410414+0000, chain.objs.size()=1 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.288__shadow_.X6xUk_jc2J9MTIG_Pi7VPnc0C6_2-RW_0 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17579224990089677863', time=2024-09-14T13:38:33.443245+0000, chain.objs.size()=1 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.ewbdmlnZCRdcF-J44Vow2RBYySH_a-5_0 2024-09-14T11:58:38.815 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12460663619364419007', time=2024-09-14T13:38:33.483953+0000, chain.objs.size()=1 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.817+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.SiwmSaTn9dOlDxC1_ShQziVmbABD7md_0 2024-09-14T11:58:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.819+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3639703746670140247', time=2024-09-14T13:38:33.521444+0000, chain.objs.size()=1 2024-09-14T11:58:38.817 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.819+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.05hsH7ZLHHLo_mALS2GQOqtqjvY_pzB_0 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17846074768648582762', time=2024-09-14T13:38:38.676602+0000, chain.objs.size()=1 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.298__shadow_.R-Q8W6n4WD4CRdecokXh_f-N0B3s4sl_0 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17790207991040470368', time=2024-09-14T13:38:38.677305+0000, chain.objs.size()=1 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.298__shadow_.exWwNzSMTgt9tT9AMMxCgn4Z3vrQmZY_0 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3044028213392622576', time=2024-09-14T13:38:41.008342+0000, chain.objs.size()=1 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.821+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.301__shadow_.RNxE2N2i6BaQX20VG_v6aedTLJYLPTZ_0 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11490013053440602064', time=2024-09-14T13:38:41.739035+0000, chain.objs.size()=1 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.302__shadow_.hyXcQAs6ZdfMmTio7mAK7xZR2aj_OSJ_0 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17337590012938685955', time=2024-09-14T13:38:42.511824+0000, chain.objs.size()=1 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.303__shadow_.WMVntIK7USEmWXVhe1bJf1QPTA3m5x2_0 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1932223447714689353', time=2024-09-14T13:39:38.511080+0000, chain.objs.size()=1 2024-09-14T11:58:38.820 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0dWrusJ4apGSnXWsj1PELOZmZ5Gt00J_0 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12346710493579823479', time=2024-09-14T13:39:38.635240+0000, chain.objs.size()=1 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Ind81Q4AI06y9XUuKF-1RxiblDgrMz4_0 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10122397844805605785', time=2024-09-14T13:39:38.853452+0000, chain.objs.size()=1 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zbZ3VlGbAumOJHTW-hW118a-k0uo4VQ_0 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12067031061978804320', time=2024-09-14T13:39:39.081094+0000, chain.objs.size()=1 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DFT5WVMYgMN7Bqy4gEG22ucbUFAblqm_0 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17596843180444685832', time=2024-09-14T13:39:40.660102+0000, chain.objs.size()=1 2024-09-14T11:58:38.821 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.822+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vz784rWxRxXIRv1u7OlHMXydJTkO43S_0 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.825+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17175359419097359661', time=2024-09-14T13:39:40.710775+0000, chain.objs.size()=1 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.825+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.McJ67mbY35scsYyRw03JhDJqGL0wy0b_0 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15099954672935817478', time=2024-09-14T13:39:40.863846+0000, chain.objs.size()=1 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xFr44Xg6cejWhVY3pXgd1a-l8N9U4TK_0 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18345142026196353675', time=2024-09-14T13:39:41.011317+0000, chain.objs.size()=1 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NoMGQOkpMmuZSpCAof-djb6ewiwE-OQ_0 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11317625396641093506', time=2024-09-14T13:39:41.140203+0000, chain.objs.size()=1 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.826+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pq6R2UXt9sltXHLAN1I9WQ3sHBeATX__0 2024-09-14T11:58:38.824 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3137027255978308705', time=2024-09-14T13:39:41.503170+0000, chain.objs.size()=1 2024-09-14T11:58:38.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.u4ptwrG2NJWqwk7H0ufCFOcMRNf37qa_0 2024-09-14T11:58:38.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13571308599505119661', time=2024-09-14T13:39:42.015104+0000, chain.objs.size()=1 2024-09-14T11:58:38.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.j4vzWpJz9_Sv3c4ZdKEp3DyeWmpuTn-_0 2024-09-14T11:58:38.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11254455371574459061', time=2024-09-14T13:39:42.344938+0000, chain.objs.size()=1 2024-09-14T11:58:38.825 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.827+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YYTVBVilKu70IFX-9HYNFObLQhEGrLL_0 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2692430900744132962', time=2024-09-14T13:39:42.686027+0000, chain.objs.size()=1 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Neud8BWmC7Y4-FFAXAoStZgCQOZSeWy_0 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17831997501595725945', time=2024-09-14T13:39:42.868391+0000, chain.objs.size()=1 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PIYI-yQJF17OYRhJDBNOEuItCDVwoSF_0 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10031341813384901732', time=2024-09-14T13:39:43.819142+0000, chain.objs.size()=1 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6a4nH8BUCpSHxkfErOAH-UZ3UducBeG_0 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9887091018909879071', time=2024-09-14T13:39:44.137269+0000, chain.objs.size()=1 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GcrwwUOx00Whowyqy0VBIdIdk-RfjXq_0 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14799653309883487589', time=2024-09-14T13:39:44.435646+0000, chain.objs.size()=1 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.829+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2nS897taKN9l3FpJVXlXc8czvBP30QU_0 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.119123471498062625', time=2024-09-14T13:39:44.765859+0000, chain.objs.size()=1 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LD68CpReVIaBKRyBejYWEUGhf9hcyeJ_0 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6039611934733265053', time=2024-09-14T13:39:45.956657+0000, chain.objs.size()=1 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4QHbFNwyvGXPYVeHYc-rTX8jDKN54rb_0 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15588262062000714962', time=2024-09-14T13:39:46.286911+0000, chain.objs.size()=1 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.830+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AS7MI3DTy2xF5pcBIz9P4Kcc38cpzXj_0 2024-09-14T11:58:38.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4395125200732208787', time=2024-09-14T13:39:46.882271+0000, chain.objs.size()=1 2024-09-14T11:58:38.830 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bOrG1P0bR3KV0LKcc08PXwZ1cdy8Qtd_0 2024-09-14T11:58:38.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10628436365569335414', time=2024-09-14T13:39:47.019745+0000, chain.objs.size()=1 2024-09-14T11:58:38.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7ACCLt61-rrZNLrGPUlDw_Cyc294mRj_0 2024-09-14T11:58:38.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17729676859628143090', time=2024-09-14T13:39:47.950968+0000, chain.objs.size()=1 2024-09-14T11:58:38.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.832+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.r7olLHwC3Y4W1XkzjRDD3LxV73xKZA1_0 2024-09-14T11:58:38.831 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7789903142704495514', time=2024-09-14T13:39:48.942572+0000, chain.objs.size()=1 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vRWEfInnYV9JjhlFWeMq1bfua7rlAjy_0 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.84040718675453401', time=2024-09-14T13:39:49.060414+0000, chain.objs.size()=1 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cetfPTIHoM5lJ70Fdmo5Xj0EAn0ebX-_0 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18407184834717642555', time=2024-09-14T13:39:49.087773+0000, chain.objs.size()=1 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.O5ns8gla_SRQVzwz5POUh_WFBx7vcD-_0 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2422319504939494544', time=2024-09-14T13:39:49.256322+0000, chain.objs.size()=1 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6V32tVaL7NGqcol8_3wBI5yo0l2aqQx_0 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13886748831426844583', time=2024-09-14T13:39:49.966469+0000, chain.objs.size()=1 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8sS7m16n7r5nvffliuhyZ-qKW55pRqH_0 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17969599686207868134', time=2024-09-14T13:39:50.083191+0000, chain.objs.size()=1 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-7SFfpmmE7082AkX257NYYMnnfBmd9d_0 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7988275378891863496', time=2024-09-14T13:39:50.274975+0000, chain.objs.size()=1 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ML91-5RzBExLNN-F_Wm50Fmcrj-EFS3_0 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16020736367739590816', time=2024-09-14T13:39:50.423556+0000, chain.objs.size()=1 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.834+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.y7caUWFbL8FhS6TJ2tAvfziP7UMbkbh_0 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12577488090694855781', time=2024-09-14T13:40:32.721330+0000, chain.objs.size()=1 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zEV0cJgoZE8nJaLYvfP8dVA0tXbtAGN_0 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17174396769806745198', time=2024-09-14T13:40:32.978099+0000, chain.objs.size()=1 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.y4B6348eC13KEIJ6EE20EyD04EyKYZq_0 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18332811263279510363', time=2024-09-14T13:40:33.016377+0000, chain.objs.size()=1 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.837+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.RbMIj8MgZ5auVQzxob5DvBCcLCP8-qd_0 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.838+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5831113409269223103', time=2024-09-14T13:40:33.207915+0000, chain.objs.size()=1 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.838+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fRck6ZTj69Rm7-CP8zhrCcL1H-Aen4Z_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.204253526958354318', time=2024-09-14T13:40:33.264526+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.L91VtNbrTNqXRsyUqqET_qYYcQTKO_M_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15314519522104893956', time=2024-09-14T13:40:35.076110+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Fho1uWsCNJufN9oPMcop8nZcbeBq81P_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9691261425406531602', time=2024-09-14T13:40:35.181055+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.30_jahkWAK4QfywucD7ScKRn4OYhebp_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14866802713419795808', time=2024-09-14T13:40:35.243536+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6HxafxIfqhqtcHK8obSJGWNu4z8aHmb_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13528521053146768281', time=2024-09-14T13:40:36.178449+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MMtzaJtPB2BE4kcFhgXPZ59wr9JLbTw_0 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6334867532868440893', time=2024-09-14T13:40:36.193114+0000, chain.objs.size()=1 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.GX2abvj33BXu4sflSDY7EOxd9ZCKcIk_0 2024-09-14T11:58:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3775642778081351220', time=2024-09-14T13:40:36.587918+0000, chain.objs.size()=1 2024-09-14T11:58:38.839 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.840+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JDhKF9Bi1iw5Mte7AfefVH8LiIOGFR__0 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7184256034672939807', time=2024-09-14T13:40:36.836295+0000, chain.objs.size()=1 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NbJrwVQbYzstdvrkIJoJQLFhYYcGuQs_0 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17748806643339611800', time=2024-09-14T13:40:37.738341+0000, chain.objs.size()=1 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Dkkj3yc9C4YALwQVSe5SNZXDJ4WgnU-_0 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2914045487090738488', time=2024-09-14T13:40:37.926681+0000, chain.objs.size()=1 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.INkCDiXsPv7GCuHwpI-IFb1X8Ytcok9_0 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18348982993966813887', time=2024-09-14T13:40:38.159608+0000, chain.objs.size()=1 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.843+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iKkslqxWRXObOaIJiIHB9uB8J_wmlun_0 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.847+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/90513 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=42, truncated=0, next_marker='' 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6039781875034129561', time=2024-09-14T13:40:38.291386+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.k1mIty3NE3wlqe4KFlqV5NyNdNct3Y7_0 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13916262297376799288', time=2024-09-14T13:40:38.439666+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EW336VAtjdtZ-I7XPfJvb3aNwVZI3hM_0 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2829480831992230800', time=2024-09-14T13:40:38.651561+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VhNS7qElp06McfKDqn-KJUHD5hTywoG_0 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5340144171917659529', time=2024-09-14T13:40:38.747883+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-Rb0aiIh6yBvHRSjTIbgf29zX5GFxG4_0 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3031633517239793001', time=2024-09-14T13:40:39.130417+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bLo8JeiyfJjap459XT7BHvj3jUXOZ3y_0 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14374324603594862250', time=2024-09-14T13:40:39.581239+0000, chain.objs.size()=1 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.M1u94jO4jTy3Y-V75AmRf3efo7d7ZWe_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6028089306301942401', time=2024-09-14T13:40:39.591401+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JNQ-XyDMDBSuJsOi2_19uK5NrVI9Jd-_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2563554910275757372', time=2024-09-14T13:40:39.706632+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.uPsh3jvDChfBMAW8SRoYgXxmNP3tKr2_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17714998432035942106', time=2024-09-14T13:40:39.974088+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JgI73D5I_Q_Fi_Oh0VzUfkUMqOyGuj0_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.640406153078364264', time=2024-09-14T13:40:40.022207+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gPm_3PpDvGmTY5KP-Fq0RnPm_3afm9f_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1223441496541250406', time=2024-09-14T13:40:40.269270+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.62-bhts8NxxwBKyj-naaoRTNanvq82G_0 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9017626001376637813', time=2024-09-14T13:40:40.307371+0000, chain.objs.size()=1 2024-09-14T11:58:38.850 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.850+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hMqotq_HAmkeAj1Tdg0otz2IX-pwQyN_0 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13352441205260699704', time=2024-09-14T13:40:40.718545+0000, chain.objs.size()=1 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.JTdzjCG7jxXuDHck4vPcKObrIKJPKcq_0 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8902694923213199744', time=2024-09-14T13:40:41.301171+0000, chain.objs.size()=1 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zO5Xss5W3LsHITPuPvs2AQl34QT3L-v_0 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15333725101844851301', time=2024-09-14T13:40:41.792321+0000, chain.objs.size()=1 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VEy05Pd-5zVLRZBhVflq4RBPX623gu9_0 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10918793175865827366', time=2024-09-14T13:40:42.245955+0000, chain.objs.size()=1 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KebylfnM107A65KR1mOiY-FweVGGD7A_0 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13847516164976088402', time=2024-09-14T13:40:42.579899+0000, chain.objs.size()=1 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.DSHfRY-YXGv_L53zwAS5_dz_8HwPvJo_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7883451075668499790', time=2024-09-14T13:40:42.729128+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ruAw2VOfhzacx4z64cULZ0tyBFRQVrV_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13161823945399659582', time=2024-09-14T13:40:42.763351+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yRfNSQfQrs7pB2P5izzhTkCAowCvKz7_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17244265523101832229', time=2024-09-14T13:40:42.804557+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.cwUslwskReKAiLPXaM1LewXy_DVfdq7_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3572606273989803280', time=2024-09-14T13:40:42.950138+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pw5-VaH5LS9WNHZfKV_hBbeZwFgUywY_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9573642323073405826', time=2024-09-14T13:40:42.996950+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3O3B9Upyrpa3YJTKkTB3X5EQPqOjlMS_0 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12076657954320117238', time=2024-09-14T13:40:43.138683+0000, chain.objs.size()=1 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.855+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PUmOgLk3W5wuMhIZQ4jcinZEWU-Iqqs_0 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4572756392208139941', time=2024-09-14T13:40:45.555475+0000, chain.objs.size()=1 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.329__shadow_.AHfWAVpb-zqWTN6GOVEdqR0GyosRQOi_0 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13409028834345921026', time=2024-09-14T13:42:17.147277+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.466__shadow_.8t4OLcPfPSgcwY1Kg6m3dQ2TwkMfTw__0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11991917932187117117', time=2024-09-14T13:42:58.373385+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.515__shadow_.giw3Mjj6VDlVH5dPt7QAo_FN0jj7ziV_0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10587409614962529060', time=2024-09-14T13:46:28.542117+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:qYWgGbHSeCTT5ImPesFlpVbJhna9BU0_.nF-21wYDzPDnKKXK8iIleHyhK08MWmQ_0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4681873299727266996', time=2024-09-14T13:46:29.980037+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:lcFYnvUQ0Z2qQAz4kokCUjxCVDXtTVo_.uz-o54p8REsIMTMJBEe_mq3c_zaJ2BO_0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4987047027772690255', time=2024-09-14T13:46:32.336291+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:CLcYBK2GjIgvzU64pIV0qSerHWHNJk._.DVL2ttPcmp-XXIXFBFagPU8BD3VuAYA_0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11157833931666935413', time=2024-09-14T13:46:43.061082+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:iafmcH-3AIVln.wRwhNRBWmoNM7VI0w_.meGPm_PNiUEQG2eIx6awBSxxSBWR83Z_0 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.854092126949497809', time=2024-09-14T13:47:07.048942+0000, chain.objs.size()=1 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:G35xXOmaiTNH0ZEau08f5ba7gEdIcBZ_.11zTBauq6ejetrtVsR1Eo8bsrqcmuE7_0 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7611261322482828971', time=2024-09-14T13:47:08.319447+0000, chain.objs.size()=1 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:2MLVA.qjxKKHLpnf1g8KN7a66VsRY.6_._K5p-fQTUKcuE4_adOy6yaZdb7hcDKR_0 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18391282409177163849', time=2024-09-14T13:47:31.933564+0000, chain.objs.size()=1 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.859+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:s3hBM22deDEBcy-Opo7yE.oNrrV6JTW_.ggqc5KiWR87vyP6qqOuDXvKGNlUki61_0 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.860+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17021591641354225428', time=2024-09-14T13:47:34.480314+0000, chain.objs.size()=1 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.860+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:3TjB7yNFWMF9pW9aAc4lDUNSexm2KYa_.7NlRIqk6lSqq8GxP3QdZSxuT9sj5Jug_0 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.862+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3027814761066518168', time=2024-09-14T13:47:38.330257+0000, chain.objs.size()=1 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.862+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.586__shadow:i0pojTiDF8auG-28BcE25I8jOXl4zTQ_.cCGdkQnuenJaNqkh1Yp-uwzGkjDKTt7_0 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7346413626383866819', time=2024-09-14T13:48:55.169256+0000, chain.objs.size()=12 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.1 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.1_1 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.2 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.2_1 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.3 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.3_1 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.4 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.4_1 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.5 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.864+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.5_1 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.866+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__multipart_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.6 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.615__shadow_multipart_enc.2~HuKc5Y1r1abzDxG6mwYmCWy69D-OCf0.6_1 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2290045002661525303', time=2024-09-14T13:52:34.077484+0000, chain.objs.size()=1 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.666__shadow_._cwMV-R1kuOFfrxoavYPuoa1mpAu6_t_0 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4918529733020267855', time=2024-09-14T13:52:36.428670+0000, chain.objs.size()=1 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.669__shadow_.rm-EHzbclNFucs4CyWfJ2XGIygBTmFC_0 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15253756608821173935', time=2024-09-14T13:53:01.940962+0000, chain.objs.size()=1 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.868+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.709__shadow:R4pbuOyw9fESTjxBBZ.Q.kqZHtctTvi_.78N2gBoj_sdA3yZ9H4H7mrc2dSeV2nx_0 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5998239889676104476', time=2024-09-14T13:53:02.561869+0000, chain.objs.size()=1 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.710__shadow_.38Jw6WOxkNekn6u-IxllsHI1zW4dXjS_0 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.869+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17013192582396982484', time=2024-09-14T13:53:53.399565+0000, chain.objs.size()=1 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.869+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.742__shadow_.Pf72FVv7SN4LxyQvx6vbsdV1uJdbJLW_0 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.872+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.757592149667595841', time=2024-09-14T13:55:44.675108+0000, chain.objs.size()=1 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.872+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.770__shadow_.9TGlAKl8gLYbfPFse3G0uJ4SKKm6AN4_0 2024-09-14T11:58:38.873 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.876+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.876 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.878+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:58:38.877 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.879+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.880+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50465' 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_LH83G959XGaysaHrD7W_QIdYkiJ15q_', time=2024-09-14T13:34:37.266212+0000, chain.objs.size()=1 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_.s7XL_7J7MXJP7hy2iGsgjXPlrXYknrJ_0 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5639249841077699042', time=2024-09-14T13:37:10.502692+0000, chain.objs.size()=1 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.251__shadow_.L12tlkBBGSqIxp_thS-OUr9nG1KrxBq_0 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11126832359572974428', time=2024-09-14T13:37:13.458183+0000, chain.objs.size()=1 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.255__shadow_.lmA7OntCMvfCbWLFKS-VW22SWEoTE0i_0 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7782628637392053221', time=2024-09-14T13:37:58.296528+0000, chain.objs.size()=1 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.AI4BR9h20m5w0PcZ6HGedNOB4hsVGpe_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12189325236290889097', time=2024-09-14T13:38:00.505400+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7bHzyVVe0EDWlbxLZ3xOSAiovS78eR4_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18338567198006536924', time=2024-09-14T13:38:01.197915+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.tS7sW3ZNV1BKYxGKDua_qiNdyKB2mOK_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6776218164507752576', time=2024-09-14T13:38:01.370322+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.chpKQTi18J7-LVLM_LFhHXX_wXEQcHU_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7604805137250555917', time=2024-09-14T13:38:01.649544+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GQ0k24BtXfVlxr6cMwWGbpxAIjpjfxr_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8415235889169807157', time=2024-09-14T13:38:01.711681+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.fp4tZeD2WfAxO2gr26aFwwUYmCZvI8c_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16555391607656579157', time=2024-09-14T13:38:02.062431+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iT9Ogy8gi9_V2Q-7TrTK8HShe89kkgA_0 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7545106026971288018', time=2024-09-14T13:38:02.384515+0000, chain.objs.size()=1 2024-09-14T11:58:38.880 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.yR9IxVXqreoMGe-eMIM-2f9iuP9EAxJ_0 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9797498519785497619', time=2024-09-14T13:38:02.890255+0000, chain.objs.size()=1 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.881+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.m7M8sKx0kqYsj1Yn3hwh629SwBlCbgW_0 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6654488327544744375', time=2024-09-14T13:38:02.986636+0000, chain.objs.size()=1 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UiFzD9C4BjPYUsT1BUhwb72gtC2RhaH_0 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.884+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18307287904711475814', time=2024-09-14T13:38:03.045412+0000, chain.objs.size()=1 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.884+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.-ewJRKxFBN-xGRx2UpQOgA2Zw3Pxk-d_0 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12719262842917423624', time=2024-09-14T13:38:03.856637+0000, chain.objs.size()=1 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.K-pkWhAmLUEjo0gIO8cjNSl4tdWGNiA_0 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10756903506311433440', time=2024-09-14T13:38:04.562541+0000, chain.objs.size()=1 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.muwExTVtbLoo7t9M_fuMNZCX3iHc_Ot_0 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2158438557709528438', time=2024-09-14T13:38:05.198632+0000, chain.objs.size()=1 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OleHoTX265h2rpaxlrBtfJtWiPHh5Pa_0 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6749507117929116435', time=2024-09-14T13:38:05.242868+0000, chain.objs.size()=1 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Yg-tacvaIKmSHulpgMpmIJoCRzL3arK_0 2024-09-14T11:58:38.883 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14823751277910762076', time=2024-09-14T13:38:05.362785+0000, chain.objs.size()=1 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aGuhCg6y-CsBQyXCMwy-zhCGMNAw_1s_0 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13992197494636946215', time=2024-09-14T13:38:05.743602+0000, chain.objs.size()=1 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.WWbsaX3VjMbWbM86M_ye1VOcy9Q966-_0 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15926765780916413898', time=2024-09-14T13:38:05.762331+0000, chain.objs.size()=1 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.G7EvCbH5IGJC1ImQzTFgDQPc3UrZcRi_0 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13152748318572165829', time=2024-09-14T13:38:06.741798+0000, chain.objs.size()=1 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.885+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.A0zAs6M4m2p0-JB_evX6JLTAiD4B7Hg_0 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.886+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.385040017227558255', time=2024-09-14T13:38:07.063868+0000, chain.objs.size()=1 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.886+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._7YVU66lYsijbvmFj5JxyRHQBuUUoRj_0 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2703908590580976136', time=2024-09-14T13:38:07.706823+0000, chain.objs.size()=1 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VjlFy3ShN3WhGA62QQ-06COIfzXP0wj_0 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14899565326080336655', time=2024-09-14T13:38:08.257127+0000, chain.objs.size()=1 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.owT227yvMcZCcTQafqoLwZXu04--YNB_0 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9849134259788350528', time=2024-09-14T13:38:08.641637+0000, chain.objs.size()=1 2024-09-14T11:58:38.886 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.888+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.zKorU7MSrn7da4BLc9ru-1WGM8XAOvi_0 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3640642124910651710', time=2024-09-14T13:38:09.389185+0000, chain.objs.size()=1 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8hJTsgPMf-u88ICRbvBUHskZGpgaZ5Q_0 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13355126396877273098', time=2024-09-14T13:38:10.276281+0000, chain.objs.size()=1 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lfvggadhUj42Su08SYWwX9PNYN_ias-_0 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17336162964527576177', time=2024-09-14T13:38:13.902792+0000, chain.objs.size()=1 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.889+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.268__shadow_.0VffZZbui6zASclnEYnz2RAxX2icYrn_0 2024-09-14T11:58:38.887 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4646261795785604665', time=2024-09-14T13:38:15.259820+0000, chain.objs.size()=1 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.270__shadow_.7KPOmwRxibLqjeqCXFO5ehnOmQximut_0 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.765952678171711059', time=2024-09-14T13:38:43.963774+0000, chain.objs.size()=1 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.305__shadow_.2Af__DUzxccjUsT6YDotBQvxAZIXtU1_0 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15443562923118600420', time=2024-09-14T13:38:45.661532+0000, chain.objs.size()=1 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.890+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.307__shadow_.g3IhpZwX9Y9uA2SjnAYqDl5s45wKn_v_0 2024-09-14T11:58:38.888 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13456967708153727735', time=2024-09-14T13:38:52.930854+0000, chain.objs.size()=1 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.316__shadow_.aeT0YVG_P1CjpexlMGTwc0xFPPe2e6K_0 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.891+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10376990390863194898', time=2024-09-14T13:39:38.698136+0000, chain.objs.size()=1 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.891+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.H7Kb2kRlyQYyZuo66Xe_TvcOOYMcDtc_0 2024-09-14T11:58:38.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.892+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15775441590251371488', time=2024-09-14T13:39:39.431133+0000, chain.objs.size()=1 2024-09-14T11:58:38.890 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.892+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QaylJ8yXMDmw3-JjxsWafmtfLW0hDqZ_0 2024-09-14T11:58:38.891 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2527579076439708620', time=2024-09-14T13:39:40.459829+0000, chain.objs.size()=1 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.U30WuFJnTsliUN9S0uGiCxzf65fjMBU_0 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.894+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3606279016669880022', time=2024-09-14T13:39:40.710864+0000, chain.objs.size()=1 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.894+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uDOQV4dX7vBu-FZnmnT-Q2_1tPziGM3_0 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.695156041470826376', time=2024-09-14T13:39:40.713972+0000, chain.objs.size()=1 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._3ihkHcXHLbysX3hOaM6lOdN4ix3zlq_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14839985533073754695', time=2024-09-14T13:39:41.339709+0000, chain.objs.size()=1 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0spQo_qGwjn7Wg7NY36qz3QKKlVMQjc_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17204278240024344601', time=2024-09-14T13:39:42.406801+0000, chain.objs.size()=1 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._usnICE1j__ElEzs1_nkByQTjG1DFYR_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16941053315527795453', time=2024-09-14T13:39:42.534383+0000, chain.objs.size()=1 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Oqvhrn20RB1OOBHc7gNOsDT0cay3Nva_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18115009209649883682', time=2024-09-14T13:39:42.653875+0000, chain.objs.size()=1 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vhy45LAhWwDLs61Dj-q-4g9YwZGtHKT_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6733705354324871651', time=2024-09-14T13:39:42.796048+0000, chain.objs.size()=1 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sqWvkuzJzyaJZfEycZL87qvwy28-Gga_0 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17266170753578929823', time=2024-09-14T13:39:43.156579+0000, chain.objs.size()=1 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C-_O3OxwWrklXu3xFZgIJHr_VTveg4q_0 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3778431152799707164', time=2024-09-14T13:39:43.821217+0000, chain.objs.size()=1 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.895+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pRgxV7BmmR3sR8aF5nxxqnOvYh64hZD_0 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.896+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7087779707813526728', time=2024-09-14T13:39:44.819714+0000, chain.objs.size()=1 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.896+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.34emHAJKa5DbEfEpmuCtBox64_5Ikca_0 2024-09-14T11:58:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.898+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12235694132647419354', time=2024-09-14T13:39:45.631296+0000, chain.objs.size()=1 2024-09-14T11:58:38.895 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.898+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CYOAHwMTqqgalwpESvewh1IYInKFzHl_0 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14218976368598240925', time=2024-09-14T13:39:45.706581+0000, chain.objs.size()=1 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0nDSWDiYaUqzYFxkU8HPoi0UY6WfuvW_0 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11960750837200740251', time=2024-09-14T13:39:46.241069+0000, chain.objs.size()=1 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.elh60bOAYkeK3QpRb3yhHZHL48OgpbI_0 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3285834247544714552', time=2024-09-14T13:39:46.488855+0000, chain.objs.size()=1 2024-09-14T11:58:38.899 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.901+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0JDZzhZMonwF9fUqXyoTeWDOzOCr-t-_0 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1320988818384149510', time=2024-09-14T13:39:46.842637+0000, chain.objs.size()=1 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vl-MMPWHmkOuQju2Vt59n7wK9HM-Kv__0 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14561752636302955836', time=2024-09-14T13:39:46.885148+0000, chain.objs.size()=1 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dzozYb8xMpF-n1SFNdJcoWzBRVeKwy3_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14057006242939358548', time=2024-09-14T13:39:46.891788+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TWcU_6ki0vjVGRqh6xuTqoSn01LQtNl_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13155312139905637022', time=2024-09-14T13:39:46.942098+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2mvQDtutwtkSVQiQ9p7_H1TvlUXn3QN_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15206481922543523296', time=2024-09-14T13:39:48.013198+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PMclbHvQEBNLXUnqfMsbYth98xczqZn_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8671246002424006053', time=2024-09-14T13:39:48.621351+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XOw9TSzdMs2ppfSXvQnPUyHf7To5egR_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7033703898338307204', time=2024-09-14T13:39:48.723330+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vDQ3h4EJmQJh1Bse6u33x9w1Ml6Qwzu_0 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14362999087787635915', time=2024-09-14T13:39:49.454855+0000, chain.objs.size()=1 2024-09-14T11:58:38.901 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.902+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.P6OfYfkA6B_b5qn5wG3NttDEynKGQdY_0 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5694716004623804739', time=2024-09-14T13:39:49.535869+0000, chain.objs.size()=1 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tsyE0CEl88ZAIQ6BP9ssg69cFr6UfVU_0 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11191134269850939260', time=2024-09-14T13:39:49.574775+0000, chain.objs.size()=1 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2b5W2bPSI__ixJcyfeG8OG3q3QJ6a0-_0 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15195349501387028909', time=2024-09-14T13:39:49.621241+0000, chain.objs.size()=1 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.906+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OsNI5ZV8TwHR6iZWY1hIGWqyMyKKh73_0 2024-09-14T11:58:38.905 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11650621723942194289', time=2024-09-14T13:39:50.151353+0000, chain.objs.size()=1 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lUbiSw4BxZ8tfgr2YkTinuqnAjbSeBE_0 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5642740570851762225', time=2024-09-14T13:39:50.481509+0000, chain.objs.size()=1 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.PCq2b0I-FY-791f0XeuR8YNM2GJDnFA_0 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16860435809212162915', time=2024-09-14T13:39:50.780466+0000, chain.objs.size()=1 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TVQOIWME6mB4L06aeWJCnzZhpQG1HK5_0 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9731948230986612156', time=2024-09-14T13:40:31.260616+0000, chain.objs.size()=1 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.YS7vz7K8WA5p0RhGgISxCSFUQZAeXHA_0 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.479245892790384471', time=2024-09-14T13:40:31.621815+0000, chain.objs.size()=1 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.908+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.n4Cpz581Q4cJhC5ZRzznMfWD0Ou3Ntt_0 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6975800031865350904', time=2024-09-14T13:40:33.109725+0000, chain.objs.size()=1 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.w5yHQIjQkYPRavHSwLRAxJM9ilcPqry_0 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12891341940409326977', time=2024-09-14T13:40:33.407002+0000, chain.objs.size()=1 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kYnBuxaU0P5n0Bjuwc-JSbccBzrykp__0 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11662474914970780390', time=2024-09-14T13:40:34.264622+0000, chain.objs.size()=1 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6Ulrv1ikPqH38pofazVwVxqjqbu-WZg_0 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3962357202831363847', time=2024-09-14T13:40:35.299812+0000, chain.objs.size()=1 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.w8sSqtT6znO2AIp6KYmI-5-JFWV0S1s_0 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8159353876465146970', time=2024-09-14T13:40:35.433497+0000, chain.objs.size()=1 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tGxlqjrULr6zgw28vXjzJE_p5mjRYQU_0 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14162220414132495751', time=2024-09-14T13:40:36.085638+0000, chain.objs.size()=1 2024-09-14T11:58:38.909 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.910+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.y2IJFCNBRGDIWdNqUwo19jv-GFEBzqy_0 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18258080983426116253', time=2024-09-14T13:40:36.787512+0000, chain.objs.size()=1 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.i1pOvfUBFId6LKvhBCujoWpAIYUlFMR_0 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11202285073611311327', time=2024-09-14T13:40:37.018373+0000, chain.objs.size()=1 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.U02oFf2rXNWSQSqrDLfeIZbqlOXcDaH_0 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3935600556228108704', time=2024-09-14T13:40:37.062453+0000, chain.objs.size()=1 2024-09-14T11:58:38.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.912+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qP8Gmy0ym-va0dy5MjwzgYAevP2kpAF_0 2024-09-14T11:58:38.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10473225538389216100', time=2024-09-14T13:40:37.572504+0000, chain.objs.size()=1 2024-09-14T11:58:38.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ebDCjTbSSJZuwoLkE6JUEcn7A5jZQ-h_0 2024-09-14T11:58:38.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.913+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8365464057152750069', time=2024-09-14T13:40:37.847961+0000, chain.objs.size()=1 2024-09-14T11:58:38.911 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.913+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OSSYbFw-MexJ4o0bEvSdsBysgBrPGVL_0 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.914+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7817061466382515201', time=2024-09-14T13:40:38.045625+0000, chain.objs.size()=1 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.914+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1AxMShXu7KreWHA75QzUDGXUhslRdij_0 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.914+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7608037595735121796', time=2024-09-14T13:40:38.731630+0000, chain.objs.size()=1 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.914+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1iXpgapXY9mgqGhyp56j66sQ2tfoqhH_0 2024-09-14T11:58:38.913 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.302326874742231672', time=2024-09-14T13:40:39.177442+0000, chain.objs.size()=1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.qSr1UxmzHB7EiuXYrjtCCc1HpHmVkar_0 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11688023568946650826', time=2024-09-14T13:40:39.851645+0000, chain.objs.size()=1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.piMW0kiD_Cir4V4mkAKRkR4t1toMZt9_0 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11474407543460272397', time=2024-09-14T13:40:40.191022+0000, chain.objs.size()=1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XP5mr_3yf3mnW5pI2iws1_JuiuChrrT_0 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9144562255618205346', time=2024-09-14T13:40:40.846363+0000, chain.objs.size()=1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.916+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.gTKZfaWXIA3FqpXdAYZHjKTHwATJJo3_0 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2351643046658977453', time=2024-09-14T13:40:41.024635+0000, chain.objs.size()=1 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.bIkJVvdUhBlVleRTDDWB0N6L4R_5_5K_0 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9077358095115346533', time=2024-09-14T13:40:41.262598+0000, chain.objs.size()=1 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.E1Q87JoFS5RSlhocw2dftTG3M0FCQTi_0 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1724668864664815783', time=2024-09-14T13:40:41.524033+0000, chain.objs.size()=1 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.IjGMSkz_QfxyCeeYQl_Tj2kC5d07Uor_0 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16293324003366708922', time=2024-09-14T13:40:41.878559+0000, chain.objs.size()=1 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.D7wCuceFe1ExfrIy3T-aWhMwjTSvT-E_0 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3902206758824373491', time=2024-09-14T13:40:42.444649+0000, chain.objs.size()=1 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.917+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0bGklMc9x5hUsrcO45mySCl-uIB_cGo_0 2024-09-14T11:58:38.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.919+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2709083656500438927', time=2024-09-14T13:40:42.804939+0000, chain.objs.size()=1 2024-09-14T11:58:38.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.919+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.h7SddMo86KQOLnUGB9U8-q8DH9i1IhY_0 2024-09-14T11:58:38.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.919+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12838111936872574639', time=2024-09-14T13:40:53.959020+0000, chain.objs.size()=1 2024-09-14T11:58:38.917 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.919+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.342__shadow_.-Zy2wtYf6QkNQZJdsw1XjSxiCTZJNx__0 2024-09-14T11:58:38.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.920+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8227005120792331753', time=2024-09-14T13:42:07.604059+0000, chain.objs.size()=1 2024-09-14T11:58:38.918 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.920+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.456__shadow_.DF96_cAgfhfFpcWqQRwG-08eYZHcM0H_0 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17123387000415969965', time=2024-09-14T13:42:15.180095+0000, chain.objs.size()=1 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.464__shadow_.7U3f4urEgHChPFWYVNwZsiWHV_QKIl8_0 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7290968791812277124', time=2024-09-14T13:42:16.882176+0000, chain.objs.size()=1 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.466__shadow_.m85NyXVGOO7DlfL9PC1Ev5iRaQaUZBB_0 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12326976358143337444', time=2024-09-14T13:42:44.138513+0000, chain.objs.size()=1 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.504__shadow:nXVm7kgqo4bEjJ3nspqbS4K0zCG-G3f_.yY5dyJN8j4H7SaCtGPpt97HFLH7Fu-1_0 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.295320583646384073', time=2024-09-14T13:43:34.366736+0000, chain.objs.size()=3 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~95wGHugR29xI07szD8f2qg2gHplWa45.1 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~95wGHugR29xI07szD8f2qg2gHplWa45.2 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.522__multipart_mymultipart.2~95wGHugR29xI07szD8f2qg2gHplWa45.3 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5614367393282410496', time=2024-09-14T13:46:27.347512+0000, chain.objs.size()=1 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:nWH1YTAEfXOsdkt882v8zqdMmglbXA._.PytgtroptswPsTDYj9WhccNAjBgpt-q_0 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17387315042330870361', time=2024-09-14T13:46:41.087196+0000, chain.objs.size()=1 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.923+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.574__shadow_.h4ea_VUReaO5MkwK33YLSSrJtXDRGAc_0 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7648414682357352525', time=2024-09-14T13:46:47.461549+0000, chain.objs.size()=1 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.576__shadow:8ta-PbNDdwWZ.a3xK-GqEazoVzdf235_.WtK9FHgJnUGpNxwharAQ7mOmlG6icPj_0 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6323145534790045821', time=2024-09-14T13:47:02.289703+0000, chain.objs.size()=1 2024-09-14T11:58:38.922 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:lfeBBKDsZvBQ35YdupeJI75gGBCuSMl_.6VXOxpGCE0BOvXxUFQpU2fDtpdZlG9m_0 2024-09-14T11:58:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16995051071951550239', time=2024-09-14T13:47:31.980203+0000, chain.objs.size()=1 2024-09-14T11:58:38.923 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.924+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:Nk7LB5S6AiymQlAz3NRpa472mVauUUS_.auQ8j_mYFRHhf2Rjdzjl0qLNbvXzxBz_0 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.929+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/50465 2024-09-14T11:58:38.929 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6628394491923838123', time=2024-09-14T13:47:32.019807+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:U6D-l14XcjKe7P23cJHPIKQW16sJhuk_.jdFCLTH_XvJfzh-V4ajcPMp60hLBNaK_0 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8479774625797762441', time=2024-09-14T13:47:38.374597+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.586__shadow:NvlTrxdkfOAnyRSMOPwjw9eqLbvs.hp_.DJ--1SxFTNeG-94XK-7Me7WEhLwpDs-_0 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17847629829561712676', time=2024-09-14T13:51:49.807832+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.636__shadow_.yFnjoTuUD-Wh9MYKTGDOcuF7eerZiZe_0 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5723560919322699684', time=2024-09-14T13:52:09.668845+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.653__shadow_.-NQHcnX2JH9_JdHfyHPvT7zk0dOHZ3B_0 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7720759548772409323', time=2024-09-14T13:53:27.828271+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.719__shadow_.CVcGNOCMxbJsERj0PV4EjToxJOOaYHQ_0 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17678016509270098801', time=2024-09-14T13:55:28.554559+0000, chain.objs.size()=1 2024-09-14T11:58:38.930 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.932+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.763__shadow_.5rlAXmyFEDb-p7BnpPuUxnTBx_obZL2_0 2024-09-14T11:58:38.933 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.935+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.935 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.938+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:58:38.936 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.939+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.937 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.939+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57220' 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9943136704780764507', time=2024-09-14T13:34:30.840741+0000, chain.objs.size()=3 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_._Ge-kmq26cU2_bH6H1ySsCJ3cQ5adBa_0 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_._Ge-kmq26cU2_bH6H1ySsCJ3cQ5adBa_1 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_._Ge-kmq26cU2_bH6H1ySsCJ3cQ5adBa_2 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5270115045436226105', time=2024-09-14T13:34:39.223008+0000, chain.objs.size()=5 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-LUKEWARM.2~_43fOTzGOXswPCyNrA6JkTj-NF6EVKu.1 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_foo-LUKEWARM.2~_43fOTzGOXswPCyNrA6JkTj-NF6EVKu.1_1 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-LUKEWARM.2~_43fOTzGOXswPCyNrA6JkTj-NF6EVKu.2 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__shadow_foo-LUKEWARM.2~_43fOTzGOXswPCyNrA6JkTj-NF6EVKu.2_1 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.162__multipart_foo-LUKEWARM.2~_43fOTzGOXswPCyNrA6JkTj-NF6EVKu.3 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_L1XbNA1pVOHns5ocYl6AQShOEyeFjTS', time=2024-09-14T13:34:47.661985+0000, chain.objs.size()=1 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.166__shadow_.CTNidiRD_z8jenx_CXzMwN_HWP1erSg_0 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3624246165111031838', time=2024-09-14T13:35:07.380626+0000, chain.objs.size()=1 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.184__shadow_.lOModOPZxHHUMjpGFGO-l1K3rwSkupf_0 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.886855916440303706', time=2024-09-14T13:36:58.454061+0000, chain.objs.size()=1 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.236__shadow_.lZ3SkgvqTWMrFUgWtq-2vgznNNsP0Zh_0 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10931053230182755200', time=2024-09-14T13:36:59.211027+0000, chain.objs.size()=1 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.940+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.237__shadow_.VvGmK_kqNM_PNz41tmn0Wpwow-sdJTx_0 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8928822732291272456', time=2024-09-14T13:37:17.756586+0000, chain.objs.size()=1 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.261__shadow_.5plIGBnQjDQJ6vGV1s_0zSEgkSNqJ5L_0 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4848931807449810013', time=2024-09-14T13:37:57.860058+0000, chain.objs.size()=1 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.2IcULjoKG0Igl0wdKwQFIMdhLvV8GZ9_0 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18259274525522952723', time=2024-09-14T13:37:58.472505+0000, chain.objs.size()=1 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_._-iHhAR-h1e1TAmXZUdNncl3Xjwhgpz_0 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9877800403664535035', time=2024-09-14T13:37:58.571443+0000, chain.objs.size()=1 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.bOZP_7PLNPgUzq_hBkmYPZk8Hk23I75_0 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1168599168991788909', time=2024-09-14T13:37:58.572087+0000, chain.objs.size()=1 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.IzM0XcWQ7z6YCSIyaggdPj8t82yh8Sb_0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5757599587489999426', time=2024-09-14T13:37:58.643439+0000, chain.objs.size()=1 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uW0JxX2DKEEz-r_jlz59FOocMN-Sgan_0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5079315961006831379', time=2024-09-14T13:37:59.509208+0000, chain.objs.size()=1 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JmGeajhoNo3OtAcOsfj54VORATsso5Y_0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7412849484239607216', time=2024-09-14T13:38:00.097218+0000, chain.objs.size()=1 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OmxOzdsGW-jAXo2T8F3o0KEe8P6S9r__0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3845081846600782487', time=2024-09-14T13:38:00.325689+0000, chain.objs.size()=1 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.m4T9CHH4wyOL9mIj-KAbSohAcwBNJNB_0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4154259604273562701', time=2024-09-14T13:38:00.703183+0000, chain.objs.size()=1 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qL21-o5DryvgHSgZpQjm9aayFgVJnvx_0 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.624921772861102868', time=2024-09-14T13:38:01.526441+0000, chain.objs.size()=1 2024-09-14T11:58:38.944 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.944+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hSebRII4AXBOWNsj8GAQGEjZzRx2fuo_0 2024-09-14T11:58:38.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7772631468727599525', time=2024-09-14T13:38:01.840093+0000, chain.objs.size()=1 2024-09-14T11:58:38.946 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.keb2mfwxAwNWn2Kea1yrZJzIKhEAKSz_0 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9282277920596802221', time=2024-09-14T13:38:05.321108+0000, chain.objs.size()=1 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qDIMoMG7KrJev1lsfrP8m1t3HXvE3UV_0 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14113325086572881484', time=2024-09-14T13:38:05.645932+0000, chain.objs.size()=1 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.rYWAygR4hJtglY5OR8jWM7EKwtTvYeq_0 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4687962971057209734', time=2024-09-14T13:38:06.448876+0000, chain.objs.size()=1 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.948+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LYAZlVLNbp4Nml6jbFJ3d_OR5Msvmgv_0 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.949+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9174228045922808600', time=2024-09-14T13:38:07.729414+0000, chain.objs.size()=1 2024-09-14T11:58:38.947 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.949+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xp5g-ORv8ct8aUXJNLjFEAIL6-T5XN0_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.949+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11837942250630110242', time=2024-09-14T13:38:08.275019+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.949+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CbTS7Wi0O-W0omj8sYazzDHkqtiaKeq_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4429298777025483248', time=2024-09-14T13:38:08.986137+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5U1VItPr9ESm8QAU4FCIGz4YWC_ARKV_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5311467857479346420', time=2024-09-14T13:38:08.986918+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.G_RBSQVayF9niB3JxgRxolxGG5xa470_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5004360846445993175', time=2024-09-14T13:38:09.443976+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6UMIFIOKZyL_ClaVQlbczO1cKhvrkgE_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3730525803621472238', time=2024-09-14T13:38:09.748724+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9e1HBTNBeZYJUZKizu494UAuMVVACSN_0 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16178907784141927115', time=2024-09-14T13:38:09.749645+0000, chain.objs.size()=1 2024-09-14T11:58:38.948 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.950+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kr1nYgFWEWTbTEjkeoOAVYZ-7MNMjOb_0 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1588949724415006098', time=2024-09-14T13:38:10.078234+0000, chain.objs.size()=1 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RRwxhPBPlymevJdLeWIQ_0mRIZmFeIR_0 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11493769474118227666', time=2024-09-14T13:38:10.135415+0000, chain.objs.size()=1 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aD_bHZRk2Ck6O9xzI9XCn8Ro9U5d8V6_0 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3885631519244419014', time=2024-09-14T13:38:11.104491+0000, chain.objs.size()=1 2024-09-14T11:58:38.951 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.264__shadow_.rRLXiEp4AgXKFRv8Cc--YnXt5VhROzb_0 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2298567575107322542', time=2024-09-14T13:38:12.531288+0000, chain.objs.size()=1 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.266__shadow_.J4HQE7OAMy4rxl7_TN9b_GKMugYxPX1_0 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8117463214343537381', time=2024-09-14T13:38:20.945255+0000, chain.objs.size()=1 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.953+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.278__shadow_.QAqgxNbTTpLnmR0vNzlPgQ7Xgm7jdAS_0 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.954+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4414880718830705343', time=2024-09-14T13:38:33.521376+0000, chain.objs.size()=1 2024-09-14T11:58:38.952 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.954+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.qid2E_S_ZiKaz03mHqoTSFpCuycex2e_0 2024-09-14T11:58:38.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3977019135472585338', time=2024-09-14T13:38:41.750954+0000, chain.objs.size()=1 2024-09-14T11:58:38.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.302__shadow_.OsKx7e1OYSonwz4wyfXZ8P6006tGscS_0 2024-09-14T11:58:38.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10830291832459184703', time=2024-09-14T13:38:46.913933+0000, chain.objs.size()=1 2024-09-14T11:58:38.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.308__shadow:70dpg1FrUWgGiC6nMq2XGIz1JsHlCMA_.GeL36mSqO8mMBM7w4JvC5Gq-69Y5nSO_0 2024-09-14T11:58:38.953 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9485539141283269340', time=2024-09-14T13:39:38.539762+0000, chain.objs.size()=1 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CLKoz9TNzCtWBhTMqF3F2dMln8pKGMA_0 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.338616215726946147', time=2024-09-14T13:39:39.337093+0000, chain.objs.size()=1 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.KCJGinBnLWnDwl6kTrMtvSDL4hENEio_0 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17161776590401334723', time=2024-09-14T13:39:39.491919+0000, chain.objs.size()=1 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.955+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b7e9dpPqfOoV4N1-gZN1WIROBXK_Dc3_0 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.956+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12761867750804731907', time=2024-09-14T13:39:42.015079+0000, chain.objs.size()=1 2024-09-14T11:58:38.954 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.956+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JuSwfYNHhhr64ElB5WX0BJivbwUQCsg_0 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7654868853234200665', time=2024-09-14T13:39:43.150640+0000, chain.objs.size()=1 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hTbXJ3W_SojhVGU6WczL2UvAK-q4ecq_0 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14590890044858567093', time=2024-09-14T13:39:43.854726+0000, chain.objs.size()=1 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CtvI7GyC1-lBQICjDWSNGrGPP7AVO8H_0 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3762166192675220745', time=2024-09-14T13:39:43.964258+0000, chain.objs.size()=1 2024-09-14T11:58:38.958 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.960+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C45npHCvRF6rq8dfQwthql758Edqeh2_0 2024-09-14T11:58:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5009971257952305838', time=2024-09-14T13:39:44.074494+0000, chain.objs.size()=1 2024-09-14T11:58:38.960 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SfVAWmCCiiVGnHrgrgb1oB34nKUAtkF_0 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13379825119566306135', time=2024-09-14T13:39:44.296098+0000, chain.objs.size()=1 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._qKUBI8CCkjlkSsIsIFf8NoSVKgKNW3_0 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.364346769433687042', time=2024-09-14T13:39:44.478602+0000, chain.objs.size()=1 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.VSQH10hTvXTeneCanQjeTACEQmr-PgD_0 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14903170667953576448', time=2024-09-14T13:39:44.689560+0000, chain.objs.size()=1 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4_IzkjAnfEKa56PefM89Y3GKWj6z_Vo_0 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6297839567692885268', time=2024-09-14T13:39:44.848375+0000, chain.objs.size()=1 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TfIcM7yz9iWXaBS0n3wkGNPkC-xX0fb_0 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.921672662676767114', time=2024-09-14T13:39:45.267967+0000, chain.objs.size()=1 2024-09-14T11:58:38.961 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.963+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dbgXiYhQbDI7SoduCzAs7e-5eiw4kQx_0 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16812285730882304109', time=2024-09-14T13:39:45.287852+0000, chain.objs.size()=1 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kCtAIj-wDfefw0iN_F2E2hlwg0MVDH3_0 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13053165222134716861', time=2024-09-14T13:39:45.883068+0000, chain.objs.size()=1 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ycyMmCcQ0-5XeHVLMujyrl1-Y2lbNw-_0 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2537471041204453493', time=2024-09-14T13:39:46.052791+0000, chain.objs.size()=1 2024-09-14T11:58:38.962 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.964+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.j7Tr2W7fNAGlHtYb4zdI_sYOFCedeil_0 2024-09-14T11:58:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.965+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15600862155834388528', time=2024-09-14T13:39:46.402142+0000, chain.objs.size()=1 2024-09-14T11:58:38.963 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.965+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.sEcRatr95ChEX_wMWMbeTHZAJ1vrTfD_0 2024-09-14T11:58:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.965+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18118034200263168878', time=2024-09-14T13:39:46.882236+0000, chain.objs.size()=1 2024-09-14T11:58:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.965+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ePui9rhWuVPgPszrfbZMuFRkWKTv7Fm_0 2024-09-14T11:58:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.966+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14313325448081291799', time=2024-09-14T13:39:46.882889+0000, chain.objs.size()=1 2024-09-14T11:58:38.964 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.966+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Sk3zdKbj0uFrGbtvT8imcOz7lh4sWJt_0 2024-09-14T11:58:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7596498045000212698', time=2024-09-14T13:39:46.883748+0000, chain.objs.size()=1 2024-09-14T11:58:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.RtmIJ2nOgdPLOJ5F_n8A-vr1thPJv3e_0 2024-09-14T11:58:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11880437857186862184', time=2024-09-14T13:39:47.168791+0000, chain.objs.size()=1 2024-09-14T11:58:38.965 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vnNFJ6_RgfUaI5x7rzPhDw_ERx5X2Oj_0 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14878367381319986388', time=2024-09-14T13:39:47.259465+0000, chain.objs.size()=1 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.967+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dmsVQWeC1VuWMVmJdBqls3NHpbFHzGG_0 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6774801333903798172', time=2024-09-14T13:39:47.366553+0000, chain.objs.size()=1 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9WYf8-V3_8J2pISHLyTpTElauRyBlNQ_0 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13660440144099749216', time=2024-09-14T13:39:47.486024+0000, chain.objs.size()=1 2024-09-14T11:58:38.966 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fNFD7HRJ9fUUxrAplsjawT82mfUHcm__0 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7973567328678413830', time=2024-09-14T13:39:48.876379+0000, chain.objs.size()=1 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0ZjboEE8Gshu3hf_mda_rxPMK36WC1p_0 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6768060435208933219', time=2024-09-14T13:39:48.939689+0000, chain.objs.size()=1 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YEjGqro3be2zdPqdCz1_ici7l_1FLr0_0 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1131615255493042479', time=2024-09-14T13:39:49.387446+0000, chain.objs.size()=1 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.402qvfrf7sDH7of4tuL6HLxT-GbhceJ_0 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10652732264418378811', time=2024-09-14T13:39:50.083179+0000, chain.objs.size()=1 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.968+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.BOQFGvVk1sIl_liwufmFvOOaSmV5r1N_0 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7170980818236820301', time=2024-09-14T13:39:50.352869+0000, chain.objs.size()=1 2024-09-14T11:58:38.967 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.hfVT2MqIwAuldcuNh6aftuAsXofGcQ0_0 2024-09-14T11:58:38.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.969+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9260996925551433085', time=2024-09-14T13:39:50.667441+0000, chain.objs.size()=1 2024-09-14T11:58:38.968 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.969+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.B3Rkf15t6SwEwusNmjCxc7j12lYWsrU_0 2024-09-14T11:58:38.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.972+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2178756811121763632', time=2024-09-14T13:39:50.720687+0000, chain.objs.size()=1 2024-09-14T11:58:38.969 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.972+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.B7dOO3yZ-jgOF30sMaXrTwmupwBFWJ0_0 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4545984562776665282', time=2024-09-14T13:40:31.085167+0000, chain.objs.size()=1 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.mU5pJcw3i9-YQyZKkHDu2EfSmMhiGaB_0 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14918807752633066574', time=2024-09-14T13:40:31.379825+0000, chain.objs.size()=1 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CDoqngcFPTFzhud6Eu6Jytz55wuMAUr_0 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2483486163340915348', time=2024-09-14T13:40:31.380657+0000, chain.objs.size()=1 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NBwjGJBlISx3yYC3kGBG6Rzz7ZCflxa_0 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13078931536019017918', time=2024-09-14T13:40:31.381472+0000, chain.objs.size()=1 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ohtVO9TIdeFQ43W3krPe_Qel6hma-bn_0 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15374215533541008176', time=2024-09-14T13:40:31.855102+0000, chain.objs.size()=1 2024-09-14T11:58:38.971 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.973+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KRgt0ZN9JD7B-o9s60fbYwT3tzQUZYC_0 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13197366100109193184', time=2024-09-14T13:40:32.721264+0000, chain.objs.size()=1 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OOKpbSSLoahpWClJQAvLOPBou7UlSM6_0 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7437466677073942108', time=2024-09-14T13:40:33.319172+0000, chain.objs.size()=1 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PmEW71nvR45494yCYLCbbEAH_GY6lLG_0 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6595380651775285812', time=2024-09-14T13:40:34.390137+0000, chain.objs.size()=1 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.auwNdWLr7e0Xe3FYwbr1Eb__uQaiiTx_0 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3260881984509682170', time=2024-09-14T13:40:36.022875+0000, chain.objs.size()=1 2024-09-14T11:58:38.973 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.975+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.F9bFym9KDWUo34nVE1kGf-7KAWLfQTD_0 2024-09-14T11:58:38.974 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.977+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15085136651371653329', time=2024-09-14T13:40:36.087514+0000, chain.objs.size()=1 2024-09-14T11:58:38.975 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.977+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3-VcupDgi99b2dAp2OwsqnBNQR8-Ybg_0 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14318667439210966280', time=2024-09-14T13:40:37.514608+0000, chain.objs.size()=1 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Kwt9zokYvKWmJ7T6BtGZPo2giKJSh-h_0 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2656260647249555955', time=2024-09-14T13:40:37.701914+0000, chain.objs.size()=1 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-g2vIvg9t2W23R5fUsT1QYEfIvnVz6Q_0 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14308900665132629495', time=2024-09-14T13:40:37.960263+0000, chain.objs.size()=1 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NsSPVhqnS5LGVDWI7ebOkmDMACovKAp_0 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10788340159849705384', time=2024-09-14T13:40:38.000698+0000, chain.objs.size()=1 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sC1QwPeEe10CViy06g3ub_-XUS-veRs_0 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13962764510561468591', time=2024-09-14T13:40:38.039681+0000, chain.objs.size()=1 2024-09-14T11:58:38.976 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.978+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9f4bRKC2sC7DIdhbYdSjVFnP9EmfHMH_0 2024-09-14T11:58:38.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5904594638434054793', time=2024-09-14T13:40:38.368817+0000, chain.objs.size()=1 2024-09-14T11:58:38.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OeAHSQFiu3etcPxgpR2KC3fBlwcXsOf_0 2024-09-14T11:58:38.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16112464092204517368', time=2024-09-14T13:40:39.191152+0000, chain.objs.size()=1 2024-09-14T11:58:38.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jeOd5x2fnNNXIDJieHUX3-uOuXPfL4M_0 2024-09-14T11:58:38.977 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1132332037456776166', time=2024-09-14T13:40:39.412426+0000, chain.objs.size()=1 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rdgIOB2I27wxTPZ29grAlWVV3JnQhC2_0 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12621175418268076855', time=2024-09-14T13:40:40.117523+0000, chain.objs.size()=1 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.h9-Lj7wLIbIO5rfA5h6zbEaGiOvsf6O_0 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16866702726639511267', time=2024-09-14T13:40:40.807705+0000, chain.objs.size()=1 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.979+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Bp7g-vYgCKMCbQAwegN6DV0mpFMxCMX_0 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14129794611148019324', time=2024-09-14T13:40:41.822285+0000, chain.objs.size()=1 2024-09-14T11:58:38.978 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QZktDFp_5B2SzpkND9fDgBeJ1-4Dh4B_0 2024-09-14T11:58:38.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.981+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12644766466665886627', time=2024-09-14T13:40:41.900771+0000, chain.objs.size()=1 2024-09-14T11:58:38.979 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.981+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WquPGTQcy3uUtQ-jz8WndzxzZsvZlZb_0 2024-09-14T11:58:38.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.983+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13806698851498444519', time=2024-09-14T13:40:42.246362+0000, chain.objs.size()=1 2024-09-14T11:58:38.981 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.983+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.2uRpiKEOb__9iZJS0XS8r84qPu5y1aB_0 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9674103210321068962', time=2024-09-14T13:40:42.247444+0000, chain.objs.size()=1 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.kOoTKS950ubOec0dyde2jGHlxqx8gCP_0 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3936285746312678308', time=2024-09-14T13:40:42.492464+0000, chain.objs.size()=1 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.iGAOpD_qxNONFXAwQ0meH-tDtn5sQoM_0 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12296201297954674346', time=2024-09-14T13:40:42.763417+0000, chain.objs.size()=1 2024-09-14T11:58:38.982 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.26kZJ50GmzpBkfiJbJmv99F1mfcyvcE_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12862691795411534126', time=2024-09-14T13:40:42.929018+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oPPAprl-kvH5srOk46y74z1Rl_prXPl_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17742380407148639478', time=2024-09-14T13:40:43.086819+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.k6JAcJVcgTuiZ_fdRhz1qapW6Wd4cjD_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7016651286587637645', time=2024-09-14T13:40:48.830635+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.334__shadow_.IOlaTHOIJ3m7KVrOp-AT8wMwbOlKgPi_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.569594737279362035', time=2024-09-14T13:41:10.282181+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.372__shadow_.LFHyNgCHSX8kVZ7MlQ5pXnikB3bE7t8_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16268303655977314628', time=2024-09-14T13:41:10.924684+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.373__shadow_.bxbh6VJujosJLcEa_lNb2BTKvUMrfMy_0 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17718083254159348335', time=2024-09-14T13:41:50.221502+0000, chain.objs.size()=1 2024-09-14T11:58:38.983 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.431__shadow_.ds9UTCjnaVDB46842mpAeUJ19sozpRm_0 2024-09-14T11:58:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2050274017248863689', time=2024-09-14T13:42:04.139773+0000, chain.objs.size()=1 2024-09-14T11:58:38.984 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.984+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.451__shadow_.JNxwDQqdn37Hxsjb0hZxgQbHnD25hSL_0 2024-09-14T11:58:38.989 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.991+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/57220 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12809274501917757493', time=2024-09-14T13:43:07.019707+0000, chain.objs.size()=2 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.aIsky1XvR2rfokUxLGbF1nGybnbIXfL_0 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.518__shadow_.aIsky1XvR2rfokUxLGbF1nGybnbIXfL_1 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14011458273728547472', time=2024-09-14T13:46:29.258742+0000, chain.objs.size()=1 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:Q1ZV9DhVrBAt18flyN0NQW4cmTrDTH1_.IOCB84v8INDMDszLUDUC8rPA9p9F536_0 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.339204459051065519', time=2024-09-14T13:46:42.583018+0000, chain.objs.size()=1 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow_.OeUEWy3UPEhyhSm9BSuDReL20un4I7__0 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11366077761429734304', time=2024-09-14T13:47:03.421248+0000, chain.objs.size()=1 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:p28mAG-Mqu-39zSqccqg1D-OTxziGpQ_.BA0VebwXafVlfHrxfgUTVcxH-8BnWfh_0 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5967046116291583185', time=2024-09-14T13:47:09.302982+0000, chain.objs.size()=1 2024-09-14T11:58:38.992 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:NREyfdobFoVQFBk4neauLQc6p2ZxmWf_.wZ8Ax-kvhnIPcN-RKI8E3-zKm46IcAr_0 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13083046340162258778', time=2024-09-14T13:47:27.801969+0000, chain.objs.size()=4 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~O850g3bMoYj6Dhp-USRNACf7Zv1DgTy.1 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~O850g3bMoYj6Dhp-USRNACf7Zv1DgTy.2 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~O850g3bMoYj6Dhp-USRNACf7Zv1DgTy.3 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~O850g3bMoYj6Dhp-USRNACf7Zv1DgTy.4 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9774708044524113494', time=2024-09-14T13:47:32.059084+0000, chain.objs.size()=1 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.580__shadow:LxYGvGczl0U.lkn08uVEZ7ybmTilkhT_.rUDkp4BDeddgorwJQgcK-NcWi8cGwcF_0 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4220531970772315755', time=2024-09-14T13:47:40.903344+0000, chain.objs.size()=1 2024-09-14T11:58:38.993 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.994+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:Mbo9i30aviPQlBL7dePgBRknIbdOK9N_.luUjHgVXMBdj0X0X6ryRGst1WP8wi4W_0 2024-09-14T11:58:38.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.998+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3179049368750146877', time=2024-09-14T13:54:08.747422+0000, chain.objs.size()=1 2024-09-14T11:58:38.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.998+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.747__shadow_.k1WmvvnpphSpyD_of-11XHjUz9HEtpD_0 2024-09-14T11:58:38.995 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.998+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13040733666284111994', time=2024-09-14T13:58:05.419126+0000, chain.objs.size()=1 2024-09-14T11:58:38.996 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:38.998+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.783__shadow_.R1CIr2By1KnicoDXk6ADC3OmmRc6PPX_0 2024-09-14T11:58:38.998 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.000+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:39.000 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.003+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:58:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.004+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.002 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.004+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50493' 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_rvKAXo2nMZ-2OaXpj9E1_M-JN8DvWgs', time=2024-09-14T13:34:31.275548+0000, chain.objs.size()=3 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.6iSfqWu2pd_Q2BwL0O7a3aSvEZojXgQ_0 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.6iSfqWu2pd_Q2BwL0O7a3aSvEZojXgQ_1 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.6iSfqWu2pd_Q2BwL0O7a3aSvEZojXgQ_2 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1380485584728217584', time=2024-09-14T13:36:59.219222+0000, chain.objs.size()=1 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.237__shadow_.E_6azunrINr7cQKA1PXiOIRzTJpjsXu_0 2024-09-14T11:58:39.004 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7629456434539584902', time=2024-09-14T13:37:00.245250+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.238__shadow_.rJn9e118uoPHq4rVzWVLDXTorRPTDzz_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6536788842122162356', time=2024-09-14T13:37:03.219659+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.242__shadow_.liCwNGK6XPbkuYDy-QbfpCa2nvRwWcJ_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7735666910650435984', time=2024-09-14T13:37:07.542352+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.247__shadow_.yhx-wQEjnkBj0fV5ZoXS74o8UM1R3Jx_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3158591568610975290', time=2024-09-14T13:37:13.460116+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.255__shadow_.jbfhSqsVASt4N-2oerk0OTI-0uadsIj_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9572827917886562406', time=2024-09-14T13:37:17.750509+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.261__shadow_.CY2KE_XGT1Ybe1zMH9l6HrksRLYuguD_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2722796915783994079', time=2024-09-14T13:37:57.846069+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.V7v0297-CoMtB6f_Xrbh2iH9wgp0xaO_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9741913105539236832', time=2024-09-14T13:37:58.248978+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nOJKPQgdEjF6ZYRD3t6nxp4cciAdZuu_0 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8647390908107980860', time=2024-09-14T13:38:00.071804+0000, chain.objs.size()=1 2024-09-14T11:58:39.005 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.005+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.sH45b_2UGH_esvoh2lKmAdvmWitkkT0_0 2024-09-14T11:58:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13747948674424414578', time=2024-09-14T13:38:00.514063+0000, chain.objs.size()=1 2024-09-14T11:58:39.006 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RWtunMoyPv5Z3M49XubgN_2pgQvNEYM_0 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.964336601056544267', time=2024-09-14T13:38:01.565767+0000, chain.objs.size()=1 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iA6U05C6CysUT8ybx5IETm-rbK8eA0T_0 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12279720870519736625', time=2024-09-14T13:38:01.677243+0000, chain.objs.size()=1 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.008+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.S1J_cyIeovD3sCNXQe_NwEpq-BwV19u_0 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3531802047379936786', time=2024-09-14T13:38:02.216770+0000, chain.objs.size()=1 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.72H03ACq1QUDr9YOUbZvuFpj8VE7VUw_0 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16841952470382107589', time=2024-09-14T13:38:02.381166+0000, chain.objs.size()=1 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.PktBwA5nULO3v-DcHvbD3vSNZ8qUEAj_0 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3311780240644417666', time=2024-09-14T13:38:02.947747+0000, chain.objs.size()=1 2024-09-14T11:58:39.007 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.009+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W_P65Xwvz3Nb2rmpUY8J8mau7dCWIjq_0 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2966522787423663002', time=2024-09-14T13:38:03.256375+0000, chain.objs.size()=1 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.p6qpn1JfQmt1DFqgD7rjd6Ad_WWclsQ_0 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16198724516740836436', time=2024-09-14T13:38:03.489310+0000, chain.objs.size()=1 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Hk3IWdgEjKz6NyDNUkIk90OSr0XQ5s6_0 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7745258725719349600', time=2024-09-14T13:38:03.602173+0000, chain.objs.size()=1 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.I04BICXumrN9Lq_JVuSASf2zMFhttT9_0 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17793970433309366182', time=2024-09-14T13:38:03.827223+0000, chain.objs.size()=1 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qv0eYDI15MjVKc0PZriM6I2ddfB6C0e_0 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2841751340341363838', time=2024-09-14T13:38:04.699525+0000, chain.objs.size()=1 2024-09-14T11:58:39.008 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.010+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3nw8TixFpZkReZzJCJ2hye7K0J9EyQ3_0 2024-09-14T11:58:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2561042966110729300', time=2024-09-14T13:38:05.033921+0000, chain.objs.size()=1 2024-09-14T11:58:39.011 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8bxWH6DVw2-b9sycYyQhHgeETywxSKI_0 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2840081497676521527', time=2024-09-14T13:38:05.068833+0000, chain.objs.size()=1 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Jgx0lcUpI3CTT3uErsR6Lpq7PkY5ehl_0 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8612739448538883503', time=2024-09-14T13:38:05.086252+0000, chain.objs.size()=1 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.errBX9c4tJpPqxYDNbA1M7a_MwJqzGD_0 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8958434004001875399', time=2024-09-14T13:38:05.719664+0000, chain.objs.size()=1 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RUbYfzcHuxljJ7PZee_HK71ryLTUgV0_0 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12804573279825782311', time=2024-09-14T13:38:06.329830+0000, chain.objs.size()=1 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.t6QuJg7SKhqBF7gJlWY9wkjRYDHbpY6_0 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10812023374671957010', time=2024-09-14T13:38:07.354922+0000, chain.objs.size()=1 2024-09-14T11:58:39.012 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.013+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MZmpB6Wt4I7jzDa3iF5oyn8ayDXYbga_0 2024-09-14T11:58:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.015+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4632463379519069445', time=2024-09-14T13:38:07.705927+0000, chain.objs.size()=1 2024-09-14T11:58:39.013 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.015+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hddzQyc5vNZHCqVvcYxbYzxlQGAzJ7E_0 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10719122810014560908', time=2024-09-14T13:38:07.895207+0000, chain.objs.size()=1 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1qaC4jbHQSM5hBtNsWtmdBiA-tWbLZe_0 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6916955141431341851', time=2024-09-14T13:38:08.619373+0000, chain.objs.size()=1 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.6a8UaXcxbI2FEG6UAlevcWXAidWfqUH_0 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15522931683690734864', time=2024-09-14T13:38:08.683899+0000, chain.objs.size()=1 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0UljEIU03ax53TzV2FaNRMgaIbqtD51_0 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5532669722156357623', time=2024-09-14T13:38:10.077803+0000, chain.objs.size()=1 2024-09-14T11:58:39.014 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.016+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5sxqOAhwOsOqRVBwktTRVSoqRLCDSaU_0 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3758510955776455950', time=2024-09-14T13:38:10.337066+0000, chain.objs.size()=1 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.dxBmwgkqaRkRVJbrEG1tKT2Qx_zMFl7_0 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6733241522144495928', time=2024-09-14T13:38:13.896657+0000, chain.objs.size()=1 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.268__shadow_._149HQ8WbtDPH4beOVtauGod31EyGgH_0 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10682388884896047755', time=2024-09-14T13:38:26.900930+0000, chain.objs.size()=1 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.286__shadow_.cbOgaSU1c1kFJP4KDec_U1m_XF5wbiS_0 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8473063074844088186', time=2024-09-14T13:38:29.137635+0000, chain.objs.size()=1 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.289__shadow_.fojecpJMvLae93E2NeB6SwnaBlTzjd5_0 2024-09-14T11:58:39.015 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2620373661949749172', time=2024-09-14T13:38:29.138485+0000, chain.objs.size()=1 2024-09-14T11:58:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.017+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.289__shadow_.32m2MlY0jATc_6_EPHARxWkefNguPrg_0 2024-09-14T11:58:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.018+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18317614858578012167', time=2024-09-14T13:38:30.593358+0000, chain.objs.size()=1 2024-09-14T11:58:39.016 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.018+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.291__shadow_.n5bjuJ5xIi17ZNm-SapfxiHKiGPeHDf_0 2024-09-14T11:58:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11662116462785133830', time=2024-09-14T13:38:33.473695+0000, chain.objs.size()=1 2024-09-14T11:58:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.HHFBC5ews8tdbBQGfVqQeunIayXgArD_0 2024-09-14T11:58:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10938600873930347722', time=2024-09-14T13:38:33.581658+0000, chain.objs.size()=1 2024-09-14T11:58:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.08dCfHnhnbG_oyakGPX7PjqG7bWdmde_0 2024-09-14T11:58:39.019 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9599817059331377494', time=2024-09-14T13:38:35.594798+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.DhwTr-DigEWg2trwIQh9HoJYcEQwgbG_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5252242578142563412', time=2024-09-14T13:38:35.626563+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.kJ2-JBb7f6aHFtH0bcIt6qTnWFwVQRT_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16520575293067689996', time=2024-09-14T13:38:35.685721+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.9OuigFD4R-D1UDZkcwIt0JtjHRchz4V_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8887844854499775476', time=2024-09-14T13:38:37.945061+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.297__shadow_._gJbebBDijDcRuxRsi3KMCpShcQZob4_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17925020606923987939', time=2024-09-14T13:38:41.006814+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.301__shadow_.BAgsFqW0ky-dRP7GnHTSVKBhRmCDaVO_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10533159432745510036', time=2024-09-14T13:39:39.576065+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.FUeqaf-xWV-yhnZlMrPpj_iNAs7KRYU_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16334258462994063954', time=2024-09-14T13:39:39.656092+0000, chain.objs.size()=1 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dbX869PPDcEhMhEDwB2crGShbJ8gv_f_0 2024-09-14T11:58:39.020 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9566415436436008355', time=2024-09-14T13:39:40.540168+0000, chain.objs.size()=1 2024-09-14T11:58:39.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Xm7jSeS5VM825vcroaQ6BMV8sPevdlC_0 2024-09-14T11:58:39.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10110777228076113196', time=2024-09-14T13:39:41.230002+0000, chain.objs.size()=1 2024-09-14T11:58:39.021 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.021+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_._722xfrMCMEXRDP089XYwWOYkjYGST8_0 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5438889393135814240', time=2024-09-14T13:39:42.033259+0000, chain.objs.size()=1 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xq7gGMzOU6SCxFZnPqhEEX6i0G-XSet_0 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6997500188934172910', time=2024-09-14T13:39:42.323940+0000, chain.objs.size()=1 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ecLAEb1RucRzoaISMzTd1xCQpzTBQBj_0 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15362916642444398135', time=2024-09-14T13:39:42.689513+0000, chain.objs.size()=1 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nL2sRdzhgDyJ3gZif-qMiUQPeQDdhzx_0 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.681995849453970456', time=2024-09-14T13:39:42.690054+0000, chain.objs.size()=1 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.AFjty9yAqExD028mT8KghEb5rZ8vV9A_0 2024-09-14T11:58:39.024 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15398263881422815645', time=2024-09-14T13:39:44.817341+0000, chain.objs.size()=1 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.IzOu3ga5520aBUhRBs3Y-BPrpI_TKed_0 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15866760499350044530', time=2024-09-14T13:39:45.432205+0000, chain.objs.size()=1 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.026+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OLfzTrDP4edEo2yyFf3My5fxoaXvzJZ_0 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10107516076837994784', time=2024-09-14T13:39:45.515836+0000, chain.objs.size()=1 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2rYo7jotT8zkyE3z6eVc4_yKi6KTRjH_0 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9891516001576083504', time=2024-09-14T13:39:45.659049+0000, chain.objs.size()=1 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Es2aIyykFSaYON1rlMhlBPHCkshoG5R_0 2024-09-14T11:58:39.025 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8424292553568300920', time=2024-09-14T13:39:45.679537+0000, chain.objs.size()=1 2024-09-14T11:58:39.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xyflZDHdhDjaIrqMcU63nXl0mZbsC-l_0 2024-09-14T11:58:39.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8967693166955601603', time=2024-09-14T13:39:45.762181+0000, chain.objs.size()=1 2024-09-14T11:58:39.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.WXSA0R4HldkDTv2Tx8xW0e9FD4dipaG_0 2024-09-14T11:58:39.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15064266896220549140', time=2024-09-14T13:39:46.050358+0000, chain.objs.size()=1 2024-09-14T11:58:39.026 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.027+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.pyzP5qRCZTyt0DMDjj5aJk1v7Eg0wp6_0 2024-09-14T11:58:39.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11950231377098579266', time=2024-09-14T13:39:48.833674+0000, chain.objs.size()=1 2024-09-14T11:58:39.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OXp5N9XNvixkRrRsYPkJrh6GyCgr4Ja_0 2024-09-14T11:58:39.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8784314388086904699', time=2024-09-14T13:39:49.364132+0000, chain.objs.size()=1 2024-09-14T11:58:39.028 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.gtBf7k92OsiKDX9vF-xB-pCS73xcd5t_0 2024-09-14T11:58:39.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13503344133646846210', time=2024-09-14T13:39:49.572235+0000, chain.objs.size()=1 2024-09-14T11:58:39.029 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.030+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DWTLIFdF0aOlsZ_MoSG0rJEPn-Ul86O_0 2024-09-14T11:58:39.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2086169886758027727', time=2024-09-14T13:39:49.946162+0000, chain.objs.size()=1 2024-09-14T11:58:39.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qo2EKZDfl2CWpNda8FB-kYAZNL5CST9_0 2024-09-14T11:58:39.030 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3557542372213755637', time=2024-09-14T13:39:50.110318+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.4drRky0npTV4xvyv14LRwRTgVcsmqlC_0 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6978721381959273867', time=2024-09-14T13:40:31.155272+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tHs1AnceaUiVvo9Q-S0JD_lD7XlyPk__0 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7705748003057422626', time=2024-09-14T13:40:31.334706+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XE76KE2Cib0vgbzoultqwrFxLXqN6jp_0 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16434330534547175563', time=2024-09-14T13:40:31.618260+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.x3A-GZDd35GHSS8iSz15zOCkdHyEKXO_0 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15707351742579132826', time=2024-09-14T13:40:32.866449+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0N3AlT_xQqa5NcGAY5ANJM7-9swQlEq_0 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10077595897924713250', time=2024-09-14T13:40:32.895992+0000, chain.objs.size()=1 2024-09-14T11:58:39.031 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OZCAZl_MAhzMboasyh7VLsrEju5UcX3_0 2024-09-14T11:58:39.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1066932608417230306', time=2024-09-14T13:40:33.261760+0000, chain.objs.size()=1 2024-09-14T11:58:39.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.033+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ti2r0Ube-AqZyYqnmIXVpTiJLLPuyYw_0 2024-09-14T11:58:39.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9798103326780610980', time=2024-09-14T13:40:33.695022+0000, chain.objs.size()=1 2024-09-14T11:58:39.032 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.H_j1m8WXga6VgtqbeEIheju1C0_y9L6_0 2024-09-14T11:58:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8609124243196063081', time=2024-09-14T13:40:33.695746+0000, chain.objs.size()=1 2024-09-14T11:58:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.edoFp4rKQP6DXMIgc0Ovqfjn-rVL1VD_0 2024-09-14T11:58:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7934492911536039219', time=2024-09-14T13:40:34.230741+0000, chain.objs.size()=1 2024-09-14T11:58:39.033 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.035+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zLSs6ylvXPQoVkHrjh3w09ylu0SmWEw_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8576474597649351846', time=2024-09-14T13:40:34.411586+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1OJslnhjJrrPn-pxBDqDOQUTaKqYRQt_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6950295536941295507', time=2024-09-14T13:40:34.725561+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zK11-nKylfvySal6jar_HVZetXU7s9X_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9283026343832227216', time=2024-09-14T13:40:35.069182+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MhJijOIgiABbAHeIiydqG7GetofyIpm_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4412097536768444753', time=2024-09-14T13:40:36.043319+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Nn0b5tT3ax2pKZwwO0MLtgUIElytfqg_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12205846225714383082', time=2024-09-14T13:40:36.569624+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.88VHeZjXd_sVOARuPfzyYQzAE5-lKAL_0 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.468241784785973640', time=2024-09-14T13:40:37.584882+0000, chain.objs.size()=1 2024-09-14T11:58:39.035 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.64Rh2qi1x5GZQtgidEjJHGNrkg7qNOr_0 2024-09-14T11:58:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14377468589355748629', time=2024-09-14T13:40:37.857167+0000, chain.objs.size()=1 2024-09-14T11:58:39.036 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.037+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6nulvbvaw453Y9vMe5VM-yLlyhdwAWu_0 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13945115557262471397', time=2024-09-14T13:40:38.187945+0000, chain.objs.size()=1 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Ng5IAwHWc6OMU-Hw4vwY3P0MBw2XDgz_0 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16557865830976150284', time=2024-09-14T13:40:38.682264+0000, chain.objs.size()=1 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.9mIwPlAftKDohDj6fySHgkkAZIpC5P0_0 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16502665712671181751', time=2024-09-14T13:40:39.314628+0000, chain.objs.size()=1 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.i8MC7qHHxeM1PChR0c3xsecjSCQwDm7_0 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12129906834385851446', time=2024-09-14T13:40:39.676812+0000, chain.objs.size()=1 2024-09-14T11:58:39.038 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.040+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Hyc_UXw9BwVEpPm0I1FV4iVA40PfTzR_0 2024-09-14T11:58:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.041+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6601158890442017231', time=2024-09-14T13:40:40.923415+0000, chain.objs.size()=1 2024-09-14T11:58:39.039 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.041+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.MSekMS0W9F5YHqnmo5nntFlBHlff-lk_0 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16855277025641134770', time=2024-09-14T13:40:41.080411+0000, chain.objs.size()=1 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Mr12YgDMm3N6bZOip4MViqatT4uUQDf_0 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11675320008548664', time=2024-09-14T13:40:41.081315+0000, chain.objs.size()=1 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1FiwF1C-sXDMDzpDP6Y300Kfh4SFHi7_0 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14538461580833444252', time=2024-09-14T13:40:41.136739+0000, chain.objs.size()=1 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Gf8f1g9NDDy5WF-IJzBrRxQ3dsUHw0T_0 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9195842850586126121', time=2024-09-14T13:40:41.647411+0000, chain.objs.size()=1 2024-09-14T11:58:39.040 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.042+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zsjoFiSyydoiaDJc72yXyPvyfOFCE12_0 2024-09-14T11:58:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11128590949841537417', time=2024-09-14T13:40:41.840617+0000, chain.objs.size()=1 2024-09-14T11:58:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.WXdC1f7tgCI3kT2ZSs04tZY_nxtWWaw_0 2024-09-14T11:58:39.041 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.044+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15247938506103533477', time=2024-09-14T13:40:42.216958+0000, chain.objs.size()=1 2024-09-14T11:58:39.042 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.044+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QEzfbMfmdYGbTpIVqQpiKLNlDbmZ_Wn_0 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2568179327014031009', time=2024-09-14T13:40:42.447806+0000, chain.objs.size()=1 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.v-_Q6zJwWcBdWBdYYKvOS6wWc2GTLcN_0 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12860877434556189921', time=2024-09-14T13:40:42.814915+0000, chain.objs.size()=1 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.m9QUlcJBaFcFQjLXmEcHm-DDhAFr4pT_0 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7555217528559859434', time=2024-09-14T13:41:09.054999+0000, chain.objs.size()=1 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.370__shadow_.557ZOpsfeK-P2RdNMwDtt2ztKNSj7EO_0 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10560238638211840297', time=2024-09-14T13:41:15.291216+0000, chain.objs.size()=1 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.378__shadow_.iMScQxWougoTnBc0gIafeb9O58QMWXo_0 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7114632981199681412', time=2024-09-14T13:44:59.577990+0000, chain.objs.size()=1 2024-09-14T11:58:39.043 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.045+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.529__shadow_.AtYGmwqOOtyQhTXwshXgP1bGa3HrcFU_0 2024-09-14T11:58:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.047+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~KdfsyZWpkE629I3PwqfjfLob82fGCJ6', time=2024-09-14T13:45:02.038596+0000, chain.objs.size()=2 2024-09-14T11:58:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.047+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.530__multipart_mymultipart.2~KdfsyZWpkE629I3PwqfjfLob82fGCJ6.1 2024-09-14T11:58:39.045 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.047+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.530__multipart_mymultipart.2~KdfsyZWpkE629I3PwqfjfLob82fGCJ6.2 2024-09-14T11:58:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.048+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5372932932543732910', time=2024-09-14T13:45:50.590303+0000, chain.objs.size()=2 2024-09-14T11:58:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.048+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.552__shadow_.CIOfhOTkj5DfaUpeYedDXSWCZq5xTsA_0 2024-09-14T11:58:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.048+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.552__shadow_.CIOfhOTkj5DfaUpeYedDXSWCZq5xTsA_1 2024-09-14T11:58:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.049+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2141319807239890579', time=2024-09-14T13:46:34.962583+0000, chain.objs.size()=1 2024-09-14T11:58:39.046 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.049+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:g9eE157ayDwsuibkjPAQ9tQFgoNfY6a_.QSWX88QH1f4W-R3m0szG8XFv6lLBcGn_0 2024-09-14T11:58:39.050 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.053+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/50493 2024-09-14T11:58:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:58:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6767978505919150816', time=2024-09-14T13:46:36.852530+0000, chain.objs.size()=1 2024-09-14T11:58:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:HUxW5pwzW5PHknvrPoKTdulmVi2ISVM_.zVpeoicG6rug1rST0_p8cmMoNIHaRJx_0 2024-09-14T11:58:39.053 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14466444727932596386', time=2024-09-14T13:46:42.523248+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow_.Bdq2U2EljvTYXpzIKBiVSELo5Y4ztGV_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17820434927508477040', time=2024-09-14T13:47:35.139550+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.583__shadow:TC8xMvKx22CifMSz8N0bK3txdyirsPB_.VW2AvSFeRjy1JC9wArGX8SZPBzcdRPw_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1819440817052085505', time=2024-09-14T13:47:52.051003+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.606__shadow_.PCr0AUkjZvdaYe6scuW6P17LcKYSFDp_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2312788494907998694', time=2024-09-14T13:51:06.360153+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.619__shadow_.rDce-NEiQ7bHRZcWN4WG4j0wXR-6Vj5_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5832305905533338962', time=2024-09-14T13:51:54.989544+0000, chain.objs.size()=2 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.643__shadow_.1LGlYHJI69mlgVisw3EG9Cr64g9aHib_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.643__shadow_.1LGlYHJI69mlgVisw3EG9Cr64g9aHib_1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11913690832248375116', time=2024-09-14T13:53:17.380470+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.717__shadow:O2zGVGN2seEg6TaHc33NvFx2mYawUHC_.oJxkadIIxKVbh0lY9iWHeZRvBke511Y_0 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9041879126311641550', time=2024-09-14T13:54:47.399200+0000, chain.objs.size()=1 2024-09-14T11:58:39.054 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.055+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.753__shadow_.GbP7IX-lLCDURf2pW9YZIYVvDfx0bfC_0 2024-09-14T11:58:39.057 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.059+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:39.059 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.062+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:58:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.063+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.061 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.064+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47483' 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_minGv0ljpaP4RBTt7lfsWV0XI636OMS', time=2024-09-14T13:34:45.519593+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:11989569-703c-4397-b0f1-7ddb0279a491.4517.164__shadow_.BqSyuQ07LM15oOGnKrr62LsDKHegu4p_0 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7436697695816680544', time=2024-09-14T13:35:21.358812+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.198__shadow_.Z1PV94MzB-tNbJyzTteqaiZKeki00Vl_0 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18288142860861788086', time=2024-09-14T13:37:06.076867+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.245__shadow_.g6f7kuoW92IH1HIYm70UWi0t7SVsNP9_0 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14576241645765200408', time=2024-09-14T13:37:11.234357+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.252__shadow_.q4Mja7iyEceHTAXmvt_6gibkxgW6Md-_0 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18326493402846415945', time=2024-09-14T13:37:57.995830+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.NPpI1QOmNpefwDymQhMsQrHftT_etac_0 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5879459977448046856', time=2024-09-14T13:37:58.102030+0000, chain.objs.size()=1 2024-09-14T11:58:39.063 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LKj3TkiCwz6yb5DIom4Q3WinpgMRiep_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2497863135557026457', time=2024-09-14T13:37:58.102728+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.STrghTJSQUkAUi3TGIrqY6p1bzD2jXr_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2108441697709986486', time=2024-09-14T13:37:58.103534+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h_FpekXwCUorgpRtuGW8fsuT96amthN_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8530720726095090324', time=2024-09-14T13:37:58.240775+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wZRXYQx7T6dFJL0Q3QjmnC1SFoAGbUQ_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14716083529467408888', time=2024-09-14T13:37:58.395519+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7vXQAuUMM3hUoNbXy_4sTcWUShRSXBs_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14329823691179987608', time=2024-09-14T13:37:58.439413+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.c0EB8Yyg4zqF1cey5XXpqyoLvKWDa1m_0 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5029387378636692109', time=2024-09-14T13:37:58.784081+0000, chain.objs.size()=1 2024-09-14T11:58:39.064 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.065+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Z9T_A7SqAow-hMlOsezqH9JYAJD9_lC_0 2024-09-14T11:58:39.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.067+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6358413808029289262', time=2024-09-14T13:37:58.875030+0000, chain.objs.size()=1 2024-09-14T11:58:39.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.067+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.r2cUWS3YFR3dstNeBkncStdqPtOXAP7_0 2024-09-14T11:58:39.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.068+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18104164197069032903', time=2024-09-14T13:38:00.230038+0000, chain.objs.size()=1 2024-09-14T11:58:39.065 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.068+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.kvRmKsPovrwa2TWeSeE9mcwrMIn4F6Z_0 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1911552052885444674', time=2024-09-14T13:38:00.274877+0000, chain.objs.size()=1 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1p2HhZfTBTDlt8-s9_-n0u7Hm3uxT1U_0 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.409591670495551234', time=2024-09-14T13:38:01.452646+0000, chain.objs.size()=1 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.vnRm5q6ChuRqbcwlNb8ye9lmjMmFkXd_0 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11502954900496382856', time=2024-09-14T13:38:01.615074+0000, chain.objs.size()=1 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.RbHv4WLPvCtX6KMnqH5mbpZ6_5k8xvb_0 2024-09-14T11:58:39.067 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7125420756450958382', time=2024-09-14T13:38:01.937102+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.39zRXtKYNE-sOtcyWnxJSnOSPifjV7A_0 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6619617749914408810', time=2024-09-14T13:38:02.146848+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.FNhYkWl3yZBQ9vYMmAyihkz3bCbQNVm_0 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3322803873722947173', time=2024-09-14T13:38:02.333272+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.wcevHiRL3BG-IWo7SmeKGOcwnvDKYVH_0 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5528238958418950520', time=2024-09-14T13:38:04.037184+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OfTle1Sx_c5vWRwaq3opuKnwDM6V5pJ_0 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13269462898009421687', time=2024-09-14T13:38:04.088192+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.KqAOSAiNN3oa7THsW0ogOx9xV2KEnkC_0 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9695983231290348789', time=2024-09-14T13:38:06.304573+0000, chain.objs.size()=1 2024-09-14T11:58:39.068 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.069+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZiO68_9JLDCVR63amxw04SE9POWNBu0_0 2024-09-14T11:58:39.072 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.071+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1790706436349023729', time=2024-09-14T13:38:06.305244+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.071+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1xeJ1XMonoB3Oynie26RKflTg-woDX__0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.071+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17322195759020436063', time=2024-09-14T13:38:06.596089+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.071+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JZFvlvnXgTw49iUsG034UoMqYfgKQco_0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.072+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7131765557277235685', time=2024-09-14T13:38:07.242914+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.072+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.oYsiqnBhtOZvszynSYSO_R6tmxoAuCi_0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14582364717169688655', time=2024-09-14T13:38:08.424993+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.xofEkLyv6HsRamxFBB1OcgUOI5oDR8F_0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6106571346756995909', time=2024-09-14T13:38:08.425556+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.R5uFIzh0q5NaDAV4C2BaX8Ou2ixX2eB_0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7146250553061133600', time=2024-09-14T13:38:10.043837+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Q-hsSf5e70HovTgpX43V4zizrWE31Sz_0 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3116874961401098157', time=2024-09-14T13:38:10.202913+0000, chain.objs.size()=1 2024-09-14T11:58:39.073 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3dPaT_wntUc_PY1wkrxbIhgN0RqQPLD_0 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6993190157672250273', time=2024-09-14T13:38:11.853120+0000, chain.objs.size()=1 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.265__shadow_.sDDipH9ciXri4zdNU4KHPFUpUQQwAmG_0 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12435582843459760940', time=2024-09-14T13:38:13.210354+0000, chain.objs.size()=1 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.267__shadow_.LwCnyzwMis0PO6qtpJqYEjD1kzDW3tQ_0 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6631285819961428146', time=2024-09-14T13:38:19.436851+0000, chain.objs.size()=1 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.276__shadow_.cJNwzdCKE67S6JiYcyact6ma0ukEBCX_0 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7562369106651371101', time=2024-09-14T13:38:28.403684+0000, chain.objs.size()=1 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.074+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.288__shadow_.wk5CkSSTJ_2JeS9RqjjTWBnqN9OB-Y9_0 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.075+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16487130958535794334', time=2024-09-14T13:38:37.186411+0000, chain.objs.size()=1 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.075+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.296__shadow_.t2ZVKY7xJY7YwyIqsLkMfJL1esSHpeF_0 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.076+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5669893109163561530', time=2024-09-14T13:38:39.477011+0000, chain.objs.size()=1 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.076+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.299__shadow_.IF0fZtuTSv37vM6HJmjDqrIdZ9w9fAJ_0 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.077+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4811589254932877612', time=2024-09-14T13:38:43.958906+0000, chain.objs.size()=1 2024-09-14T11:58:39.075 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.077+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.305__shadow_.tCGP96sc8S0sTaEZQQ9-ZJt1dMD76q3_0 2024-09-14T11:58:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.079+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8003388625933320173', time=2024-09-14T13:39:38.635221+0000, chain.objs.size()=1 2024-09-14T11:58:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.079+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UOshByTVH92vyPUeEO-5CrsI2rVyS02_0 2024-09-14T11:58:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.079+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.979834963649255146', time=2024-09-14T13:39:40.505847+0000, chain.objs.size()=1 2024-09-14T11:58:39.077 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.079+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vGaOSPEybrJdUuuzaLZpme_jB0OfZAN_0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12350880065427134004', time=2024-09-14T13:39:41.224711+0000, chain.objs.size()=1 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Tz855ZwHu9IMFPU7PIx7TRzifO-YCzX_0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16951829309591570459', time=2024-09-14T13:39:41.251239+0000, chain.objs.size()=1 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.DSRSs0MZfSfQhBRtlNdLedoXXYkjwpg_0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.236100093235611255', time=2024-09-14T13:39:41.371068+0000, chain.objs.size()=1 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XPKL_QTJ5-xawD2NfuSKc9Jz0Q58Edf_0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15839659863976693782', time=2024-09-14T13:39:42.651667+0000, chain.objs.size()=1 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LL3_1fRQCU8nehYWyxFCdxOkFmY4En0_0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3092945374589359300', time=2024-09-14T13:39:42.686028+0000, chain.objs.size()=1 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.9gXax1vyzIe7p2p1uEBjDvhJTIOPI57_0 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6843690277232150817', time=2024-09-14T13:39:43.150730+0000, chain.objs.size()=1 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.080+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SJi2DdCFD4_cIhgygVxvvmPozTtLcBW_0 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.081+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13722814981961094138', time=2024-09-14T13:39:44.334509+0000, chain.objs.size()=1 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.081+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mYCwCAp0VzfaGJ1QJyDZg1bj2dTsNtj_0 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4436494563561320373', time=2024-09-14T13:39:44.335280+0000, chain.objs.size()=1 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.cVAMtHjSLXadh-a9Ckn22mIIH0huQ8S_0 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10437583454041086243', time=2024-09-14T13:39:44.336085+0000, chain.objs.size()=1 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wP_E1QOiEyMDTHQA-U-5U1Obttzis_N_0 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15995185699408295466', time=2024-09-14T13:39:44.616447+0000, chain.objs.size()=1 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.083+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.kOpTSjLSmDHUhJiiGmHbVEhkEIFgrOS_0 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.084+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15151815215433607686', time=2024-09-14T13:39:45.400479+0000, chain.objs.size()=1 2024-09-14T11:58:39.081 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.084+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CLCH1tMTn-h4fOjMojQeszUGRtHGBPm_0 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1052292593165632133', time=2024-09-14T13:39:45.460857+0000, chain.objs.size()=1 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.F685j8F-VGu4nqlBDQRhM1Dq_XQk8_z_0 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8908402534885032899', time=2024-09-14T13:39:45.588214+0000, chain.objs.size()=1 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.xHGtdBuPpuYpAROhOYus_qH0PzRMYr__0 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4718323574395929291', time=2024-09-14T13:39:45.849143+0000, chain.objs.size()=1 2024-09-14T11:58:39.083 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SUO8BG9XxaINLWfB6Kbo6iTdRYki2x7_0 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7241316889105518274', time=2024-09-14T13:39:46.433091+0000, chain.objs.size()=1 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.8nTAEA5XFfT8P374gQJUDxgknU1QR_g_0 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15631638126563243698', time=2024-09-14T13:39:47.635498+0000, chain.objs.size()=1 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.SsMlT18lG04Q2Id8CqEPPFPnW0Xhudv_0 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13535556820833850564', time=2024-09-14T13:39:47.766596+0000, chain.objs.size()=1 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.0u9iKQRn3nRekqrs7an-AI0NONVnuGS_0 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8356352461840169019', time=2024-09-14T13:39:48.703894+0000, chain.objs.size()=1 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.085+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.rJiUMJZSwxmLTkultdy0frjfWb0577M_0 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.086+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9439315259189828814', time=2024-09-14T13:39:49.127236+0000, chain.objs.size()=1 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.086+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-I_MaYi65fIVzlqOWUnpq9hs_3XGFAp_0 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5530228411428729174', time=2024-09-14T13:39:49.127913+0000, chain.objs.size()=1 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nGREuXlv0DjuzxkbXZdd8yZ50HNwUji_0 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14812796609661780211', time=2024-09-14T13:39:49.209078+0000, chain.objs.size()=1 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.OsXtJjTPlUW9qYpoT75TgHaNh1ELynl_0 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5878196830566510944', time=2024-09-14T13:39:50.617111+0000, chain.objs.size()=1 2024-09-14T11:58:39.085 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.087+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oNdUwUNS1SaQyCMEZL88FTAGAch0-N1_0 2024-09-14T11:58:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9561465211666491017', time=2024-09-14T13:39:50.843102+0000, chain.objs.size()=1 2024-09-14T11:58:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ZCl20gyVKHm1EcDG_pSnsIh9p8yY5We_0 2024-09-14T11:58:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6968159330480645339', time=2024-09-14T13:39:50.888828+0000, chain.objs.size()=1 2024-09-14T11:58:39.087 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.089+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.dhimg_BNKcU0n3Ey2jeM3IJxzZjScVG_0 2024-09-14T11:58:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.089+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7386264568952577577', time=2024-09-14T13:40:30.756440+0000, chain.objs.size()=1 2024-09-14T11:58:39.088 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.090+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-63UkB7emqgYFLVeyGy1VaTMXlLivL3_0 2024-09-14T11:58:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.091+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14540066959829688409', time=2024-09-14T13:40:30.787596+0000, chain.objs.size()=1 2024-09-14T11:58:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.091+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.PiXaIQzcU1ecTbrowiU1PgCl9qoUWuU_0 2024-09-14T11:58:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.091+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5415221975326894882', time=2024-09-14T13:40:30.966392+0000, chain.objs.size()=1 2024-09-14T11:58:39.089 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.091+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AlzLoMi2vdjUwr90QR3lY9RpWKIMHrQ_0 2024-09-14T11:58:39.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.684316732651178765', time=2024-09-14T13:40:31.298524+0000, chain.objs.size()=1 2024-09-14T11:58:39.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.XEEjxbPsodTAhIehTUmmmOmFT5DKPM8_0 2024-09-14T11:58:39.091 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5721034185322034995', time=2024-09-14T13:40:31.498241+0000, chain.objs.size()=1 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.0MnX305B9-OZoEuCM0mkQ9yBT1lXwmB_0 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2641762753577937322', time=2024-09-14T13:40:31.751449+0000, chain.objs.size()=1 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.VpjfKncD57FLJdEFQRQ27GLKTeWr0zJ_0 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7493860021793163714', time=2024-09-14T13:40:32.577808+0000, chain.objs.size()=1 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.FPF3N_2CADkxcyvMvVhSsnHF0ynKPEL_0 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7456791108078970285', time=2024-09-14T13:40:33.207920+0000, chain.objs.size()=1 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ccknSPqOL-Btgvp0WPq8vlGURCw_BMz_0 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10798876709760454537', time=2024-09-14T13:40:33.363531+0000, chain.objs.size()=1 2024-09-14T11:58:39.092 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.093+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rZsKbjvpBBU_uM57S2KQZrgdtQlMmzf_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15517966441450549697', time=2024-09-14T13:40:33.700533+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.Wjqicw9U4wq8X_H1wAFOY-SlPB0wc60_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16052860412550396689', time=2024-09-14T13:40:34.222670+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.AUgUiRA-9yW96dih6Wso6PwziHxFCyP_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17286187573090062866', time=2024-09-14T13:40:35.105063+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.M2rupqghff_e6rmbUDHBbOrTMxLl14W_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5707140903223005306', time=2024-09-14T13:40:35.889559+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4sMYtj5z4aqyCMWF8d87JWV8jDGjVxH_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.611529590665293458', time=2024-09-14T13:40:35.905018+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.M2wZNG_SrYEkBQJCi7AFRSnNG3bppSA_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11651758301442031287', time=2024-09-14T13:40:36.041434+0000, chain.objs.size()=1 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.TXQnsVXQKzRzsB3ktC15APqo30TPWDB_0 2024-09-14T11:58:39.096 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2856874012762308732', time=2024-09-14T13:40:36.330509+0000, chain.objs.size()=1 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-aWIs4KT0MDbgbUQIUX1hMadVbtcish_0 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.45399344999459852', time=2024-09-14T13:40:36.374506+0000, chain.objs.size()=1 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.NHcmfbGA0M98fscJZnTb1cE8HJNhU_1_0 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13637013388076612562', time=2024-09-14T13:40:36.459963+0000, chain.objs.size()=1 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.z68pAMWq6OZj1o7WMQbGqG8F8SZYoLT_0 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18197986211220869469', time=2024-09-14T13:40:36.745936+0000, chain.objs.size()=1 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZFgUg0GiNJXLPFsj8VBD9NN03PuMnYt_0 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8429607524847292561', time=2024-09-14T13:40:36.836303+0000, chain.objs.size()=1 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.098+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.tdwU3Sqd3FHM7Xkezt65p1kkdXBHzRk_0 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.101+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17881622287814264764', time=2024-09-14T13:40:37.522354+0000, chain.objs.size()=1 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.101+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.ZfZWyKtIeSeCRv5FDVub3YHjr2DfBMx_0 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9932610499379680649', time=2024-09-14T13:40:37.975268+0000, chain.objs.size()=1 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.fBZbA6TTOzWeIF91gA_OMbGqnnq7dNt_0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4728468083066463317', time=2024-09-14T13:40:38.439692+0000, chain.objs.size()=1 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.E0Wo1V8tOnSH-QspYBMJlZyFuiSYvvH_0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16422330046462534998', time=2024-09-14T13:40:38.478884+0000, chain.objs.size()=1 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.q2Z2Ed5sdoR5wcZhwTRoJ9Xr0JVCYuM_0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10639690006683900292', time=2024-09-14T13:40:38.629950+0000, chain.objs.size()=1 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eVZBB089WPo-RT4jQaRqCWkEdkfBZTJ_0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10498336984895327107', time=2024-09-14T13:40:38.736507+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eNEn46rEdDQ3LcVA8bn-EmfdIqhUOtO_0 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.361616798137650886', time=2024-09-14T13:40:39.086164+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1U5dew5sG0vet36FEvjZy_Hoy9OhJb2_0 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1139299104456866526', time=2024-09-14T13:40:39.191159+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.jPteKBLpXn9HEkq7JP9r9zYXFHcV4jx_0 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7836885201980418561', time=2024-09-14T13:40:39.974132+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.En5oHB69GiyBQs0KvS3sIS08VqSUIcm_0 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13088203571090459404', time=2024-09-14T13:40:40.212631+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.eKXl7GB1S40QuGa4Ta7sL3KyPlaDRKH_0 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3924284500160361028', time=2024-09-14T13:40:40.321507+0000, chain.objs.size()=1 2024-09-14T11:58:39.102 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.103+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7xEjXU40eocDaPaTt5MLNm-5hMO6dRA_0 2024-09-14T11:58:39.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.106+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1420450273953422393', time=2024-09-14T13:40:41.123867+0000, chain.objs.size()=1 2024-09-14T11:58:39.104 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.106+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.OCqmIsShoiXsww9J6KDusFTIFG6KxxK_0 2024-09-14T11:58:39.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.107+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1690919007390955458', time=2024-09-14T13:40:41.562228+0000, chain.objs.size()=1 2024-09-14T11:58:39.105 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.107+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.vfP_Co7bwfu4EqytpzkuqMqPSAq8mBi_0 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2394339107350530580', time=2024-09-14T13:40:42.565088+0000, chain.objs.size()=1 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.loI-dOhJExEwffAXK1yJRcVW0SO0u52_0 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4727176410936410206', time=2024-09-14T13:40:43.061634+0000, chain.objs.size()=1 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.r5rjDxsxRWAHlmRDBXKI7nKqLvoPW_j_0 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8028114016282978564', time=2024-09-14T13:40:56.297535+0000, chain.objs.size()=1 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.346__shadow_.EUHovT-b-9KG8rYdfZBsSQkfcM3zVxj_0 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5417360716125681543', time=2024-09-14T13:41:14.539802+0000, chain.objs.size()=1 2024-09-14T11:58:39.107 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.108+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.377__shadow_.fXUWEV9qUspnfTlb_1iMvkECTyqQhmY_0 2024-09-14T11:58:39.109 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.112+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47483 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11296632795874059099', time=2024-09-14T13:41:16.827791+0000, chain.objs.size()=1 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.380__shadow_.2IFHp5sKKGlp6zkFgeBV08KvS2BVnes_0 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11235977695703081490', time=2024-09-14T13:42:28.295524+0000, chain.objs.size()=1 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.485__shadow_.-xlXS4OeJNT5dHSWuf7L1DBy9GVmDXc_0 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7619334341478779290', time=2024-09-14T13:44:05.184386+0000, chain.objs.size()=6 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.1 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.RH-7-zkccoi-oTUJIZ91xaWEWdYMijQW.2 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.3 2024-09-14T11:58:39.113 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.4 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.5 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.523__multipart_mymultipart.2~7QslJxFrkXjNifBCjMUXl0aDQqL99ks.6 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~OSrwszNWKNiYNebx4dESTiplu_D_Ba-', time=2024-09-14T13:45:08.059458+0000, chain.objs.size()=1 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.535__multipart_mymultipart.2~OSrwszNWKNiYNebx4dESTiplu_D_Ba-.1 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9248558315161823307', time=2024-09-14T13:46:02.275210+0000, chain.objs.size()=1 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.557__shadow_.MHCjVPriYAmEsYEheigwtPlrHhIUZVQ_0 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3420417933437424158', time=2024-09-14T13:46:23.241997+0000, chain.objs.size()=1 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.566__shadow_.7Wsd6DmbjObAxwd9zBSUbVpTyEv-8JD_0 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12008536446048699997', time=2024-09-14T13:46:38.324182+0000, chain.objs.size()=1 2024-09-14T11:58:39.114 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.115+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.571__shadow:Q24-n4Dw5luoqlBKTJB8xcxxsbWPCUa_._8iAJ38VdaR906FPT8assce6tvwmAnr_0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11854375282730050253', time=2024-09-14T13:46:39.076424+0000, chain.objs.size()=1 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.572__shadow_.eZe9j4UPpEk_jr5wc56dDY7pyPU3knB_0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6905359815814684243', time=2024-09-14T13:46:41.274355+0000, chain.objs.size()=1 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.574__shadow_.9nEOAXQwmH8EUoukK3Tv819OaRVBWoH_0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12777689069548101709', time=2024-09-14T13:46:52.852436+0000, chain.objs.size()=1 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.577__shadow:zA2zxtZHSvfnCGaRJv-XI7.fxCnJYKf_.x138wcblnWjJVW77Tb82f0UvgILnlsK_0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16285161347701867189', time=2024-09-14T13:46:55.473928+0000, chain.objs.size()=1 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:CajpA9IFi.3tS8TspTNyfJIhm8kfiHi_.xJEzO7NQug46i6gslJsmxOF3SuzUxtA_0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12186310001772161880', time=2024-09-14T13:47:04.274378+0000, chain.objs.size()=1 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:0-P0QaC9W5DbzrzPlZb.uF6aGEdOaFU_.WYXBpXpdX1f3dSqjzTjvecyzVqa_uIy_0 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17833448848974461418', time=2024-09-14T13:47:14.850831+0000, chain.objs.size()=1 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:YZxlvNvfqBHQveFtSES9TZThi-uf2Vh_.2Kv6FrqAG20uetfWLJ1E5JRMY28XOXg_0 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11521430763877378095', time=2024-09-14T13:47:28.790637+0000, chain.objs.size()=4 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~NDKYOFRnv-SajIumG4LHkYO9C1hMG_z.1 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~NDKYOFRnv-SajIumG4LHkYO9C1hMG_z.2 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~NDKYOFRnv-SajIumG4LHkYO9C1hMG_z.3 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~NDKYOFRnv-SajIumG4LHkYO9C1hMG_z.4 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9052003094140342631', time=2024-09-14T13:47:29.662672+0000, chain.objs.size()=4 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.118+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~CwCB1J3vjsq8e2lUCtz3pJddue6ybOp.1 2024-09-14T11:58:39.121 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.123+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~CwCB1J3vjsq8e2lUCtz3pJddue6ybOp.2 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~CwCB1J3vjsq8e2lUCtz3pJddue6ybOp.3 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.579__multipart_testobj.2~CwCB1J3vjsq8e2lUCtz3pJddue6ybOp.4 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13850062718258417022', time=2024-09-14T13:47:34.480355+0000, chain.objs.size()=1 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:6I7VYZIol-CIDyoPw0NNBG0yIUWx3ZK_.BOlvAPNbQmwgUdqRImkcIPGV74qjJua_0 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5129008363424633356', time=2024-09-14T13:47:41.065949+0000, chain.objs.size()=1 2024-09-14T11:58:39.122 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:0K21V7QQQRQ9TegMDlsM6lAeCFVhKb-_.HVIla5pscHjY_EjcjKWWvdC2fN_qcBH_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2787474378793695904', time=2024-09-14T13:51:07.068316+0000, chain.objs.size()=1 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.620__shadow_.sDlh7H0MG7Op1E7R2udyyrqXC_Xdtjn_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13554428588808375877', time=2024-09-14T13:51:07.717388+0000, chain.objs.size()=1 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.621__shadow_.RdICATkGZqw0XyEHxb02EXaH9iBWaid_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2323128408939768902', time=2024-09-14T13:52:04.953420+0000, chain.objs.size()=2 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.649__shadow_.GJHSZ8uQphf01aKuCmxf3PPqKENEfy8_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.649__shadow_.GJHSZ8uQphf01aKuCmxf3PPqKENEfy8_1 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9072884643363934696', time=2024-09-14T13:52:32.058030+0000, chain.objs.size()=1 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.664__shadow_.yLmVV9sFHNV3r27lfhYppDScAXv7e1J_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14862840259401192127', time=2024-09-14T13:52:50.944425+0000, chain.objs.size()=1 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.124+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.694__shadow:M-u8U2z895Yrf5bcve9wsd7lpFLrSDg_.QiihxVB_TyXGytD9ZQvdpM6vAKejzej_0 2024-09-14T11:58:39.123 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.126+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12922002214551276772', time=2024-09-14T13:52:52.322585+0000, chain.objs.size()=1 2024-09-14T11:58:39.124 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.126+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.696__shadow_.boIHhETg7TRzF-Mxc6eTlJZVXk9RF7V_0 2024-09-14T11:58:39.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10162480043108115107', time=2024-09-14T13:54:04.296950+0000, chain.objs.size()=1 2024-09-14T11:58:39.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.746__shadow_.thXJ1dnjN_6ulH8L62cTESucPyyw9B8_0 2024-09-14T11:58:39.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.130+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17927417844499819469', time=2024-09-14T13:55:42.538203+0000, chain.objs.size()=1 2024-09-14T11:58:39.128 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.130+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.768__shadow_.djE6jy6TjRxjaGE2CyqgxKJhQsWSBym_0 2024-09-14T11:58:39.131 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.133+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:39.133 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.135+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:58:39.134 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.136+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.135 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.137+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43645' 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17700657503467434149', time=2024-09-14T13:37:00.241200+0000, chain.objs.size()=1 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.238__shadow_.RVxaCndtx7fdPmRlfGKLwhrq292-Lyb_0 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16586574716553834044', time=2024-09-14T13:37:08.293953+0000, chain.objs.size()=1 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.248__shadow_.wtOnfwd9uw2ceo3sPdN5pJg1-d9fonj_0 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11300809312737834626', time=2024-09-14T13:37:09.753081+0000, chain.objs.size()=1 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.250__shadow_.fYw9pMPtACvXqYd27FJbCbnbPcqGaqI_0 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8582760578438221479', time=2024-09-14T13:37:14.908044+0000, chain.objs.size()=1 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.257__shadow_.7obSaI4ePzOHo6tiXwI1DbTrhRvETOF_0 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13549523010573276409', time=2024-09-14T13:37:58.318938+0000, chain.objs.size()=1 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.aL14vpW2-Z3pDDtUW0opPnwYMVvAKcC_0 2024-09-14T11:58:39.137 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3621016717422101065', time=2024-09-14T13:37:58.910028+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ovf00fW8REqowZiPkHu33_2DptI4p4h_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18342733374655614450', time=2024-09-14T13:37:58.939430+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h9ZqYMT7VFA9r-n5gpEQPO1IAufKeOf_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13949193566132933749', time=2024-09-14T13:37:59.657166+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.4GkjNmRFxIsI1DgOTJjPJdIbZCnW4nn_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9339758815380518835', time=2024-09-14T13:38:00.057895+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Zniyp0r6w645wLWSQi_ZCjSJtP1SKtt_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10993102197735343284', time=2024-09-14T13:38:00.399678+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.LZjNh-FROjXnspKVXzPzH25SYZ5G2fZ_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17238874788006858748', time=2024-09-14T13:38:00.549785+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.56HWgr6aEH4wYSxL725DBCFGrcoNJLX_0 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6060496037334912541', time=2024-09-14T13:38:00.608375+0000, chain.objs.size()=1 2024-09-14T11:58:39.138 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.138+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.qnJdUd2M4VCRk4lSkdl4KTEUu-joWbv_0 2024-09-14T11:58:39.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13119312861807142869', time=2024-09-14T13:38:01.355543+0000, chain.objs.size()=1 2024-09-14T11:58:39.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nhHqc9wQspom7dCTuAPE6wpxJRXPpId_0 2024-09-14T11:58:39.140 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12189242218218360217', time=2024-09-14T13:38:02.005084+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.UKfCd7ptxXv70QjOqvC9g9HP_BGAIRc_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15788442289557066745', time=2024-09-14T13:38:02.028127+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.1Vs3B_Fhwe7a1VQ6bnMEW923faBacLl_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9446813924894589765', time=2024-09-14T13:38:02.136043+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Y-SyaZ1eRoQ7Il1j1mPiR7YjyH-8DKe_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2422727856445667012', time=2024-09-14T13:38:02.406391+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.V8lqOnhexWo3TPBlixeGXuwz-1iyZSI_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6768705048272460194', time=2024-09-14T13:38:03.140305+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DLSLIy036VcLUf86ZXsM8mUz6i-LY_q_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11157840251760768592', time=2024-09-14T13:38:03.182087+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.J0hNYsM-n6sTn1dJfia3Jwy_w7FXmOt_0 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2559750995478113222', time=2024-09-14T13:38:03.227706+0000, chain.objs.size()=1 2024-09-14T11:58:39.141 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hfJFDco59bOH52YmyX3ZcsJ-XuJG0Sa_0 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2783842691384898707', time=2024-09-14T13:38:03.333549+0000, chain.objs.size()=1 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.GdSbkoq-PLem3JDfJ7gfMXUurAbYD7s_0 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14675639223933498806', time=2024-09-14T13:38:03.487702+0000, chain.objs.size()=1 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jSeC6sOm_8-RLZl_Nuce77KJtFjL4uP_0 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16120860881253781491', time=2024-09-14T13:38:03.531967+0000, chain.objs.size()=1 2024-09-14T11:58:39.142 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.142+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XeXnm4-33nuohevFg_Lq5ip-L1lD3dB_0 2024-09-14T11:58:39.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.146+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6432817395081253035', time=2024-09-14T13:38:03.702352+0000, chain.objs.size()=1 2024-09-14T11:58:39.144 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.146+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3aMhRbUDecl1SXjyS2EBrgthaMLq2Zl_0 2024-09-14T11:58:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.147+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12936052152513368711', time=2024-09-14T13:38:03.971510+0000, chain.objs.size()=1 2024-09-14T11:58:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.147+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Ssv2-RUNEVSaoLQlLwDz7lDO1Q25Eu__0 2024-09-14T11:58:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2276255144184312094', time=2024-09-14T13:38:04.547391+0000, chain.objs.size()=1 2024-09-14T11:58:39.145 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Q3YkcrUrtKzT22LRwklHjF3EG180yeT_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3097159382516026495', time=2024-09-14T13:38:04.921591+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JsiWmsg8Lf3SGWlG2DgQyc4ZEf6qZ-t_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14709465276670932024', time=2024-09-14T13:38:04.976737+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9RuXCM7hJdeq0WLYPzDTUYkKCjbUxrS_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13616149985231848347', time=2024-09-14T13:38:05.656390+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YFLVIEcu_bSb6YBnIi85YRb5Dw9_3wB_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13674244309224980311', time=2024-09-14T13:38:06.685912+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7nsqVIuHXFHEZrUkf6NzWRXmf5LSV6X_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13659010284610546461', time=2024-09-14T13:38:07.860928+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.uJgHPi_JJDBaXQMwEwf5TYwStRtHMEb_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9120912434427997870', time=2024-09-14T13:38:09.696336+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.chaw7Y_JZPM-nVPigX1EKFXqtNg_xAp_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12493347382250827053', time=2024-09-14T13:38:10.133844+0000, chain.objs.size()=1 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZRs1NLBjnmZT8xrilJc2MJIMwXsvY26_0 2024-09-14T11:58:39.146 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7195949644942846672', time=2024-09-14T13:38:10.248637+0000, chain.objs.size()=1 2024-09-14T11:58:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.148+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eIpBwiHR3OlXzrNSmFQl7ZGfmsB6sRV_0 2024-09-14T11:58:39.147 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.150+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13405505919982568732', time=2024-09-14T13:38:10.390848+0000, chain.objs.size()=1 2024-09-14T11:58:39.148 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.150+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.CO_w-ILq3-fm2NyXZgZPsa8uuZ0V9w-_0 2024-09-14T11:58:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4031392455365596188', time=2024-09-14T13:38:18.709878+0000, chain.objs.size()=1 2024-09-14T11:58:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.275__shadow_.u8Gm0YDl2jOtXFBY8UmhrEjtQugC1DD_0 2024-09-14T11:58:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.151+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3980159266470175388', time=2024-09-14T13:38:23.848126+0000, chain.objs.size()=1 2024-09-14T11:58:39.149 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.151+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.282__shadow_.u89MOY4JT_huybNmfMxjXa1R7LhU67E_0 2024-09-14T11:58:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.152+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11212045235535736519', time=2024-09-14T13:38:30.588717+0000, chain.objs.size()=1 2024-09-14T11:58:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.152+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.291__shadow_.zGNgz_j7Exd_r2U156cX5ZzhPjuozXo_0 2024-09-14T11:58:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.152+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1660623836243555164', time=2024-09-14T13:38:33.581023+0000, chain.objs.size()=1 2024-09-14T11:58:39.150 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.152+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.wmeAGGIlUUO_5PMrVY6084Fb1WChDmL_0 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10670605672317239918', time=2024-09-14T13:38:35.555377+0000, chain.objs.size()=1 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.Cb_GIAAtVjFEpx9vx04ePqopR44HDmP_0 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8372757649449218626', time=2024-09-14T13:38:35.694733+0000, chain.objs.size()=1 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.294__shadow_.97-XiUJro2MBxzt7watOVTosda5FsLX_0 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5763335780245361558', time=2024-09-14T13:38:38.677382+0000, chain.objs.size()=1 2024-09-14T11:58:39.151 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.298__shadow_.oXyI9OIFe3zWofI1cg4V9uDPaLfp3QL_0 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5627468984306888146', time=2024-09-14T13:38:39.478557+0000, chain.objs.size()=1 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.153+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.299__shadow_.Off09_Lmo8e2fTMvATR5wE5uQCGbj1o_0 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16205632963421044449', time=2024-09-14T13:38:41.744625+0000, chain.objs.size()=1 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.302__shadow_.JTettWcBx8X5Sc3SRrhNj2j5OLq3OYY_0 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10601407302091099056', time=2024-09-14T13:39:38.770177+0000, chain.objs.size()=1 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.CnGRmZMuEQ57DJ07RE7LPQ9Hdhohzvb_0 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13848374325484661697', time=2024-09-14T13:39:38.950430+0000, chain.objs.size()=1 2024-09-14T11:58:39.152 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.154+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YXTOPMTYzlU4YzwGYDQJYU-ABIEZabU_0 2024-09-14T11:58:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11954279449812743604', time=2024-09-14T13:39:38.951716+0000, chain.objs.size()=1 2024-09-14T11:58:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.tXJSXB4mtUq2Zes2FRod8j6524ylqR5_0 2024-09-14T11:58:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.157+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3686478593627336518', time=2024-09-14T13:39:40.294506+0000, chain.objs.size()=1 2024-09-14T11:58:39.155 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.157+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vhUlnSzAFO8fgoEND432Lq6XQCFFJkN_0 2024-09-14T11:58:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.159+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14452970281436917099', time=2024-09-14T13:39:40.485089+0000, chain.objs.size()=1 2024-09-14T11:58:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.159+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.K4ijGeBpd6qoPjXghVyf4xCXP_RiQYZ_0 2024-09-14T11:58:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.159+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17195450898609241702', time=2024-09-14T13:39:40.654892+0000, chain.objs.size()=1 2024-09-14T11:58:39.156 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.159+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7vWodWYPXiBNiNGv66Yl1mTxJCec50R_0 2024-09-14T11:58:39.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.160+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8128077338413167059', time=2024-09-14T13:39:40.806096+0000, chain.objs.size()=1 2024-09-14T11:58:39.157 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.160+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.eTAzChpwYroW3wP4ebk7P5s-gWAoh59_0 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3314396828211536328', time=2024-09-14T13:39:40.901258+0000, chain.objs.size()=1 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b_8bDuTOg6clOnO6VN3mGUsBFDLLZKs_0 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16539958919922705118', time=2024-09-14T13:39:42.158667+0000, chain.objs.size()=1 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fppxa7XTGserVFB1ncvmeVeofjs_0eV_0 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16442475909275888811', time=2024-09-14T13:39:42.339165+0000, chain.objs.size()=1 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LBolmiGKViXW-naODacg9jBRG1vweYm_0 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9934822300291378823', time=2024-09-14T13:39:42.789870+0000, chain.objs.size()=1 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XTaKfy55gAyZuH2Ln7sfyXZ_kn0Ib6R_0 2024-09-14T11:58:39.159 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2276738492848804681', time=2024-09-14T13:39:42.944029+0000, chain.objs.size()=1 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.jkQOfh_DnfWk5H_gQfoY2F-CV8rIsip_0 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9255959699096046552', time=2024-09-14T13:39:43.890087+0000, chain.objs.size()=1 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wC0hwWxW-nmRJMdxWOYG5kqLQpUsfk-_0 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13535393314444343244', time=2024-09-14T13:39:43.997146+0000, chain.objs.size()=1 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.vancYIgqK5CcruU22i65GxInGN7gaTh_0 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18252456080586729940', time=2024-09-14T13:39:44.503081+0000, chain.objs.size()=1 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.161+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.M3OWjMQ_Brstw22Ocf1puJe9JeWC1qF_0 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.162+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3834397286663794862', time=2024-09-14T13:39:46.231097+0000, chain.objs.size()=1 2024-09-14T11:58:39.160 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.162+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NXtYoxpX-TIvOb_s3WCb4lgc2UkEMnX_0 2024-09-14T11:58:39.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.162+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8585933862547788137', time=2024-09-14T13:39:46.876919+0000, chain.objs.size()=1 2024-09-14T11:58:39.161 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.162+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.2ftwzpLMZl-p2sl3wyKESsYljzJXAsN_0 2024-09-14T11:58:39.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.164+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11161223690264682636', time=2024-09-14T13:39:47.152600+0000, chain.objs.size()=1 2024-09-14T11:58:39.162 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.164+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.1-XcB2WUqM739PlQYbJVP5Czqd1UIxg_0 2024-09-14T11:58:39.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.165+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12758790378360397135', time=2024-09-14T13:39:47.254210+0000, chain.objs.size()=1 2024-09-14T11:58:39.163 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.165+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.JSkGjMmoydmTVc5phY9ybY8-ip7H8gb_0 2024-09-14T11:58:39.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14856187921477525247', time=2024-09-14T13:39:47.412322+0000, chain.objs.size()=1 2024-09-14T11:58:39.164 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nW7lQGQc3IlrMLJtFWn6-06aD4e7Kr0_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16647425316576067767', time=2024-09-14T13:39:47.567358+0000, chain.objs.size()=1 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.GDWrMlLYLHNkI898xRiKbBNEkgiOrg8_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17637818397483121545', time=2024-09-14T13:39:48.054631+0000, chain.objs.size()=1 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.u-EpwuyyHtjSOxLg3XPcvqTzl3j-GuJ_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12859380418432820950', time=2024-09-14T13:39:48.580107+0000, chain.objs.size()=1 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.fO81pTSQyNKHAdgtcgWfoiRv36bhxz8_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17713306137253863680', time=2024-09-14T13:39:49.478013+0000, chain.objs.size()=1 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.NNFR7vtbMnKcY9jBwK9vgZ33t8UZP27_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11307462355041650090', time=2024-09-14T13:39:50.272520+0000, chain.objs.size()=1 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.LZqa0R2U1TLaA_8nWDK83YXlPq6-teI_0 2024-09-14T11:58:39.165 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3847322975926167282', time=2024-09-14T13:39:50.273735+0000, chain.objs.size()=1 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.XrD0N4ONKZU3qXSI1z-bnXEMeCZby8P_0 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3684701292187309734', time=2024-09-14T13:39:50.541724+0000, chain.objs.size()=1 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.teE70--BvzQnRwzGPmN_7UvPn3OnZWJ_0 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16634084025845993551', time=2024-09-14T13:39:50.582219+0000, chain.objs.size()=1 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.ET846j1ys-L4-A4a-g_mp5FMDvLH4rp_0 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7327260913810061428', time=2024-09-14T13:39:50.643335+0000, chain.objs.size()=1 2024-09-14T11:58:39.166 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.167+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.QRFlxHxXe8WCITn7Gk-boXEhTjS5Jeh_0 2024-09-14T11:58:39.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.170+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12555325546713479727', time=2024-09-14T13:39:50.688430+0000, chain.objs.size()=1 2024-09-14T11:58:39.167 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.170+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oaY4k-hpfu7Ju_jR_iclLrwh2aRysVw_0 2024-09-14T11:58:39.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.170+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.336674203149657910', time=2024-09-14T13:39:50.776782+0000, chain.objs.size()=1 2024-09-14T11:58:39.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.170+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.C9ViWT62lZu259hiLCfj5ofpjtP_N7E_0 2024-09-14T11:58:39.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.171+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8932880062879889677', time=2024-09-14T13:39:50.842631+0000, chain.objs.size()=1 2024-09-14T11:58:39.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.171+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.b2rBMxsjCzNVsXLBvUkGyKWYP4_8CiN_0 2024-09-14T11:58:39.168 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.171+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.293128894076428244', time=2024-09-14T13:40:30.952023+0000, chain.objs.size()=1 2024-09-14T11:58:39.169 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.171+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8BC0IESGe9Eucgh4QLKS7Jzy85q8-WF_0 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6550535250222726822', time=2024-09-14T13:40:31.794258+0000, chain.objs.size()=1 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.P3vJnci848rjdsaUlfBsKXensyUo0i9_0 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12843650735681281111', time=2024-09-14T13:40:32.529847+0000, chain.objs.size()=1 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sVznxbLP3Qp9FivVCE9Wv_PFBqDOIQy_0 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15139233710363855288', time=2024-09-14T13:40:32.750954+0000, chain.objs.size()=1 2024-09-14T11:58:39.170 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.172+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.v0wqXRSqUzkM6DfFnO0DnLQ9lD-KjX7_0 2024-09-14T11:58:39.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3860874111810506846', time=2024-09-14T13:40:32.822708+0000, chain.objs.size()=1 2024-09-14T11:58:39.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xQEuaMwqnDQQMzqAPcV1rO7n9dHZC82_0 2024-09-14T11:58:39.172 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10266404225811554351', time=2024-09-14T13:40:32.846323+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.zpMxbl7Ouu826QRpER0a31Kv25U-cp1_0 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15781008353810976926', time=2024-09-14T13:40:33.153803+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.KdxktN6jsRx9NB4vOMFoqx4oLENkxBw_0 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12284841409255197293', time=2024-09-14T13:40:33.316053+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HhoryH7MoZfRtW-CAiO-Dpd6Ks3g81r_0 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16914148426968252914', time=2024-09-14T13:40:33.589441+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5odhRLsHnKFHkdpt5_qHOsqfpe5MTRt_0 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9058354908703099432', time=2024-09-14T13:40:34.534472+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5M9OH2wc6_wlkcFRJszlGPNSqpYZEzB_0 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13867092048956675608', time=2024-09-14T13:40:34.895698+0000, chain.objs.size()=1 2024-09-14T11:58:39.173 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.174+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.nY7JncIP5SazHfdwTk8-TeJSDaMvD-Z_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8644446360714181397', time=2024-09-14T13:40:34.896366+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oPKOC_lYuxrSg9ugpstpFXDe5kuyQNG_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18126459405038410291', time=2024-09-14T13:40:35.404833+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.S6iHQCT9BePYsI96ZOaZrEFAwken5Al_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1736214514300994595', time=2024-09-14T13:40:35.881446+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.wbE1DJQ0OwADhQNfP9z5a_GOTI-vK5l_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17516099523509942715', time=2024-09-14T13:40:36.212446+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.8zHZgemroZqzbl8v_UP2lANc4R2eR8p_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7887387304411571435', time=2024-09-14T13:40:36.374156+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.V1q5KKm4D_uS0FDFWY3_M26O18KrxHv_0 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11524008223986226291', time=2024-09-14T13:40:36.825095+0000, chain.objs.size()=1 2024-09-14T11:58:39.176 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.866dkeBI5y9cibfYt11N193GlX3zmx__0 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.178+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13878503207081984389', time=2024-09-14T13:40:36.974943+0000, chain.objs.size()=1 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.rbeIMNU352GUeIN7jGqsI97sZ2d3xZm_0 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9821911848254311962', time=2024-09-14T13:40:37.905380+0000, chain.objs.size()=1 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.K9Jhx4tp42Bw9_3dR0d7J53zXW3zlY5_0 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18279826626702033252', time=2024-09-14T13:40:38.367643+0000, chain.objs.size()=1 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.hFV5PZZBrAe-VE6zwg1mzx3Jp3Iq44y_0 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15024557499701713324', time=2024-09-14T13:40:38.530897+0000, chain.objs.size()=1 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.n8rwXpnmrI3nNqbJho-eK3NtVaAn8MG_0 2024-09-14T11:58:39.177 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4785189733359972269', time=2024-09-14T13:40:39.757409+0000, chain.objs.size()=1 2024-09-14T11:58:39.178 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.179+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.E5g3Aj_6lCmvJ-e8fnUiL_32KbIqVHT_0 2024-09-14T11:58:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10820960257937683792', time=2024-09-14T13:40:39.892229+0000, chain.objs.size()=1 2024-09-14T11:58:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.oKbIv8HPybghtO3HwGh4TQVwCLpX3kL_0 2024-09-14T11:58:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.184+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14267160663052817380', time=2024-09-14T13:40:40.289762+0000, chain.objs.size()=1 2024-09-14T11:58:39.182 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.184+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.BYSgqZU5ElBbpIZkeMFWfhgTCFgkVXR_0 2024-09-14T11:58:39.184 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.186+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/43645 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8681075019655472590', time=2024-09-14T13:40:40.681513+0000, chain.objs.size()=1 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SyqnW_s23rCw9KGxoPE1FJ1iw4sXsUx_0 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10318330015815608058', time=2024-09-14T13:41:49.589689+0000, chain.objs.size()=1 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.430__shadow_.0BNWSJZIy-0i23d2XWd1hgax2aVC3Bt_0 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9184240756048040657', time=2024-09-14T13:42:10.433317+0000, chain.objs.size()=1 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.459__shadow_.4fnJ4q8kQX_74ZGfUIdbZG3mvIalbhX_0 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7003200200601902898', time=2024-09-14T13:42:27.433538+0000, chain.objs.size()=1 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.484__shadow_.NIIxcqOQwpHd0uwrVeJc23glMiWpG9C_0 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6123680680437130557', time=2024-09-14T13:42:33.566787+0000, chain.objs.size()=1 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.489__shadow_.OMTzsqAYtE_hW1_TGPdANE7-jDTyqVv_0 2024-09-14T11:58:39.187 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8155989640910266846', time=2024-09-14T13:43:07.269519+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.519__multipart_mymultipart.2~QYgS5Vo3qjj_hAutn67keXKbHnvZDf8.1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3760791077267565866', time=2024-09-14T13:45:53.578384+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.553__shadow_.DvOem-2wLManjzVtfPdYOySTlu4RWiF_0 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4080289384960548393', time=2024-09-14T13:46:11.835629+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.559__shadow_.fuOtIqRysJEhbz0_Jm7GmbOxBt6NSp__0 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14926594872746191744', time=2024-09-14T13:46:27.025121+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:.Tyu3yd8IjNnRm865Po28Hgynnm7sO9_.RU2XsY9zxwzbl-kx0y4pG1kwMMh8kP6_0 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11881670949799558361', time=2024-09-14T13:46:27.603181+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:Fmk4CIi71-zd6oS6UyD3E4jecEE7WZj_.RPiuJjg_1XKjRPdOg4eJ1gTw0jAIkKP_0 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7795098985690841080', time=2024-09-14T13:46:35.220442+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.570__shadow:vyBCYpjrjanLCw9iymy5Gng.yIASt0Q_.67DehPdZaCVT7Gz2zlshZtyLGQXHe1f_0 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5244845171379179123', time=2024-09-14T13:46:44.841428+0000, chain.objs.size()=1 2024-09-14T11:58:39.188 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.189+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.575__shadow:VZjvkPX10HVVWwSxAVXqQub7mR2eJOz_.Z3T9F8GrjfmRaaEDHCLDcLNkWhu1kDf_0 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9054136605775526237', time=2024-09-14T13:52:15.166410+0000, chain.objs.size()=1 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.657__shadow_.NiHuFnzbxfClZXF2ckw8WGwNaLpkxwU_0 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12119069574281652803', time=2024-09-14T13:52:38.235832+0000, chain.objs.size()=1 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.672__shadow_.bzkSeFK6HR4xdjpfhLs0evxIY_r4WSf_0 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12482052835547633431', time=2024-09-14T13:52:52.969420+0000, chain.objs.size()=1 2024-09-14T11:58:39.190 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.192+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.697__shadow:xqi7X4Vg2A96mohbanq.qKnbTPbRthq_.tQnDdXB3AhP53KsZutr72N0rGhXC-Nk_0 2024-09-14T11:58:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.193+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~jauw3FDOb6vi7MW9IEebYAnpvDY3Ghg', time=2024-09-14T13:53:54.689953+0000, chain.objs.size()=1 2024-09-14T11:58:39.191 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.193+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.743__multipart_mymultipart.2~jauw3FDOb6vi7MW9IEebYAnpvDY3Ghg.1 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13067464680321960129', time=2024-09-14T13:54:10.105780+0000, chain.objs.size()=1 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.749__shadow_.S84nqzlF1no8Yt2HOSaiM7uq94mHb7j_0 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8924395516224613709', time=2024-09-14T13:55:08.737897+0000, chain.objs.size()=1 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.761__shadow_.ERcYnNEVbs4_h9-emWzcl8LOzmHgi3S_0 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14665696554535558150', time=2024-09-14T13:55:43.414786+0000, chain.objs.size()=1 2024-09-14T11:58:39.192 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.194+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.769__shadow_.wGQe1OaqIaPVNmWJ_upU-0doHMEv1A__0 2024-09-14T11:58:39.195 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.197+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:39.198 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.200+0000 7efe2a614800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:58:39.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.201+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.199 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.202+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.202+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47627' 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.202+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='_2A_iSmmwhWtlVOLf7n3NnQZXumapYqn', time=2024-09-14T13:34:35.016493+0000, chain.objs.size()=3 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.202+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.g4jbMRYyXyCExo1xVaO5Cj_Wi7_WXlG_0 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.g4jbMRYyXyCExo1xVaO5Cj_Wi7_WXlG_1 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.161__shadow_.g4jbMRYyXyCExo1xVaO5Cj_Wi7_WXlG_2 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5866299304391089464', time=2024-09-14T13:35:06.818189+0000, chain.objs.size()=1 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.183__shadow_.L_WnbnvwiZH8n3JSwvcE-95eo6ZKQ98_0 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5385667711163317277', time=2024-09-14T13:35:23.550225+0000, chain.objs.size()=1 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.201__shadow_.3tDfXxGv_Zxz6nXRCrCaFGsLhgtnhCd_0 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='2~y3YJCEoEXeNVNTrIfWGeazg9-IZ7kGY', time=2024-09-14T13:35:24.764244+0000, chain.objs.size()=2 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.202__multipart_mymultipart.2~y3YJCEoEXeNVNTrIfWGeazg9-IZ7kGY.1 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.202__shadow_mymultipart.2~y3YJCEoEXeNVNTrIfWGeazg9-IZ7kGY.1_1 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3858193904542468059', time=2024-09-14T13:37:07.536998+0000, chain.objs.size()=1 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.247__shadow_.xqzWr_4T3fRE0tmlEG0-lvFgmwH7yBy_0 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4364544704084604295', time=2024-09-14T13:37:15.576976+0000, chain.objs.size()=1 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.258__shadow_.AEu6FonVuNit78_bHqqUKy5gcHTxmII_0 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15705951056883584076', time=2024-09-14T13:37:15.580349+0000, chain.objs.size()=1 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.258__shadow_.vG3k1bS-3byXFA0AQpS9QSVYqt15uJn_0 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9789915581867960042', time=2024-09-14T13:37:16.937503+0000, chain.objs.size()=1 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.260__shadow_.ELBnsa8yvj9ljTkQUHy_F1H93MXwIw2_0 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7193400899062538733', time=2024-09-14T13:37:57.746208+0000, chain.objs.size()=1 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.203+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.XlWjeGuP-XeR1XdApW5enmU22kL6MAr_0 2024-09-14T11:58:39.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.205+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8299478019036912764', time=2024-09-14T13:37:57.747037+0000, chain.objs.size()=1 2024-09-14T11:58:39.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.205+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jxvuYqbq1ku1dXySIFJdDOZRSti1rWb_0 2024-09-14T11:58:39.203 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.206+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12526375005057286718', time=2024-09-14T13:37:58.935313+0000, chain.objs.size()=1 2024-09-14T11:58:39.204 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.206+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.9GXdvrHpZK5myyLloGhlxsoToru_IBD_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.206+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3033753203267060193', time=2024-09-14T13:37:59.505517+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.gySgAPRQD1-u3PT5J09NjCi2Jt7ZYmb_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16536183908333674701', time=2024-09-14T13:37:59.617017+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JWzbp_b-uCyEqOmk50JPsRBsxPwSLtW_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7365628425343268893', time=2024-09-14T13:38:00.155171+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.YmYJn5FtoDTUE9D4PsbkiGp7zw9pRI2_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1334752028528241442', time=2024-09-14T13:38:00.200912+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.V5JztqSicDIIFwr_pNAD7zWAF2xQ4Ys_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.624520731446489218', time=2024-09-14T13:38:01.194451+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.MDP_EoX758Jp8pFU48NJOMUiKxvHyTF_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5908422583761768013', time=2024-09-14T13:38:01.681098+0000, chain.objs.size()=1 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.SwXIGUMlAq9qiinB5a02Qkr2it_eRJs_0 2024-09-14T11:58:39.205 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9005864306752369036', time=2024-09-14T13:38:02.059418+0000, chain.objs.size()=1 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.h90So2aVUgVs5ORhV5-22Jt91uZ769R_0 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11709643723033596770', time=2024-09-14T13:38:02.425976+0000, chain.objs.size()=1 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iPVlPQy34MWmTzjuShY625kVZmJMNFP_0 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12972082088328329892', time=2024-09-14T13:38:03.485853+0000, chain.objs.size()=1 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.207+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.hkPgtE877BMtYMuHBmnobPRxx2X_hxa_0 2024-09-14T11:58:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.210+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.110270598450057203', time=2024-09-14T13:38:03.562978+0000, chain.objs.size()=1 2024-09-14T11:58:39.208 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.210+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.JmbG_TxffU2ci8YTz8FspacznP8tviY_0 2024-09-14T11:58:39.209 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.211+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17166997604240489902', time=2024-09-14T13:38:04.993399+0000, chain.objs.size()=1 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.7xMgD_LxYkd9LjX8sGe0qG3oWPyl8qp_0 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7589266408091813191', time=2024-09-14T13:38:05.195208+0000, chain.objs.size()=1 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.OWG2sph5FFCg2BxQ4ANTH-ilsw5sx-t_0 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13250595798700881196', time=2024-09-14T13:38:05.550377+0000, chain.objs.size()=1 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.L0IC-6ixLvXLIq7QJGT931ECYXDV7ap_0 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13744686973426180198', time=2024-09-14T13:38:06.154027+0000, chain.objs.size()=1 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.W36aW070iE6JArSR_U_R8mk-PrhtRhb_0 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.966649287244523475', time=2024-09-14T13:38:06.188657+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.Hv0hgBltbOcgXFOaG0Ln3N4e6bP90VK_0 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16434013372352755640', time=2024-09-14T13:38:06.510414+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.nJmKaeSdcgrACTjrOAKISE9B_oFI00a_0 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2331644635521727526', time=2024-09-14T13:38:07.049056+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ud2E3Z4LPN2h8hX3f2M27k4b2aM-6Cm_0 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9614182424307540138', time=2024-09-14T13:38:07.227371+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.km_X5olGSsoA4QKR_VawPvF7qLuQpA4_0 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7308475436698755367', time=2024-09-14T13:38:07.352851+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.r1K_TekCkWs5vdd9AZMVLjElLBQtk2L_0 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17346042954829795122', time=2024-09-14T13:38:08.259139+0000, chain.objs.size()=1 2024-09-14T11:58:39.211 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.212+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.VmNS82n2nZijTzs7J7Io0FkXdGqcoo3_0 2024-09-14T11:58:39.212 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.215+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7567060329981237115', time=2024-09-14T13:38:08.550522+0000, chain.objs.size()=1 2024-09-14T11:58:39.213 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.215+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.lP5xb5cFIPJCQaWPR3j6ywI7EIzy5jh_0 2024-09-14T11:58:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3005013799560422044', time=2024-09-14T13:38:08.719912+0000, chain.objs.size()=1 2024-09-14T11:58:39.214 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.5mqNQDNNZqH86tRdoBmLllmPDq8jUrg_0 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2669999863371086518', time=2024-09-14T13:38:08.920138+0000, chain.objs.size()=1 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.3NOQyTc4RlXZ1dvHpWS4c-W8sOexb9d_0 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17925604162254618412', time=2024-09-14T13:38:09.366191+0000, chain.objs.size()=1 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.HSkQHRWOnlt-YwdRJ3ZKxrVajHr6pN1_0 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14335110371287994621', time=2024-09-14T13:38:09.435970+0000, chain.objs.size()=1 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.DBMzJJFEd9sajgnFwhcZ_-POoacbWgp_0 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13324316639523790879', time=2024-09-14T13:38:09.436713+0000, chain.objs.size()=1 2024-09-14T11:58:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0N0Z2oDfyUZ1fmLR1E3QuO1Im0VGXNx_0 2024-09-14T11:58:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9779115692566644505', time=2024-09-14T13:38:09.520057+0000, chain.objs.size()=1 2024-09-14T11:58:39.216 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.217+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.8cMDq5FiaTMH9ZLsYLDtKZb-zd1btd__0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2169769390727876401', time=2024-09-14T13:38:09.584055+0000, chain.objs.size()=1 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.0rA_lWSYyqZ6of2htElax5N10DTQb7A_0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14225227510487244733', time=2024-09-14T13:38:09.584771+0000, chain.objs.size()=1 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.eNimu4ykH_Phvjwa57bjnI2o_sNYM8d_0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10780749362080509827', time=2024-09-14T13:38:09.585339+0000, chain.objs.size()=1 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.jw_z0s5iOhP-qF0PbY_Z2fZ1JJ5noWN_0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1314649010496425432', time=2024-09-14T13:38:09.867082+0000, chain.objs.size()=1 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.ZE9mQR6xrt9kaunUTpu5b0Iq_NOeZTE_0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6416414543952696292', time=2024-09-14T13:38:09.895808+0000, chain.objs.size()=1 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.219+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.b2lOgo12wEqboxOdcvRZFT_fnGHkew-_0 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1497596337196560141', time=2024-09-14T13:38:10.362200+0000, chain.objs.size()=1 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.263__shadow_.iYBYOmciUAjMK1Q4zpdl-frO6IjzKW2_0 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1724046304283457471', time=2024-09-14T13:38:33.580379+0000, chain.objs.size()=1 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.AixFeUO5W1ZOroz1DBufo4ZRZ6AXV0F_0 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15618501185533792409', time=2024-09-14T13:38:33.607845+0000, chain.objs.size()=1 2024-09-14T11:58:39.219 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.221+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.293__shadow_.zbIiieQtnRfe4xwaed6zfivRgLRTYuQ_0 2024-09-14T11:58:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7326166143849060240', time=2024-09-14T13:39:38.560720+0000, chain.objs.size()=1 2024-09-14T11:58:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.iP0P3emYMp5mAwDt2yIwUNGQday-EsL_0 2024-09-14T11:58:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1422492162481778754', time=2024-09-14T13:39:39.518671+0000, chain.objs.size()=1 2024-09-14T11:58:39.220 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.6fXvrvm1-kPFE8u0B0A6246EGv6El9f_0 2024-09-14T11:58:39.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5461014645771840755', time=2024-09-14T13:39:39.631782+0000, chain.objs.size()=1 2024-09-14T11:58:39.221 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.222+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.UmzY06PijhxeHRVZNA0LW1VllWqwSl4_0 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17964748078954153462', time=2024-09-14T13:39:40.385455+0000, chain.objs.size()=1 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.P4bHZCKgrRaQc2DTU-UKPHKW_8YjZnJ_0 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5283544418044880569', time=2024-09-14T13:39:40.539198+0000, chain.objs.size()=1 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bmm8iUu4zCmCE5FRhtIf2xtU7MyXJjf_0 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9548989891904137657', time=2024-09-14T13:39:40.655126+0000, chain.objs.size()=1 2024-09-14T11:58:39.223 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.uiZSMJi-wc_QgZHYS5VVLudcmrVbkQs_0 2024-09-14T11:58:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3469738131076695369', time=2024-09-14T13:39:40.731141+0000, chain.objs.size()=1 2024-09-14T11:58:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YSHhH92u1FD0TOjyKx_lQl5PIAm5cqF_0 2024-09-14T11:58:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9728930408729839074', time=2024-09-14T13:39:41.058787+0000, chain.objs.size()=1 2024-09-14T11:58:39.224 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.225+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.bom92tv1eCqY5yVu636X-lgQIiSQWft_0 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6729193165960288600', time=2024-09-14T13:39:41.137181+0000, chain.objs.size()=1 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.70G3A3UaOnanJfAS29YlFd0ZhhNIIWN_0 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14041495375451509850', time=2024-09-14T13:39:41.138957+0000, chain.objs.size()=1 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.or2H-GDTtV9lfZ1jTDfOpCTHUs0tBrj_0 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12856477869705364002', time=2024-09-14T13:39:41.372343+0000, chain.objs.size()=1 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.227+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Mzeg4firzJuSrts7okJhcO2VCSzIKQe_0 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14011124835628194262', time=2024-09-14T13:39:42.713252+0000, chain.objs.size()=1 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mMg_GDzrN2LOlXDUc0OdEKEn8F8jTcP_0 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10186397105697212068', time=2024-09-14T13:39:43.161228+0000, chain.objs.size()=1 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.TPU6vJitD87wv6ax11zBvlD0Tmxl0Jy_0 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3459857865894418440', time=2024-09-14T13:39:43.671667+0000, chain.objs.size()=1 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.228+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.oGGQvhz_uXeuKd248Yr0sG4IXEcSs2U_0 2024-09-14T11:58:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.230+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7489558511813038581', time=2024-09-14T13:39:44.088788+0000, chain.objs.size()=1 2024-09-14T11:58:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.230+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mjhbsRmYb1N-6UNlfJH6VE6Ap1kJKez_0 2024-09-14T11:58:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.230+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15560361070388484320', time=2024-09-14T13:39:44.380727+0000, chain.objs.size()=1 2024-09-14T11:58:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.230+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.Um8jX2cxwhGrwaWzzJTYahMM0lfUXSH_0 2024-09-14T11:58:39.228 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16854593755421970148', time=2024-09-14T13:39:44.428298+0000, chain.objs.size()=1 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.deU6Rdcti0J3ihdSqTewBEp7eDvPjdb_0 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.990730592815783135', time=2024-09-14T13:39:44.567017+0000, chain.objs.size()=1 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5FujBYVx1cwNdUk8HQ9cOxC68mmEquL_0 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1241006196954975051', time=2024-09-14T13:39:44.753863+0000, chain.objs.size()=1 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.16WtVoeoq_0bj9tV10Kp359SNX5ZuHe_0 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12843812141815345397', time=2024-09-14T13:39:45.394606+0000, chain.objs.size()=1 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.231+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.mQYJVn6BijF7YECZUlApum0vsv_4QNb_0 2024-09-14T11:58:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.232+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18172929931853895579', time=2024-09-14T13:39:45.456777+0000, chain.objs.size()=1 2024-09-14T11:58:39.230 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.232+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.qfjpYIorOs1Lkih0ZWp9eHf1g1JLboG_0 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5965260652202351354', time=2024-09-14T13:39:47.520708+0000, chain.objs.size()=1 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.lIfClsHyXTl0I5vNYsZPWGd-jG5Iyp8_0 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16173380483050629199', time=2024-09-14T13:39:47.521621+0000, chain.objs.size()=1 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.7NqUhx--Y76lUJIEAsqcgbtsCO3O5Rn_0 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9265171056542188523', time=2024-09-14T13:39:47.701901+0000, chain.objs.size()=1 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.YTICyMBS1LiNJMLXaY34HhcAk-uPhV__0 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11472853994387478201', time=2024-09-14T13:39:48.043723+0000, chain.objs.size()=1 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.234+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.zTpA2GDZm3MzHckXpNkCOITyqy1P8-l_0 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9700588262542033195', time=2024-09-14T13:39:48.559660+0000, chain.objs.size()=1 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.-XcQY5tLB8D53W3_s1sxH2-gbnvoZyL_0 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13667481516763013829', time=2024-09-14T13:39:48.758298+0000, chain.objs.size()=1 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.wBGe_0JS0ZRM1AAdRwA2Me1KSPmWuJf_0 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2858790755701749712', time=2024-09-14T13:39:49.423554+0000, chain.objs.size()=1 2024-09-14T11:58:39.233 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.235+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.nto2QDQhtSmVPXM27aeKNXj2GYTOEIB_0 2024-09-14T11:58:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14327734276319105904', time=2024-09-14T13:39:50.285077+0000, chain.objs.size()=1 2024-09-14T11:58:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.324__shadow_.5v1iSUph0lpmb2t5V9gaDRTRFFWD_ui_0 2024-09-14T11:58:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15135098528588815911', time=2024-09-14T13:40:31.467637+0000, chain.objs.size()=1 2024-09-14T11:58:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.5Bg0NAR9SeM6dvShTDe2tF1qStC_Gk0_0 2024-09-14T11:58:39.235 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1693496012229707618', time=2024-09-14T13:40:32.718855+0000, chain.objs.size()=1 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.-wfZdU4q4-ykdprbvG9iRbpeF_IBOc9_0 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8633973821349418009', time=2024-09-14T13:40:33.702346+0000, chain.objs.size()=1 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.237+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.S_A7bCvMQa2u1VjsjhJ5zrwMwFwuy-x_0 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.238+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7553513544932815329', time=2024-09-14T13:40:33.730039+0000, chain.objs.size()=1 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.HjA8jd4O0vLgr0v5K9N_HTtoqwbJ5Ld_0 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.238+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11639616069737457298', time=2024-09-14T13:40:34.254485+0000, chain.objs.size()=1 2024-09-14T11:58:39.236 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.238+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.3sOPzMqQYSMHaPAOW43drDMdz_ANNh5_0 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.240+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.18256386212576015518', time=2024-09-14T13:40:34.442327+0000, chain.objs.size()=1 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.240+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.LtQN4u8o6X2mM590BeJkTtjsewZTMEe_0 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10898149470907423669', time=2024-09-14T13:40:34.557117+0000, chain.objs.size()=1 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.pdYL0KHyccwHCGXP06bsRizSIhQ2fiH_0 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7717652360431785099', time=2024-09-14T13:40:34.677914+0000, chain.objs.size()=1 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.UztXsX9cEcQWdRcVclgow1iqR0sQYKO_0 2024-09-14T11:58:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.14633210492688353737', time=2024-09-14T13:40:34.988126+0000, chain.objs.size()=1 2024-09-14T11:58:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EsS7McDBxHkqb235p3KHbMMThuwDqVr_0 2024-09-14T11:58:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17689929987078885165', time=2024-09-14T13:40:35.066321+0000, chain.objs.size()=1 2024-09-14T11:58:39.239 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.241+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.6oI72vvM0EecrwQ0LvgX5uzsho9BLgK_0 2024-09-14T11:58:39.240 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17299993520640669951', time=2024-09-14T13:40:35.096717+0000, chain.objs.size()=1 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.sy9FzN3gBd4mSh-9NW9dgkAwJzSn0ko_0 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15682696343564238611', time=2024-09-14T13:40:36.085858+0000, chain.objs.size()=1 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.dYk7NefryLIADcZuhPV4rDQk1Er7Lom_0 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.2932963608862541806', time=2024-09-14T13:40:38.162777+0000, chain.objs.size()=1 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.1nn3gNg9Mw5f7PF_ScujoOXw3LbPRDs_0 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15491641599205897429', time=2024-09-14T13:40:38.296341+0000, chain.objs.size()=1 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.64WtDRvEOuT4ZUyiNOMKHxvSfVlUjIp_0 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3772925511397995012', time=2024-09-14T13:40:38.622702+0000, chain.objs.size()=1 2024-09-14T11:58:39.241 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.d_zzwIX8Pyr8Gzup9e2nXZIP-c3s32w_0 2024-09-14T11:58:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8155096265689265257', time=2024-09-14T13:40:39.117675+0000, chain.objs.size()=1 2024-09-14T11:58:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.243+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4U5az6abc4IOf8Tu-yrIshiR7lHdR9q_0 2024-09-14T11:58:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.244+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16057500993524580057', time=2024-09-14T13:40:39.236975+0000, chain.objs.size()=1 2024-09-14T11:58:39.242 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.244+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.7XAZpigCPpsTwhNmiBX4zFLpYpv5wn9_0 2024-09-14T11:58:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13020480741983157513', time=2024-09-14T13:40:39.660964+0000, chain.objs.size()=1 2024-09-14T11:58:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.xu-doqr3z2FUlQGNPp0mQD62diR0stW_0 2024-09-14T11:58:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.5661652464872251843', time=2024-09-14T13:40:41.045824+0000, chain.objs.size()=1 2024-09-14T11:58:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.yEO5FJdEpoqcVeKppfZzRuoQVQWMSK7_0 2024-09-14T11:58:39.243 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3411850085239576320', time=2024-09-14T13:40:41.068256+0000, chain.objs.size()=1 2024-09-14T11:58:39.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.CEZMvr0XqoYPhaP2j4-IMoJ1jPg8mQp_0 2024-09-14T11:58:39.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17934078723032787930', time=2024-09-14T13:40:41.098100+0000, chain.objs.size()=1 2024-09-14T11:58:39.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.245+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.EXf62uFJoHnawqyrVnKT4MMSm7cnyDY_0 2024-09-14T11:58:39.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.246+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.7153875115979934870', time=2024-09-14T13:40:41.646741+0000, chain.objs.size()=1 2024-09-14T11:58:39.244 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.246+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.SaAFU0vzFgpOaxh8E3D_f2FP3MM8dO__0 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6882971260295599045', time=2024-09-14T13:40:41.688072+0000, chain.objs.size()=1 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_._gW9H4cqqiJqvjgHl-LZR60C2exqFth_0 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12075586703784077306', time=2024-09-14T13:40:41.763791+0000, chain.objs.size()=1 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.QpIviLT39ImeRVfOsz6MKBj-q_POH22_0 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17656370467065191942', time=2024-09-14T13:40:42.218264+0000, chain.objs.size()=1 2024-09-14T11:58:39.247 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.248+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.4V__wsk0wCTZHno1arWByHvW-Pt31R4_0 2024-09-14T11:58:39.250 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.252+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 0/47627 2024-09-14T11:58:39.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:58:39.253 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.17104570206305540999', time=2024-09-14T13:40:42.359189+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.325__shadow_.X8p4hir5T3zDaqXQPh4QEahckAPsWEG_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.3668091241625028933', time=2024-09-14T13:40:46.881777+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.331__shadow_.pTzjdmZG7KNwpwMfIRyC0vyZuLJ2WCD_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.8615550363421994135', time=2024-09-14T13:40:52.489446+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.340__shadow_.AfOXGpIdB9coWCjR3Fm6SphtWSq1Ohg_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.4472731505534964842', time=2024-09-14T13:40:53.083396+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.341__shadow_.6UHU09IHfG6AEZjAUQ6m1-RcMNX5APy_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.9256771561642353620', time=2024-09-14T13:41:00.571953+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.354__shadow_.rrJlj8L1F0Y3-07wcziiA1uO7pR8P1t_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12382504322457479575', time=2024-09-14T13:41:16.074971+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.379__shadow_.tXs3WjO7Qx02x5KL1imdTkI99TsGFcQ_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10304355903947011096', time=2024-09-14T13:41:18.965631+0000, chain.objs.size()=1 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.383__shadow_.KB0wyrY4OEDim4fmrGbB2BiPW1LPrr5_0 2024-09-14T11:58:39.254 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.898871389783105305', time=2024-09-14T13:42:28.295221+0000, chain.objs.size()=1 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.485__shadow_.UspaIKXSIwZhTtDJMp_n0uDmMOojcqa_0 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10048315283301376882', time=2024-09-14T13:44:47.193996+0000, chain.objs.size()=2 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~MO0Qe1pcrQfRMDZNYwRmOHS7E5rBHQq.1 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.526__multipart_mymultipart.2~MO0Qe1pcrQfRMDZNYwRmOHS7E5rBHQq.2 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16875901186197932520', time=2024-09-14T13:46:12.861292+0000, chain.objs.size()=1 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.560__shadow_.ByKa8ItcPfc6oZQwhOGKK_i1fzRk1t9_0 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.12762563448609034846', time=2024-09-14T13:46:56.206571+0000, chain.objs.size()=1 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.255+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.578__shadow:nES5e6IXmkQPTrEA6t2E3QXMhBawkUT_.TcHsJTKkL4KXcRxmOPHQWS_s78xuKsI_0 2024-09-14T11:58:39.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16709754960290379304', time=2024-09-14T13:47:34.112400+0000, chain.objs.size()=1 2024-09-14T11:58:39.257 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.581__shadow:Clhbha0t-LTYzzaKp7RT3h9xWnRM-1t_.SBkEheLedA9NMyls-q896g99eEuNuKT_0 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11400466111390830554', time=2024-09-14T13:47:41.161691+0000, chain.objs.size()=1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.588__shadow:TPz94ifzHuj.ieI9E5l4BtQX2H947Lu_.ahTiziWblD-F4w0HN301k6ELBg4zAnl_0 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10109014456624151410', time=2024-09-14T13:49:02.960680+0000, chain.objs.size()=12 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.1_1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.2 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.2_1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.3 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.3_1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.4 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.4_1 2024-09-14T11:58:39.258 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.259+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.5 2024-09-14T11:58:39.261 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.263+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.5_1 2024-09-14T11:58:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__multipart_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.6 2024-09-14T11:58:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.616__shadow_multipart_enc.2~kfRqkg1OWnt9ah5iXoudYEfqFJDQlAB.6_1 2024-09-14T11:58:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.264+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.11743884187523464016', time=2024-09-14T13:51:29.080349+0000, chain.objs.size()=12 2024-09-14T11:58:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.1 2024-09-14T11:58:39.262 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.264+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.1_1 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.2 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.2_1 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.3 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.3_1 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.4 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.265+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.4_1 2024-09-14T11:58:39.266 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.268+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.5 2024-09-14T11:58:39.267 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.269+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.5_1 2024-09-14T11:58:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__multipart_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.6 2024-09-14T11:58:39.270 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.272+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.624__shadow_multipart_enc.2~SBJqR2nFXKuql-0-UQWlcD_il3fnsjV.6_1 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.15008967060879562811', time=2024-09-14T13:51:49.051554+0000, chain.objs.size()=1 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.635__shadow_.H2t91r_mZ4whv7mouG6F7qIamHYYG57_0 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.6570142880702510727', time=2024-09-14T13:53:00.438061+0000, chain.objs.size()=1 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.707__shadow_.XjVScAhHAsOM6TW-hCnRMosALYsC1hR_0 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.16499605097172881738', time=2024-09-14T13:53:04.180347+0000, chain.objs.size()=1 2024-09-14T11:58:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.712__multipart_file1.2~gc8qiitMSRsRDYMdsEZmghhNqgOTcu8.1 2024-09-14T11:58:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.13631050715628459338', time=2024-09-14T13:53:06.082298+0000, chain.objs.size()=1 2024-09-14T11:58:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.715__shadow:MEYCiak32Z1b1FijgXt1.y-IQ.y4D-W_.cEDgH-WdsvDfXzlQe4ZrSqftnDIHH0p_0 2024-09-14T11:58:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.1194782132324012826', time=2024-09-14T13:53:27.826053+0000, chain.objs.size()=1 2024-09-14T11:58:39.273 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.719__shadow_.CVcGNOCMxbJsERj0PV4EjToxJOOaYHQ_0 2024-09-14T11:58:39.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 20 garbage collection: RGWGC::process iterating over entry tag='11989569-703c-4397-b0f1-7ddb0279a491.4517.10182485547439361293', time=2024-09-14T13:54:51.804852+0000, chain.objs.size()=1 2024-09-14T11:58:39.276 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.274+0000 7efe2a614800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:11989569-703c-4397-b0f1-7ddb0279a491.4517.754__shadow_.bFk5tWymj1slB8bboDHa5zfWs7VxKhC_0 2024-09-14T11:58:39.277 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.279+0000 7efe2a614800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:39.280 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.282+0000 7efcd77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:39.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.284+0000 7efe2a614800 20 remove_watcher() i=0 2024-09-14T11:58:39.282 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.284+0000 7efe2a614800 2 removed watcher, disabling cache 2024-09-14T11:58:39.283 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.285+0000 7efe2a614800 20 remove_watcher() i=1 2024-09-14T11:58:39.284 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.286+0000 7efe2a614800 20 remove_watcher() i=2 2024-09-14T11:58:39.285 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.287+0000 7efe2a614800 20 remove_watcher() i=3 2024-09-14T11:58:39.286 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.288+0000 7efe2a614800 20 remove_watcher() i=4 2024-09-14T11:58:39.287 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.289+0000 7efe2a614800 20 remove_watcher() i=5 2024-09-14T11:58:39.288 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.291+0000 7efe2a614800 20 remove_watcher() i=6 2024-09-14T11:58:39.290 INFO:teuthology.orchestra.run.smithi029.stderr:2024-09-14T11:58:39.292+0000 7efe2a614800 20 remove_watcher() i=7 2024-09-14T11:58:39.301 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:58:39.311 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:58:39.345 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:58:39.345 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:39.679 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:58:39.690 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:58:39.693 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2123,"stamp":"2024-09-14T11:58:37.890520+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":561313907,"num_objects":3829,"num_object_clones":0,"num_object_copies":14318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3829,"num_whiteouts":0,"num_read":309368,"num_read_kb":2562824,"num_write":162753,"num_write_kb":2614706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13996,"ondisk_log_size":13996,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2629848,"kb_used_data":943140,"kb_used_omap":12,"kb_used_meta":1686067,"kb_avail":752344872,"statfs":{"total":773094113280,"available":770401148928,"internally_reserved":0,"allocated":965775360,"data_stored":949853042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1726533168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-194567432,"num_objects":-1119,"num_object_clones":0,"num_object_copies":-4436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1119,"num_whiteouts":0,"num_read":1277,"num_read_kb":1223,"num_write":1196,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005152"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552583+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:55:27.552583+0000","last_peered":"2024-09-14T11:55:27.552583+0000","last_clean":"2024-09-14T11:55:27.552583+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:55:27.552583+0000","last_undegraded":"2024-09-14T11:55:27.552583+0000","last_fullsized":"2024-09-14T11:55:27.552583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":13318,"num_write":13,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.732014+0000","last_change":"2024-09-14T11:32:11.437735+0000","last_active":"2024-09-14T11:54:42.732014+0000","last_peered":"2024-09-14T11:54:42.732014+0000","last_clean":"2024-09-14T11:54:42.732014+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:54:42.732014+0000","last_undegraded":"2024-09-14T11:54:42.732014+0000","last_fullsized":"2024-09-14T11:54:42.732014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:47.395141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.554054+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:55:28.554054+0000","last_peered":"2024-09-14T11:55:28.554054+0000","last_clean":"2024-09-14T11:55:28.554054+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:55:28.554054+0000","last_undegraded":"2024-09-14T11:55:28.554054+0000","last_fullsized":"2024-09-14T11:55:28.554054+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":24554,"num_write":6,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.449688+0000","last_change":"2024-09-14T11:15:22.382182+0000","last_active":"2024-09-14T11:57:52.449688+0000","last_peered":"2024-09-14T11:57:52.449688+0000","last_clean":"2024-09-14T11:57:52.449688+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:57:52.449688+0000","last_undegraded":"2024-09-14T11:57:52.449688+0000","last_fullsized":"2024-09-14T11:57:52.449688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:17.002880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.732724+0000","last_change":"2024-09-14T11:12:39.149946+0000","last_active":"2024-09-14T11:54:47.732724+0000","last_peered":"2024-09-14T11:54:47.732724+0000","last_clean":"2024-09-14T11:54:47.732724+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:54:47.732724+0000","last_undegraded":"2024-09-14T11:54:47.732724+0000","last_fullsized":"2024-09-14T11:54:47.732724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:07.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.660125+0000","last_change":"2024-09-14T11:32:11.434861+0000","last_active":"2024-09-14T11:53:58.660125+0000","last_peered":"2024-09-14T11:53:58.660125+0000","last_clean":"2024-09-14T11:53:58.660125+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:58.660125+0000","last_undegraded":"2024-09-14T11:53:58.660125+0000","last_fullsized":"2024-09-14T11:53:58.660125+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:31.993353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655710+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:55:02.655710+0000","last_peered":"2024-09-14T11:55:02.655710+0000","last_clean":"2024-09-14T11:55:02.655710+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:55:02.655710+0000","last_undegraded":"2024-09-14T11:55:02.655710+0000","last_fullsized":"2024-09-14T11:55:02.655710+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:42.694530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738922+0000","last_change":"2024-09-14T11:15:22.378824+0000","last_active":"2024-09-14T11:55:27.738922+0000","last_peered":"2024-09-14T11:55:27.738922+0000","last_clean":"2024-09-14T11:55:27.738922+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:55:27.738922+0000","last_undegraded":"2024-09-14T11:55:27.738922+0000","last_fullsized":"2024-09-14T11:55:27.738922+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647590+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:53:57.647590+0000","last_peered":"2024-09-14T11:53:57.647590+0000","last_clean":"2024-09-14T11:53:57.647590+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:53:57.647590+0000","last_undegraded":"2024-09-14T11:53:57.647590+0000","last_fullsized":"2024-09-14T11:53:57.647590+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:18.964434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.450876+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:57:37.450876+0000","last_peered":"2024-09-14T11:57:37.450876+0000","last_clean":"2024-09-14T11:57:37.450876+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:57:37.450876+0000","last_undegraded":"2024-09-14T11:57:37.450876+0000","last_fullsized":"2024-09-14T11:57:37.450876+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":9,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.549083+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:54:58.549083+0000","last_peered":"2024-09-14T11:54:58.549083+0000","last_clean":"2024-09-14T11:54:58.549083+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:54:58.549083+0000","last_undegraded":"2024-09-14T11:54:58.549083+0000","last_fullsized":"2024-09-14T11:54:58.549083+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8380416,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":2,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541604+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:54:17.541604+0000","last_peered":"2024-09-14T11:54:17.541604+0000","last_clean":"2024-09-14T11:54:17.541604+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:54:17.541604+0000","last_undegraded":"2024-09-14T11:54:17.541604+0000","last_fullsized":"2024-09-14T11:54:17.541604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.758307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.647995+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:54:02.647995+0000","last_peered":"2024-09-14T11:54:02.647995+0000","last_clean":"2024-09-14T11:54:02.647995+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:54:02.647995+0000","last_undegraded":"2024-09-14T11:54:02.647995+0000","last_fullsized":"2024-09-14T11:54:02.647995+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.355968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535330+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:55:07.535330+0000","last_peered":"2024-09-14T11:55:07.535330+0000","last_clean":"2024-09-14T11:55:07.535330+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:55:07.535330+0000","last_undegraded":"2024-09-14T11:55:07.535330+0000","last_fullsized":"2024-09-14T11:55:07.535330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:34.726917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.661402+0000","last_change":"2024-09-14T11:15:25.395023+0000","last_active":"2024-09-14T11:54:08.661402+0000","last_peered":"2024-09-14T11:54:08.661402+0000","last_clean":"2024-09-14T11:54:08.661402+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:54:08.661402+0000","last_undegraded":"2024-09-14T11:54:08.661402+0000","last_fullsized":"2024-09-14T11:54:08.661402+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:00.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":10232,"num_write":4,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542336+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:54:13.542336+0000","last_peered":"2024-09-14T11:54:13.542336+0000","last_clean":"2024-09-14T11:54:13.542336+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:54:13.542336+0000","last_undegraded":"2024-09-14T11:54:13.542336+0000","last_fullsized":"2024-09-14T11:54:13.542336+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.328393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670510+0000","last_change":"2024-09-14T11:12:39.152199+0000","last_active":"2024-09-14T11:55:08.670510+0000","last_peered":"2024-09-14T11:55:08.670510+0000","last_clean":"2024-09-14T11:55:08.670510+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:55:08.670510+0000","last_undegraded":"2024-09-14T11:55:08.670510+0000","last_fullsized":"2024-09-14T11:55:08.670510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:33.862160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.673548+0000","last_change":"2024-09-14T11:15:25.385836+0000","last_active":"2024-09-14T11:55:28.673548+0000","last_peered":"2024-09-14T11:55:28.673548+0000","last_clean":"2024-09-14T11:55:28.673548+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:55:28.673548+0000","last_undegraded":"2024-09-14T11:55:28.673548+0000","last_fullsized":"2024-09-14T11:55:28.673548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:47.787237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'6","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.553346+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:55:23.553346+0000","last_peered":"2024-09-14T11:55:23.553346+0000","last_clean":"2024-09-14T11:55:23.553346+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:55:23.553346+0000","last_undegraded":"2024-09-14T11:55:23.553346+0000","last_fullsized":"2024-09-14T11:55:23.553346+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":16,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.646678+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:53:52.646678+0000","last_peered":"2024-09-14T11:53:52.646678+0000","last_clean":"2024-09-14T11:53:52.646678+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:53:52.646678+0000","last_undegraded":"2024-09-14T11:53:52.646678+0000","last_fullsized":"2024-09-14T11:53:52.646678+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:27.384797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659128+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:55:27.659128+0000","last_peered":"2024-09-14T11:55:27.659128+0000","last_clean":"2024-09-14T11:55:27.659128+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:55:27.659128+0000","last_undegraded":"2024-09-14T11:55:27.659128+0000","last_fullsized":"2024-09-14T11:55:27.659128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.543032+0000","last_change":"2024-09-14T11:12:39.148861+0000","last_active":"2024-09-14T11:56:12.543032+0000","last_peered":"2024-09-14T11:56:12.543032+0000","last_clean":"2024-09-14T11:56:12.543032+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:56:12.543032+0000","last_undegraded":"2024-09-14T11:56:12.543032+0000","last_fullsized":"2024-09-14T11:56:12.543032+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:48.885213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.538794+0000","last_change":"2024-09-14T11:32:11.441324+0000","last_active":"2024-09-14T11:55:32.538794+0000","last_peered":"2024-09-14T11:55:32.538794+0000","last_clean":"2024-09-14T11:55:32.538794+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:55:32.538794+0000","last_undegraded":"2024-09-14T11:55:32.538794+0000","last_fullsized":"2024-09-14T11:55:32.538794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:40.912189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.654974+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:54:57.654974+0000","last_peered":"2024-09-14T11:54:57.654974+0000","last_clean":"2024-09-14T11:54:57.654974+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:54:57.654974+0000","last_undegraded":"2024-09-14T11:54:57.654974+0000","last_fullsized":"2024-09-14T11:54:57.654974+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.739392+0000","last_change":"2024-09-14T11:32:11.425898+0000","last_active":"2024-09-14T11:55:32.739392+0000","last_peered":"2024-09-14T11:55:32.739392+0000","last_clean":"2024-09-14T11:55:32.739392+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:55:32.739392+0000","last_undegraded":"2024-09-14T11:55:32.739392+0000","last_fullsized":"2024-09-14T11:55:32.739392+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:44.908579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.661902+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:54:02.661902+0000","last_peered":"2024-09-14T11:54:02.661902+0000","last_clean":"2024-09-14T11:54:02.661902+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:54:02.661902+0000","last_undegraded":"2024-09-14T11:54:02.661902+0000","last_fullsized":"2024-09-14T11:54:02.661902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:37.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.648976+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:54:07.648976+0000","last_peered":"2024-09-14T11:54:07.648976+0000","last_clean":"2024-09-14T11:54:07.648976+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:54:07.648976+0000","last_undegraded":"2024-09-14T11:54:07.648976+0000","last_fullsized":"2024-09-14T11:54:07.648976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:25.067236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615637+0000","last_change":"2024-09-14T11:15:22.364016+0000","last_active":"2024-09-14T11:58:37.615637+0000","last_peered":"2024-09-14T11:58:37.615637+0000","last_clean":"2024-09-14T11:58:37.615637+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:58:37.615637+0000","last_undegraded":"2024-09-14T11:58:37.615637+0000","last_fullsized":"2024-09-14T11:58:37.615637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:25.332714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.743509+0000","last_change":"2024-09-14T11:12:39.148536+0000","last_active":"2024-09-14T11:56:12.743509+0000","last_peered":"2024-09-14T11:56:12.743509+0000","last_clean":"2024-09-14T11:56:12.743509+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:56:12.743509+0000","last_undegraded":"2024-09-14T11:56:12.743509+0000","last_fullsized":"2024-09-14T11:56:12.743509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:22.270515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'3","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:08.541568+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:54:08.541568+0000","last_peered":"2024-09-14T11:54:08.541568+0000","last_clean":"2024-09-14T11:54:08.541568+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:54:08.541568+0000","last_undegraded":"2024-09-14T11:54:08.541568+0000","last_fullsized":"2024-09-14T11:54:08.541568+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:54.069010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648099+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:54:02.648099+0000","last_peered":"2024-09-14T11:54:02.648099+0000","last_clean":"2024-09-14T11:54:02.648099+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:54:02.648099+0000","last_undegraded":"2024-09-14T11:54:02.648099+0000","last_fullsized":"2024-09-14T11:54:02.648099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.960689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647680+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:53:57.647680+0000","last_peered":"2024-09-14T11:53:57.647680+0000","last_clean":"2024-09-14T11:53:57.647680+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:53:57.647680+0000","last_undegraded":"2024-09-14T11:53:57.647680+0000","last_fullsized":"2024-09-14T11:53:57.647680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:18.749825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446319+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:57:27.446319+0000","last_peered":"2024-09-14T11:57:27.446319+0000","last_clean":"2024-09-14T11:57:27.446319+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:57:27.446319+0000","last_undegraded":"2024-09-14T11:57:27.446319+0000","last_fullsized":"2024-09-14T11:57:27.446319+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":15350,"num_write":13,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549645+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:55:03.549645+0000","last_peered":"2024-09-14T11:55:03.549645+0000","last_clean":"2024-09-14T11:55:03.549645+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:55:03.549645+0000","last_undegraded":"2024-09-14T11:55:03.549645+0000","last_fullsized":"2024-09-14T11:55:03.549645+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668344+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:54:42.668344+0000","last_peered":"2024-09-14T11:54:42.668344+0000","last_clean":"2024-09-14T11:54:42.668344+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:54:42.668344+0000","last_undegraded":"2024-09-14T11:54:42.668344+0000","last_fullsized":"2024-09-14T11:54:42.668344+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647472+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:53:57.647472+0000","last_peered":"2024-09-14T11:53:57.647472+0000","last_clean":"2024-09-14T11:53:57.647472+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:57.647472+0000","last_undegraded":"2024-09-14T11:53:57.647472+0000","last_fullsized":"2024-09-14T11:53:57.647472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:22.717875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446265+0000","last_change":"2024-09-14T11:15:25.391047+0000","last_active":"2024-09-14T11:57:27.446265+0000","last_peered":"2024-09-14T11:57:27.446265+0000","last_clean":"2024-09-14T11:57:27.446265+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:57:27.446265+0000","last_undegraded":"2024-09-14T11:57:27.446265+0000","last_fullsized":"2024-09-14T11:57:27.446265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:36.099082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652801+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:54:42.652801+0000","last_peered":"2024-09-14T11:54:42.652801+0000","last_clean":"2024-09-14T11:54:42.652801+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:54:42.652801+0000","last_undegraded":"2024-09-14T11:54:42.652801+0000","last_fullsized":"2024-09-14T11:54:42.652801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:54.823817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669689+0000","last_change":"2024-09-14T11:15:22.380265+0000","last_active":"2024-09-14T11:55:03.669689+0000","last_peered":"2024-09-14T11:55:03.669689+0000","last_clean":"2024-09-14T11:55:03.669689+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:55:03.669689+0000","last_undegraded":"2024-09-14T11:55:03.669689+0000","last_fullsized":"2024-09-14T11:55:03.669689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.546224+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:54:38.546224+0000","last_peered":"2024-09-14T11:54:38.546224+0000","last_clean":"2024-09-14T11:54:38.546224+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:54:38.546224+0000","last_undegraded":"2024-09-14T11:54:38.546224+0000","last_fullsized":"2024-09-14T11:54:38.546224+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647657+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:53:57.647657+0000","last_peered":"2024-09-14T11:53:57.647657+0000","last_clean":"2024-09-14T11:53:57.647657+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:53:57.647657+0000","last_undegraded":"2024-09-14T11:53:57.647657+0000","last_fullsized":"2024-09-14T11:53:57.647657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:43.844584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670462+0000","last_change":"2024-09-14T11:15:25.394352+0000","last_active":"2024-09-14T11:55:08.670462+0000","last_peered":"2024-09-14T11:55:08.670462+0000","last_clean":"2024-09-14T11:55:08.670462+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:55:08.670462+0000","last_undegraded":"2024-09-14T11:55:08.670462+0000","last_fullsized":"2024-09-14T11:55:08.670462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:35.832475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653140+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:54:42.653140+0000","last_peered":"2024-09-14T11:54:42.653140+0000","last_clean":"2024-09-14T11:54:42.653140+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:54:42.653140+0000","last_undegraded":"2024-09-14T11:54:42.653140+0000","last_fullsized":"2024-09-14T11:54:42.653140+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:29.954707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.742985+0000","last_change":"2024-09-14T11:32:11.425357+0000","last_active":"2024-09-14T11:56:07.742985+0000","last_peered":"2024-09-14T11:56:07.742985+0000","last_clean":"2024-09-14T11:56:07.742985+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:56:07.742985+0000","last_undegraded":"2024-09-14T11:56:07.742985+0000","last_fullsized":"2024-09-14T11:56:07.742985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:04.671224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.679588+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:55:52.679588+0000","last_peered":"2024-09-14T11:55:52.679588+0000","last_clean":"2024-09-14T11:55:52.679588+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:55:52.679588+0000","last_undegraded":"2024-09-14T11:55:52.679588+0000","last_fullsized":"2024-09-14T11:55:52.679588+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":3079,"num_write":5,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668319+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:54:42.668319+0000","last_peered":"2024-09-14T11:54:42.668319+0000","last_clean":"2024-09-14T11:54:42.668319+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:54:42.668319+0000","last_undegraded":"2024-09-14T11:54:42.668319+0000","last_fullsized":"2024-09-14T11:54:42.668319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:51.143671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662654+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:55:57.662654+0000","last_peered":"2024-09-14T11:55:57.662654+0000","last_clean":"2024-09-14T11:55:57.662654+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:55:57.662654+0000","last_undegraded":"2024-09-14T11:55:57.662654+0000","last_fullsized":"2024-09-14T11:55:57.662654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.741529+0000","last_change":"2024-09-14T11:15:22.370925+0000","last_active":"2024-09-14T11:55:52.741529+0000","last_peered":"2024-09-14T11:55:52.741529+0000","last_clean":"2024-09-14T11:55:52.741529+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:55:52.741529+0000","last_undegraded":"2024-09-14T11:55:52.741529+0000","last_fullsized":"2024-09-14T11:55:52.741529+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.657676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.678742+0000","last_change":"2024-09-14T11:32:11.435885+0000","last_active":"2024-09-14T11:56:03.678742+0000","last_peered":"2024-09-14T11:56:03.678742+0000","last_clean":"2024-09-14T11:56:03.678742+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:56:03.678742+0000","last_undegraded":"2024-09-14T11:56:03.678742+0000","last_fullsized":"2024-09-14T11:56:03.678742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:04.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:27.454554+0000","last_change":"2024-09-14T11:15:25.389833+0000","last_active":"2024-09-14T11:58:27.454554+0000","last_peered":"2024-09-14T11:58:27.454554+0000","last_clean":"2024-09-14T11:58:27.454554+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:58:27.454554+0000","last_undegraded":"2024-09-14T11:58:27.454554+0000","last_fullsized":"2024-09-14T11:58:27.454554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.345624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672755+0000","last_change":"2024-09-14T11:12:39.147355+0000","last_active":"2024-09-14T11:55:23.672755+0000","last_peered":"2024-09-14T11:55:23.672755+0000","last_clean":"2024-09-14T11:55:23.672755+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:55:23.672755+0000","last_undegraded":"2024-09-14T11:55:23.672755+0000","last_fullsized":"2024-09-14T11:55:23.672755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:13.956283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.542021+0000","last_change":"2024-09-14T11:15:22.379118+0000","last_active":"2024-09-14T11:56:02.542021+0000","last_peered":"2024-09-14T11:56:02.542021+0000","last_clean":"2024-09-14T11:56:02.542021+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:56:02.542021+0000","last_undegraded":"2024-09-14T11:56:02.542021+0000","last_fullsized":"2024-09-14T11:56:02.542021+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.600963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738869+0000","last_change":"2024-09-14T11:12:39.149430+0000","last_active":"2024-09-14T11:55:27.738869+0000","last_peered":"2024-09-14T11:55:27.738869+0000","last_clean":"2024-09-14T11:55:27.738869+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:55:27.738869+0000","last_undegraded":"2024-09-14T11:55:27.738869+0000","last_fullsized":"2024-09-14T11:55:27.738869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653286+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:54:42.653286+0000","last_peered":"2024-09-14T11:54:42.653286+0000","last_clean":"2024-09-14T11:54:42.653286+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:54:42.653286+0000","last_undegraded":"2024-09-14T11:54:42.653286+0000","last_fullsized":"2024-09-14T11:54:42.653286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:15.841468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544712+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:54:28.544712+0000","last_peered":"2024-09-14T11:54:28.544712+0000","last_clean":"2024-09-14T11:54:28.544712+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:54:28.544712+0000","last_undegraded":"2024-09-14T11:54:28.544712+0000","last_fullsized":"2024-09-14T11:54:28.544712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:36.393782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101966,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2106,"num_write":3,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.650300+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:54:22.650300+0000","last_peered":"2024-09-14T11:54:22.650300+0000","last_clean":"2024-09-14T11:54:22.650300+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:54:22.650300+0000","last_undegraded":"2024-09-14T11:54:22.650300+0000","last_fullsized":"2024-09-14T11:54:22.650300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:49.433106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668478+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:54:42.668478+0000","last_peered":"2024-09-14T11:54:42.668478+0000","last_clean":"2024-09-14T11:54:42.668478+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:54:42.668478+0000","last_undegraded":"2024-09-14T11:54:42.668478+0000","last_fullsized":"2024-09-14T11:54:42.668478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.627281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'11","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665597+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:54:27.665597+0000","last_peered":"2024-09-14T11:54:27.665597+0000","last_clean":"2024-09-14T11:54:27.665597+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:54:27.665597+0000","last_undegraded":"2024-09-14T11:54:27.665597+0000","last_fullsized":"2024-09-14T11:54:27.665597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.725661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":9238,"num_write":21,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.530112+0000","last_change":"2024-09-14T11:15:22.377316+0000","last_active":"2024-09-14T11:54:22.530112+0000","last_peered":"2024-09-14T11:54:22.530112+0000","last_clean":"2024-09-14T11:54:22.530112+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:54:22.530112+0000","last_undegraded":"2024-09-14T11:54:22.530112+0000","last_fullsized":"2024-09-14T11:54:22.530112+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:25.594786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668371+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:54:42.668371+0000","last_peered":"2024-09-14T11:54:42.668371+0000","last_clean":"2024-09-14T11:54:42.668371+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:54:42.668371+0000","last_undegraded":"2024-09-14T11:54:42.668371+0000","last_fullsized":"2024-09-14T11:54:42.668371+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:37.210143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.650977+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:54:27.650977+0000","last_peered":"2024-09-14T11:54:27.650977+0000","last_clean":"2024-09-14T11:54:27.650977+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:54:27.650977+0000","last_undegraded":"2024-09-14T11:54:27.650977+0000","last_fullsized":"2024-09-14T11:54:27.650977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:47.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652877+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:54:42.652877+0000","last_peered":"2024-09-14T11:54:42.652877+0000","last_clean":"2024-09-14T11:54:42.652877+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:54:42.652877+0000","last_undegraded":"2024-09-14T11:54:42.652877+0000","last_fullsized":"2024-09-14T11:54:42.652877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:12.740126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.434370+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:56:47.434370+0000","last_peered":"2024-09-14T11:56:47.434370+0000","last_clean":"2024-09-14T11:56:47.434370+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:56:47.434370+0000","last_undegraded":"2024-09-14T11:56:47.434370+0000","last_fullsized":"2024-09-14T11:56:47.434370+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":9236,"num_write":12,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.557512+0000","last_change":"2024-09-14T11:15:22.380025+0000","last_active":"2024-09-14T11:55:53.557512+0000","last_peered":"2024-09-14T11:55:53.557512+0000","last_clean":"2024-09-14T11:55:53.557512+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:55:53.557512+0000","last_undegraded":"2024-09-14T11:55:53.557512+0000","last_fullsized":"2024-09-14T11:55:53.557512+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:46.350891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678034+0000","last_change":"2024-09-14T11:12:39.148220+0000","last_active":"2024-09-14T11:55:58.678034+0000","last_peered":"2024-09-14T11:55:58.678034+0000","last_clean":"2024-09-14T11:55:58.678034+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:55:58.678034+0000","last_undegraded":"2024-09-14T11:55:58.678034+0000","last_fullsized":"2024-09-14T11:55:58.678034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:39.515999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672229+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:55:07.672229+0000","last_peered":"2024-09-14T11:55:07.672229+0000","last_clean":"2024-09-14T11:55:07.672229+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:55:07.672229+0000","last_undegraded":"2024-09-14T11:55:07.672229+0000","last_fullsized":"2024-09-14T11:55:07.672229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:49.122371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656337+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:55:07.656337+0000","last_peered":"2024-09-14T11:55:07.656337+0000","last_clean":"2024-09-14T11:55:07.656337+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:55:07.656337+0000","last_undegraded":"2024-09-14T11:55:07.656337+0000","last_fullsized":"2024-09-14T11:55:07.656337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436876+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:57:02.436876+0000","last_peered":"2024-09-14T11:57:02.436876+0000","last_clean":"2024-09-14T11:57:02.436876+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:57:02.436876+0000","last_undegraded":"2024-09-14T11:57:02.436876+0000","last_fullsized":"2024-09-14T11:57:02.436876+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:13.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663286+0000","last_change":"2024-09-14T11:12:39.156458+0000","last_active":"2024-09-14T11:56:02.663286+0000","last_peered":"2024-09-14T11:56:02.663286+0000","last_clean":"2024-09-14T11:56:02.663286+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:56:02.663286+0000","last_undegraded":"2024-09-14T11:56:02.663286+0000","last_fullsized":"2024-09-14T11:56:02.663286+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:31.776422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.549256+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:55:07.549256+0000","last_peered":"2024-09-14T11:55:07.549256+0000","last_clean":"2024-09-14T11:55:07.549256+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:55:07.549256+0000","last_undegraded":"2024-09-14T11:55:07.549256+0000","last_fullsized":"2024-09-14T11:55:07.549256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:29.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655633+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:55:02.655633+0000","last_peered":"2024-09-14T11:55:02.655633+0000","last_clean":"2024-09-14T11:55:02.655633+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:55:02.655633+0000","last_undegraded":"2024-09-14T11:55:02.655633+0000","last_fullsized":"2024-09-14T11:55:02.655633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:50.686182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.734284+0000","last_change":"2024-09-14T11:15:22.372158+0000","last_active":"2024-09-14T11:55:02.734284+0000","last_peered":"2024-09-14T11:55:02.734284+0000","last_clean":"2024-09-14T11:55:02.734284+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:55:02.734284+0000","last_undegraded":"2024-09-14T11:55:02.734284+0000","last_fullsized":"2024-09-14T11:55:02.734284+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.110739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678107+0000","last_change":"2024-09-14T11:12:39.150717+0000","last_active":"2024-09-14T11:55:58.678107+0000","last_peered":"2024-09-14T11:55:58.678107+0000","last_clean":"2024-09-14T11:55:58.678107+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:55:58.678107+0000","last_undegraded":"2024-09-14T11:55:58.678107+0000","last_fullsized":"2024-09-14T11:55:58.678107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:45.689240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665743+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:54:27.665743+0000","last_peered":"2024-09-14T11:54:27.665743+0000","last_clean":"2024-09-14T11:54:27.665743+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:54:27.665743+0000","last_undegraded":"2024-09-14T11:54:27.665743+0000","last_fullsized":"2024-09-14T11:54:27.665743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:26.826579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.542574+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:54:22.542574+0000","last_peered":"2024-09-14T11:54:22.542574+0000","last_clean":"2024-09-14T11:54:22.542574+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:54:22.542574+0000","last_undegraded":"2024-09-14T11:54:22.542574+0000","last_fullsized":"2024-09-14T11:54:22.542574+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665689+0000","last_change":"2024-09-14T11:12:39.152381+0000","last_active":"2024-09-14T11:54:27.665689+0000","last_peered":"2024-09-14T11:54:27.665689+0000","last_clean":"2024-09-14T11:54:27.665689+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:54:27.665689+0000","last_undegraded":"2024-09-14T11:54:27.665689+0000","last_fullsized":"2024-09-14T11:54:27.665689+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:49.106166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550583+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:55:08.550583+0000","last_peered":"2024-09-14T11:55:08.550583+0000","last_clean":"2024-09-14T11:55:08.550583+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:55:08.550583+0000","last_undegraded":"2024-09-14T11:55:08.550583+0000","last_fullsized":"2024-09-14T11:55:08.550583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:30.888765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544802+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:54:28.544802+0000","last_peered":"2024-09-14T11:54:28.544802+0000","last_clean":"2024-09-14T11:54:28.544802+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:54:28.544802+0000","last_undegraded":"2024-09-14T11:54:28.544802+0000","last_fullsized":"2024-09-14T11:54:28.544802+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.330595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.432156+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:56:32.432156+0000","last_peered":"2024-09-14T11:56:32.432156+0000","last_clean":"2024-09-14T11:56:32.432156+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:56:32.432156+0000","last_undegraded":"2024-09-14T11:56:32.432156+0000","last_fullsized":"2024-09-14T11:56:32.432156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.438324+0000","last_change":"2024-09-14T11:12:39.147602+0000","last_active":"2024-09-14T11:56:27.438324+0000","last_peered":"2024-09-14T11:56:27.438324+0000","last_clean":"2024-09-14T11:56:27.438324+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:56:27.438324+0000","last_undegraded":"2024-09-14T11:56:27.438324+0000","last_fullsized":"2024-09-14T11:56:27.438324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:46.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.742512+0000","last_change":"2024-09-14T11:32:11.429687+0000","last_active":"2024-09-14T11:56:02.742512+0000","last_peered":"2024-09-14T11:56:02.742512+0000","last_clean":"2024-09-14T11:56:02.742512+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:56:02.742512+0000","last_undegraded":"2024-09-14T11:56:02.742512+0000","last_fullsized":"2024-09-14T11:56:02.742512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:04.011582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443285+0000","last_change":"2024-09-14T11:15:25.393792+0000","last_active":"2024-09-14T11:57:07.443285+0000","last_peered":"2024-09-14T11:57:07.443285+0000","last_clean":"2024-09-14T11:57:07.443285+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:57:07.443285+0000","last_undegraded":"2024-09-14T11:57:07.443285+0000","last_fullsized":"2024-09-14T11:57:07.443285+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:55.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16376,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.441510+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:57:32.441510+0000","last_peered":"2024-09-14T11:57:32.441510+0000","last_clean":"2024-09-14T11:57:32.441510+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:57:32.441510+0000","last_undegraded":"2024-09-14T11:57:32.441510+0000","last_fullsized":"2024-09-14T11:57:32.441510+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7164,"num_write":11,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:37.553896+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:55:37.553896+0000","last_peered":"2024-09-14T11:55:37.553896+0000","last_clean":"2024-09-14T11:55:37.553896+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:55:37.553896+0000","last_undegraded":"2024-09-14T11:55:37.553896+0000","last_fullsized":"2024-09-14T11:55:37.553896+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12313,"num_write":19,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670674+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:54:57.670674+0000","last_peered":"2024-09-14T11:54:57.670674+0000","last_clean":"2024-09-14T11:54:57.670674+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:54:57.670674+0000","last_undegraded":"2024-09-14T11:54:57.670674+0000","last_fullsized":"2024-09-14T11:54:57.670674+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.148504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.437717+0000","last_change":"2024-09-14T11:12:39.147615+0000","last_active":"2024-09-14T11:56:23.437717+0000","last_peered":"2024-09-14T11:56:23.437717+0000","last_clean":"2024-09-14T11:56:23.437717+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:56:23.437717+0000","last_undegraded":"2024-09-14T11:56:23.437717+0000","last_fullsized":"2024-09-14T11:56:23.437717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:19.785409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656302+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:55:07.656302+0000","last_peered":"2024-09-14T11:55:07.656302+0000","last_clean":"2024-09-14T11:55:07.656302+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:55:07.656302+0000","last_undegraded":"2024-09-14T11:55:07.656302+0000","last_fullsized":"2024-09-14T11:55:07.656302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:40.123052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669707+0000","last_change":"2024-09-14T11:15:25.396627+0000","last_active":"2024-09-14T11:55:03.669707+0000","last_peered":"2024-09-14T11:55:03.669707+0000","last_clean":"2024-09-14T11:55:03.669707+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:55:03.669707+0000","last_undegraded":"2024-09-14T11:55:03.669707+0000","last_fullsized":"2024-09-14T11:55:03.669707+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:23.471334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534143+0000","last_change":"2024-09-14T11:15:22.378471+0000","last_active":"2024-09-14T11:54:57.534143+0000","last_peered":"2024-09-14T11:54:57.534143+0000","last_clean":"2024-09-14T11:54:57.534143+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:54:57.534143+0000","last_undegraded":"2024-09-14T11:54:57.534143+0000","last_fullsized":"2024-09-14T11:54:57.534143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:11.906269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681832+0000","last_change":"2024-09-14T11:12:39.142992+0000","last_active":"2024-09-14T11:56:23.681832+0000","last_peered":"2024-09-14T11:56:23.681832+0000","last_clean":"2024-09-14T11:56:23.681832+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:56:23.681832+0000","last_undegraded":"2024-09-14T11:56:23.681832+0000","last_fullsized":"2024-09-14T11:56:23.681832+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.230213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672320+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:55:07.672320+0000","last_peered":"2024-09-14T11:55:07.672320+0000","last_clean":"2024-09-14T11:55:07.672320+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:55:07.672320+0000","last_undegraded":"2024-09-14T11:55:07.672320+0000","last_fullsized":"2024-09-14T11:55:07.672320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:44.097739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549751+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:55:03.549751+0000","last_peered":"2024-09-14T11:55:03.549751+0000","last_clean":"2024-09-14T11:55:03.549751+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:55:03.549751+0000","last_undegraded":"2024-09-14T11:55:03.549751+0000","last_fullsized":"2024-09-14T11:55:03.549751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669044+0000","last_change":"2024-09-14T11:15:22.376114+0000","last_active":"2024-09-14T11:54:58.669044+0000","last_peered":"2024-09-14T11:54:58.669044+0000","last_clean":"2024-09-14T11:54:58.669044+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:54:58.669044+0000","last_undegraded":"2024-09-14T11:54:58.669044+0000","last_fullsized":"2024-09-14T11:54:58.669044+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:22.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.668992+0000","last_change":"2024-09-14T11:12:39.149756+0000","last_active":"2024-09-14T11:54:47.668992+0000","last_peered":"2024-09-14T11:54:47.668992+0000","last_clean":"2024-09-14T11:54:47.668992+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:54:47.668992+0000","last_undegraded":"2024-09-14T11:54:47.668992+0000","last_fullsized":"2024-09-14T11:54:47.668992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:07.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'314","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400780+0000","last_change":"2024-09-14T10:56:39.693906+0000","last_active":"2024-09-14T11:58:37.400780+0000","last_peered":"2024-09-14T11:58:37.400780+0000","last_clean":"2024-09-14T11:58:37.400780+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:58:37.400780+0000","last_undegraded":"2024-09-14T11:58:37.400780+0000","last_fullsized":"2024-09-14T11:58:37.400780+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:28.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9490061,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":574,"num_read_kb":9138,"num_write":1077,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'440","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.264788+0000","last_change":"2024-09-14T10:56:41.690207+0000","last_active":"2024-09-14T11:55:58.264788+0000","last_peered":"2024-09-14T11:55:58.264788+0000","last_clean":"2024-09-14T11:55:58.264788+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:55:58.264788+0000","last_undegraded":"2024-09-14T11:55:58.264788+0000","last_fullsized":"2024-09-14T11:55:58.264788+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:16.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'306","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.354229+0000","last_change":"2024-09-14T10:56:39.680660+0000","last_active":"2024-09-14T11:58:37.354229+0000","last_peered":"2024-09-14T11:58:37.354229+0000","last_clean":"2024-09-14T11:58:37.354229+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:37.354229+0000","last_undegraded":"2024-09-14T11:58:37.354229+0000","last_fullsized":"2024-09-14T11:58:37.354229+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:39.615498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9815057,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":571,"num_read_kb":47838,"num_write":1145,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'490","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460547+0000","last_change":"2024-09-14T10:56:41.699684+0000","last_active":"2024-09-14T11:56:10.460547+0000","last_peered":"2024-09-14T11:56:10.460547+0000","last_clean":"2024-09-14T11:56:10.460547+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:56:10.460547+0000","last_undegraded":"2024-09-14T11:56:10.460547+0000","last_fullsized":"2024-09-14T11:56:10.460547+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'364","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415833+0000","last_change":"2024-09-14T10:56:39.673016+0000","last_active":"2024-09-14T11:58:37.415833+0000","last_peered":"2024-09-14T11:58:37.415833+0000","last_clean":"2024-09-14T11:58:37.415833+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:37.415833+0000","last_undegraded":"2024-09-14T11:58:37.415833+0000","last_fullsized":"2024-09-14T11:58:37.415833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:56.452286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10971206,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":789,"num_read_kb":44180,"num_write":1229,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'371","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337410+0000","last_change":"2024-09-14T10:56:41.694979+0000","last_active":"2024-09-14T11:56:18.337410+0000","last_peered":"2024-09-14T11:56:18.337410+0000","last_clean":"2024-09-14T11:56:18.337410+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:56:18.337410+0000","last_undegraded":"2024-09-14T11:56:18.337410+0000","last_fullsized":"2024-09-14T11:56:18.337410+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:14.514694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'436","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.539746+0000","last_change":"2024-09-14T10:56:39.693767+0000","last_active":"2024-09-14T11:58:37.539746+0000","last_peered":"2024-09-14T11:58:37.539746+0000","last_clean":"2024-09-14T11:58:37.539746+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:37.539746+0000","last_undegraded":"2024-09-14T11:58:37.539746+0000","last_fullsized":"2024-09-14T11:58:37.539746+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:57.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17561900,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":946,"num_read_kb":27790,"num_write":1275,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1224","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266363+0000","last_change":"2024-09-14T10:56:41.698071+0000","last_active":"2024-09-14T11:55:58.266363+0000","last_peered":"2024-09-14T11:55:58.266363+0000","last_clean":"2024-09-14T11:55:58.266363+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:55:58.266363+0000","last_undegraded":"2024-09-14T11:55:58.266363+0000","last_fullsized":"2024-09-14T11:55:58.266363+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:18.150057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'307","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.378471+0000","last_change":"2024-09-14T10:56:39.695001+0000","last_active":"2024-09-14T11:58:37.378471+0000","last_peered":"2024-09-14T11:58:37.378471+0000","last_clean":"2024-09-14T11:58:37.378471+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:37.378471+0000","last_undegraded":"2024-09-14T11:58:37.378471+0000","last_fullsized":"2024-09-14T11:58:37.378471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.100648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8382083,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":505,"num_read_kb":13771,"num_write":1043,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'575","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266908+0000","last_change":"2024-09-14T10:56:41.688774+0000","last_active":"2024-09-14T11:55:58.266908+0000","last_peered":"2024-09-14T11:55:58.266908+0000","last_clean":"2024-09-14T11:55:58.266908+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:55:58.266908+0000","last_undegraded":"2024-09-14T11:55:58.266908+0000","last_fullsized":"2024-09-14T11:55:58.266908+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:12.204837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'299","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.546748+0000","last_change":"2024-09-14T10:56:39.687131+0000","last_active":"2024-09-14T11:58:37.546748+0000","last_peered":"2024-09-14T11:58:37.546748+0000","last_clean":"2024-09-14T11:58:37.546748+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:37.546748+0000","last_undegraded":"2024-09-14T11:58:37.546748+0000","last_fullsized":"2024-09-14T11:58:37.546748+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:02.638600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5187176,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":460,"num_read_kb":13548,"num_write":1046,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'833","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313416+0000","last_change":"2024-09-14T10:56:41.692162+0000","last_active":"2024-09-14T11:56:49.313416+0000","last_peered":"2024-09-14T11:56:49.313416+0000","last_clean":"2024-09-14T11:56:49.313416+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:56:49.313416+0000","last_undegraded":"2024-09-14T11:56:49.313416+0000","last_fullsized":"2024-09-14T11:56:49.313416+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'284","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.342005+0000","last_change":"2024-09-14T10:56:39.695403+0000","last_active":"2024-09-14T11:58:37.342005+0000","last_peered":"2024-09-14T11:58:37.342005+0000","last_clean":"2024-09-14T11:58:37.342005+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:37.342005+0000","last_undegraded":"2024-09-14T11:58:37.342005+0000","last_fullsized":"2024-09-14T11:58:37.342005+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.933894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785474,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":588,"num_read_kb":14446,"num_write":1020,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.821254+0000","last_change":"2024-09-14T10:56:41.689448+0000","last_active":"2024-09-14T11:55:44.821254+0000","last_peered":"2024-09-14T11:55:44.821254+0000","last_clean":"2024-09-14T11:55:44.821254+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:55:44.821254+0000","last_undegraded":"2024-09-14T11:55:44.821254+0000","last_fullsized":"2024-09-14T11:55:44.821254+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:26.618232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'303","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.349668+0000","last_change":"2024-09-14T10:56:39.676967+0000","last_active":"2024-09-14T11:58:37.349668+0000","last_peered":"2024-09-14T11:58:37.349668+0000","last_clean":"2024-09-14T11:58:37.349668+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:37.349668+0000","last_undegraded":"2024-09-14T11:58:37.349668+0000","last_fullsized":"2024-09-14T11:58:37.349668+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:55.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221114,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":615,"num_read_kb":23065,"num_write":1122,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'425","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518743+0000","last_change":"2024-09-14T10:56:41.681136+0000","last_active":"2024-09-14T11:56:16.518743+0000","last_peered":"2024-09-14T11:56:16.518743+0000","last_clean":"2024-09-14T11:56:16.518743+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:56:16.518743+0000","last_undegraded":"2024-09-14T11:56:16.518743+0000","last_fullsized":"2024-09-14T11:56:16.518743+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:35.914131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'454","reported_seq":1879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447330+0000","last_change":"2024-09-14T10:56:41.695103+0000","last_active":"2024-09-14T11:57:23.447330+0000","last_peered":"2024-09-14T11:57:23.447330+0000","last_clean":"2024-09-14T11:57:23.447330+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:57:23.447330+0000","last_undegraded":"2024-09-14T11:57:23.447330+0000","last_fullsized":"2024-09-14T11:57:23.447330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:47.177973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'381","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406182+0000","last_change":"2024-09-14T10:56:39.694286+0000","last_active":"2024-09-14T11:58:37.406182+0000","last_peered":"2024-09-14T11:58:37.406182+0000","last_clean":"2024-09-14T11:58:37.406182+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:37.406182+0000","last_undegraded":"2024-09-14T11:58:37.406182+0000","last_fullsized":"2024-09-14T11:58:37.406182+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:43.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6514601,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":884,"num_read_kb":12852,"num_write":1544,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'532","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.516606+0000","last_change":"2024-09-14T10:56:41.700369+0000","last_active":"2024-09-14T11:56:16.516606+0000","last_peered":"2024-09-14T11:56:16.516606+0000","last_clean":"2024-09-14T11:56:16.516606+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:56:16.516606+0000","last_undegraded":"2024-09-14T11:56:16.516606+0000","last_fullsized":"2024-09-14T11:56:16.516606+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.164622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'269","reported_seq":871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:31.734362+0000","last_change":"2024-09-14T10:56:39.681268+0000","last_active":"2024-09-14T11:55:31.734362+0000","last_peered":"2024-09-14T11:55:31.734362+0000","last_clean":"2024-09-14T11:55:31.734362+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:55:31.734362+0000","last_undegraded":"2024-09-14T11:55:31.734362+0000","last_fullsized":"2024-09-14T11:55:31.734362+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:31.116262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11117588,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":445,"num_read_kb":13589,"num_write":953,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'636","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910117+0000","last_change":"2024-09-14T10:56:41.684245+0000","last_active":"2024-09-14T11:56:51.910117+0000","last_peered":"2024-09-14T11:56:51.910117+0000","last_clean":"2024-09-14T11:56:51.910117+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:56:51.910117+0000","last_undegraded":"2024-09-14T11:56:51.910117+0000","last_fullsized":"2024-09-14T11:56:51.910117+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:41.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'325","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.666974+0000","last_change":"2024-09-14T10:56:39.689695+0000","last_active":"2024-09-14T11:54:43.666974+0000","last_peered":"2024-09-14T11:54:43.666974+0000","last_clean":"2024-09-14T11:54:43.666974+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:54:43.666974+0000","last_undegraded":"2024-09-14T11:54:43.666974+0000","last_fullsized":"2024-09-14T11:54:43.666974+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4209397,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":648,"num_read_kb":72218,"num_write":1189,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1144","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.775492+0000","last_change":"2024-09-14T10:56:41.690350+0000","last_active":"2024-09-14T11:57:45.775492+0000","last_peered":"2024-09-14T11:57:45.775492+0000","last_clean":"2024-09-14T11:57:45.775492+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:57:45.775492+0000","last_undegraded":"2024-09-14T11:57:45.775492+0000","last_fullsized":"2024-09-14T11:57:45.775492+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:17.084325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'294","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.571392+0000","last_change":"2024-09-14T10:56:39.673331+0000","last_active":"2024-09-14T11:56:33.571392+0000","last_peered":"2024-09-14T11:56:33.571392+0000","last_clean":"2024-09-14T11:56:33.571392+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:56:33.571392+0000","last_undegraded":"2024-09-14T11:56:33.571392+0000","last_fullsized":"2024-09-14T11:56:33.571392+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:09.718190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8556368,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":593,"num_read_kb":16353,"num_write":1143,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749815+0000","last_change":"2024-09-14T10:56:41.689989+0000","last_active":"2024-09-14T11:57:07.749815+0000","last_peered":"2024-09-14T11:57:07.749815+0000","last_clean":"2024-09-14T11:57:07.749815+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:57:07.749815+0000","last_undegraded":"2024-09-14T11:57:07.749815+0000","last_fullsized":"2024-09-14T11:57:07.749815+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:27.009017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'283","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.395153+0000","last_change":"2024-09-14T10:56:39.685439+0000","last_active":"2024-09-14T11:58:37.395153+0000","last_peered":"2024-09-14T11:58:37.395153+0000","last_clean":"2024-09-14T11:58:37.395153+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:37.395153+0000","last_undegraded":"2024-09-14T11:58:37.395153+0000","last_fullsized":"2024-09-14T11:58:37.395153+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4940556,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":506,"num_read_kb":6224,"num_write":1004,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'757","reported_seq":2336,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.905582+0000","last_change":"2024-09-14T10:56:41.699633+0000","last_active":"2024-09-14T11:58:09.905582+0000","last_peered":"2024-09-14T11:58:09.905582+0000","last_clean":"2024-09-14T11:58:09.905582+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:58:09.905582+0000","last_undegraded":"2024-09-14T11:58:09.905582+0000","last_fullsized":"2024-09-14T11:58:09.905582+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.536330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'325","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338061+0000","last_change":"2024-09-14T10:56:39.686616+0000","last_active":"2024-09-14T11:58:37.338061+0000","last_peered":"2024-09-14T11:58:37.338061+0000","last_clean":"2024-09-14T11:58:37.338061+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:37.338061+0000","last_undegraded":"2024-09-14T11:58:37.338061+0000","last_fullsized":"2024-09-14T11:58:37.338061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.022385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1258263,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":612,"num_read_kb":11097,"num_write":1124,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'102","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.924904+0000","last_change":"2024-09-14T10:56:49.738494+0000","last_active":"2024-09-14T11:56:52.924904+0000","last_peered":"2024-09-14T11:56:52.924904+0000","last_clean":"2024-09-14T11:56:52.924904+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:56:52.924904+0000","last_undegraded":"2024-09-14T11:56:52.924904+0000","last_fullsized":"2024-09-14T11:56:52.924904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:00.728999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'435","reported_seq":2152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.887571+0000","last_change":"2024-09-14T10:56:41.692358+0000","last_active":"2024-09-14T11:58:09.887571+0000","last_peered":"2024-09-14T11:58:09.887571+0000","last_clean":"2024-09-14T11:58:09.887571+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:09.887571+0000","last_undegraded":"2024-09-14T11:58:09.887571+0000","last_fullsized":"2024-09-14T11:58:09.887571+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:23.909831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'313","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.260682+0000","last_change":"2024-09-14T10:56:39.690334+0000","last_active":"2024-09-14T11:58:37.260682+0000","last_peered":"2024-09-14T11:58:37.260682+0000","last_clean":"2024-09-14T11:58:37.260682+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:37.260682+0000","last_undegraded":"2024-09-14T11:58:37.260682+0000","last_fullsized":"2024-09-14T11:58:37.260682+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:01.620284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8705643,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":659,"num_read_kb":79858,"num_write":1085,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546248+0000","last_change":"2024-09-14T10:56:43.703574+0000","last_active":"2024-09-14T11:54:47.546248+0000","last_peered":"2024-09-14T11:54:47.546248+0000","last_clean":"2024-09-14T11:54:47.546248+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:54:47.546248+0000","last_undegraded":"2024-09-14T11:54:47.546248+0000","last_fullsized":"2024-09-14T11:54:47.546248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:13.211833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'334","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.292696+0000","last_change":"2024-09-14T10:56:45.717205+0000","last_active":"2024-09-14T11:58:11.292696+0000","last_peered":"2024-09-14T11:58:11.292696+0000","last_clean":"2024-09-14T11:58:11.292696+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:58:11.292696+0000","last_undegraded":"2024-09-14T11:58:11.292696+0000","last_fullsized":"2024-09-14T11:58:11.292696+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:15.199061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54475,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1053,"num_write":424,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669188+0000","last_change":"2024-09-14T10:56:47.732016+0000","last_active":"2024-09-14T11:54:47.669188+0000","last_peered":"2024-09-14T11:54:47.669188+0000","last_clean":"2024-09-14T11:54:47.669188+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:54:47.669188+0000","last_undegraded":"2024-09-14T11:54:47.669188+0000","last_fullsized":"2024-09-14T11:54:47.669188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:03.581653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2511","reported_seq":4330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.571152+0000","last_change":"2024-09-14T10:56:49.748541+0000","last_active":"2024-09-14T11:57:32.571152+0000","last_peered":"2024-09-14T11:57:32.571152+0000","last_clean":"2024-09-14T11:57:32.571152+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:57:32.571152+0000","last_undegraded":"2024-09-14T11:57:32.571152+0000","last_fullsized":"2024-09-14T11:57:32.571152+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.702024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1504","reported_seq":3164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.567258+0000","last_change":"2024-09-14T10:56:41.690515+0000","last_active":"2024-09-14T11:57:07.567258+0000","last_peered":"2024-09-14T11:57:07.567258+0000","last_clean":"2024-09-14T11:57:07.567258+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:57:07.567258+0000","last_undegraded":"2024-09-14T11:57:07.567258+0000","last_fullsized":"2024-09-14T11:57:07.567258+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:30.187152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'304","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.396571+0000","last_change":"2024-09-14T10:56:39.693720+0000","last_active":"2024-09-14T11:58:37.396571+0000","last_peered":"2024-09-14T11:58:37.396571+0000","last_clean":"2024-09-14T11:58:37.396571+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:37.396571+0000","last_undegraded":"2024-09-14T11:58:37.396571+0000","last_fullsized":"2024-09-14T11:58:37.396571+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:54.885183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2381958,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":536,"num_read_kb":7352,"num_write":1078,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.658029+0000","last_change":"2024-09-14T10:56:43.698968+0000","last_active":"2024-09-14T11:55:17.658029+0000","last_peered":"2024-09-14T11:55:17.658029+0000","last_clean":"2024-09-14T11:55:17.658029+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:55:17.658029+0000","last_undegraded":"2024-09-14T11:55:17.658029+0000","last_fullsized":"2024-09-14T11:55:17.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.047693+0000","last_change":"2024-09-14T10:56:45.722700+0000","last_active":"2024-09-14T11:57:19.047693+0000","last_peered":"2024-09-14T11:57:19.047693+0000","last_clean":"2024-09-14T11:57:19.047693+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:57:19.047693+0000","last_undegraded":"2024-09-14T11:57:19.047693+0000","last_fullsized":"2024-09-14T11:57:19.047693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:14.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.547649+0000","last_change":"2024-09-14T10:56:47.736072+0000","last_active":"2024-09-14T11:54:48.547649+0000","last_peered":"2024-09-14T11:54:48.547649+0000","last_clean":"2024-09-14T11:54:48.547649+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:54:48.547649+0000","last_undegraded":"2024-09-14T11:54:48.547649+0000","last_fullsized":"2024-09-14T11:54:48.547649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:39.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723799+0000","last_change":"2024-09-14T10:56:49.750882+0000","last_active":"2024-09-14T11:58:09.723799+0000","last_peered":"2024-09-14T11:58:09.723799+0000","last_clean":"2024-09-14T11:58:09.723799+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:58:09.723799+0000","last_undegraded":"2024-09-14T11:58:09.723799+0000","last_fullsized":"2024-09-14T11:58:09.723799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:22.830554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'632","reported_seq":2376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.885005+0000","last_change":"2024-09-14T10:56:41.694089+0000","last_active":"2024-09-14T11:58:09.885005+0000","last_peered":"2024-09-14T11:58:09.885005+0000","last_clean":"2024-09-14T11:58:09.885005+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:09.885005+0000","last_undegraded":"2024-09-14T11:58:09.885005+0000","last_fullsized":"2024-09-14T11:58:09.885005+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:57.336561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'319","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426043+0000","last_change":"2024-09-14T10:56:39.694928+0000","last_active":"2024-09-14T11:58:37.426043+0000","last_peered":"2024-09-14T11:58:37.426043+0000","last_clean":"2024-09-14T11:58:37.426043+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:37.426043+0000","last_undegraded":"2024-09-14T11:58:37.426043+0000","last_fullsized":"2024-09-14T11:58:37.426043+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:30.362849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11713341,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":563,"num_read_kb":77740,"num_write":1107,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653968+0000","last_change":"2024-09-14T10:56:43.701731+0000","last_active":"2024-09-14T11:54:47.653968+0000","last_peered":"2024-09-14T11:54:47.653968+0000","last_clean":"2024-09-14T11:54:47.653968+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:54:47.653968+0000","last_undegraded":"2024-09-14T11:54:47.653968+0000","last_fullsized":"2024-09-14T11:54:47.653968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:01.110895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'139","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.089458+0000","last_change":"2024-09-14T10:56:45.721500+0000","last_active":"2024-09-14T11:57:19.089458+0000","last_peered":"2024-09-14T11:57:19.089458+0000","last_clean":"2024-09-14T11:57:19.089458+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:57:19.089458+0000","last_undegraded":"2024-09-14T11:57:19.089458+0000","last_fullsized":"2024-09-14T11:57:19.089458+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.327884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'773","reported_seq":4514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.588783+0000","last_change":"2024-09-14T10:56:47.731166+0000","last_active":"2024-09-14T11:58:36.588783+0000","last_peered":"2024-09-14T11:58:36.588783+0000","last_clean":"2024-09-14T11:58:36.588783+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:58:36.588783+0000","last_undegraded":"2024-09-14T11:58:36.588783+0000","last_fullsized":"2024-09-14T11:58:36.588783+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'210","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442305+0000","last_change":"2024-09-14T10:56:49.740657+0000","last_active":"2024-09-14T11:56:53.442305+0000","last_peered":"2024-09-14T11:56:53.442305+0000","last_clean":"2024-09-14T11:56:53.442305+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:56:53.442305+0000","last_undegraded":"2024-09-14T11:56:53.442305+0000","last_fullsized":"2024-09-14T11:56:53.442305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:29.712729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'435","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460767+0000","last_change":"2024-09-14T10:56:41.695277+0000","last_active":"2024-09-14T11:56:10.460767+0000","last_peered":"2024-09-14T11:56:10.460767+0000","last_clean":"2024-09-14T11:56:10.460767+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:56:10.460767+0000","last_undegraded":"2024-09-14T11:56:10.460767+0000","last_fullsized":"2024-09-14T11:56:10.460767+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.480333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'260","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669602+0000","last_change":"2024-09-14T10:56:39.686745+0000","last_active":"2024-09-14T11:55:03.669602+0000","last_peered":"2024-09-14T11:55:03.669602+0000","last_clean":"2024-09-14T11:55:03.669602+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:55:03.669602+0000","last_undegraded":"2024-09-14T11:55:03.669602+0000","last_fullsized":"2024-09-14T11:55:03.669602+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:17.862362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4895168,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":455,"num_read_kb":94665,"num_write":911,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546276+0000","last_change":"2024-09-14T10:56:43.702583+0000","last_active":"2024-09-14T11:54:47.546276+0000","last_peered":"2024-09-14T11:54:47.546276+0000","last_clean":"2024-09-14T11:54:47.546276+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:54:47.546276+0000","last_undegraded":"2024-09-14T11:54:47.546276+0000","last_fullsized":"2024-09-14T11:54:47.546276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:02.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'269","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.285054+0000","last_change":"2024-09-14T10:56:45.717333+0000","last_active":"2024-09-14T11:58:11.285054+0000","last_peered":"2024-09-14T11:58:11.285054+0000","last_clean":"2024-09-14T11:58:11.285054+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:58:11.285054+0000","last_undegraded":"2024-09-14T11:58:11.285054+0000","last_fullsized":"2024-09-14T11:58:11.285054+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:45.182188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53009,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":925,"num_write":352,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'809","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594992+0000","last_change":"2024-09-14T10:56:47.734484+0000","last_active":"2024-09-14T11:58:36.594992+0000","last_peered":"2024-09-14T11:58:36.594992+0000","last_clean":"2024-09-14T11:58:36.594992+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:58:36.594992+0000","last_undegraded":"2024-09-14T11:58:36.594992+0000","last_fullsized":"2024-09-14T11:58:36.594992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'658","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.883179+0000","last_change":"2024-09-14T10:56:41.690375+0000","last_active":"2024-09-14T11:58:09.883179+0000","last_peered":"2024-09-14T11:58:09.883179+0000","last_clean":"2024-09-14T11:58:09.883179+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:09.883179+0000","last_undegraded":"2024-09-14T11:58:09.883179+0000","last_fullsized":"2024-09-14T11:58:09.883179+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.339603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.379692+0000","last_change":"2024-09-14T10:56:39.698021+0000","last_active":"2024-09-14T11:58:37.379692+0000","last_peered":"2024-09-14T11:58:37.379692+0000","last_clean":"2024-09-14T11:58:37.379692+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:37.379692+0000","last_undegraded":"2024-09-14T11:58:37.379692+0000","last_fullsized":"2024-09-14T11:58:37.379692+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:46.013676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4894756,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":496,"num_read_kb":17523,"num_write":982,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.674155+0000","last_change":"2024-09-14T10:56:43.698774+0000","last_active":"2024-09-14T11:55:17.674155+0000","last_peered":"2024-09-14T11:55:17.674155+0000","last_clean":"2024-09-14T11:55:17.674155+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:55:17.674155+0000","last_undegraded":"2024-09-14T11:55:17.674155+0000","last_fullsized":"2024-09-14T11:55:17.674155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:15.883668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'408","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.297485+0000","last_change":"2024-09-14T10:56:45.715379+0000","last_active":"2024-09-14T11:58:11.297485+0000","last_peered":"2024-09-14T11:58:11.297485+0000","last_clean":"2024-09-14T11:58:11.297485+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:58:11.297485+0000","last_undegraded":"2024-09-14T11:58:11.297485+0000","last_fullsized":"2024-09-14T11:58:11.297485+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:11.970010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":1307,"num_write":536,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536831+0000","last_change":"2024-09-14T10:56:47.727987+0000","last_active":"2024-09-14T11:55:17.536831+0000","last_peered":"2024-09-14T11:55:17.536831+0000","last_clean":"2024-09-14T11:55:17.536831+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:55:17.536831+0000","last_undegraded":"2024-09-14T11:55:17.536831+0000","last_fullsized":"2024-09-14T11:55:17.536831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:35.450777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'581","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311916+0000","last_change":"2024-09-14T10:56:49.748529+0000","last_active":"2024-09-14T11:58:11.311916+0000","last_peered":"2024-09-14T11:58:11.311916+0000","last_clean":"2024-09-14T11:58:11.311916+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:58:11.311916+0000","last_undegraded":"2024-09-14T11:58:11.311916+0000","last_fullsized":"2024-09-14T11:58:11.311916+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.226410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'450","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909742+0000","last_change":"2024-09-14T10:56:41.699591+0000","last_active":"2024-09-14T11:56:51.909742+0000","last_peered":"2024-09-14T11:56:51.909742+0000","last_clean":"2024-09-14T11:56:51.909742+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:56:51.909742+0000","last_undegraded":"2024-09-14T11:56:51.909742+0000","last_fullsized":"2024-09-14T11:56:51.909742+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:55.170546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406033+0000","last_change":"2024-09-14T10:56:39.691536+0000","last_active":"2024-09-14T11:58:37.406033+0000","last_peered":"2024-09-14T11:58:37.406033+0000","last_clean":"2024-09-14T11:58:37.406033+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:37.406033+0000","last_undegraded":"2024-09-14T11:58:37.406033+0000","last_fullsized":"2024-09-14T11:58:37.406033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:03.544842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459283,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":60976,"num_write":1158,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.155670+0000","last_change":"2024-09-14T10:56:43.702569+0000","last_active":"2024-09-14T11:58:36.155670+0000","last_peered":"2024-09-14T11:58:36.155670+0000","last_clean":"2024-09-14T11:58:36.155670+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:36.155670+0000","last_undegraded":"2024-09-14T11:58:36.155670+0000","last_fullsized":"2024-09-14T11:58:36.155670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'279","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.138032+0000","last_change":"2024-09-14T10:56:45.717223+0000","last_active":"2024-09-14T11:58:37.138032+0000","last_peered":"2024-09-14T11:58:37.138032+0000","last_clean":"2024-09-14T11:58:37.138032+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:58:37.138032+0000","last_undegraded":"2024-09-14T11:58:37.138032+0000","last_fullsized":"2024-09-14T11:58:37.138032+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:53.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659151+0000","last_change":"2024-09-14T10:56:47.728715+0000","last_active":"2024-09-14T11:55:27.659151+0000","last_peered":"2024-09-14T11:55:27.659151+0000","last_clean":"2024-09-14T11:55:27.659151+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:55:27.659151+0000","last_undegraded":"2024-09-14T11:55:27.659151+0000","last_fullsized":"2024-09-14T11:55:27.659151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:34.862116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'110","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.691270+0000","last_change":"2024-09-14T10:56:49.740475+0000","last_active":"2024-09-14T11:57:28.691270+0000","last_peered":"2024-09-14T11:57:28.691270+0000","last_clean":"2024-09-14T11:57:28.691270+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:57:28.691270+0000","last_undegraded":"2024-09-14T11:57:28.691270+0000","last_fullsized":"2024-09-14T11:57:28.691270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:13.870392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'435","reported_seq":1865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.886202+0000","last_change":"2024-09-14T10:56:41.699032+0000","last_active":"2024-09-14T11:58:09.886202+0000","last_peered":"2024-09-14T11:58:09.886202+0000","last_clean":"2024-09-14T11:58:09.886202+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:09.886202+0000","last_undegraded":"2024-09-14T11:58:09.886202+0000","last_fullsized":"2024-09-14T11:58:09.886202+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:20.716515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'281","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.329783+0000","last_change":"2024-09-14T10:56:39.695515+0000","last_active":"2024-09-14T11:58:37.329783+0000","last_peered":"2024-09-14T11:58:37.329783+0000","last_clean":"2024-09-14T11:58:37.329783+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:37.329783+0000","last_undegraded":"2024-09-14T11:58:37.329783+0000","last_fullsized":"2024-09-14T11:58:37.329783+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:30.996747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6248327,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":477,"num_read_kb":11457,"num_write":924,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737627+0000","last_change":"2024-09-14T10:56:43.701838+0000","last_active":"2024-09-14T11:55:17.737627+0000","last_peered":"2024-09-14T11:55:17.737627+0000","last_clean":"2024-09-14T11:55:17.737627+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:55:17.737627+0000","last_undegraded":"2024-09-14T11:55:17.737627+0000","last_fullsized":"2024-09-14T11:55:17.737627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.350355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'291","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.299748+0000","last_change":"2024-09-14T10:56:45.715385+0000","last_active":"2024-09-14T11:58:11.299748+0000","last_peered":"2024-09-14T11:58:11.299748+0000","last_clean":"2024-09-14T11:58:11.299748+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:58:11.299748+0000","last_undegraded":"2024-09-14T11:58:11.299748+0000","last_fullsized":"2024-09-14T11:58:11.299748+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.655994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":941,"num_write":372,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'794","reported_seq":2923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594937+0000","last_change":"2024-09-14T10:56:47.732668+0000","last_active":"2024-09-14T11:58:36.594937+0000","last_peered":"2024-09-14T11:58:36.594937+0000","last_clean":"2024-09-14T11:58:36.594937+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:58:36.594937+0000","last_undegraded":"2024-09-14T11:58:36.594937+0000","last_fullsized":"2024-09-14T11:58:36.594937+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:36.329167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'144","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723376+0000","last_change":"2024-09-14T10:56:49.751141+0000","last_active":"2024-09-14T11:58:09.723376+0000","last_peered":"2024-09-14T11:58:09.723376+0000","last_clean":"2024-09-14T11:58:09.723376+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:58:09.723376+0000","last_undegraded":"2024-09-14T11:58:09.723376+0000","last_fullsized":"2024-09-14T11:58:09.723376+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:59.575096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'437","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.698726+0000","last_change":"2024-09-14T10:56:41.699606+0000","last_active":"2024-09-14T11:55:28.698726+0000","last_peered":"2024-09-14T11:55:28.698726+0000","last_clean":"2024-09-14T11:55:28.698726+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:55:28.698726+0000","last_undegraded":"2024-09-14T11:55:28.698726+0000","last_fullsized":"2024-09-14T11:55:28.698726+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.073985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'310","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.678526+0000","last_change":"2024-09-14T10:57:16.313659+0000","last_active":"2024-09-14T11:58:37.678526+0000","last_peered":"2024-09-14T11:58:37.678526+0000","last_clean":"2024-09-14T11:58:37.678526+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:37.678526+0000","last_undegraded":"2024-09-14T11:58:37.678526+0000","last_fullsized":"2024-09-14T11:58:37.678526+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:49.985260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6974727,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":703,"num_read_kb":20707,"num_write":1054,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.738288+0000","last_change":"2024-09-14T10:56:43.700827+0000","last_active":"2024-09-14T11:55:22.738288+0000","last_peered":"2024-09-14T11:55:22.738288+0000","last_clean":"2024-09-14T11:55:22.738288+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:55:22.738288+0000","last_undegraded":"2024-09-14T11:55:22.738288+0000","last_fullsized":"2024-09-14T11:55:22.738288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:43.830453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'489","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.365214+0000","last_change":"2024-09-14T10:56:45.716585+0000","last_active":"2024-09-14T11:58:37.365214+0000","last_peered":"2024-09-14T11:58:37.365214+0000","last_clean":"2024-09-14T11:58:37.365214+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:58:37.365214+0000","last_undegraded":"2024-09-14T11:58:37.365214+0000","last_fullsized":"2024-09-14T11:58:37.365214+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:59.261412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":837,"num_read_kb":1985,"num_write":686,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737599+0000","last_change":"2024-09-14T10:56:47.727232+0000","last_active":"2024-09-14T11:55:17.737599+0000","last_peered":"2024-09-14T11:55:17.737599+0000","last_clean":"2024-09-14T11:55:17.737599+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:55:17.737599+0000","last_undegraded":"2024-09-14T11:55:17.737599+0000","last_fullsized":"2024-09-14T11:55:17.737599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.261352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'153","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.913275+0000","last_change":"2024-09-14T10:56:49.745209+0000","last_active":"2024-09-14T11:56:52.913275+0000","last_peered":"2024-09-14T11:56:52.913275+0000","last_clean":"2024-09-14T11:56:52.913275+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:56:52.913275+0000","last_undegraded":"2024-09-14T11:56:52.913275+0000","last_fullsized":"2024-09-14T11:56:52.913275+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:00.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'485","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781154+0000","last_change":"2024-09-14T10:56:41.695419+0000","last_active":"2024-09-14T11:56:52.781154+0000","last_peered":"2024-09-14T11:56:52.781154+0000","last_clean":"2024-09-14T11:56:52.781154+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:56:52.781154+0000","last_undegraded":"2024-09-14T11:56:52.781154+0000","last_fullsized":"2024-09-14T11:56:52.781154+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:25.326798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'341","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415777+0000","last_change":"2024-09-14T10:56:39.686597+0000","last_active":"2024-09-14T11:58:37.415777+0000","last_peered":"2024-09-14T11:58:37.415777+0000","last_clean":"2024-09-14T11:58:37.415777+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:37.415777+0000","last_undegraded":"2024-09-14T11:58:37.415777+0000","last_fullsized":"2024-09-14T11:58:37.415777+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.571169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14028949,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":678,"num_read_kb":26829,"num_write":1292,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737663+0000","last_change":"2024-09-14T10:56:43.702604+0000","last_active":"2024-09-14T11:55:17.737663+0000","last_peered":"2024-09-14T11:55:17.737663+0000","last_clean":"2024-09-14T11:55:17.737663+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:55:17.737663+0000","last_undegraded":"2024-09-14T11:55:17.737663+0000","last_fullsized":"2024-09-14T11:55:17.737663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:06.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'332","reported_seq":912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:33.449064+0000","last_change":"2024-09-14T10:56:45.720877+0000","last_active":"2024-09-14T11:57:33.449064+0000","last_peered":"2024-09-14T11:57:33.449064+0000","last_clean":"2024-09-14T11:57:33.449064+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:57:33.449064+0000","last_undegraded":"2024-09-14T11:57:33.449064+0000","last_fullsized":"2024-09-14T11:57:33.449064+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:57.447381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64409,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":552,"num_read_kb":1123,"num_write":504,"num_write_kb":395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658208+0000","last_change":"2024-09-14T10:56:47.732467+0000","last_active":"2024-09-14T11:55:22.658208+0000","last_peered":"2024-09-14T11:55:22.658208+0000","last_clean":"2024-09-14T11:55:22.658208+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:55:22.658208+0000","last_undegraded":"2024-09-14T11:55:22.658208+0000","last_fullsized":"2024-09-14T11:55:22.658208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:40.009813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446796+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:07.446796+0000","last_peered":"2024-09-14T11:57:07.446796+0000","last_clean":"2024-09-14T11:57:07.446796+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:07.446796+0000","last_undegraded":"2024-09-14T11:57:07.446796+0000","last_fullsized":"2024-09-14T11:57:07.446796+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:22.648516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'765","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.878498+0000","last_change":"2024-09-14T10:56:41.694599+0000","last_active":"2024-09-14T11:58:09.878498+0000","last_peered":"2024-09-14T11:58:09.878498+0000","last_clean":"2024-09-14T11:58:09.878498+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:09.878498+0000","last_undegraded":"2024-09-14T11:58:09.878498+0000","last_fullsized":"2024-09-14T11:58:09.878498+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:34.020278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'313","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672714+0000","last_change":"2024-09-14T10:56:39.682095+0000","last_active":"2024-09-14T11:55:23.672714+0000","last_peered":"2024-09-14T11:55:23.672714+0000","last_clean":"2024-09-14T11:55:23.672714+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:55:23.672714+0000","last_undegraded":"2024-09-14T11:55:23.672714+0000","last_fullsized":"2024-09-14T11:55:23.672714+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:36.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8271384,"num_objects":90,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":604,"num_read_kb":27548,"num_write":1147,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536865+0000","last_change":"2024-09-14T10:56:43.707450+0000","last_active":"2024-09-14T11:55:17.536865+0000","last_peered":"2024-09-14T11:55:17.536865+0000","last_clean":"2024-09-14T11:55:17.536865+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:55:17.536865+0000","last_undegraded":"2024-09-14T11:55:17.536865+0000","last_fullsized":"2024-09-14T11:55:17.536865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:10.147136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'346","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.913274+0000","last_change":"2024-09-14T10:56:45.709793+0000","last_active":"2024-09-14T11:58:36.913274+0000","last_peered":"2024-09-14T11:58:36.913274+0000","last_clean":"2024-09-14T11:58:36.913274+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:36.913274+0000","last_undegraded":"2024-09-14T11:58:36.913274+0000","last_fullsized":"2024-09-14T11:58:36.913274+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:43.142877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'753","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.590126+0000","last_change":"2024-09-14T10:56:47.728010+0000","last_active":"2024-09-14T11:58:36.590126+0000","last_peered":"2024-09-14T11:58:36.590126+0000","last_clean":"2024-09-14T11:58:36.590126+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:58:36.590126+0000","last_undegraded":"2024-09-14T11:58:36.590126+0000","last_fullsized":"2024-09-14T11:58:36.590126+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:16.673244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'120","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.768184+0000","last_change":"2024-09-14T10:56:49.746163+0000","last_active":"2024-09-14T11:56:50.768184+0000","last_peered":"2024-09-14T11:56:50.768184+0000","last_clean":"2024-09-14T11:56:50.768184+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:56:50.768184+0000","last_undegraded":"2024-09-14T11:56:50.768184+0000","last_fullsized":"2024-09-14T11:56:50.768184+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:25.956197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.312517+0000","last_change":"2024-09-14T10:56:41.687409+0000","last_active":"2024-09-14T11:56:49.312517+0000","last_peered":"2024-09-14T11:56:49.312517+0000","last_clean":"2024-09-14T11:56:49.312517+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:56:49.312517+0000","last_undegraded":"2024-09-14T11:56:49.312517+0000","last_fullsized":"2024-09-14T11:56:49.312517+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:52.835617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'296","reported_seq":931,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:59.985469+0000","last_change":"2024-09-14T10:56:39.683292+0000","last_active":"2024-09-14T11:57:59.985469+0000","last_peered":"2024-09-14T11:57:59.985469+0000","last_clean":"2024-09-14T11:57:59.985469+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:57:59.985469+0000","last_undegraded":"2024-09-14T11:57:59.985469+0000","last_fullsized":"2024-09-14T11:57:59.985469+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:04.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8404935,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":490,"num_read_kb":90386,"num_write":1046,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.167037+0000","last_change":"2024-09-14T10:56:43.701046+0000","last_active":"2024-09-14T11:58:36.167037+0000","last_peered":"2024-09-14T11:58:36.167037+0000","last_clean":"2024-09-14T11:58:36.167037+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:58:36.167037+0000","last_undegraded":"2024-09-14T11:58:36.167037+0000","last_fullsized":"2024-09-14T11:58:36.167037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'92","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.017399+0000","last_change":"2024-09-14T10:56:45.713884+0000","last_active":"2024-09-14T11:57:19.017399+0000","last_peered":"2024-09-14T11:57:19.017399+0000","last_clean":"2024-09-14T11:57:19.017399+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:57:19.017399+0000","last_undegraded":"2024-09-14T11:57:19.017399+0000","last_fullsized":"2024-09-14T11:57:19.017399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:23.564660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'772","reported_seq":2397,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.398010+0000","last_change":"2024-09-14T10:56:47.728790+0000","last_active":"2024-09-14T11:58:14.398010+0000","last_peered":"2024-09-14T11:58:14.398010+0000","last_clean":"2024-09-14T11:58:14.398010+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:58:14.398010+0000","last_undegraded":"2024-09-14T11:58:14.398010+0000","last_fullsized":"2024-09-14T11:58:14.398010+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.655451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.297030+0000","last_change":"2024-09-14T10:56:49.746716+0000","last_active":"2024-09-14T11:56:49.297030+0000","last_peered":"2024-09-14T11:56:49.297030+0000","last_clean":"2024-09-14T11:56:49.297030+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:56:49.297030+0000","last_undegraded":"2024-09-14T11:56:49.297030+0000","last_fullsized":"2024-09-14T11:56:49.297030+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.164615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'788","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782702+0000","last_change":"2024-09-14T10:56:41.698077+0000","last_active":"2024-09-14T11:56:52.782702+0000","last_peered":"2024-09-14T11:56:52.782702+0000","last_clean":"2024-09-14T11:56:52.782702+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:56:52.782702+0000","last_undegraded":"2024-09-14T11:56:52.782702+0000","last_fullsized":"2024-09-14T11:56:52.782702+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.788116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'292","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415724+0000","last_change":"2024-09-14T10:57:15.795505+0000","last_active":"2024-09-14T11:58:37.415724+0000","last_peered":"2024-09-14T11:58:37.415724+0000","last_clean":"2024-09-14T11:58:37.415724+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:37.415724+0000","last_undegraded":"2024-09-14T11:58:37.415724+0000","last_fullsized":"2024-09-14T11:58:37.415724+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.548600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101310,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":502,"num_read_kb":1389,"num_write":968,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.551662+0000","last_change":"2024-09-14T10:56:43.698906+0000","last_active":"2024-09-14T11:55:13.551662+0000","last_peered":"2024-09-14T11:55:13.551662+0000","last_clean":"2024-09-14T11:55:13.551662+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:55:13.551662+0000","last_undegraded":"2024-09-14T11:55:13.551662+0000","last_fullsized":"2024-09-14T11:55:13.551662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:39.807629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'391","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.293933+0000","last_change":"2024-09-14T10:56:45.719001+0000","last_active":"2024-09-14T11:58:11.293933+0000","last_peered":"2024-09-14T11:58:11.293933+0000","last_clean":"2024-09-14T11:58:11.293933+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:58:11.293933+0000","last_undegraded":"2024-09-14T11:58:11.293933+0000","last_fullsized":"2024-09-14T11:58:11.293933+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:08.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1226,"num_read_kb":1694,"num_write":1780,"num_write_kb":1621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672095+0000","last_change":"2024-09-14T10:56:47.735876+0000","last_active":"2024-09-14T11:55:18.672095+0000","last_peered":"2024-09-14T11:55:18.672095+0000","last_clean":"2024-09-14T11:55:18.672095+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:55:18.672095+0000","last_undegraded":"2024-09-14T11:55:18.672095+0000","last_fullsized":"2024-09-14T11:55:18.672095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:40.099775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.186925+0000","last_change":"2024-09-14T10:56:49.743347+0000","last_active":"2024-09-14T11:56:50.186925+0000","last_peered":"2024-09-14T11:56:50.186925+0000","last_clean":"2024-09-14T11:56:50.186925+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:56:50.186925+0000","last_undegraded":"2024-09-14T11:56:50.186925+0000","last_fullsized":"2024-09-14T11:56:50.186925+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'647","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817022+0000","last_change":"2024-09-14T10:56:41.692220+0000","last_active":"2024-09-14T11:55:53.817022+0000","last_peered":"2024-09-14T11:55:53.817022+0000","last_clean":"2024-09-14T11:55:53.817022+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:55:53.817022+0000","last_undegraded":"2024-09-14T11:55:53.817022+0000","last_fullsized":"2024-09-14T11:55:53.817022+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:11.440656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432896+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T11:56:37.432896+0000","last_peered":"2024-09-14T11:56:37.432896+0000","last_clean":"2024-09-14T11:56:37.432896+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:56:37.432896+0000","last_undegraded":"2024-09-14T11:56:37.432896+0000","last_fullsized":"2024-09-14T11:56:37.432896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.547015+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T11:54:52.547015+0000","last_peered":"2024-09-14T11:54:52.547015+0000","last_clean":"2024-09-14T11:54:52.547015+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:54:52.547015+0000","last_undegraded":"2024-09-14T11:54:52.547015+0000","last_fullsized":"2024-09-14T11:54:52.547015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'292","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.374926+0000","last_change":"2024-09-14T10:56:39.687055+0000","last_active":"2024-09-14T11:58:37.374926+0000","last_peered":"2024-09-14T11:58:37.374926+0000","last_clean":"2024-09-14T11:58:37.374926+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:37.374926+0000","last_undegraded":"2024-09-14T11:58:37.374926+0000","last_fullsized":"2024-09-14T11:58:37.374926+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:32.344503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13986456,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":596,"num_read_kb":39228,"num_write":965,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672300+0000","last_change":"2024-09-14T10:56:43.702002+0000","last_active":"2024-09-14T11:55:07.672300+0000","last_peered":"2024-09-14T11:55:07.672300+0000","last_clean":"2024-09-14T11:55:07.672300+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:55:07.672300+0000","last_undegraded":"2024-09-14T11:55:07.672300+0000","last_fullsized":"2024-09-14T11:55:07.672300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:33.474891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'786","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.734667+0000","last_change":"2024-09-14T10:56:45.716034+0000","last_active":"2024-09-14T11:58:36.734667+0000","last_peered":"2024-09-14T11:58:36.734667+0000","last_clean":"2024-09-14T11:58:36.734667+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:58:36.734667+0000","last_undegraded":"2024-09-14T11:58:36.734667+0000","last_fullsized":"2024-09-14T11:58:36.734667+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:25.384704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183012,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1531,"num_read_kb":3433,"num_write":1486,"num_write_kb":1341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.657591+0000","last_change":"2024-09-14T10:56:47.736084+0000","last_active":"2024-09-14T11:55:17.657591+0000","last_peered":"2024-09-14T11:55:17.657591+0000","last_clean":"2024-09-14T11:55:17.657591+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:55:17.657591+0000","last_undegraded":"2024-09-14T11:55:17.657591+0000","last_fullsized":"2024-09-14T11:55:17.657591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:49.305417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.811415+0000","last_change":"2024-09-14T10:56:49.743581+0000","last_active":"2024-09-14T11:56:52.811415+0000","last_peered":"2024-09-14T11:56:52.811415+0000","last_clean":"2024-09-14T11:56:52.811415+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:56:52.811415+0000","last_undegraded":"2024-09-14T11:56:52.811415+0000","last_fullsized":"2024-09-14T11:56:52.811415+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:57.012986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337471+0000","last_change":"2024-09-14T10:56:41.699990+0000","last_active":"2024-09-14T11:56:18.337471+0000","last_peered":"2024-09-14T11:56:18.337471+0000","last_clean":"2024-09-14T11:56:18.337471+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:56:18.337471+0000","last_undegraded":"2024-09-14T11:56:18.337471+0000","last_fullsized":"2024-09-14T11:56:18.337471+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:37.126708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.667394+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T11:54:37.667394+0000","last_peered":"2024-09-14T11:54:37.667394+0000","last_clean":"2024-09-14T11:54:37.667394+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:54:37.667394+0000","last_undegraded":"2024-09-14T11:54:37.667394+0000","last_fullsized":"2024-09-14T11:54:37.667394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'252","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417184+0000","last_change":"2024-09-14T10:56:39.691928+0000","last_active":"2024-09-14T11:58:37.417184+0000","last_peered":"2024-09-14T11:58:37.417184+0000","last_clean":"2024-09-14T11:58:37.417184+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:37.417184+0000","last_undegraded":"2024-09-14T11:58:37.417184+0000","last_fullsized":"2024-09-14T11:58:37.417184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956222,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":399,"num_read_kb":19285,"num_write":828,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.551105+0000","last_change":"2024-09-14T10:56:43.701669+0000","last_active":"2024-09-14T11:55:17.551105+0000","last_peered":"2024-09-14T11:55:17.551105+0000","last_clean":"2024-09-14T11:55:17.551105+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:55:17.551105+0000","last_undegraded":"2024-09-14T11:55:17.551105+0000","last_fullsized":"2024-09-14T11:55:17.551105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:32.330161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1320","reported_seq":2995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.211084+0000","last_change":"2024-09-14T10:56:45.719919+0000","last_active":"2024-09-14T11:58:37.211084+0000","last_peered":"2024-09-14T11:58:37.211084+0000","last_clean":"2024-09-14T11:58:37.211084+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:58:37.211084+0000","last_undegraded":"2024-09-14T11:58:37.211084+0000","last_fullsized":"2024-09-14T11:58:37.211084+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:28.154269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171063,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2082,"num_read_kb":3793,"num_write":1186,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.673250+0000","last_change":"2024-09-14T10:56:47.734554+0000","last_active":"2024-09-14T11:55:12.673250+0000","last_peered":"2024-09-14T11:55:12.673250+0000","last_clean":"2024-09-14T11:55:12.673250+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:55:12.673250+0000","last_undegraded":"2024-09-14T11:55:12.673250+0000","last_fullsized":"2024-09-14T11:55:12.673250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:20.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'94","reported_seq":590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.504531+0000","last_change":"2024-09-14T10:56:49.741143+0000","last_active":"2024-09-14T11:56:16.504531+0000","last_peered":"2024-09-14T11:56:16.504531+0000","last_clean":"2024-09-14T11:56:16.504531+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:56:16.504531+0000","last_undegraded":"2024-09-14T11:56:16.504531+0000","last_fullsized":"2024-09-14T11:56:16.504531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.919275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'936","reported_seq":2803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.816582+0000","last_change":"2024-09-14T10:56:41.698132+0000","last_active":"2024-09-14T11:55:53.816582+0000","last_peered":"2024-09-14T11:55:53.816582+0000","last_clean":"2024-09-14T11:55:53.816582+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:55:53.816582+0000","last_undegraded":"2024-09-14T11:55:53.816582+0000","last_fullsized":"2024-09-14T11:55:53.816582+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.829080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.733197+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T11:54:52.733197+0000","last_peered":"2024-09-14T11:54:52.733197+0000","last_clean":"2024-09-14T11:54:52.733197+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:54:52.733197+0000","last_undegraded":"2024-09-14T11:54:52.733197+0000","last_fullsized":"2024-09-14T11:54:52.733197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'274","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.337834+0000","last_change":"2024-09-14T10:56:39.677391+0000","last_active":"2024-09-14T11:58:37.337834+0000","last_peered":"2024-09-14T11:58:37.337834+0000","last_clean":"2024-09-14T11:58:37.337834+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:37.337834+0000","last_undegraded":"2024-09-14T11:58:37.337834+0000","last_fullsized":"2024-09-14T11:58:37.337834+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.834286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5317536,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":498,"num_read_kb":14745,"num_write":946,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737709+0000","last_change":"2024-09-14T10:56:43.701856+0000","last_active":"2024-09-14T11:55:17.737709+0000","last_peered":"2024-09-14T11:55:17.737709+0000","last_clean":"2024-09-14T11:55:17.737709+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:55:17.737709+0000","last_undegraded":"2024-09-14T11:55:17.737709+0000","last_fullsized":"2024-09-14T11:55:17.737709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:25.200569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'291","reported_seq":1564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.772091+0000","last_change":"2024-09-14T10:56:45.720189+0000","last_active":"2024-09-14T11:58:06.772091+0000","last_peered":"2024-09-14T11:58:06.772091+0000","last_clean":"2024-09-14T11:58:06.772091+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:58:06.772091+0000","last_undegraded":"2024-09-14T11:58:06.772091+0000","last_fullsized":"2024-09-14T11:58:06.772091+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:21.350299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656311+0000","last_change":"2024-09-14T10:56:47.737357+0000","last_active":"2024-09-14T11:55:07.656311+0000","last_peered":"2024-09-14T11:55:07.656311+0000","last_clean":"2024-09-14T11:55:07.656311+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:55:07.656311+0000","last_undegraded":"2024-09-14T11:55:07.656311+0000","last_fullsized":"2024-09-14T11:55:07.656311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:59.652704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.061479+0000","last_change":"2024-09-14T10:56:49.741618+0000","last_active":"2024-09-14T11:56:53.061479+0000","last_peered":"2024-09-14T11:56:53.061479+0000","last_clean":"2024-09-14T11:56:53.061479+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:56:53.061479+0000","last_undegraded":"2024-09-14T11:56:53.061479+0000","last_fullsized":"2024-09-14T11:56:53.061479+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:04.982419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'530","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.908964+0000","last_change":"2024-09-14T10:56:41.691332+0000","last_active":"2024-09-14T11:56:51.908964+0000","last_peered":"2024-09-14T11:56:51.908964+0000","last_clean":"2024-09-14T11:56:51.908964+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:56:51.908964+0000","last_undegraded":"2024-09-14T11:56:51.908964+0000","last_fullsized":"2024-09-14T11:56:51.908964+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:24.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.546981+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T11:54:52.546981+0000","last_peered":"2024-09-14T11:54:52.546981+0000","last_clean":"2024-09-14T11:54:52.546981+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:54:52.546981+0000","last_undegraded":"2024-09-14T11:54:52.546981+0000","last_fullsized":"2024-09-14T11:54:52.546981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'256","reported_seq":888,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.273298+0000","last_change":"2024-09-14T10:56:39.677476+0000","last_active":"2024-09-14T11:55:43.273298+0000","last_peered":"2024-09-14T11:55:43.273298+0000","last_clean":"2024-09-14T11:55:43.273298+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:55:43.273298+0000","last_undegraded":"2024-09-14T11:55:43.273298+0000","last_fullsized":"2024-09-14T11:55:43.273298+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:50.866073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4950577,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":454,"num_read_kb":28769,"num_write":944,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656928+0000","last_change":"2024-09-14T10:56:43.703850+0000","last_active":"2024-09-14T11:55:12.656928+0000","last_peered":"2024-09-14T11:55:12.656928+0000","last_clean":"2024-09-14T11:55:12.656928+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:55:12.656928+0000","last_undegraded":"2024-09-14T11:55:12.656928+0000","last_fullsized":"2024-09-14T11:55:12.656928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.154206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'142","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.449373+0000","last_change":"2024-09-14T10:56:45.723094+0000","last_active":"2024-09-14T11:57:27.449373+0000","last_peered":"2024-09-14T11:57:27.449373+0000","last_clean":"2024-09-14T11:57:27.449373+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:57:27.449373+0000","last_undegraded":"2024-09-14T11:57:27.449373+0000","last_fullsized":"2024-09-14T11:57:27.449373+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:07.418105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672147+0000","last_change":"2024-09-14T10:56:47.735245+0000","last_active":"2024-09-14T11:55:18.672147+0000","last_peered":"2024-09-14T11:55:18.672147+0000","last_clean":"2024-09-14T11:55:18.672147+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:55:18.672147+0000","last_undegraded":"2024-09-14T11:55:18.672147+0000","last_fullsized":"2024-09-14T11:55:18.672147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:24.475897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.766817+0000","last_change":"2024-09-14T10:56:49.746061+0000","last_active":"2024-09-14T11:56:52.766817+0000","last_peered":"2024-09-14T11:56:52.766817+0000","last_clean":"2024-09-14T11:56:52.766817+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:56:52.766817+0000","last_undegraded":"2024-09-14T11:56:52.766817+0000","last_fullsized":"2024-09-14T11:56:52.766817+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:28.330851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'387","reported_seq":1839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.537862+0000","last_change":"2024-09-14T10:56:41.693401+0000","last_active":"2024-09-14T11:55:32.537862+0000","last_peered":"2024-09-14T11:55:32.537862+0000","last_clean":"2024-09-14T11:55:32.537862+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:55:32.537862+0000","last_undegraded":"2024-09-14T11:55:32.537862+0000","last_fullsized":"2024-09-14T11:55:32.537862+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:32.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'383","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417753+0000","last_change":"2024-09-14T10:56:39.690724+0000","last_active":"2024-09-14T11:58:37.417753+0000","last_peered":"2024-09-14T11:58:37.417753+0000","last_clean":"2024-09-14T11:58:37.417753+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:37.417753+0000","last_undegraded":"2024-09-14T11:58:37.417753+0000","last_fullsized":"2024-09-14T11:58:37.417753+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:30.610560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4548668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":648,"num_read_kb":3738,"num_write":1292,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.533548+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T11:54:52.533548+0000","last_peered":"2024-09-14T11:54:52.533548+0000","last_clean":"2024-09-14T11:54:52.533548+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:54:52.533548+0000","last_undegraded":"2024-09-14T11:54:52.533548+0000","last_fullsized":"2024-09-14T11:54:52.533548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656288+0000","last_change":"2024-09-14T10:56:43.700042+0000","last_active":"2024-09-14T11:55:07.656288+0000","last_peered":"2024-09-14T11:55:07.656288+0000","last_clean":"2024-09-14T11:55:07.656288+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:55:07.656288+0000","last_undegraded":"2024-09-14T11:55:07.656288+0000","last_fullsized":"2024-09-14T11:55:07.656288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:24.603692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'609","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.829544+0000","last_change":"2024-09-14T10:56:45.716237+0000","last_active":"2024-09-14T11:58:36.829544+0000","last_peered":"2024-09-14T11:58:36.829544+0000","last_clean":"2024-09-14T11:58:36.829544+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:58:36.829544+0000","last_undegraded":"2024-09-14T11:58:36.829544+0000","last_fullsized":"2024-09-14T11:58:36.829544+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:41.293686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114592,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":2166,"num_write":878,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550619+0000","last_change":"2024-09-14T10:56:47.732150+0000","last_active":"2024-09-14T11:55:08.550619+0000","last_peered":"2024-09-14T11:55:08.550619+0000","last_clean":"2024-09-14T11:55:08.550619+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:55:08.550619+0000","last_undegraded":"2024-09-14T11:55:08.550619+0000","last_fullsized":"2024-09-14T11:55:08.550619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:42.244231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'168","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.826154+0000","last_change":"2024-09-14T10:56:49.748121+0000","last_active":"2024-09-14T11:56:49.826154+0000","last_peered":"2024-09-14T11:56:49.826154+0000","last_clean":"2024-09-14T11:56:49.826154+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:56:49.826154+0000","last_undegraded":"2024-09-14T11:56:49.826154+0000","last_fullsized":"2024-09-14T11:56:49.826154+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:52.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754696+0000","last_change":"2024-09-14T10:56:41.700935+0000","last_active":"2024-09-14T11:56:12.754696+0000","last_peered":"2024-09-14T11:56:12.754696+0000","last_clean":"2024-09-14T11:56:12.754696+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:56:12.754696+0000","last_undegraded":"2024-09-14T11:56:12.754696+0000","last_fullsized":"2024-09-14T11:56:12.754696+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:51.471808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'278","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338194+0000","last_change":"2024-09-14T10:56:39.675452+0000","last_active":"2024-09-14T11:58:37.338194+0000","last_peered":"2024-09-14T11:58:37.338194+0000","last_clean":"2024-09-14T11:58:37.338194+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:37.338194+0000","last_undegraded":"2024-09-14T11:58:37.338194+0000","last_fullsized":"2024-09-14T11:58:37.338194+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:40.705030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27645,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":486,"num_read_kb":39755,"num_write":919,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670754+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T11:54:57.670754+0000","last_peered":"2024-09-14T11:54:57.670754+0000","last_clean":"2024-09-14T11:54:57.670754+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:54:57.670754+0000","last_undegraded":"2024-09-14T11:54:57.670754+0000","last_fullsized":"2024-09-14T11:54:57.670754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669698+0000","last_change":"2024-09-14T10:56:43.698284+0000","last_active":"2024-09-14T11:55:03.669698+0000","last_peered":"2024-09-14T11:55:03.669698+0000","last_clean":"2024-09-14T11:55:03.669698+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:55:03.669698+0000","last_undegraded":"2024-09-14T11:55:03.669698+0000","last_fullsized":"2024-09-14T11:55:03.669698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:00.094354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'191","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.127349+0000","last_change":"2024-09-14T10:56:45.711166+0000","last_active":"2024-09-14T11:57:19.127349+0000","last_peered":"2024-09-14T11:57:19.127349+0000","last_clean":"2024-09-14T11:57:19.127349+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:57:19.127349+0000","last_undegraded":"2024-09-14T11:57:19.127349+0000","last_fullsized":"2024-09-14T11:57:19.127349+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:47.059448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'796","reported_seq":2593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.587421+0000","last_change":"2024-09-14T10:56:47.728767+0000","last_active":"2024-09-14T11:58:36.587421+0000","last_peered":"2024-09-14T11:58:36.587421+0000","last_clean":"2024-09-14T11:58:36.587421+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:58:36.587421+0000","last_undegraded":"2024-09-14T11:58:36.587421+0000","last_fullsized":"2024-09-14T11:58:36.587421+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.533201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452881+0000","last_change":"2024-09-14T10:56:49.737155+0000","last_active":"2024-09-14T11:57:52.452881+0000","last_peered":"2024-09-14T11:57:52.452881+0000","last_clean":"2024-09-14T11:57:52.452881+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:57:52.452881+0000","last_undegraded":"2024-09-14T11:57:52.452881+0000","last_fullsized":"2024-09-14T11:57:52.452881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:24.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910688+0000","last_change":"2024-09-14T10:56:41.696110+0000","last_active":"2024-09-14T11:56:51.910688+0000","last_peered":"2024-09-14T11:56:51.910688+0000","last_clean":"2024-09-14T11:56:51.910688+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:56:51.910688+0000","last_undegraded":"2024-09-14T11:56:51.910688+0000","last_fullsized":"2024-09-14T11:56:51.910688+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:47.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.328058+0000","last_change":"2024-09-14T10:56:39.689300+0000","last_active":"2024-09-14T11:58:37.328058+0000","last_peered":"2024-09-14T11:58:37.328058+0000","last_clean":"2024-09-14T11:58:37.328058+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:37.328058+0000","last_undegraded":"2024-09-14T11:58:37.328058+0000","last_fullsized":"2024-09-14T11:58:37.328058+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:27.768196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5872509,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":651,"num_read_kb":30578,"num_write":1020,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.534766+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T11:55:02.534766+0000","last_peered":"2024-09-14T11:55:02.534766+0000","last_clean":"2024-09-14T11:55:02.534766+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:55:02.534766+0000","last_undegraded":"2024-09-14T11:55:02.534766+0000","last_fullsized":"2024-09-14T11:55:02.534766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549708+0000","last_change":"2024-09-14T10:56:43.703110+0000","last_active":"2024-09-14T11:55:03.549708+0000","last_peered":"2024-09-14T11:55:03.549708+0000","last_clean":"2024-09-14T11:55:03.549708+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:55:03.549708+0000","last_undegraded":"2024-09-14T11:55:03.549708+0000","last_fullsized":"2024-09-14T11:55:03.549708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:12.622307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'119","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.096817+0000","last_change":"2024-09-14T10:56:45.722824+0000","last_active":"2024-09-14T11:57:19.096817+0000","last_peered":"2024-09-14T11:57:19.096817+0000","last_clean":"2024-09-14T11:57:19.096817+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:57:19.096817+0000","last_undegraded":"2024-09-14T11:57:19.096817+0000","last_fullsized":"2024-09-14T11:57:19.096817+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:19.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'811","reported_seq":2996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.593571+0000","last_change":"2024-09-14T10:56:47.731609+0000","last_active":"2024-09-14T11:58:36.593571+0000","last_peered":"2024-09-14T11:58:36.593571+0000","last_clean":"2024-09-14T11:58:36.593571+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:58:36.593571+0000","last_undegraded":"2024-09-14T11:58:36.593571+0000","last_fullsized":"2024-09-14T11:58:36.593571+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.877641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'289","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.773375+0000","last_change":"2024-09-14T10:56:49.747406+0000","last_active":"2024-09-14T11:56:52.773375+0000","last_peered":"2024-09-14T11:56:52.773375+0000","last_clean":"2024-09-14T11:56:52.773375+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:56:52.773375+0000","last_undegraded":"2024-09-14T11:56:52.773375+0000","last_fullsized":"2024-09-14T11:56:52.773375+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.880523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518469+0000","last_change":"2024-09-14T10:56:41.691206+0000","last_active":"2024-09-14T11:56:16.518469+0000","last_peered":"2024-09-14T11:56:16.518469+0000","last_clean":"2024-09-14T11:56:16.518469+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:56:16.518469+0000","last_undegraded":"2024-09-14T11:56:16.518469+0000","last_fullsized":"2024-09-14T11:56:16.518469+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'412","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.343800+0000","last_change":"2024-09-14T10:56:39.692650+0000","last_active":"2024-09-14T11:58:37.343800+0000","last_peered":"2024-09-14T11:58:37.343800+0000","last_clean":"2024-09-14T11:58:37.343800+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:37.343800+0000","last_undegraded":"2024-09-14T11:58:37.343800+0000","last_fullsized":"2024-09-14T11:58:37.343800+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:04.303763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301611,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":968,"num_read_kb":14136,"num_write":1455,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669743+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T11:55:03.669743+0000","last_peered":"2024-09-14T11:55:03.669743+0000","last_clean":"2024-09-14T11:55:03.669743+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:55:03.669743+0000","last_undegraded":"2024-09-14T11:55:03.669743+0000","last_fullsized":"2024-09-14T11:55:03.669743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.655180+0000","last_change":"2024-09-14T10:56:43.703274+0000","last_active":"2024-09-14T11:54:57.655180+0000","last_peered":"2024-09-14T11:54:57.655180+0000","last_clean":"2024-09-14T11:54:57.655180+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:54:57.655180+0000","last_undegraded":"2024-09-14T11:54:57.655180+0000","last_fullsized":"2024-09-14T11:54:57.655180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:29.718912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'767","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.290965+0000","last_change":"2024-09-14T10:56:45.720876+0000","last_active":"2024-09-14T11:58:37.290965+0000","last_peered":"2024-09-14T11:58:37.290965+0000","last_clean":"2024-09-14T11:58:37.290965+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:58:37.290965+0000","last_undegraded":"2024-09-14T11:58:37.290965+0000","last_fullsized":"2024-09-14T11:58:37.290965+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202517,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":3195,"num_write":1122,"num_write_kb":955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656600+0000","last_change":"2024-09-14T10:56:47.731417+0000","last_active":"2024-09-14T11:55:07.656600+0000","last_peered":"2024-09-14T11:55:07.656600+0000","last_clean":"2024-09-14T11:55:07.656600+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:55:07.656600+0000","last_undegraded":"2024-09-14T11:55:07.656600+0000","last_fullsized":"2024-09-14T11:55:07.656600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:34.160341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'154","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.473141+0000","last_change":"2024-09-14T10:56:49.746978+0000","last_active":"2024-09-14T11:55:39.473141+0000","last_peered":"2024-09-14T11:55:39.473141+0000","last_clean":"2024-09-14T11:55:39.473141+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:55:39.473141+0000","last_undegraded":"2024-09-14T11:55:39.473141+0000","last_fullsized":"2024-09-14T11:55:39.473141+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:12.779368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'168","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.003254+0000","last_change":"2024-09-14T10:56:49.747311+0000","last_active":"2024-09-14T11:56:53.003254+0000","last_peered":"2024-09-14T11:56:53.003254+0000","last_clean":"2024-09-14T11:56:53.003254+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:56:53.003254+0000","last_undegraded":"2024-09-14T11:56:53.003254+0000","last_fullsized":"2024-09-14T11:56:53.003254+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:47.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1122","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447401+0000","last_change":"2024-09-14T10:56:41.687812+0000","last_active":"2024-09-14T11:57:23.447401+0000","last_peered":"2024-09-14T11:57:23.447401+0000","last_clean":"2024-09-14T11:57:23.447401+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:57:23.447401+0000","last_undegraded":"2024-09-14T11:57:23.447401+0000","last_fullsized":"2024-09-14T11:57:23.447401+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:02.391191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'340","reported_seq":987,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:09.699421+0000","last_change":"2024-09-14T10:56:39.670814+0000","last_active":"2024-09-14T11:56:09.699421+0000","last_peered":"2024-09-14T11:56:09.699421+0000","last_clean":"2024-09-14T11:56:09.699421+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:56:09.699421+0000","last_undegraded":"2024-09-14T11:56:09.699421+0000","last_fullsized":"2024-09-14T11:56:09.699421+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":332970,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":560,"num_read_kb":10191,"num_write":1122,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535277+0000","last_change":"2024-09-14T10:56:43.705030+0000","last_active":"2024-09-14T11:55:07.535277+0000","last_peered":"2024-09-14T11:55:07.535277+0000","last_clean":"2024-09-14T11:55:07.535277+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:55:07.535277+0000","last_undegraded":"2024-09-14T11:55:07.535277+0000","last_fullsized":"2024-09-14T11:55:07.535277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'329","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.298713+0000","last_change":"2024-09-14T10:56:45.717554+0000","last_active":"2024-09-14T11:58:11.298713+0000","last_peered":"2024-09-14T11:58:11.298713+0000","last_clean":"2024-09-14T11:58:11.298713+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:58:11.298713+0000","last_undegraded":"2024-09-14T11:58:11.298713+0000","last_fullsized":"2024-09-14T11:58:11.298713+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.209988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1261,"num_write":450,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656516+0000","last_change":"2024-09-14T10:56:47.725547+0000","last_active":"2024-09-14T11:55:07.656516+0000","last_peered":"2024-09-14T11:55:07.656516+0000","last_clean":"2024-09-14T11:55:07.656516+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:55:07.656516+0000","last_undegraded":"2024-09-14T11:55:07.656516+0000","last_fullsized":"2024-09-14T11:55:07.656516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.084006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.627089+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:55:30.627089+0000","last_peered":"2024-09-14T11:55:30.627089+0000","last_clean":"2024-09-14T11:55:30.627089+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:55:30.627089+0000","last_undegraded":"2024-09-14T11:55:30.627089+0000","last_fullsized":"2024-09-14T11:55:30.627089+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.809740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1055","reported_seq":2864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445536+0000","last_change":"2024-09-14T10:56:41.693098+0000","last_active":"2024-09-14T11:57:22.445536+0000","last_peered":"2024-09-14T11:57:22.445536+0000","last_clean":"2024-09-14T11:57:22.445536+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:57:22.445536+0000","last_undegraded":"2024-09-14T11:57:22.445536+0000","last_fullsized":"2024-09-14T11:57:22.445536+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:04.578146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426044+0000","last_change":"2024-09-14T10:56:39.696942+0000","last_active":"2024-09-14T11:58:37.426044+0000","last_peered":"2024-09-14T11:58:37.426044+0000","last_clean":"2024-09-14T11:58:37.426044+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:37.426044+0000","last_undegraded":"2024-09-14T11:58:37.426044+0000","last_fullsized":"2024-09-14T11:58:37.426044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:03.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14730799,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":790,"num_read_kb":46830,"num_write":1250,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656693+0000","last_change":"2024-09-14T10:56:43.695342+0000","last_active":"2024-09-14T11:55:07.656693+0000","last_peered":"2024-09-14T11:55:07.656693+0000","last_clean":"2024-09-14T11:55:07.656693+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:55:07.656693+0000","last_undegraded":"2024-09-14T11:55:07.656693+0000","last_fullsized":"2024-09-14T11:55:07.656693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:45.552140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.731707+0000","last_change":"2024-09-14T10:56:45.719223+0000","last_active":"2024-09-14T11:57:18.731707+0000","last_peered":"2024-09-14T11:57:18.731707+0000","last_clean":"2024-09-14T11:57:18.731707+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:57:18.731707+0000","last_undegraded":"2024-09-14T11:57:18.731707+0000","last_fullsized":"2024-09-14T11:57:18.731707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:12.736414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672205+0000","last_change":"2024-09-14T10:56:47.735092+0000","last_active":"2024-09-14T11:55:07.672205+0000","last_peered":"2024-09-14T11:55:07.672205+0000","last_clean":"2024-09-14T11:55:07.672205+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:55:07.672205+0000","last_undegraded":"2024-09-14T11:55:07.672205+0000","last_fullsized":"2024-09-14T11:55:07.672205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:26.157686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.919060+0000","last_change":"2024-09-14T10:56:49.748097+0000","last_active":"2024-09-14T11:56:51.919060+0000","last_peered":"2024-09-14T11:56:51.919060+0000","last_clean":"2024-09-14T11:56:51.919060+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:56:51.919060+0000","last_undegraded":"2024-09-14T11:56:51.919060+0000","last_fullsized":"2024-09-14T11:56:51.919060+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:32.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'555","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655868+0000","last_change":"2024-09-14T10:56:41.695455+0000","last_active":"2024-09-14T11:55:02.655868+0000","last_peered":"2024-09-14T11:55:02.655868+0000","last_clean":"2024-09-14T11:55:02.655868+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:55:02.655868+0000","last_undegraded":"2024-09-14T11:55:02.655868+0000","last_fullsized":"2024-09-14T11:55:02.655868+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:44.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'360","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.464257+0000","last_change":"2024-09-14T10:56:39.690454+0000","last_active":"2024-09-14T11:58:37.464257+0000","last_peered":"2024-09-14T11:58:37.464257+0000","last_clean":"2024-09-14T11:58:37.464257+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:37.464257+0000","last_undegraded":"2024-09-14T11:58:37.464257+0000","last_fullsized":"2024-09-14T11:58:37.464257+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:21.163573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270682,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":802,"num_read_kb":27462,"num_write":1372,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672163+0000","last_change":"2024-09-14T10:56:43.699062+0000","last_active":"2024-09-14T11:55:07.672163+0000","last_peered":"2024-09-14T11:55:07.672163+0000","last_clean":"2024-09-14T11:55:07.672163+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:55:07.672163+0000","last_undegraded":"2024-09-14T11:55:07.672163+0000","last_fullsized":"2024-09-14T11:55:07.672163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:26.963005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.284014+0000","last_change":"2024-09-14T10:56:45.715959+0000","last_active":"2024-09-14T11:58:11.284014+0000","last_peered":"2024-09-14T11:58:11.284014+0000","last_clean":"2024-09-14T11:58:11.284014+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:58:11.284014+0000","last_undegraded":"2024-09-14T11:58:11.284014+0000","last_fullsized":"2024-09-14T11:58:11.284014+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:05.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1077,"num_write":422,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670532+0000","last_change":"2024-09-14T10:56:47.732777+0000","last_active":"2024-09-14T11:55:08.670532+0000","last_peered":"2024-09-14T11:55:08.670532+0000","last_clean":"2024-09-14T11:55:08.670532+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:55:08.670532+0000","last_undegraded":"2024-09-14T11:55:08.670532+0000","last_fullsized":"2024-09-14T11:55:08.670532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:56.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'132","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:50.364550+0000","last_change":"2024-09-14T10:56:49.744968+0000","last_active":"2024-09-14T11:55:50.364550+0000","last_peered":"2024-09-14T11:55:50.364550+0000","last_clean":"2024-09-14T11:55:50.364550+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:55:50.364550+0000","last_undegraded":"2024-09-14T11:55:50.364550+0000","last_fullsized":"2024-09-14T11:55:50.364550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.920523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'545","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655810+0000","last_change":"2024-09-14T10:56:41.692451+0000","last_active":"2024-09-14T11:55:02.655810+0000","last_peered":"2024-09-14T11:55:02.655810+0000","last_clean":"2024-09-14T11:55:02.655810+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:55:02.655810+0000","last_undegraded":"2024-09-14T11:55:02.655810+0000","last_fullsized":"2024-09-14T11:55:02.655810+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:39.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'328","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.401708+0000","last_change":"2024-09-14T10:56:39.691385+0000","last_active":"2024-09-14T11:58:37.401708+0000","last_peered":"2024-09-14T11:58:37.401708+0000","last_clean":"2024-09-14T11:58:37.401708+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:37.401708+0000","last_undegraded":"2024-09-14T11:58:37.401708+0000","last_fullsized":"2024-09-14T11:58:37.401708+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15149076,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":674,"num_read_kb":41704,"num_write":1209,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669646+0000","last_change":"2024-09-14T10:56:43.704083+0000","last_active":"2024-09-14T11:55:03.669646+0000","last_peered":"2024-09-14T11:55:03.669646+0000","last_clean":"2024-09-14T11:55:03.669646+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:55:03.669646+0000","last_undegraded":"2024-09-14T11:55:03.669646+0000","last_fullsized":"2024-09-14T11:55:03.669646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.605990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'278","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.280355+0000","last_change":"2024-09-14T10:56:45.716753+0000","last_active":"2024-09-14T11:58:11.280355+0000","last_peered":"2024-09-14T11:58:11.280355+0000","last_clean":"2024-09-14T11:58:11.280355+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:58:11.280355+0000","last_undegraded":"2024-09-14T11:58:11.280355+0000","last_fullsized":"2024-09-14T11:58:11.280355+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:06.690939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":994,"num_write":372,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656266+0000","last_change":"2024-09-14T10:56:47.736112+0000","last_active":"2024-09-14T11:55:07.656266+0000","last_peered":"2024-09-14T11:55:07.656266+0000","last_clean":"2024-09-14T11:55:07.656266+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:55:07.656266+0000","last_undegraded":"2024-09-14T11:55:07.656266+0000","last_fullsized":"2024-09-14T11:55:07.656266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:10.784169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'481","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.461087+0000","last_change":"2024-09-14T10:56:41.690497+0000","last_active":"2024-09-14T11:56:10.461087+0000","last_peered":"2024-09-14T11:56:10.461087+0000","last_clean":"2024-09-14T11:56:10.461087+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:56:10.461087+0000","last_undegraded":"2024-09-14T11:56:10.461087+0000","last_fullsized":"2024-09-14T11:56:10.461087+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:04.625419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.232655+0000","last_change":"2024-09-14T10:56:39.680360+0000","last_active":"2024-09-14T11:58:37.232655+0000","last_peered":"2024-09-14T11:58:37.232655+0000","last_clean":"2024-09-14T11:58:37.232655+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:37.232655+0000","last_undegraded":"2024-09-14T11:58:37.232655+0000","last_fullsized":"2024-09-14T11:58:37.232655+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:47.696842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653223,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":524,"num_read_kb":63779,"num_write":845,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"37'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.156737+0000","last_change":"2024-09-14T10:56:43.698511+0000","last_active":"2024-09-14T11:58:36.156737+0000","last_peered":"2024-09-14T11:58:36.156737+0000","last_clean":"2024-09-14T11:58:36.156737+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:36.156737+0000","last_undegraded":"2024-09-14T11:58:36.156737+0000","last_fullsized":"2024-09-14T11:58:36.156737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.127093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'491","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.447584+0000","last_change":"2024-09-14T10:56:45.720443+0000","last_active":"2024-09-14T11:58:37.447584+0000","last_peered":"2024-09-14T11:58:37.447584+0000","last_clean":"2024-09-14T11:58:37.447584+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:58:37.447584+0000","last_undegraded":"2024-09-14T11:58:37.447584+0000","last_fullsized":"2024-09-14T11:58:37.447584+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.146179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":882,"num_read_kb":2032,"num_write":763,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541697+0000","last_change":"2024-09-14T10:56:47.731799+0000","last_active":"2024-09-14T11:54:17.541697+0000","last_peered":"2024-09-14T11:54:17.541697+0000","last_clean":"2024-09-14T11:54:17.541697+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:54:17.541697+0000","last_undegraded":"2024-09-14T11:54:17.541697+0000","last_fullsized":"2024-09-14T11:54:17.541697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.343090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'455","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266414+0000","last_change":"2024-09-14T10:56:41.691362+0000","last_active":"2024-09-14T11:55:58.266414+0000","last_peered":"2024-09-14T11:55:58.266414+0000","last_clean":"2024-09-14T11:55:58.266414+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:55:58.266414+0000","last_undegraded":"2024-09-14T11:55:58.266414+0000","last_fullsized":"2024-09-14T11:55:58.266414+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:01.380624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'300","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.372358+0000","last_change":"2024-09-14T10:56:39.673809+0000","last_active":"2024-09-14T11:58:37.372358+0000","last_peered":"2024-09-14T11:58:37.372358+0000","last_clean":"2024-09-14T11:58:37.372358+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:37.372358+0000","last_undegraded":"2024-09-14T11:58:37.372358+0000","last_fullsized":"2024-09-14T11:58:37.372358+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:32.335582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10492050,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":557,"num_read_kb":50717,"num_write":1006,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669754+0000","last_change":"2024-09-14T10:56:43.701698+0000","last_active":"2024-09-14T11:55:03.669754+0000","last_peered":"2024-09-14T11:55:03.669754+0000","last_clean":"2024-09-14T11:55:03.669754+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:55:03.669754+0000","last_undegraded":"2024-09-14T11:55:03.669754+0000","last_fullsized":"2024-09-14T11:55:03.669754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.260764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'310","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.281654+0000","last_change":"2024-09-14T10:56:45.719927+0000","last_active":"2024-09-14T11:58:11.281654+0000","last_peered":"2024-09-14T11:58:11.281654+0000","last_clean":"2024-09-14T11:58:11.281654+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:58:11.281654+0000","last_undegraded":"2024-09-14T11:58:11.281654+0000","last_fullsized":"2024-09-14T11:58:11.281654+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63343,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1061,"num_write":438,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529645+0000","last_change":"2024-09-14T10:56:47.726517+0000","last_active":"2024-09-14T11:54:17.529645+0000","last_peered":"2024-09-14T11:54:17.529645+0000","last_clean":"2024-09-14T11:54:17.529645+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:54:17.529645+0000","last_undegraded":"2024-09-14T11:54:17.529645+0000","last_fullsized":"2024-09-14T11:54:17.529645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:13.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'150","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.548609+0000","last_change":"2024-09-14T10:56:49.743152+0000","last_active":"2024-09-14T11:55:43.548609+0000","last_peered":"2024-09-14T11:55:43.548609+0000","last_clean":"2024-09-14T11:55:43.548609+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:55:43.548609+0000","last_undegraded":"2024-09-14T11:55:43.548609+0000","last_fullsized":"2024-09-14T11:55:43.548609+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:00.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'552","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.443381+0000","last_change":"2024-09-14T10:56:41.685799+0000","last_active":"2024-09-14T11:56:42.443381+0000","last_peered":"2024-09-14T11:56:42.443381+0000","last_clean":"2024-09-14T11:56:42.443381+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:56:42.443381+0000","last_undegraded":"2024-09-14T11:56:42.443381+0000","last_fullsized":"2024-09-14T11:56:42.443381+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'274","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.982447+0000","last_change":"2024-09-14T10:56:39.684773+0000","last_active":"2024-09-14T11:58:08.982447+0000","last_peered":"2024-09-14T11:58:08.982447+0000","last_clean":"2024-09-14T11:58:08.982447+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:08.982447+0000","last_undegraded":"2024-09-14T11:58:08.982447+0000","last_fullsized":"2024-09-14T11:58:08.982447+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.903799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12592784,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":526,"num_read_kb":82907,"num_write":1023,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542445+0000","last_change":"2024-09-14T10:56:43.704594+0000","last_active":"2024-09-14T11:54:13.542445+0000","last_peered":"2024-09-14T11:54:13.542445+0000","last_clean":"2024-09-14T11:54:13.542445+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:54:13.542445+0000","last_undegraded":"2024-09-14T11:54:13.542445+0000","last_fullsized":"2024-09-14T11:54:13.542445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'302","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.303729+0000","last_change":"2024-09-14T10:56:45.713501+0000","last_active":"2024-09-14T11:58:11.303729+0000","last_peered":"2024-09-14T11:58:11.303729+0000","last_clean":"2024-09-14T11:58:11.303729+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:58:11.303729+0000","last_undegraded":"2024-09-14T11:58:11.303729+0000","last_fullsized":"2024-09-14T11:58:11.303729+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:35.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59479,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1009,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534180+0000","last_change":"2024-09-14T10:56:47.733388+0000","last_active":"2024-09-14T11:54:57.534180+0000","last_peered":"2024-09-14T11:54:57.534180+0000","last_clean":"2024-09-14T11:54:57.534180+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:54:57.534180+0000","last_undegraded":"2024-09-14T11:54:57.534180+0000","last_fullsized":"2024-09-14T11:54:57.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:57.789850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'166","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311096+0000","last_change":"2024-09-14T10:56:49.745862+0000","last_active":"2024-09-14T11:58:11.311096+0000","last_peered":"2024-09-14T11:58:11.311096+0000","last_clean":"2024-09-14T11:58:11.311096+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:58:11.311096+0000","last_undegraded":"2024-09-14T11:58:11.311096+0000","last_fullsized":"2024-09-14T11:58:11.311096+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.824927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'529","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.873131+0000","last_change":"2024-09-14T10:56:41.686220+0000","last_active":"2024-09-14T11:58:09.873131+0000","last_peered":"2024-09-14T11:58:09.873131+0000","last_clean":"2024-09-14T11:58:09.873131+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:09.873131+0000","last_undegraded":"2024-09-14T11:58:09.873131+0000","last_fullsized":"2024-09-14T11:58:09.873131+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:09.136596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'330","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426263+0000","last_change":"2024-09-14T10:57:16.216561+0000","last_active":"2024-09-14T11:58:37.426263+0000","last_peered":"2024-09-14T11:58:37.426263+0000","last_clean":"2024-09-14T11:58:37.426263+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:37.426263+0000","last_undegraded":"2024-09-14T11:58:37.426263+0000","last_fullsized":"2024-09-14T11:58:37.426263+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11708820,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":570,"num_read_kb":42073,"num_write":1097,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529656+0000","last_change":"2024-09-14T10:56:43.707654+0000","last_active":"2024-09-14T11:54:17.529656+0000","last_peered":"2024-09-14T11:54:17.529656+0000","last_clean":"2024-09-14T11:54:17.529656+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:54:17.529656+0000","last_undegraded":"2024-09-14T11:54:17.529656+0000","last_fullsized":"2024-09-14T11:54:17.529656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.644607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'102","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.120594+0000","last_change":"2024-09-14T10:56:45.723330+0000","last_active":"2024-09-14T11:57:19.120594+0000","last_peered":"2024-09-14T11:57:19.120594+0000","last_clean":"2024-09-14T11:57:19.120594+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:57:19.120594+0000","last_undegraded":"2024-09-14T11:57:19.120594+0000","last_fullsized":"2024-09-14T11:57:19.120594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.375494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'773","reported_seq":4305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:14.398078+0000","last_change":"2024-09-14T10:56:47.725052+0000","last_active":"2024-09-14T11:58:14.398078+0000","last_peered":"2024-09-14T11:58:14.398078+0000","last_clean":"2024-09-14T11:58:14.398078+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:58:14.398078+0000","last_undegraded":"2024-09-14T11:58:14.398078+0000","last_fullsized":"2024-09-14T11:58:14.398078+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:47.209530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.919170+0000","last_change":"2024-09-14T10:56:49.751037+0000","last_active":"2024-09-14T11:56:52.919170+0000","last_peered":"2024-09-14T11:56:52.919170+0000","last_clean":"2024-09-14T11:56:52.919170+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:56:52.919170+0000","last_undegraded":"2024-09-14T11:56:52.919170+0000","last_fullsized":"2024-09-14T11:56:52.919170+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:10.690807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'413","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.748759+0000","last_change":"2024-09-14T10:56:41.697565+0000","last_active":"2024-09-14T11:56:52.748759+0000","last_peered":"2024-09-14T11:56:52.748759+0000","last_clean":"2024-09-14T11:56:52.748759+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:56:52.748759+0000","last_undegraded":"2024-09-14T11:56:52.748759+0000","last_fullsized":"2024-09-14T11:56:52.748759+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:10.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.486064+0000","last_change":"2024-09-14T10:56:39.680420+0000","last_active":"2024-09-14T11:58:37.486064+0000","last_peered":"2024-09-14T11:58:37.486064+0000","last_clean":"2024-09-14T11:58:37.486064+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:37.486064+0000","last_undegraded":"2024-09-14T11:58:37.486064+0000","last_fullsized":"2024-09-14T11:58:37.486064+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:32.687547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080169,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":440,"num_read_kb":9665,"num_write":951,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.664084+0000","last_change":"2024-09-14T10:56:43.698568+0000","last_active":"2024-09-14T11:54:17.664084+0000","last_peered":"2024-09-14T11:54:17.664084+0000","last_clean":"2024-09-14T11:54:17.664084+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:54:17.664084+0000","last_undegraded":"2024-09-14T11:54:17.664084+0000","last_fullsized":"2024-09-14T11:54:17.664084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:50.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'320","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.981914+0000","last_change":"2024-09-14T10:56:45.718845+0000","last_active":"2024-09-14T11:58:36.981914+0000","last_peered":"2024-09-14T11:58:36.981914+0000","last_clean":"2024-09-14T11:58:36.981914+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:58:36.981914+0000","last_undegraded":"2024-09-14T11:58:36.981914+0000","last_fullsized":"2024-09-14T11:58:36.981914+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:13.209858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653460+0000","last_change":"2024-09-14T10:56:47.733362+0000","last_active":"2024-09-14T11:54:47.653460+0000","last_peered":"2024-09-14T11:54:47.653460+0000","last_clean":"2024-09-14T11:54:47.653460+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:54:47.653460+0000","last_undegraded":"2024-09-14T11:54:47.653460+0000","last_fullsized":"2024-09-14T11:54:47.653460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:33.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'123","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.829287+0000","last_change":"2024-09-14T10:56:49.749682+0000","last_active":"2024-09-14T11:56:49.829287+0000","last_peered":"2024-09-14T11:56:49.829287+0000","last_clean":"2024-09-14T11:56:49.829287+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:56:49.829287+0000","last_undegraded":"2024-09-14T11:56:49.829287+0000","last_fullsized":"2024-09-14T11:56:49.829287+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:32.089427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'396","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.284146+0000","last_change":"2024-09-14T10:56:41.695266+0000","last_active":"2024-09-14T11:56:49.284146+0000","last_peered":"2024-09-14T11:56:49.284146+0000","last_clean":"2024-09-14T11:56:49.284146+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:56:49.284146+0000","last_undegraded":"2024-09-14T11:56:49.284146+0000","last_fullsized":"2024-09-14T11:56:49.284146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.489293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'281","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.526636+0000","last_change":"2024-09-14T10:56:39.681309+0000","last_active":"2024-09-14T11:58:37.526636+0000","last_peered":"2024-09-14T11:58:37.526636+0000","last_clean":"2024-09-14T11:58:37.526636+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:37.526636+0000","last_undegraded":"2024-09-14T11:58:37.526636+0000","last_fullsized":"2024-09-14T11:58:37.526636+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:25.783922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7295109,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":529,"num_read_kb":29813,"num_write":1032,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541668+0000","last_change":"2024-09-14T10:56:43.698362+0000","last_active":"2024-09-14T11:54:17.541668+0000","last_peered":"2024-09-14T11:54:17.541668+0000","last_clean":"2024-09-14T11:54:17.541668+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:54:17.541668+0000","last_undegraded":"2024-09-14T11:54:17.541668+0000","last_fullsized":"2024-09-14T11:54:17.541668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.790448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.069236+0000","last_change":"2024-09-14T10:56:45.714250+0000","last_active":"2024-09-14T11:58:37.069236+0000","last_peered":"2024-09-14T11:58:37.069236+0000","last_clean":"2024-09-14T11:58:37.069236+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:58:37.069236+0000","last_undegraded":"2024-09-14T11:58:37.069236+0000","last_fullsized":"2024-09-14T11:58:37.069236+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:33.117467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669009+0000","last_change":"2024-09-14T10:56:47.735191+0000","last_active":"2024-09-14T11:54:58.669009+0000","last_peered":"2024-09-14T11:54:58.669009+0000","last_clean":"2024-09-14T11:54:58.669009+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:54:58.669009+0000","last_undegraded":"2024-09-14T11:54:58.669009+0000","last_fullsized":"2024-09-14T11:54:58.669009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.084195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'105","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.049900+0000","last_change":"2024-09-14T10:56:49.737999+0000","last_active":"2024-09-14T11:56:00.049900+0000","last_peered":"2024-09-14T11:56:00.049900+0000","last_clean":"2024-09-14T11:56:00.049900+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:56:00.049900+0000","last_undegraded":"2024-09-14T11:56:00.049900+0000","last_fullsized":"2024-09-14T11:56:00.049900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.183467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'350","reported_seq":1779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553158+0000","last_change":"2024-09-14T10:57:15.793797+0000","last_active":"2024-09-14T11:55:32.553158+0000","last_peered":"2024-09-14T11:55:32.553158+0000","last_clean":"2024-09-14T11:55:32.553158+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:55:32.553158+0000","last_undegraded":"2024-09-14T11:55:32.553158+0000","last_fullsized":"2024-09-14T11:55:32.553158+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:28.436278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'366","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400385+0000","last_change":"2024-09-14T10:56:39.693756+0000","last_active":"2024-09-14T11:58:37.400385+0000","last_peered":"2024-09-14T11:58:37.400385+0000","last_clean":"2024-09-14T11:58:37.400385+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:37.400385+0000","last_undegraded":"2024-09-14T11:58:37.400385+0000","last_fullsized":"2024-09-14T11:58:37.400385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:17.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6398400,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":688,"num_read_kb":11025,"num_write":1228,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.546906+0000","last_change":"2024-09-14T10:56:43.701839+0000","last_active":"2024-09-14T11:54:43.546906+0000","last_peered":"2024-09-14T11:54:43.546906+0000","last_clean":"2024-09-14T11:54:43.546906+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:54:43.546906+0000","last_undegraded":"2024-09-14T11:54:43.546906+0000","last_fullsized":"2024-09-14T11:54:43.546906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:17.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'233","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.301001+0000","last_change":"2024-09-14T10:56:45.717972+0000","last_active":"2024-09-14T11:58:11.301001+0000","last_peered":"2024-09-14T11:58:11.301001+0000","last_clean":"2024-09-14T11:58:11.301001+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:58:11.301001+0000","last_undegraded":"2024-09-14T11:58:11.301001+0000","last_fullsized":"2024-09-14T11:58:11.301001+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:35.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61888,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":883,"num_write":320,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.543346+0000","last_change":"2024-09-14T10:56:47.727607+0000","last_active":"2024-09-14T11:54:18.543346+0000","last_peered":"2024-09-14T11:54:18.543346+0000","last_clean":"2024-09-14T11:54:18.543346+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:54:18.543346+0000","last_undegraded":"2024-09-14T11:54:18.543346+0000","last_fullsized":"2024-09-14T11:54:18.543346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:25.985367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'158","reported_seq":1613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.803159+0000","last_change":"2024-09-14T10:56:49.749341+0000","last_active":"2024-09-14T11:56:49.803159+0000","last_peered":"2024-09-14T11:56:49.803159+0000","last_clean":"2024-09-14T11:56:49.803159+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:56:49.803159+0000","last_undegraded":"2024-09-14T11:56:49.803159+0000","last_fullsized":"2024-09-14T11:56:49.803159+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:09.689856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'469","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313472+0000","last_change":"2024-09-14T10:56:41.688125+0000","last_active":"2024-09-14T11:56:49.313472+0000","last_peered":"2024-09-14T11:56:49.313472+0000","last_clean":"2024-09-14T11:56:49.313472+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:56:49.313472+0000","last_undegraded":"2024-09-14T11:56:49.313472+0000","last_fullsized":"2024-09-14T11:56:49.313472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:10.186168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'360","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.735738+0000","last_change":"2024-09-14T10:57:16.215872+0000","last_active":"2024-09-14T11:58:37.735738+0000","last_peered":"2024-09-14T11:58:37.735738+0000","last_clean":"2024-09-14T11:58:37.735738+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:37.735738+0000","last_undegraded":"2024-09-14T11:58:37.735738+0000","last_fullsized":"2024-09-14T11:58:37.735738+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:32.841426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058811,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":706,"num_read_kb":46942,"num_write":1256,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534114+0000","last_change":"2024-09-14T10:56:43.704444+0000","last_active":"2024-09-14T11:54:57.534114+0000","last_peered":"2024-09-14T11:54:57.534114+0000","last_clean":"2024-09-14T11:54:57.534114+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:54:57.534114+0000","last_undegraded":"2024-09-14T11:54:57.534114+0000","last_fullsized":"2024-09-14T11:54:57.534114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.463719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'296","reported_seq":882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.914919+0000","last_change":"2024-09-14T10:56:45.721400+0000","last_active":"2024-09-14T11:57:18.914919+0000","last_peered":"2024-09-14T11:57:18.914919+0000","last_clean":"2024-09-14T11:57:18.914919+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:57:18.914919+0000","last_undegraded":"2024-09-14T11:57:18.914919+0000","last_fullsized":"2024-09-14T11:57:18.914919+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.182048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50315,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":473,"num_read_kb":960,"num_write":374,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.649773+0000","last_change":"2024-09-14T10:56:47.736437+0000","last_active":"2024-09-14T11:54:17.649773+0000","last_peered":"2024-09-14T11:54:17.649773+0000","last_clean":"2024-09-14T11:54:17.649773+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:54:17.649773+0000","last_undegraded":"2024-09-14T11:54:17.649773+0000","last_fullsized":"2024-09-14T11:54:17.649773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:00.826459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.871440+0000","last_change":"2024-09-14T10:56:49.747246+0000","last_active":"2024-09-14T11:58:09.871440+0000","last_peered":"2024-09-14T11:58:09.871440+0000","last_clean":"2024-09-14T11:58:09.871440+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:58:09.871440+0000","last_undegraded":"2024-09-14T11:58:09.871440+0000","last_fullsized":"2024-09-14T11:58:09.871440+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:08.836336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'582","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909450+0000","last_change":"2024-09-14T10:56:41.697790+0000","last_active":"2024-09-14T11:56:51.909450+0000","last_peered":"2024-09-14T11:56:51.909450+0000","last_clean":"2024-09-14T11:56:51.909450+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:56:51.909450+0000","last_undegraded":"2024-09-14T11:56:51.909450+0000","last_fullsized":"2024-09-14T11:56:51.909450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:08.908846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'278","reported_seq":951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.571280+0000","last_change":"2024-09-14T10:56:39.673208+0000","last_active":"2024-09-14T11:56:33.571280+0000","last_peered":"2024-09-14T11:56:33.571280+0000","last_clean":"2024-09-14T11:56:33.571280+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:56:33.571280+0000","last_undegraded":"2024-09-14T11:56:33.571280+0000","last_fullsized":"2024-09-14T11:56:33.571280+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.389425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20893959,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":573,"num_read_kb":60949,"num_write":1009,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1051","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782289+0000","last_change":"2024-09-14T10:56:41.690469+0000","last_active":"2024-09-14T11:56:52.782289+0000","last_peered":"2024-09-14T11:56:52.782289+0000","last_clean":"2024-09-14T11:56:52.782289+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:56:52.782289+0000","last_undegraded":"2024-09-14T11:56:52.782289+0000","last_fullsized":"2024-09-14T11:56:52.782289+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1000,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:19.835570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'325","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.724368+0000","last_change":"2024-09-14T10:56:39.682932+0000","last_active":"2024-09-14T11:58:37.724368+0000","last_peered":"2024-09-14T11:58:37.724368+0000","last_clean":"2024-09-14T11:58:37.724368+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:37.724368+0000","last_undegraded":"2024-09-14T11:58:37.724368+0000","last_fullsized":"2024-09-14T11:58:37.724368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:56.634779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10224735,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":594,"num_read_kb":22759,"num_write":1100,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'997","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909714+0000","last_change":"2024-09-14T10:56:41.690506+0000","last_active":"2024-09-14T11:56:51.909714+0000","last_peered":"2024-09-14T11:56:51.909714+0000","last_clean":"2024-09-14T11:56:51.909714+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:56:51.909714+0000","last_undegraded":"2024-09-14T11:56:51.909714+0000","last_fullsized":"2024-09-14T11:56:51.909714+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:24.682037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'294","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.498509+0000","last_change":"2024-09-14T10:56:39.691542+0000","last_active":"2024-09-14T11:58:37.498509+0000","last_peered":"2024-09-14T11:58:37.498509+0000","last_clean":"2024-09-14T11:58:37.498509+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:37.498509+0000","last_undegraded":"2024-09-14T11:58:37.498509+0000","last_fullsized":"2024-09-14T11:58:37.498509+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:07.545833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13422990,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":944,"num_read_kb":42149,"num_write":1039,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'860","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.336478+0000","last_change":"2024-09-14T10:56:41.689333+0000","last_active":"2024-09-14T11:56:18.336478+0000","last_peered":"2024-09-14T11:56:18.336478+0000","last_clean":"2024-09-14T11:56:18.336478+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:56:18.336478+0000","last_undegraded":"2024-09-14T11:56:18.336478+0000","last_fullsized":"2024-09-14T11:56:18.336478+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:19.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'326","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.402352+0000","last_change":"2024-09-14T10:56:39.694580+0000","last_active":"2024-09-14T11:58:37.402352+0000","last_peered":"2024-09-14T11:58:37.402352+0000","last_clean":"2024-09-14T11:58:37.402352+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:37.402352+0000","last_undegraded":"2024-09-14T11:58:37.402352+0000","last_fullsized":"2024-09-14T11:58:37.402352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:23.950117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4582778,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":829,"num_read_kb":14120,"num_write":1200,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1634","reported_seq":3354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.881920+0000","last_change":"2024-09-14T10:56:41.696853+0000","last_active":"2024-09-14T11:58:09.881920+0000","last_peered":"2024-09-14T11:58:09.881920+0000","last_clean":"2024-09-14T11:58:09.881920+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:58:09.881920+0000","last_undegraded":"2024-09-14T11:58:09.881920+0000","last_fullsized":"2024-09-14T11:58:09.881920+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:47.117707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'355","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400797+0000","last_change":"2024-09-14T10:56:39.676793+0000","last_active":"2024-09-14T11:58:37.400797+0000","last_peered":"2024-09-14T11:58:37.400797+0000","last_clean":"2024-09-14T11:58:37.400797+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:37.400797+0000","last_undegraded":"2024-09-14T11:58:37.400797+0000","last_fullsized":"2024-09-14T11:58:37.400797+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2927610,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":715,"num_read_kb":3390,"num_write":1132,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.753104+0000","last_change":"2024-09-14T10:56:41.687648+0000","last_active":"2024-09-14T11:56:12.753104+0000","last_peered":"2024-09-14T11:56:12.753104+0000","last_clean":"2024-09-14T11:56:12.753104+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:56:12.753104+0000","last_undegraded":"2024-09-14T11:56:12.753104+0000","last_fullsized":"2024-09-14T11:56:12.753104+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:36.574356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'369","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.438453+0000","last_change":"2024-09-14T10:56:39.671687+0000","last_active":"2024-09-14T11:58:37.438453+0000","last_peered":"2024-09-14T11:58:37.438453+0000","last_clean":"2024-09-14T11:58:37.438453+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:37.438453+0000","last_undegraded":"2024-09-14T11:58:37.438453+0000","last_fullsized":"2024-09-14T11:58:37.438453+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:50.335751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595238,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1033,"num_read_kb":5070,"num_write":1198,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'774","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.874571+0000","last_change":"2024-09-14T10:56:41.691714+0000","last_active":"2024-09-14T11:58:09.874571+0000","last_peered":"2024-09-14T11:58:09.874571+0000","last_clean":"2024-09-14T11:58:09.874571+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:58:09.874571+0000","last_undegraded":"2024-09-14T11:58:09.874571+0000","last_fullsized":"2024-09-14T11:58:09.874571+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:17.443652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'289","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.575884+0000","last_change":"2024-09-14T10:56:39.686601+0000","last_active":"2024-09-14T11:56:33.575884+0000","last_peered":"2024-09-14T11:56:33.575884+0000","last_clean":"2024-09-14T11:56:33.575884+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:56:33.575884+0000","last_undegraded":"2024-09-14T11:56:33.575884+0000","last_fullsized":"2024-09-14T11:56:33.575884+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:57.339815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5904320,"num_objects":79,"num_object_clones":0,"num_object_copies":316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":543,"num_read_kb":6911,"num_write":1073,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'412","reported_seq":1943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.880186+0000","last_change":"2024-09-14T10:56:41.685678+0000","last_active":"2024-09-14T11:58:09.880186+0000","last_peered":"2024-09-14T11:58:09.880186+0000","last_clean":"2024-09-14T11:58:09.880186+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:09.880186+0000","last_undegraded":"2024-09-14T11:58:09.880186+0000","last_fullsized":"2024-09-14T11:58:09.880186+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:05.474990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'393","reported_seq":1253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.267236+0000","last_change":"2024-09-14T10:56:39.677501+0000","last_active":"2024-09-14T11:58:37.267236+0000","last_peered":"2024-09-14T11:58:37.267236+0000","last_clean":"2024-09-14T11:58:37.267236+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:37.267236+0000","last_undegraded":"2024-09-14T11:58:37.267236+0000","last_fullsized":"2024-09-14T11:58:37.267236+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:47.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12599751,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1272,"num_read_kb":48093,"num_write":1328,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'717","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445682+0000","last_change":"2024-09-14T10:56:41.697391+0000","last_active":"2024-09-14T11:57:22.445682+0000","last_peered":"2024-09-14T11:57:22.445682+0000","last_clean":"2024-09-14T11:57:22.445682+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:57:22.445682+0000","last_undegraded":"2024-09-14T11:57:22.445682+0000","last_fullsized":"2024-09-14T11:57:22.445682+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:49.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'371","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.475809+0000","last_change":"2024-09-14T10:56:39.680650+0000","last_active":"2024-09-14T11:58:37.475809+0000","last_peered":"2024-09-14T11:58:37.475809+0000","last_clean":"2024-09-14T11:58:37.475809+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:37.475809+0000","last_undegraded":"2024-09-14T11:58:37.475809+0000","last_fullsized":"2024-09-14T11:58:37.475809+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.313359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560019,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":847,"num_read_kb":12822,"num_write":1317,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781318+0000","last_change":"2024-09-14T10:56:41.694523+0000","last_active":"2024-09-14T11:56:52.781318+0000","last_peered":"2024-09-14T11:56:52.781318+0000","last_clean":"2024-09-14T11:56:52.781318+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:56:52.781318+0000","last_undegraded":"2024-09-14T11:56:52.781318+0000","last_fullsized":"2024-09-14T11:56:52.781318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:14.167389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'407","reported_seq":1247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.411894+0000","last_change":"2024-09-14T10:56:39.685874+0000","last_active":"2024-09-14T11:58:37.411894+0000","last_peered":"2024-09-14T11:58:37.411894+0000","last_clean":"2024-09-14T11:58:37.411894+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:37.411894+0000","last_undegraded":"2024-09-14T11:58:37.411894+0000","last_fullsized":"2024-09-14T11:58:37.411894+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:00.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224146,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1500,"num_read_kb":34980,"num_write":1337,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1164","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.335677+0000","last_change":"2024-09-14T10:56:41.684712+0000","last_active":"2024-09-14T11:56:18.335677+0000","last_peered":"2024-09-14T11:56:18.335677+0000","last_clean":"2024-09-14T11:56:18.335677+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:56:18.335677+0000","last_undegraded":"2024-09-14T11:56:18.335677+0000","last_fullsized":"2024-09-14T11:56:18.335677+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:54.887564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'282","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.559297+0000","last_change":"2024-09-14T10:56:39.692620+0000","last_active":"2024-09-14T11:58:37.559297+0000","last_peered":"2024-09-14T11:58:37.559297+0000","last_clean":"2024-09-14T11:58:37.559297+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:37.559297+0000","last_undegraded":"2024-09-14T11:58:37.559297+0000","last_fullsized":"2024-09-14T11:58:37.559297+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19437,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":448,"num_read_kb":3420,"num_write":962,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'618","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.780930+0000","last_change":"2024-09-14T10:56:41.688962+0000","last_active":"2024-09-14T11:56:52.780930+0000","last_peered":"2024-09-14T11:56:52.780930+0000","last_clean":"2024-09-14T11:56:52.780930+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:56:52.780930+0000","last_undegraded":"2024-09-14T11:56:52.780930+0000","last_fullsized":"2024-09-14T11:56:52.780930+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'295","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.327505+0000","last_change":"2024-09-14T10:57:16.314650+0000","last_active":"2024-09-14T11:58:37.327505+0000","last_peered":"2024-09-14T11:58:37.327505+0000","last_clean":"2024-09-14T11:58:37.327505+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:37.327505+0000","last_undegraded":"2024-09-14T11:58:37.327505+0000","last_fullsized":"2024-09-14T11:58:37.327505+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:28.239442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057405,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":573,"num_read_kb":7722,"num_write":987,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1674","reported_seq":3374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817636+0000","last_change":"2024-09-14T10:56:41.701632+0000","last_active":"2024-09-14T11:55:53.817636+0000","last_peered":"2024-09-14T11:55:53.817636+0000","last_clean":"2024-09-14T11:55:53.817636+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:55:53.817636+0000","last_undegraded":"2024-09-14T11:55:53.817636+0000","last_fullsized":"2024-09-14T11:55:53.817636+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:14.899433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'299","reported_seq":1036,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.671356+0000","last_change":"2024-09-14T10:56:39.685631+0000","last_active":"2024-09-14T11:55:13.671356+0000","last_peered":"2024-09-14T11:55:13.671356+0000","last_clean":"2024-09-14T11:55:13.671356+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:55:13.671356+0000","last_undegraded":"2024-09-14T11:55:13.671356+0000","last_fullsized":"2024-09-14T11:55:13.671356+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:18.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14681427,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":673,"num_read_kb":21063,"num_write":1056,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'702","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754801+0000","last_change":"2024-09-14T10:57:15.795049+0000","last_active":"2024-09-14T11:56:12.754801+0000","last_peered":"2024-09-14T11:56:12.754801+0000","last_clean":"2024-09-14T11:56:12.754801+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:56:12.754801+0000","last_undegraded":"2024-09-14T11:56:12.754801+0000","last_fullsized":"2024-09-14T11:56:12.754801+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:10.949204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'289","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.394915+0000","last_change":"2024-09-14T10:56:39.690542+0000","last_active":"2024-09-14T11:58:37.394915+0000","last_peered":"2024-09-14T11:58:37.394915+0000","last_clean":"2024-09-14T11:58:37.394915+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:37.394915+0000","last_undegraded":"2024-09-14T11:58:37.394915+0000","last_fullsized":"2024-09-14T11:58:37.394915+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.115794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243370,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":489,"num_read_kb":36238,"num_write":1018,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'409","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910480+0000","last_change":"2024-09-14T10:56:41.690216+0000","last_active":"2024-09-14T11:56:51.910480+0000","last_peered":"2024-09-14T11:56:51.910480+0000","last_clean":"2024-09-14T11:56:51.910480+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:56:51.910480+0000","last_undegraded":"2024-09-14T11:56:51.910480+0000","last_fullsized":"2024-09-14T11:56:51.910480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.654443+0000","last_change":"2024-09-14T10:57:16.215847+0000","last_active":"2024-09-14T11:58:37.654443+0000","last_peered":"2024-09-14T11:58:37.654443+0000","last_clean":"2024-09-14T11:58:37.654443+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:37.654443+0000","last_undegraded":"2024-09-14T11:58:37.654443+0000","last_fullsized":"2024-09-14T11:58:37.654443+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294118,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":838,"num_read_kb":32735,"num_write":1138,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'725","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337741+0000","last_change":"2024-09-14T10:56:41.695355+0000","last_active":"2024-09-14T11:56:18.337741+0000","last_peered":"2024-09-14T11:56:18.337741+0000","last_clean":"2024-09-14T11:56:18.337741+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:56:18.337741+0000","last_undegraded":"2024-09-14T11:56:18.337741+0000","last_fullsized":"2024-09-14T11:56:18.337741+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.776564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'314","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.550171+0000","last_change":"2024-09-14T10:56:39.685637+0000","last_active":"2024-09-14T11:58:37.550171+0000","last_peered":"2024-09-14T11:58:37.550171+0000","last_clean":"2024-09-14T11:58:37.550171+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:37.550171+0000","last_undegraded":"2024-09-14T11:58:37.550171+0000","last_fullsized":"2024-09-14T11:58:37.550171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:42.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247989,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":616,"num_read_kb":35324,"num_write":1042,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.568879+0000","last_change":"2024-09-14T10:56:39.685937+0000","last_active":"2024-09-14T11:58:37.568879+0000","last_peered":"2024-09-14T11:58:37.568879+0000","last_clean":"2024-09-14T11:58:37.568879+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:37.568879+0000","last_undegraded":"2024-09-14T11:58:37.568879+0000","last_fullsized":"2024-09-14T11:58:37.568879+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.470574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7512937,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":468,"num_read_kb":8144,"num_write":937,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'848","reported_seq":2539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.311836+0000","last_change":"2024-09-14T10:56:41.697673+0000","last_active":"2024-09-14T11:56:49.311836+0000","last_peered":"2024-09-14T11:56:49.311836+0000","last_clean":"2024-09-14T11:56:49.311836+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:56:49.311836+0000","last_undegraded":"2024-09-14T11:56:49.311836+0000","last_fullsized":"2024-09-14T11:56:49.311836+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:15.211850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'361","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.392872+0000","last_change":"2024-09-14T10:56:39.678521+0000","last_active":"2024-09-14T11:58:37.392872+0000","last_peered":"2024-09-14T11:58:37.392872+0000","last_clean":"2024-09-14T11:58:37.392872+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:37.392872+0000","last_undegraded":"2024-09-14T11:58:37.392872+0000","last_fullsized":"2024-09-14T11:58:37.392872+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:30.975047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384611,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":982,"num_read_kb":40288,"num_write":1276,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'389","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:04.142380+0000","last_change":"2024-09-14T10:56:41.693372+0000","last_active":"2024-09-14T11:56:04.142380+0000","last_peered":"2024-09-14T11:56:04.142380+0000","last_clean":"2024-09-14T11:56:04.142380+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:56:04.142380+0000","last_undegraded":"2024-09-14T11:56:04.142380+0000","last_fullsized":"2024-09-14T11:56:04.142380+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:08.940223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1898,"ondisk_log_size":1898,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1903289,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18345,"num_read_kb":36812,"num_write":15458,"num_write_kb":11995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2392064,"data_stored":1948533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2214,"ondisk_log_size":2214,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3597,"ondisk_log_size":3597,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":460191582,"num_objects":3330,"num_object_clones":0,"num_object_copies":13320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3330,"num_whiteouts":0,"num_read":41542,"num_read_kb":1932058,"num_write":70575,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":669450240,"data_stored":669450240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4319,"ondisk_log_size":4319,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":54570267,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":148,"num_read_kb":187491,"num_write":168,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":92389376,"data_stored":92379702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":44041064,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":152,"num_read_kb":178270,"num_write":176,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":83902464,"data_stored":83896016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510193,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":399240,"kb_used_data":129272,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":93972600,"statfs":{"total":96636764160,"available":96227942400,"internally_reserved":0,"allocated":132374528,"data_stored":130410375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":276429254},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510190,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266680,"kb_used_data":163304,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94105160,"statfs":{"total":96636764160,"available":96363683840,"internally_reserved":0,"allocated":167223296,"data_stored":165289585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542893,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421844,"kb_used_data":111576,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93949996,"statfs":{"total":96636764160,"available":96204795904,"internally_reserved":0,"allocated":114253824,"data_stored":112204578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":317651402},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542896,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253824,"kb_used_data":96180,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94118016,"statfs":{"total":96636764160,"available":96376848384,"internally_reserved":0,"allocated":98488320,"data_stored":96444521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542894,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":402692,"kb_used_data":118728,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93969148,"statfs":{"total":96636764160,"available":96224407552,"internally_reserved":0,"allocated":121577472,"data_stored":119566800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542897,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208852,"kb_used_data":105420,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162988,"statfs":{"total":96636764160,"available":96422899712,"internally_reserved":0,"allocated":107950080,"data_stored":106022468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542895,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285796,"kb_used_data":101872,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94086044,"statfs":{"total":96636764160,"available":96344109056,"internally_reserved":0,"allocated":104316928,"data_stored":102342096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542894,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":390920,"kb_used_data":116788,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93980920,"statfs":{"total":96636764160,"available":96236462080,"internally_reserved":0,"allocated":119590912,"data_stored":117572619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81403904,"data_stored":81403904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65474560,"data_stored":65474560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46292992,"data_stored":46292992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":78364672,"data_stored":78364672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":120963072,"data_stored":120963072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":80044032,"data_stored":80044032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":113184768,"data_stored":113184768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":83722240,"data_stored":83722240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":222118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":225098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":86193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":327680,"data_stored":276780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":376999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17817600,"data_stored":17817600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5255168,"data_stored":5251944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27258880,"data_stored":27258880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4190208,"data_stored":4190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":9457664,"data_stored":9457664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4198400,"data_stored":4195176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10493952,"data_stored":10493069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7335936,"data_stored":7335936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21032960,"data_stored":21028123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14733312,"data_stored":14729358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5238784,"data_stored":5238784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14688256,"data_stored":14688256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:39.708 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:40.067 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:58:40.077 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:58:40.079 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2124,"stamp":"2024-09-14T11:58:39.891893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":449373531,"num_objects":3216,"num_object_clones":0,"num_object_copies":11886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3216,"num_whiteouts":0,"num_read":310000,"num_read_kb":2562967,"num_write":163378,"num_write_kb":2614708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13827,"ondisk_log_size":13827,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459968,"kb_used_data":759136,"kb_used_omap":12,"kb_used_meta":1699955,"kb_avail":752514752,"statfs":{"total":773094113280,"available":770575106048,"internally_reserved":0,"allocated":777355264,"data_stored":761451905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1740754480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-306507808,"num_objects":-1732,"num_object_clones":0,"num_object_copies":-6868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1732,"num_whiteouts":0,"num_read":1909,"num_read_kb":1366,"num_write":1821,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006012"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552583+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:55:27.552583+0000","last_peered":"2024-09-14T11:55:27.552583+0000","last_clean":"2024-09-14T11:55:27.552583+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:55:27.552583+0000","last_undegraded":"2024-09-14T11:55:27.552583+0000","last_fullsized":"2024-09-14T11:55:27.552583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":13318,"num_write":13,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.732014+0000","last_change":"2024-09-14T11:32:11.437735+0000","last_active":"2024-09-14T11:54:42.732014+0000","last_peered":"2024-09-14T11:54:42.732014+0000","last_clean":"2024-09-14T11:54:42.732014+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:54:42.732014+0000","last_undegraded":"2024-09-14T11:54:42.732014+0000","last_fullsized":"2024-09-14T11:54:42.732014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:47.395141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.650977+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:58:36.650977+0000","last_peered":"2024-09-14T11:58:36.650977+0000","last_clean":"2024-09-14T11:58:36.650977+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:58:36.650977+0000","last_undegraded":"2024-09-14T11:58:36.650977+0000","last_fullsized":"2024-09-14T11:58:36.650977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.449688+0000","last_change":"2024-09-14T11:15:22.382182+0000","last_active":"2024-09-14T11:57:52.449688+0000","last_peered":"2024-09-14T11:57:52.449688+0000","last_clean":"2024-09-14T11:57:52.449688+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:57:52.449688+0000","last_undegraded":"2024-09-14T11:57:52.449688+0000","last_fullsized":"2024-09-14T11:57:52.449688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:17.002880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.732724+0000","last_change":"2024-09-14T11:12:39.149946+0000","last_active":"2024-09-14T11:54:47.732724+0000","last_peered":"2024-09-14T11:54:47.732724+0000","last_clean":"2024-09-14T11:54:47.732724+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:54:47.732724+0000","last_undegraded":"2024-09-14T11:54:47.732724+0000","last_fullsized":"2024-09-14T11:54:47.732724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:07.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.660125+0000","last_change":"2024-09-14T11:32:11.434861+0000","last_active":"2024-09-14T11:53:58.660125+0000","last_peered":"2024-09-14T11:53:58.660125+0000","last_clean":"2024-09-14T11:53:58.660125+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:58.660125+0000","last_undegraded":"2024-09-14T11:53:58.660125+0000","last_fullsized":"2024-09-14T11:53:58.660125+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:31.993353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655710+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:55:02.655710+0000","last_peered":"2024-09-14T11:55:02.655710+0000","last_clean":"2024-09-14T11:55:02.655710+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:55:02.655710+0000","last_undegraded":"2024-09-14T11:55:02.655710+0000","last_fullsized":"2024-09-14T11:55:02.655710+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:42.694530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738922+0000","last_change":"2024-09-14T11:15:22.378824+0000","last_active":"2024-09-14T11:55:27.738922+0000","last_peered":"2024-09-14T11:55:27.738922+0000","last_clean":"2024-09-14T11:55:27.738922+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:55:27.738922+0000","last_undegraded":"2024-09-14T11:55:27.738922+0000","last_fullsized":"2024-09-14T11:55:27.738922+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647590+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:53:57.647590+0000","last_peered":"2024-09-14T11:53:57.647590+0000","last_clean":"2024-09-14T11:53:57.647590+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:53:57.647590+0000","last_undegraded":"2024-09-14T11:53:57.647590+0000","last_fullsized":"2024-09-14T11:53:57.647590+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:18.964434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.450876+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:57:37.450876+0000","last_peered":"2024-09-14T11:57:37.450876+0000","last_clean":"2024-09-14T11:57:37.450876+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:57:37.450876+0000","last_undegraded":"2024-09-14T11:57:37.450876+0000","last_fullsized":"2024-09-14T11:57:37.450876+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":9,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.444017+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:57:03.444017+0000","last_peered":"2024-09-14T11:57:03.444017+0000","last_clean":"2024-09-14T11:57:03.444017+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:57:03.444017+0000","last_undegraded":"2024-09-14T11:57:03.444017+0000","last_fullsized":"2024-09-14T11:57:03.444017+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541604+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:54:17.541604+0000","last_peered":"2024-09-14T11:54:17.541604+0000","last_clean":"2024-09-14T11:54:17.541604+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:54:17.541604+0000","last_undegraded":"2024-09-14T11:54:17.541604+0000","last_fullsized":"2024-09-14T11:54:17.541604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.758307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.647995+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:54:02.647995+0000","last_peered":"2024-09-14T11:54:02.647995+0000","last_clean":"2024-09-14T11:54:02.647995+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:54:02.647995+0000","last_undegraded":"2024-09-14T11:54:02.647995+0000","last_fullsized":"2024-09-14T11:54:02.647995+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.355968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535330+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:55:07.535330+0000","last_peered":"2024-09-14T11:55:07.535330+0000","last_clean":"2024-09-14T11:55:07.535330+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:55:07.535330+0000","last_undegraded":"2024-09-14T11:55:07.535330+0000","last_fullsized":"2024-09-14T11:55:07.535330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:34.726917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.683250+0000","last_change":"2024-09-14T11:15:25.395023+0000","last_active":"2024-09-14T11:56:33.683250+0000","last_peered":"2024-09-14T11:56:33.683250+0000","last_clean":"2024-09-14T11:56:33.683250+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:56:33.683250+0000","last_undegraded":"2024-09-14T11:56:33.683250+0000","last_fullsized":"2024-09-14T11:56:33.683250+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:00.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10232,"num_write":5,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.440709+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:56:43.440709+0000","last_peered":"2024-09-14T11:56:43.440709+0000","last_clean":"2024-09-14T11:56:43.440709+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:56:43.440709+0000","last_undegraded":"2024-09-14T11:56:43.440709+0000","last_fullsized":"2024-09-14T11:56:43.440709+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.328393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670510+0000","last_change":"2024-09-14T11:12:39.152199+0000","last_active":"2024-09-14T11:55:08.670510+0000","last_peered":"2024-09-14T11:55:08.670510+0000","last_clean":"2024-09-14T11:55:08.670510+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:55:08.670510+0000","last_undegraded":"2024-09-14T11:55:08.670510+0000","last_fullsized":"2024-09-14T11:55:08.670510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:33.862160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.673548+0000","last_change":"2024-09-14T11:15:25.385836+0000","last_active":"2024-09-14T11:55:28.673548+0000","last_peered":"2024-09-14T11:55:28.673548+0000","last_clean":"2024-09-14T11:55:28.673548+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:55:28.673548+0000","last_undegraded":"2024-09-14T11:55:28.673548+0000","last_fullsized":"2024-09-14T11:55:28.673548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:47.787237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.835728+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:58:36.835728+0000","last_peered":"2024-09-14T11:58:36.835728+0000","last_clean":"2024-09-14T11:58:36.835728+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:58:36.835728+0000","last_undegraded":"2024-09-14T11:58:36.835728+0000","last_fullsized":"2024-09-14T11:58:36.835728+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.646678+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:53:52.646678+0000","last_peered":"2024-09-14T11:53:52.646678+0000","last_clean":"2024-09-14T11:53:52.646678+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:53:52.646678+0000","last_undegraded":"2024-09-14T11:53:52.646678+0000","last_fullsized":"2024-09-14T11:53:52.646678+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:27.384797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659128+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:55:27.659128+0000","last_peered":"2024-09-14T11:55:27.659128+0000","last_clean":"2024-09-14T11:55:27.659128+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:55:27.659128+0000","last_undegraded":"2024-09-14T11:55:27.659128+0000","last_fullsized":"2024-09-14T11:55:27.659128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.543032+0000","last_change":"2024-09-14T11:12:39.148861+0000","last_active":"2024-09-14T11:56:12.543032+0000","last_peered":"2024-09-14T11:56:12.543032+0000","last_clean":"2024-09-14T11:56:12.543032+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:56:12.543032+0000","last_undegraded":"2024-09-14T11:56:12.543032+0000","last_fullsized":"2024-09-14T11:56:12.543032+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:48.885213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.538794+0000","last_change":"2024-09-14T11:32:11.441324+0000","last_active":"2024-09-14T11:55:32.538794+0000","last_peered":"2024-09-14T11:55:32.538794+0000","last_clean":"2024-09-14T11:55:32.538794+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:55:32.538794+0000","last_undegraded":"2024-09-14T11:55:32.538794+0000","last_fullsized":"2024-09-14T11:55:32.538794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:40.912189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.654974+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:54:57.654974+0000","last_peered":"2024-09-14T11:54:57.654974+0000","last_clean":"2024-09-14T11:54:57.654974+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:54:57.654974+0000","last_undegraded":"2024-09-14T11:54:57.654974+0000","last_fullsized":"2024-09-14T11:54:57.654974+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.739392+0000","last_change":"2024-09-14T11:32:11.425898+0000","last_active":"2024-09-14T11:55:32.739392+0000","last_peered":"2024-09-14T11:55:32.739392+0000","last_clean":"2024-09-14T11:55:32.739392+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:55:32.739392+0000","last_undegraded":"2024-09-14T11:55:32.739392+0000","last_fullsized":"2024-09-14T11:55:32.739392+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:44.908579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.661902+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:54:02.661902+0000","last_peered":"2024-09-14T11:54:02.661902+0000","last_clean":"2024-09-14T11:54:02.661902+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:54:02.661902+0000","last_undegraded":"2024-09-14T11:54:02.661902+0000","last_fullsized":"2024-09-14T11:54:02.661902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:37.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.648976+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:54:07.648976+0000","last_peered":"2024-09-14T11:54:07.648976+0000","last_clean":"2024-09-14T11:54:07.648976+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:54:07.648976+0000","last_undegraded":"2024-09-14T11:54:07.648976+0000","last_fullsized":"2024-09-14T11:54:07.648976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:25.067236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615637+0000","last_change":"2024-09-14T11:15:22.364016+0000","last_active":"2024-09-14T11:58:37.615637+0000","last_peered":"2024-09-14T11:58:37.615637+0000","last_clean":"2024-09-14T11:58:37.615637+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:58:37.615637+0000","last_undegraded":"2024-09-14T11:58:37.615637+0000","last_fullsized":"2024-09-14T11:58:37.615637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:25.332714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.743509+0000","last_change":"2024-09-14T11:12:39.148536+0000","last_active":"2024-09-14T11:56:12.743509+0000","last_peered":"2024-09-14T11:56:12.743509+0000","last_clean":"2024-09-14T11:56:12.743509+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:56:12.743509+0000","last_undegraded":"2024-09-14T11:56:12.743509+0000","last_fullsized":"2024-09-14T11:56:12.743509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:22.270515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.439116+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:56:33.439116+0000","last_peered":"2024-09-14T11:56:33.439116+0000","last_clean":"2024-09-14T11:56:33.439116+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:56:33.439116+0000","last_undegraded":"2024-09-14T11:56:33.439116+0000","last_fullsized":"2024-09-14T11:56:33.439116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:54.069010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648099+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:54:02.648099+0000","last_peered":"2024-09-14T11:54:02.648099+0000","last_clean":"2024-09-14T11:54:02.648099+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:54:02.648099+0000","last_undegraded":"2024-09-14T11:54:02.648099+0000","last_fullsized":"2024-09-14T11:54:02.648099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.960689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647680+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:53:57.647680+0000","last_peered":"2024-09-14T11:53:57.647680+0000","last_clean":"2024-09-14T11:53:57.647680+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:53:57.647680+0000","last_undegraded":"2024-09-14T11:53:57.647680+0000","last_fullsized":"2024-09-14T11:53:57.647680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:18.749825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446319+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:57:27.446319+0000","last_peered":"2024-09-14T11:57:27.446319+0000","last_clean":"2024-09-14T11:57:27.446319+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:57:27.446319+0000","last_undegraded":"2024-09-14T11:57:27.446319+0000","last_fullsized":"2024-09-14T11:57:27.446319+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":15350,"num_write":13,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447296+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:57:23.447296+0000","last_peered":"2024-09-14T11:57:23.447296+0000","last_clean":"2024-09-14T11:57:23.447296+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:57:23.447296+0000","last_undegraded":"2024-09-14T11:57:23.447296+0000","last_fullsized":"2024-09-14T11:57:23.447296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668344+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:54:42.668344+0000","last_peered":"2024-09-14T11:54:42.668344+0000","last_clean":"2024-09-14T11:54:42.668344+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:54:42.668344+0000","last_undegraded":"2024-09-14T11:54:42.668344+0000","last_fullsized":"2024-09-14T11:54:42.668344+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647472+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:53:57.647472+0000","last_peered":"2024-09-14T11:53:57.647472+0000","last_clean":"2024-09-14T11:53:57.647472+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:57.647472+0000","last_undegraded":"2024-09-14T11:53:57.647472+0000","last_fullsized":"2024-09-14T11:53:57.647472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:22.717875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446265+0000","last_change":"2024-09-14T11:15:25.391047+0000","last_active":"2024-09-14T11:57:27.446265+0000","last_peered":"2024-09-14T11:57:27.446265+0000","last_clean":"2024-09-14T11:57:27.446265+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:57:27.446265+0000","last_undegraded":"2024-09-14T11:57:27.446265+0000","last_fullsized":"2024-09-14T11:57:27.446265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:36.099082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652801+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:54:42.652801+0000","last_peered":"2024-09-14T11:54:42.652801+0000","last_clean":"2024-09-14T11:54:42.652801+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:54:42.652801+0000","last_undegraded":"2024-09-14T11:54:42.652801+0000","last_fullsized":"2024-09-14T11:54:42.652801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:54.823817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669689+0000","last_change":"2024-09-14T11:15:22.380265+0000","last_active":"2024-09-14T11:55:03.669689+0000","last_peered":"2024-09-14T11:55:03.669689+0000","last_clean":"2024-09-14T11:55:03.669689+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:55:03.669689+0000","last_undegraded":"2024-09-14T11:55:03.669689+0000","last_fullsized":"2024-09-14T11:55:03.669689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.546224+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:54:38.546224+0000","last_peered":"2024-09-14T11:54:38.546224+0000","last_clean":"2024-09-14T11:54:38.546224+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:54:38.546224+0000","last_undegraded":"2024-09-14T11:54:38.546224+0000","last_fullsized":"2024-09-14T11:54:38.546224+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647657+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:53:57.647657+0000","last_peered":"2024-09-14T11:53:57.647657+0000","last_clean":"2024-09-14T11:53:57.647657+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:53:57.647657+0000","last_undegraded":"2024-09-14T11:53:57.647657+0000","last_fullsized":"2024-09-14T11:53:57.647657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:43.844584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670462+0000","last_change":"2024-09-14T11:15:25.394352+0000","last_active":"2024-09-14T11:55:08.670462+0000","last_peered":"2024-09-14T11:55:08.670462+0000","last_clean":"2024-09-14T11:55:08.670462+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:55:08.670462+0000","last_undegraded":"2024-09-14T11:55:08.670462+0000","last_fullsized":"2024-09-14T11:55:08.670462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:35.832475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653140+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:54:42.653140+0000","last_peered":"2024-09-14T11:54:42.653140+0000","last_clean":"2024-09-14T11:54:42.653140+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:54:42.653140+0000","last_undegraded":"2024-09-14T11:54:42.653140+0000","last_fullsized":"2024-09-14T11:54:42.653140+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:29.954707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.742985+0000","last_change":"2024-09-14T11:32:11.425357+0000","last_active":"2024-09-14T11:56:07.742985+0000","last_peered":"2024-09-14T11:56:07.742985+0000","last_clean":"2024-09-14T11:56:07.742985+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:56:07.742985+0000","last_undegraded":"2024-09-14T11:56:07.742985+0000","last_fullsized":"2024-09-14T11:56:07.742985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:04.671224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.679588+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:55:52.679588+0000","last_peered":"2024-09-14T11:55:52.679588+0000","last_clean":"2024-09-14T11:55:52.679588+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:55:52.679588+0000","last_undegraded":"2024-09-14T11:55:52.679588+0000","last_fullsized":"2024-09-14T11:55:52.679588+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":3079,"num_write":5,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668319+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:54:42.668319+0000","last_peered":"2024-09-14T11:54:42.668319+0000","last_clean":"2024-09-14T11:54:42.668319+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:54:42.668319+0000","last_undegraded":"2024-09-14T11:54:42.668319+0000","last_fullsized":"2024-09-14T11:54:42.668319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:51.143671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662654+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:55:57.662654+0000","last_peered":"2024-09-14T11:55:57.662654+0000","last_clean":"2024-09-14T11:55:57.662654+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:55:57.662654+0000","last_undegraded":"2024-09-14T11:55:57.662654+0000","last_fullsized":"2024-09-14T11:55:57.662654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.741529+0000","last_change":"2024-09-14T11:15:22.370925+0000","last_active":"2024-09-14T11:55:52.741529+0000","last_peered":"2024-09-14T11:55:52.741529+0000","last_clean":"2024-09-14T11:55:52.741529+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:55:52.741529+0000","last_undegraded":"2024-09-14T11:55:52.741529+0000","last_fullsized":"2024-09-14T11:55:52.741529+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.657676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.678742+0000","last_change":"2024-09-14T11:32:11.435885+0000","last_active":"2024-09-14T11:56:03.678742+0000","last_peered":"2024-09-14T11:56:03.678742+0000","last_clean":"2024-09-14T11:56:03.678742+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:56:03.678742+0000","last_undegraded":"2024-09-14T11:56:03.678742+0000","last_fullsized":"2024-09-14T11:56:03.678742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:04.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:27.454554+0000","last_change":"2024-09-14T11:15:25.389833+0000","last_active":"2024-09-14T11:58:27.454554+0000","last_peered":"2024-09-14T11:58:27.454554+0000","last_clean":"2024-09-14T11:58:27.454554+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:58:27.454554+0000","last_undegraded":"2024-09-14T11:58:27.454554+0000","last_fullsized":"2024-09-14T11:58:27.454554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.345624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672755+0000","last_change":"2024-09-14T11:12:39.147355+0000","last_active":"2024-09-14T11:55:23.672755+0000","last_peered":"2024-09-14T11:55:23.672755+0000","last_clean":"2024-09-14T11:55:23.672755+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:55:23.672755+0000","last_undegraded":"2024-09-14T11:55:23.672755+0000","last_fullsized":"2024-09-14T11:55:23.672755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:13.956283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.542021+0000","last_change":"2024-09-14T11:15:22.379118+0000","last_active":"2024-09-14T11:56:02.542021+0000","last_peered":"2024-09-14T11:56:02.542021+0000","last_clean":"2024-09-14T11:56:02.542021+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:56:02.542021+0000","last_undegraded":"2024-09-14T11:56:02.542021+0000","last_fullsized":"2024-09-14T11:56:02.542021+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.600963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738869+0000","last_change":"2024-09-14T11:12:39.149430+0000","last_active":"2024-09-14T11:55:27.738869+0000","last_peered":"2024-09-14T11:55:27.738869+0000","last_clean":"2024-09-14T11:55:27.738869+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:55:27.738869+0000","last_undegraded":"2024-09-14T11:55:27.738869+0000","last_fullsized":"2024-09-14T11:55:27.738869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653286+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:54:42.653286+0000","last_peered":"2024-09-14T11:54:42.653286+0000","last_clean":"2024-09-14T11:54:42.653286+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:54:42.653286+0000","last_undegraded":"2024-09-14T11:54:42.653286+0000","last_fullsized":"2024-09-14T11:54:42.653286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:15.841468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544712+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:54:28.544712+0000","last_peered":"2024-09-14T11:54:28.544712+0000","last_clean":"2024-09-14T11:54:28.544712+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:54:28.544712+0000","last_undegraded":"2024-09-14T11:54:28.544712+0000","last_fullsized":"2024-09-14T11:54:28.544712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:36.393782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101966,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2106,"num_write":3,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.650300+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:54:22.650300+0000","last_peered":"2024-09-14T11:54:22.650300+0000","last_clean":"2024-09-14T11:54:22.650300+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:54:22.650300+0000","last_undegraded":"2024-09-14T11:54:22.650300+0000","last_fullsized":"2024-09-14T11:54:22.650300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:49.433106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668478+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:54:42.668478+0000","last_peered":"2024-09-14T11:54:42.668478+0000","last_clean":"2024-09-14T11:54:42.668478+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:54:42.668478+0000","last_undegraded":"2024-09-14T11:54:42.668478+0000","last_fullsized":"2024-09-14T11:54:42.668478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.627281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'11","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665597+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:54:27.665597+0000","last_peered":"2024-09-14T11:54:27.665597+0000","last_clean":"2024-09-14T11:54:27.665597+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:54:27.665597+0000","last_undegraded":"2024-09-14T11:54:27.665597+0000","last_fullsized":"2024-09-14T11:54:27.665597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.725661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":9238,"num_write":21,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.530112+0000","last_change":"2024-09-14T11:15:22.377316+0000","last_active":"2024-09-14T11:54:22.530112+0000","last_peered":"2024-09-14T11:54:22.530112+0000","last_clean":"2024-09-14T11:54:22.530112+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:54:22.530112+0000","last_undegraded":"2024-09-14T11:54:22.530112+0000","last_fullsized":"2024-09-14T11:54:22.530112+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:25.594786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668371+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:54:42.668371+0000","last_peered":"2024-09-14T11:54:42.668371+0000","last_clean":"2024-09-14T11:54:42.668371+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:54:42.668371+0000","last_undegraded":"2024-09-14T11:54:42.668371+0000","last_fullsized":"2024-09-14T11:54:42.668371+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:37.210143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.650977+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:54:27.650977+0000","last_peered":"2024-09-14T11:54:27.650977+0000","last_clean":"2024-09-14T11:54:27.650977+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:54:27.650977+0000","last_undegraded":"2024-09-14T11:54:27.650977+0000","last_fullsized":"2024-09-14T11:54:27.650977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:47.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652877+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:54:42.652877+0000","last_peered":"2024-09-14T11:54:42.652877+0000","last_clean":"2024-09-14T11:54:42.652877+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:54:42.652877+0000","last_undegraded":"2024-09-14T11:54:42.652877+0000","last_fullsized":"2024-09-14T11:54:42.652877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:12.740126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.434370+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:56:47.434370+0000","last_peered":"2024-09-14T11:56:47.434370+0000","last_clean":"2024-09-14T11:56:47.434370+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:56:47.434370+0000","last_undegraded":"2024-09-14T11:56:47.434370+0000","last_fullsized":"2024-09-14T11:56:47.434370+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":9236,"num_write":12,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.454028+0000","last_change":"2024-09-14T11:15:22.380025+0000","last_active":"2024-09-14T11:58:08.454028+0000","last_peered":"2024-09-14T11:58:08.454028+0000","last_clean":"2024-09-14T11:58:08.454028+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:58:08.454028+0000","last_undegraded":"2024-09-14T11:58:08.454028+0000","last_fullsized":"2024-09-14T11:58:08.454028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:46.350891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678034+0000","last_change":"2024-09-14T11:12:39.148220+0000","last_active":"2024-09-14T11:55:58.678034+0000","last_peered":"2024-09-14T11:55:58.678034+0000","last_clean":"2024-09-14T11:55:58.678034+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:55:58.678034+0000","last_undegraded":"2024-09-14T11:55:58.678034+0000","last_fullsized":"2024-09-14T11:55:58.678034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:39.515999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672229+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:55:07.672229+0000","last_peered":"2024-09-14T11:55:07.672229+0000","last_clean":"2024-09-14T11:55:07.672229+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:55:07.672229+0000","last_undegraded":"2024-09-14T11:55:07.672229+0000","last_fullsized":"2024-09-14T11:55:07.672229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:49.122371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656337+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:55:07.656337+0000","last_peered":"2024-09-14T11:55:07.656337+0000","last_clean":"2024-09-14T11:55:07.656337+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:55:07.656337+0000","last_undegraded":"2024-09-14T11:55:07.656337+0000","last_fullsized":"2024-09-14T11:55:07.656337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436876+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:57:02.436876+0000","last_peered":"2024-09-14T11:57:02.436876+0000","last_clean":"2024-09-14T11:57:02.436876+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:57:02.436876+0000","last_undegraded":"2024-09-14T11:57:02.436876+0000","last_fullsized":"2024-09-14T11:57:02.436876+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:13.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663286+0000","last_change":"2024-09-14T11:12:39.156458+0000","last_active":"2024-09-14T11:56:02.663286+0000","last_peered":"2024-09-14T11:56:02.663286+0000","last_clean":"2024-09-14T11:56:02.663286+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:56:02.663286+0000","last_undegraded":"2024-09-14T11:56:02.663286+0000","last_fullsized":"2024-09-14T11:56:02.663286+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:31.776422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.549256+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:55:07.549256+0000","last_peered":"2024-09-14T11:55:07.549256+0000","last_clean":"2024-09-14T11:55:07.549256+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:55:07.549256+0000","last_undegraded":"2024-09-14T11:55:07.549256+0000","last_fullsized":"2024-09-14T11:55:07.549256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:29.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655633+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:55:02.655633+0000","last_peered":"2024-09-14T11:55:02.655633+0000","last_clean":"2024-09-14T11:55:02.655633+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:55:02.655633+0000","last_undegraded":"2024-09-14T11:55:02.655633+0000","last_fullsized":"2024-09-14T11:55:02.655633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:50.686182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.734284+0000","last_change":"2024-09-14T11:15:22.372158+0000","last_active":"2024-09-14T11:55:02.734284+0000","last_peered":"2024-09-14T11:55:02.734284+0000","last_clean":"2024-09-14T11:55:02.734284+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:55:02.734284+0000","last_undegraded":"2024-09-14T11:55:02.734284+0000","last_fullsized":"2024-09-14T11:55:02.734284+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.110739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678107+0000","last_change":"2024-09-14T11:12:39.150717+0000","last_active":"2024-09-14T11:55:58.678107+0000","last_peered":"2024-09-14T11:55:58.678107+0000","last_clean":"2024-09-14T11:55:58.678107+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:55:58.678107+0000","last_undegraded":"2024-09-14T11:55:58.678107+0000","last_fullsized":"2024-09-14T11:55:58.678107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:45.689240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665743+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:54:27.665743+0000","last_peered":"2024-09-14T11:54:27.665743+0000","last_clean":"2024-09-14T11:54:27.665743+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:54:27.665743+0000","last_undegraded":"2024-09-14T11:54:27.665743+0000","last_fullsized":"2024-09-14T11:54:27.665743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:26.826579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.542574+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:54:22.542574+0000","last_peered":"2024-09-14T11:54:22.542574+0000","last_clean":"2024-09-14T11:54:22.542574+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:54:22.542574+0000","last_undegraded":"2024-09-14T11:54:22.542574+0000","last_fullsized":"2024-09-14T11:54:22.542574+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665689+0000","last_change":"2024-09-14T11:12:39.152381+0000","last_active":"2024-09-14T11:54:27.665689+0000","last_peered":"2024-09-14T11:54:27.665689+0000","last_clean":"2024-09-14T11:54:27.665689+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:54:27.665689+0000","last_undegraded":"2024-09-14T11:54:27.665689+0000","last_fullsized":"2024-09-14T11:54:27.665689+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:49.106166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550583+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:55:08.550583+0000","last_peered":"2024-09-14T11:55:08.550583+0000","last_clean":"2024-09-14T11:55:08.550583+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:55:08.550583+0000","last_undegraded":"2024-09-14T11:55:08.550583+0000","last_fullsized":"2024-09-14T11:55:08.550583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:30.888765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544802+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:54:28.544802+0000","last_peered":"2024-09-14T11:54:28.544802+0000","last_clean":"2024-09-14T11:54:28.544802+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:54:28.544802+0000","last_undegraded":"2024-09-14T11:54:28.544802+0000","last_fullsized":"2024-09-14T11:54:28.544802+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.330595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.432156+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:56:32.432156+0000","last_peered":"2024-09-14T11:56:32.432156+0000","last_clean":"2024-09-14T11:56:32.432156+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:56:32.432156+0000","last_undegraded":"2024-09-14T11:56:32.432156+0000","last_fullsized":"2024-09-14T11:56:32.432156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.438324+0000","last_change":"2024-09-14T11:12:39.147602+0000","last_active":"2024-09-14T11:56:27.438324+0000","last_peered":"2024-09-14T11:56:27.438324+0000","last_clean":"2024-09-14T11:56:27.438324+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:56:27.438324+0000","last_undegraded":"2024-09-14T11:56:27.438324+0000","last_fullsized":"2024-09-14T11:56:27.438324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:46.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.742512+0000","last_change":"2024-09-14T11:32:11.429687+0000","last_active":"2024-09-14T11:56:02.742512+0000","last_peered":"2024-09-14T11:56:02.742512+0000","last_clean":"2024-09-14T11:56:02.742512+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:56:02.742512+0000","last_undegraded":"2024-09-14T11:56:02.742512+0000","last_fullsized":"2024-09-14T11:56:02.742512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:04.011582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443285+0000","last_change":"2024-09-14T11:15:25.393792+0000","last_active":"2024-09-14T11:57:07.443285+0000","last_peered":"2024-09-14T11:57:07.443285+0000","last_clean":"2024-09-14T11:57:07.443285+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:57:07.443285+0000","last_undegraded":"2024-09-14T11:57:07.443285+0000","last_fullsized":"2024-09-14T11:57:07.443285+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:55.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16376,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.441510+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:57:32.441510+0000","last_peered":"2024-09-14T11:57:32.441510+0000","last_clean":"2024-09-14T11:57:32.441510+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:57:32.441510+0000","last_undegraded":"2024-09-14T11:57:32.441510+0000","last_fullsized":"2024-09-14T11:57:32.441510+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7164,"num_write":11,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:37.553896+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:55:37.553896+0000","last_peered":"2024-09-14T11:55:37.553896+0000","last_clean":"2024-09-14T11:55:37.553896+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:55:37.553896+0000","last_undegraded":"2024-09-14T11:55:37.553896+0000","last_fullsized":"2024-09-14T11:55:37.553896+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12313,"num_write":19,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670674+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:54:57.670674+0000","last_peered":"2024-09-14T11:54:57.670674+0000","last_clean":"2024-09-14T11:54:57.670674+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:54:57.670674+0000","last_undegraded":"2024-09-14T11:54:57.670674+0000","last_fullsized":"2024-09-14T11:54:57.670674+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.148504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.437717+0000","last_change":"2024-09-14T11:12:39.147615+0000","last_active":"2024-09-14T11:56:23.437717+0000","last_peered":"2024-09-14T11:56:23.437717+0000","last_clean":"2024-09-14T11:56:23.437717+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:56:23.437717+0000","last_undegraded":"2024-09-14T11:56:23.437717+0000","last_fullsized":"2024-09-14T11:56:23.437717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:19.785409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656302+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:55:07.656302+0000","last_peered":"2024-09-14T11:55:07.656302+0000","last_clean":"2024-09-14T11:55:07.656302+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:55:07.656302+0000","last_undegraded":"2024-09-14T11:55:07.656302+0000","last_fullsized":"2024-09-14T11:55:07.656302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:40.123052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669707+0000","last_change":"2024-09-14T11:15:25.396627+0000","last_active":"2024-09-14T11:55:03.669707+0000","last_peered":"2024-09-14T11:55:03.669707+0000","last_clean":"2024-09-14T11:55:03.669707+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:55:03.669707+0000","last_undegraded":"2024-09-14T11:55:03.669707+0000","last_fullsized":"2024-09-14T11:55:03.669707+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:23.471334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534143+0000","last_change":"2024-09-14T11:15:22.378471+0000","last_active":"2024-09-14T11:54:57.534143+0000","last_peered":"2024-09-14T11:54:57.534143+0000","last_clean":"2024-09-14T11:54:57.534143+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:54:57.534143+0000","last_undegraded":"2024-09-14T11:54:57.534143+0000","last_fullsized":"2024-09-14T11:54:57.534143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:11.906269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681832+0000","last_change":"2024-09-14T11:12:39.142992+0000","last_active":"2024-09-14T11:56:23.681832+0000","last_peered":"2024-09-14T11:56:23.681832+0000","last_clean":"2024-09-14T11:56:23.681832+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:56:23.681832+0000","last_undegraded":"2024-09-14T11:56:23.681832+0000","last_fullsized":"2024-09-14T11:56:23.681832+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.230213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672320+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:55:07.672320+0000","last_peered":"2024-09-14T11:55:07.672320+0000","last_clean":"2024-09-14T11:55:07.672320+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:55:07.672320+0000","last_undegraded":"2024-09-14T11:55:07.672320+0000","last_fullsized":"2024-09-14T11:55:07.672320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:44.097739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549751+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:55:03.549751+0000","last_peered":"2024-09-14T11:55:03.549751+0000","last_clean":"2024-09-14T11:55:03.549751+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:55:03.549751+0000","last_undegraded":"2024-09-14T11:55:03.549751+0000","last_fullsized":"2024-09-14T11:55:03.549751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669044+0000","last_change":"2024-09-14T11:15:22.376114+0000","last_active":"2024-09-14T11:54:58.669044+0000","last_peered":"2024-09-14T11:54:58.669044+0000","last_clean":"2024-09-14T11:54:58.669044+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:54:58.669044+0000","last_undegraded":"2024-09-14T11:54:58.669044+0000","last_fullsized":"2024-09-14T11:54:58.669044+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:22.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.668992+0000","last_change":"2024-09-14T11:12:39.149756+0000","last_active":"2024-09-14T11:54:47.668992+0000","last_peered":"2024-09-14T11:54:47.668992+0000","last_clean":"2024-09-14T11:54:47.668992+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:54:47.668992+0000","last_undegraded":"2024-09-14T11:54:47.668992+0000","last_fullsized":"2024-09-14T11:54:47.668992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:07.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'314","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400780+0000","last_change":"2024-09-14T10:56:39.693906+0000","last_active":"2024-09-14T11:58:37.400780+0000","last_peered":"2024-09-14T11:58:37.400780+0000","last_clean":"2024-09-14T11:58:37.400780+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:58:37.400780+0000","last_undegraded":"2024-09-14T11:58:37.400780+0000","last_fullsized":"2024-09-14T11:58:37.400780+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:28.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9490061,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":574,"num_read_kb":9138,"num_write":1077,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'440","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.264788+0000","last_change":"2024-09-14T10:56:41.690207+0000","last_active":"2024-09-14T11:55:58.264788+0000","last_peered":"2024-09-14T11:55:58.264788+0000","last_clean":"2024-09-14T11:55:58.264788+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:55:58.264788+0000","last_undegraded":"2024-09-14T11:55:58.264788+0000","last_fullsized":"2024-09-14T11:55:58.264788+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:16.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'306","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.354229+0000","last_change":"2024-09-14T10:56:39.680660+0000","last_active":"2024-09-14T11:58:37.354229+0000","last_peered":"2024-09-14T11:58:37.354229+0000","last_clean":"2024-09-14T11:58:37.354229+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:37.354229+0000","last_undegraded":"2024-09-14T11:58:37.354229+0000","last_fullsized":"2024-09-14T11:58:37.354229+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:39.615498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9815057,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":571,"num_read_kb":47838,"num_write":1145,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'490","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460547+0000","last_change":"2024-09-14T10:56:41.699684+0000","last_active":"2024-09-14T11:56:10.460547+0000","last_peered":"2024-09-14T11:56:10.460547+0000","last_clean":"2024-09-14T11:56:10.460547+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:56:10.460547+0000","last_undegraded":"2024-09-14T11:56:10.460547+0000","last_fullsized":"2024-09-14T11:56:10.460547+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'364","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415833+0000","last_change":"2024-09-14T10:56:39.673016+0000","last_active":"2024-09-14T11:58:37.415833+0000","last_peered":"2024-09-14T11:58:37.415833+0000","last_clean":"2024-09-14T11:58:37.415833+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:37.415833+0000","last_undegraded":"2024-09-14T11:58:37.415833+0000","last_fullsized":"2024-09-14T11:58:37.415833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:56.452286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10971206,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":789,"num_read_kb":44180,"num_write":1229,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'371","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337410+0000","last_change":"2024-09-14T10:56:41.694979+0000","last_active":"2024-09-14T11:56:18.337410+0000","last_peered":"2024-09-14T11:56:18.337410+0000","last_clean":"2024-09-14T11:56:18.337410+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:56:18.337410+0000","last_undegraded":"2024-09-14T11:56:18.337410+0000","last_fullsized":"2024-09-14T11:56:18.337410+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:14.514694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'436","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.539746+0000","last_change":"2024-09-14T10:56:39.693767+0000","last_active":"2024-09-14T11:58:37.539746+0000","last_peered":"2024-09-14T11:58:37.539746+0000","last_clean":"2024-09-14T11:58:37.539746+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:37.539746+0000","last_undegraded":"2024-09-14T11:58:37.539746+0000","last_fullsized":"2024-09-14T11:58:37.539746+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:57.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17561900,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":946,"num_read_kb":27790,"num_write":1275,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1224","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266363+0000","last_change":"2024-09-14T10:56:41.698071+0000","last_active":"2024-09-14T11:55:58.266363+0000","last_peered":"2024-09-14T11:55:58.266363+0000","last_clean":"2024-09-14T11:55:58.266363+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:55:58.266363+0000","last_undegraded":"2024-09-14T11:55:58.266363+0000","last_fullsized":"2024-09-14T11:55:58.266363+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:18.150057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'307","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.378471+0000","last_change":"2024-09-14T10:56:39.695001+0000","last_active":"2024-09-14T11:58:37.378471+0000","last_peered":"2024-09-14T11:58:37.378471+0000","last_clean":"2024-09-14T11:58:37.378471+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:37.378471+0000","last_undegraded":"2024-09-14T11:58:37.378471+0000","last_fullsized":"2024-09-14T11:58:37.378471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.100648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8382083,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":505,"num_read_kb":13771,"num_write":1043,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'575","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266908+0000","last_change":"2024-09-14T10:56:41.688774+0000","last_active":"2024-09-14T11:55:58.266908+0000","last_peered":"2024-09-14T11:55:58.266908+0000","last_clean":"2024-09-14T11:55:58.266908+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:55:58.266908+0000","last_undegraded":"2024-09-14T11:55:58.266908+0000","last_fullsized":"2024-09-14T11:55:58.266908+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:12.204837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'299","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.546748+0000","last_change":"2024-09-14T10:56:39.687131+0000","last_active":"2024-09-14T11:58:37.546748+0000","last_peered":"2024-09-14T11:58:37.546748+0000","last_clean":"2024-09-14T11:58:37.546748+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:37.546748+0000","last_undegraded":"2024-09-14T11:58:37.546748+0000","last_fullsized":"2024-09-14T11:58:37.546748+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:02.638600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5187176,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":460,"num_read_kb":13548,"num_write":1046,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'833","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313416+0000","last_change":"2024-09-14T10:56:41.692162+0000","last_active":"2024-09-14T11:56:49.313416+0000","last_peered":"2024-09-14T11:56:49.313416+0000","last_clean":"2024-09-14T11:56:49.313416+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:56:49.313416+0000","last_undegraded":"2024-09-14T11:56:49.313416+0000","last_fullsized":"2024-09-14T11:56:49.313416+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'284","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.342005+0000","last_change":"2024-09-14T10:56:39.695403+0000","last_active":"2024-09-14T11:58:37.342005+0000","last_peered":"2024-09-14T11:58:37.342005+0000","last_clean":"2024-09-14T11:58:37.342005+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:37.342005+0000","last_undegraded":"2024-09-14T11:58:37.342005+0000","last_fullsized":"2024-09-14T11:58:37.342005+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.933894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785474,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":588,"num_read_kb":14446,"num_write":1020,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.821254+0000","last_change":"2024-09-14T10:56:41.689448+0000","last_active":"2024-09-14T11:55:44.821254+0000","last_peered":"2024-09-14T11:55:44.821254+0000","last_clean":"2024-09-14T11:55:44.821254+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:55:44.821254+0000","last_undegraded":"2024-09-14T11:55:44.821254+0000","last_fullsized":"2024-09-14T11:55:44.821254+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:26.618232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'303","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.349668+0000","last_change":"2024-09-14T10:56:39.676967+0000","last_active":"2024-09-14T11:58:37.349668+0000","last_peered":"2024-09-14T11:58:37.349668+0000","last_clean":"2024-09-14T11:58:37.349668+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:37.349668+0000","last_undegraded":"2024-09-14T11:58:37.349668+0000","last_fullsized":"2024-09-14T11:58:37.349668+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:55.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221114,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":615,"num_read_kb":23065,"num_write":1122,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'425","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518743+0000","last_change":"2024-09-14T10:56:41.681136+0000","last_active":"2024-09-14T11:56:16.518743+0000","last_peered":"2024-09-14T11:56:16.518743+0000","last_clean":"2024-09-14T11:56:16.518743+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:56:16.518743+0000","last_undegraded":"2024-09-14T11:56:16.518743+0000","last_fullsized":"2024-09-14T11:56:16.518743+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:35.914131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'454","reported_seq":1879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447330+0000","last_change":"2024-09-14T10:56:41.695103+0000","last_active":"2024-09-14T11:57:23.447330+0000","last_peered":"2024-09-14T11:57:23.447330+0000","last_clean":"2024-09-14T11:57:23.447330+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:57:23.447330+0000","last_undegraded":"2024-09-14T11:57:23.447330+0000","last_fullsized":"2024-09-14T11:57:23.447330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:47.177973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'381","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406182+0000","last_change":"2024-09-14T10:56:39.694286+0000","last_active":"2024-09-14T11:58:37.406182+0000","last_peered":"2024-09-14T11:58:37.406182+0000","last_clean":"2024-09-14T11:58:37.406182+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:37.406182+0000","last_undegraded":"2024-09-14T11:58:37.406182+0000","last_fullsized":"2024-09-14T11:58:37.406182+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:43.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6514601,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":884,"num_read_kb":12852,"num_write":1544,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'532","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.516606+0000","last_change":"2024-09-14T10:56:41.700369+0000","last_active":"2024-09-14T11:56:16.516606+0000","last_peered":"2024-09-14T11:56:16.516606+0000","last_clean":"2024-09-14T11:56:16.516606+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:56:16.516606+0000","last_undegraded":"2024-09-14T11:56:16.516606+0000","last_fullsized":"2024-09-14T11:56:16.516606+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.164622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'327","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.497127+0000","last_change":"2024-09-14T10:56:39.681268+0000","last_active":"2024-09-14T11:58:38.497127+0000","last_peered":"2024-09-14T11:58:38.497127+0000","last_clean":"2024-09-14T11:58:38.497127+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:38.497127+0000","last_undegraded":"2024-09-14T11:58:38.497127+0000","last_fullsized":"2024-09-14T11:58:38.497127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:31.116262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430153,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":503,"num_read_kb":13589,"num_write":1011,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'636","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910117+0000","last_change":"2024-09-14T10:56:41.684245+0000","last_active":"2024-09-14T11:56:51.910117+0000","last_peered":"2024-09-14T11:56:51.910117+0000","last_clean":"2024-09-14T11:56:51.910117+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:56:51.910117+0000","last_undegraded":"2024-09-14T11:56:51.910117+0000","last_fullsized":"2024-09-14T11:56:51.910117+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:41.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'377","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.527682+0000","last_change":"2024-09-14T10:56:39.689695+0000","last_active":"2024-09-14T11:58:38.527682+0000","last_peered":"2024-09-14T11:58:38.527682+0000","last_clean":"2024-09-14T11:58:38.527682+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:38.527682+0000","last_undegraded":"2024-09-14T11:58:38.527682+0000","last_fullsized":"2024-09-14T11:58:38.527682+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054884,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":700,"num_read_kb":72218,"num_write":1241,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1144","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.775492+0000","last_change":"2024-09-14T10:56:41.690350+0000","last_active":"2024-09-14T11:57:45.775492+0000","last_peered":"2024-09-14T11:57:45.775492+0000","last_clean":"2024-09-14T11:57:45.775492+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:57:45.775492+0000","last_undegraded":"2024-09-14T11:57:45.775492+0000","last_fullsized":"2024-09-14T11:57:45.775492+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:17.084325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'334","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.338171+0000","last_change":"2024-09-14T10:56:39.673331+0000","last_active":"2024-09-14T11:58:38.338171+0000","last_peered":"2024-09-14T11:58:38.338171+0000","last_clean":"2024-09-14T11:58:38.338171+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:38.338171+0000","last_undegraded":"2024-09-14T11:58:38.338171+0000","last_fullsized":"2024-09-14T11:58:38.338171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:09.718190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":633,"num_read_kb":16353,"num_write":1183,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749815+0000","last_change":"2024-09-14T10:56:41.689989+0000","last_active":"2024-09-14T11:57:07.749815+0000","last_peered":"2024-09-14T11:57:07.749815+0000","last_clean":"2024-09-14T11:57:07.749815+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:57:07.749815+0000","last_undegraded":"2024-09-14T11:57:07.749815+0000","last_fullsized":"2024-09-14T11:57:07.749815+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:27.009017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'283","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.395153+0000","last_change":"2024-09-14T10:56:39.685439+0000","last_active":"2024-09-14T11:58:37.395153+0000","last_peered":"2024-09-14T11:58:37.395153+0000","last_clean":"2024-09-14T11:58:37.395153+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:37.395153+0000","last_undegraded":"2024-09-14T11:58:37.395153+0000","last_fullsized":"2024-09-14T11:58:37.395153+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4940556,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":506,"num_read_kb":6224,"num_write":1004,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'757","reported_seq":2336,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.905582+0000","last_change":"2024-09-14T10:56:41.699633+0000","last_active":"2024-09-14T11:58:09.905582+0000","last_peered":"2024-09-14T11:58:09.905582+0000","last_clean":"2024-09-14T11:58:09.905582+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:58:09.905582+0000","last_undegraded":"2024-09-14T11:58:09.905582+0000","last_fullsized":"2024-09-14T11:58:09.905582+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.536330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'325","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338061+0000","last_change":"2024-09-14T10:56:39.686616+0000","last_active":"2024-09-14T11:58:37.338061+0000","last_peered":"2024-09-14T11:58:37.338061+0000","last_clean":"2024-09-14T11:58:37.338061+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:37.338061+0000","last_undegraded":"2024-09-14T11:58:37.338061+0000","last_fullsized":"2024-09-14T11:58:37.338061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.022385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1258263,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":612,"num_read_kb":11097,"num_write":1124,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'102","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.924904+0000","last_change":"2024-09-14T10:56:49.738494+0000","last_active":"2024-09-14T11:56:52.924904+0000","last_peered":"2024-09-14T11:56:52.924904+0000","last_clean":"2024-09-14T11:56:52.924904+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:56:52.924904+0000","last_undegraded":"2024-09-14T11:56:52.924904+0000","last_fullsized":"2024-09-14T11:56:52.924904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:00.728999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'435","reported_seq":2152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.887571+0000","last_change":"2024-09-14T10:56:41.692358+0000","last_active":"2024-09-14T11:58:09.887571+0000","last_peered":"2024-09-14T11:58:09.887571+0000","last_clean":"2024-09-14T11:58:09.887571+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:09.887571+0000","last_undegraded":"2024-09-14T11:58:09.887571+0000","last_fullsized":"2024-09-14T11:58:09.887571+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:23.909831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'313","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.260682+0000","last_change":"2024-09-14T10:56:39.690334+0000","last_active":"2024-09-14T11:58:37.260682+0000","last_peered":"2024-09-14T11:58:37.260682+0000","last_clean":"2024-09-14T11:58:37.260682+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:37.260682+0000","last_undegraded":"2024-09-14T11:58:37.260682+0000","last_fullsized":"2024-09-14T11:58:37.260682+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:01.620284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8705643,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":659,"num_read_kb":79858,"num_write":1085,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546248+0000","last_change":"2024-09-14T10:56:43.703574+0000","last_active":"2024-09-14T11:54:47.546248+0000","last_peered":"2024-09-14T11:54:47.546248+0000","last_clean":"2024-09-14T11:54:47.546248+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:54:47.546248+0000","last_undegraded":"2024-09-14T11:54:47.546248+0000","last_fullsized":"2024-09-14T11:54:47.546248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:13.211833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'334","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.292696+0000","last_change":"2024-09-14T10:56:45.717205+0000","last_active":"2024-09-14T11:58:11.292696+0000","last_peered":"2024-09-14T11:58:11.292696+0000","last_clean":"2024-09-14T11:58:11.292696+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:58:11.292696+0000","last_undegraded":"2024-09-14T11:58:11.292696+0000","last_fullsized":"2024-09-14T11:58:11.292696+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:15.199061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54475,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1053,"num_write":424,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669188+0000","last_change":"2024-09-14T10:56:47.732016+0000","last_active":"2024-09-14T11:54:47.669188+0000","last_peered":"2024-09-14T11:54:47.669188+0000","last_clean":"2024-09-14T11:54:47.669188+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:54:47.669188+0000","last_undegraded":"2024-09-14T11:54:47.669188+0000","last_fullsized":"2024-09-14T11:54:47.669188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:03.581653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2511","reported_seq":4330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.571152+0000","last_change":"2024-09-14T10:56:49.748541+0000","last_active":"2024-09-14T11:57:32.571152+0000","last_peered":"2024-09-14T11:57:32.571152+0000","last_clean":"2024-09-14T11:57:32.571152+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:57:32.571152+0000","last_undegraded":"2024-09-14T11:57:32.571152+0000","last_fullsized":"2024-09-14T11:57:32.571152+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.702024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1504","reported_seq":3164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.567258+0000","last_change":"2024-09-14T10:56:41.690515+0000","last_active":"2024-09-14T11:57:07.567258+0000","last_peered":"2024-09-14T11:57:07.567258+0000","last_clean":"2024-09-14T11:57:07.567258+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:57:07.567258+0000","last_undegraded":"2024-09-14T11:57:07.567258+0000","last_fullsized":"2024-09-14T11:57:07.567258+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:30.187152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'304","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.396571+0000","last_change":"2024-09-14T10:56:39.693720+0000","last_active":"2024-09-14T11:58:37.396571+0000","last_peered":"2024-09-14T11:58:37.396571+0000","last_clean":"2024-09-14T11:58:37.396571+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:37.396571+0000","last_undegraded":"2024-09-14T11:58:37.396571+0000","last_fullsized":"2024-09-14T11:58:37.396571+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:54.885183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2381958,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":536,"num_read_kb":7352,"num_write":1078,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.658029+0000","last_change":"2024-09-14T10:56:43.698968+0000","last_active":"2024-09-14T11:55:17.658029+0000","last_peered":"2024-09-14T11:55:17.658029+0000","last_clean":"2024-09-14T11:55:17.658029+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:55:17.658029+0000","last_undegraded":"2024-09-14T11:55:17.658029+0000","last_fullsized":"2024-09-14T11:55:17.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.047693+0000","last_change":"2024-09-14T10:56:45.722700+0000","last_active":"2024-09-14T11:57:19.047693+0000","last_peered":"2024-09-14T11:57:19.047693+0000","last_clean":"2024-09-14T11:57:19.047693+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:57:19.047693+0000","last_undegraded":"2024-09-14T11:57:19.047693+0000","last_fullsized":"2024-09-14T11:57:19.047693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:14.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.547649+0000","last_change":"2024-09-14T10:56:47.736072+0000","last_active":"2024-09-14T11:54:48.547649+0000","last_peered":"2024-09-14T11:54:48.547649+0000","last_clean":"2024-09-14T11:54:48.547649+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:54:48.547649+0000","last_undegraded":"2024-09-14T11:54:48.547649+0000","last_fullsized":"2024-09-14T11:54:48.547649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:39.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723799+0000","last_change":"2024-09-14T10:56:49.750882+0000","last_active":"2024-09-14T11:58:09.723799+0000","last_peered":"2024-09-14T11:58:09.723799+0000","last_clean":"2024-09-14T11:58:09.723799+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:58:09.723799+0000","last_undegraded":"2024-09-14T11:58:09.723799+0000","last_fullsized":"2024-09-14T11:58:09.723799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:22.830554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'632","reported_seq":2376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.885005+0000","last_change":"2024-09-14T10:56:41.694089+0000","last_active":"2024-09-14T11:58:09.885005+0000","last_peered":"2024-09-14T11:58:09.885005+0000","last_clean":"2024-09-14T11:58:09.885005+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:09.885005+0000","last_undegraded":"2024-09-14T11:58:09.885005+0000","last_fullsized":"2024-09-14T11:58:09.885005+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:57.336561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'319","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426043+0000","last_change":"2024-09-14T10:56:39.694928+0000","last_active":"2024-09-14T11:58:37.426043+0000","last_peered":"2024-09-14T11:58:37.426043+0000","last_clean":"2024-09-14T11:58:37.426043+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:37.426043+0000","last_undegraded":"2024-09-14T11:58:37.426043+0000","last_fullsized":"2024-09-14T11:58:37.426043+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:30.362849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11713341,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":563,"num_read_kb":77740,"num_write":1107,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653968+0000","last_change":"2024-09-14T10:56:43.701731+0000","last_active":"2024-09-14T11:54:47.653968+0000","last_peered":"2024-09-14T11:54:47.653968+0000","last_clean":"2024-09-14T11:54:47.653968+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:54:47.653968+0000","last_undegraded":"2024-09-14T11:54:47.653968+0000","last_fullsized":"2024-09-14T11:54:47.653968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:01.110895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'139","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.089458+0000","last_change":"2024-09-14T10:56:45.721500+0000","last_active":"2024-09-14T11:57:19.089458+0000","last_peered":"2024-09-14T11:57:19.089458+0000","last_clean":"2024-09-14T11:57:19.089458+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:57:19.089458+0000","last_undegraded":"2024-09-14T11:57:19.089458+0000","last_fullsized":"2024-09-14T11:57:19.089458+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.327884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'773","reported_seq":4514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.588783+0000","last_change":"2024-09-14T10:56:47.731166+0000","last_active":"2024-09-14T11:58:36.588783+0000","last_peered":"2024-09-14T11:58:36.588783+0000","last_clean":"2024-09-14T11:58:36.588783+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:58:36.588783+0000","last_undegraded":"2024-09-14T11:58:36.588783+0000","last_fullsized":"2024-09-14T11:58:36.588783+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'210","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442305+0000","last_change":"2024-09-14T10:56:49.740657+0000","last_active":"2024-09-14T11:56:53.442305+0000","last_peered":"2024-09-14T11:56:53.442305+0000","last_clean":"2024-09-14T11:56:53.442305+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:56:53.442305+0000","last_undegraded":"2024-09-14T11:56:53.442305+0000","last_fullsized":"2024-09-14T11:56:53.442305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:29.712729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'435","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460767+0000","last_change":"2024-09-14T10:56:41.695277+0000","last_active":"2024-09-14T11:56:10.460767+0000","last_peered":"2024-09-14T11:56:10.460767+0000","last_clean":"2024-09-14T11:56:10.460767+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:56:10.460767+0000","last_undegraded":"2024-09-14T11:56:10.460767+0000","last_fullsized":"2024-09-14T11:56:10.460767+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.480333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'316","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.490305+0000","last_change":"2024-09-14T10:56:39.686745+0000","last_active":"2024-09-14T11:58:38.490305+0000","last_peered":"2024-09-14T11:58:38.490305+0000","last_clean":"2024-09-14T11:58:38.490305+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:38.490305+0000","last_undegraded":"2024-09-14T11:58:38.490305+0000","last_fullsized":"2024-09-14T11:58:38.490305+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:17.862362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":681,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":511,"num_read_kb":94667,"num_write":967,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546276+0000","last_change":"2024-09-14T10:56:43.702583+0000","last_active":"2024-09-14T11:54:47.546276+0000","last_peered":"2024-09-14T11:54:47.546276+0000","last_clean":"2024-09-14T11:54:47.546276+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:54:47.546276+0000","last_undegraded":"2024-09-14T11:54:47.546276+0000","last_fullsized":"2024-09-14T11:54:47.546276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:02.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'269","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.285054+0000","last_change":"2024-09-14T10:56:45.717333+0000","last_active":"2024-09-14T11:58:11.285054+0000","last_peered":"2024-09-14T11:58:11.285054+0000","last_clean":"2024-09-14T11:58:11.285054+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:58:11.285054+0000","last_undegraded":"2024-09-14T11:58:11.285054+0000","last_fullsized":"2024-09-14T11:58:11.285054+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:45.182188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53009,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":925,"num_write":352,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'809","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594992+0000","last_change":"2024-09-14T10:56:47.734484+0000","last_active":"2024-09-14T11:58:36.594992+0000","last_peered":"2024-09-14T11:58:36.594992+0000","last_clean":"2024-09-14T11:58:36.594992+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:58:36.594992+0000","last_undegraded":"2024-09-14T11:58:36.594992+0000","last_fullsized":"2024-09-14T11:58:36.594992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'658","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.883179+0000","last_change":"2024-09-14T10:56:41.690375+0000","last_active":"2024-09-14T11:58:09.883179+0000","last_peered":"2024-09-14T11:58:09.883179+0000","last_clean":"2024-09-14T11:58:09.883179+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:09.883179+0000","last_undegraded":"2024-09-14T11:58:09.883179+0000","last_fullsized":"2024-09-14T11:58:09.883179+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.339603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.379692+0000","last_change":"2024-09-14T10:56:39.698021+0000","last_active":"2024-09-14T11:58:37.379692+0000","last_peered":"2024-09-14T11:58:37.379692+0000","last_clean":"2024-09-14T11:58:37.379692+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:37.379692+0000","last_undegraded":"2024-09-14T11:58:37.379692+0000","last_fullsized":"2024-09-14T11:58:37.379692+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:46.013676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4894756,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":496,"num_read_kb":17523,"num_write":982,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.674155+0000","last_change":"2024-09-14T10:56:43.698774+0000","last_active":"2024-09-14T11:55:17.674155+0000","last_peered":"2024-09-14T11:55:17.674155+0000","last_clean":"2024-09-14T11:55:17.674155+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:55:17.674155+0000","last_undegraded":"2024-09-14T11:55:17.674155+0000","last_fullsized":"2024-09-14T11:55:17.674155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:15.883668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'408","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.297485+0000","last_change":"2024-09-14T10:56:45.715379+0000","last_active":"2024-09-14T11:58:11.297485+0000","last_peered":"2024-09-14T11:58:11.297485+0000","last_clean":"2024-09-14T11:58:11.297485+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:58:11.297485+0000","last_undegraded":"2024-09-14T11:58:11.297485+0000","last_fullsized":"2024-09-14T11:58:11.297485+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:11.970010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":1307,"num_write":536,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536831+0000","last_change":"2024-09-14T10:56:47.727987+0000","last_active":"2024-09-14T11:55:17.536831+0000","last_peered":"2024-09-14T11:55:17.536831+0000","last_clean":"2024-09-14T11:55:17.536831+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:55:17.536831+0000","last_undegraded":"2024-09-14T11:55:17.536831+0000","last_fullsized":"2024-09-14T11:55:17.536831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:35.450777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'581","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311916+0000","last_change":"2024-09-14T10:56:49.748529+0000","last_active":"2024-09-14T11:58:11.311916+0000","last_peered":"2024-09-14T11:58:11.311916+0000","last_clean":"2024-09-14T11:58:11.311916+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:58:11.311916+0000","last_undegraded":"2024-09-14T11:58:11.311916+0000","last_fullsized":"2024-09-14T11:58:11.311916+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.226410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'450","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909742+0000","last_change":"2024-09-14T10:56:41.699591+0000","last_active":"2024-09-14T11:56:51.909742+0000","last_peered":"2024-09-14T11:56:51.909742+0000","last_clean":"2024-09-14T11:56:51.909742+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:56:51.909742+0000","last_undegraded":"2024-09-14T11:56:51.909742+0000","last_fullsized":"2024-09-14T11:56:51.909742+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:55.170546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406033+0000","last_change":"2024-09-14T10:56:39.691536+0000","last_active":"2024-09-14T11:58:37.406033+0000","last_peered":"2024-09-14T11:58:37.406033+0000","last_clean":"2024-09-14T11:58:37.406033+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:37.406033+0000","last_undegraded":"2024-09-14T11:58:37.406033+0000","last_fullsized":"2024-09-14T11:58:37.406033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:03.544842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459283,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":60976,"num_write":1158,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.155670+0000","last_change":"2024-09-14T10:56:43.702569+0000","last_active":"2024-09-14T11:58:36.155670+0000","last_peered":"2024-09-14T11:58:36.155670+0000","last_clean":"2024-09-14T11:58:36.155670+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:36.155670+0000","last_undegraded":"2024-09-14T11:58:36.155670+0000","last_fullsized":"2024-09-14T11:58:36.155670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'279","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.138032+0000","last_change":"2024-09-14T10:56:45.717223+0000","last_active":"2024-09-14T11:58:37.138032+0000","last_peered":"2024-09-14T11:58:37.138032+0000","last_clean":"2024-09-14T11:58:37.138032+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:58:37.138032+0000","last_undegraded":"2024-09-14T11:58:37.138032+0000","last_fullsized":"2024-09-14T11:58:37.138032+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:53.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659151+0000","last_change":"2024-09-14T10:56:47.728715+0000","last_active":"2024-09-14T11:55:27.659151+0000","last_peered":"2024-09-14T11:55:27.659151+0000","last_clean":"2024-09-14T11:55:27.659151+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:55:27.659151+0000","last_undegraded":"2024-09-14T11:55:27.659151+0000","last_fullsized":"2024-09-14T11:55:27.659151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:34.862116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'110","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.691270+0000","last_change":"2024-09-14T10:56:49.740475+0000","last_active":"2024-09-14T11:57:28.691270+0000","last_peered":"2024-09-14T11:57:28.691270+0000","last_clean":"2024-09-14T11:57:28.691270+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:57:28.691270+0000","last_undegraded":"2024-09-14T11:57:28.691270+0000","last_fullsized":"2024-09-14T11:57:28.691270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:13.870392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'435","reported_seq":1865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.886202+0000","last_change":"2024-09-14T10:56:41.699032+0000","last_active":"2024-09-14T11:58:09.886202+0000","last_peered":"2024-09-14T11:58:09.886202+0000","last_clean":"2024-09-14T11:58:09.886202+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:09.886202+0000","last_undegraded":"2024-09-14T11:58:09.886202+0000","last_fullsized":"2024-09-14T11:58:09.886202+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:20.716515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'281","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.329783+0000","last_change":"2024-09-14T10:56:39.695515+0000","last_active":"2024-09-14T11:58:37.329783+0000","last_peered":"2024-09-14T11:58:37.329783+0000","last_clean":"2024-09-14T11:58:37.329783+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:37.329783+0000","last_undegraded":"2024-09-14T11:58:37.329783+0000","last_fullsized":"2024-09-14T11:58:37.329783+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:30.996747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6248327,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":477,"num_read_kb":11457,"num_write":924,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737627+0000","last_change":"2024-09-14T10:56:43.701838+0000","last_active":"2024-09-14T11:55:17.737627+0000","last_peered":"2024-09-14T11:55:17.737627+0000","last_clean":"2024-09-14T11:55:17.737627+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:55:17.737627+0000","last_undegraded":"2024-09-14T11:55:17.737627+0000","last_fullsized":"2024-09-14T11:55:17.737627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.350355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'291","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.299748+0000","last_change":"2024-09-14T10:56:45.715385+0000","last_active":"2024-09-14T11:58:11.299748+0000","last_peered":"2024-09-14T11:58:11.299748+0000","last_clean":"2024-09-14T11:58:11.299748+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:58:11.299748+0000","last_undegraded":"2024-09-14T11:58:11.299748+0000","last_fullsized":"2024-09-14T11:58:11.299748+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.655994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":941,"num_write":372,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'794","reported_seq":2923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594937+0000","last_change":"2024-09-14T10:56:47.732668+0000","last_active":"2024-09-14T11:58:36.594937+0000","last_peered":"2024-09-14T11:58:36.594937+0000","last_clean":"2024-09-14T11:58:36.594937+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:58:36.594937+0000","last_undegraded":"2024-09-14T11:58:36.594937+0000","last_fullsized":"2024-09-14T11:58:36.594937+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:36.329167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'144","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723376+0000","last_change":"2024-09-14T10:56:49.751141+0000","last_active":"2024-09-14T11:58:09.723376+0000","last_peered":"2024-09-14T11:58:09.723376+0000","last_clean":"2024-09-14T11:58:09.723376+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:58:09.723376+0000","last_undegraded":"2024-09-14T11:58:09.723376+0000","last_fullsized":"2024-09-14T11:58:09.723376+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:59.575096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'437","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.698726+0000","last_change":"2024-09-14T10:56:41.699606+0000","last_active":"2024-09-14T11:55:28.698726+0000","last_peered":"2024-09-14T11:55:28.698726+0000","last_clean":"2024-09-14T11:55:28.698726+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:55:28.698726+0000","last_undegraded":"2024-09-14T11:55:28.698726+0000","last_fullsized":"2024-09-14T11:55:28.698726+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.073985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'310","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.678526+0000","last_change":"2024-09-14T10:57:16.313659+0000","last_active":"2024-09-14T11:58:37.678526+0000","last_peered":"2024-09-14T11:58:37.678526+0000","last_clean":"2024-09-14T11:58:37.678526+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:37.678526+0000","last_undegraded":"2024-09-14T11:58:37.678526+0000","last_fullsized":"2024-09-14T11:58:37.678526+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:49.985260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6974727,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":703,"num_read_kb":20707,"num_write":1054,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.738288+0000","last_change":"2024-09-14T10:56:43.700827+0000","last_active":"2024-09-14T11:55:22.738288+0000","last_peered":"2024-09-14T11:55:22.738288+0000","last_clean":"2024-09-14T11:55:22.738288+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:55:22.738288+0000","last_undegraded":"2024-09-14T11:55:22.738288+0000","last_fullsized":"2024-09-14T11:55:22.738288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:43.830453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'489","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.365214+0000","last_change":"2024-09-14T10:56:45.716585+0000","last_active":"2024-09-14T11:58:37.365214+0000","last_peered":"2024-09-14T11:58:37.365214+0000","last_clean":"2024-09-14T11:58:37.365214+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:58:37.365214+0000","last_undegraded":"2024-09-14T11:58:37.365214+0000","last_fullsized":"2024-09-14T11:58:37.365214+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:59.261412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":837,"num_read_kb":1985,"num_write":686,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737599+0000","last_change":"2024-09-14T10:56:47.727232+0000","last_active":"2024-09-14T11:55:17.737599+0000","last_peered":"2024-09-14T11:55:17.737599+0000","last_clean":"2024-09-14T11:55:17.737599+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:55:17.737599+0000","last_undegraded":"2024-09-14T11:55:17.737599+0000","last_fullsized":"2024-09-14T11:55:17.737599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.261352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'153","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.913275+0000","last_change":"2024-09-14T10:56:49.745209+0000","last_active":"2024-09-14T11:56:52.913275+0000","last_peered":"2024-09-14T11:56:52.913275+0000","last_clean":"2024-09-14T11:56:52.913275+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:56:52.913275+0000","last_undegraded":"2024-09-14T11:56:52.913275+0000","last_fullsized":"2024-09-14T11:56:52.913275+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:00.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'485","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781154+0000","last_change":"2024-09-14T10:56:41.695419+0000","last_active":"2024-09-14T11:56:52.781154+0000","last_peered":"2024-09-14T11:56:52.781154+0000","last_clean":"2024-09-14T11:56:52.781154+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:56:52.781154+0000","last_undegraded":"2024-09-14T11:56:52.781154+0000","last_fullsized":"2024-09-14T11:56:52.781154+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:25.326798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'341","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415777+0000","last_change":"2024-09-14T10:56:39.686597+0000","last_active":"2024-09-14T11:58:37.415777+0000","last_peered":"2024-09-14T11:58:37.415777+0000","last_clean":"2024-09-14T11:58:37.415777+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:37.415777+0000","last_undegraded":"2024-09-14T11:58:37.415777+0000","last_fullsized":"2024-09-14T11:58:37.415777+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.571169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14028949,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":678,"num_read_kb":26829,"num_write":1292,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737663+0000","last_change":"2024-09-14T10:56:43.702604+0000","last_active":"2024-09-14T11:55:17.737663+0000","last_peered":"2024-09-14T11:55:17.737663+0000","last_clean":"2024-09-14T11:55:17.737663+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:55:17.737663+0000","last_undegraded":"2024-09-14T11:55:17.737663+0000","last_fullsized":"2024-09-14T11:55:17.737663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:06.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'337","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.444929+0000","last_change":"2024-09-14T10:56:45.720877+0000","last_active":"2024-09-14T11:58:37.444929+0000","last_peered":"2024-09-14T11:58:37.444929+0000","last_clean":"2024-09-14T11:58:37.444929+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:58:37.444929+0000","last_undegraded":"2024-09-14T11:58:37.444929+0000","last_fullsized":"2024-09-14T11:58:37.444929+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:57.447381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658208+0000","last_change":"2024-09-14T10:56:47.732467+0000","last_active":"2024-09-14T11:55:22.658208+0000","last_peered":"2024-09-14T11:55:22.658208+0000","last_clean":"2024-09-14T11:55:22.658208+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:55:22.658208+0000","last_undegraded":"2024-09-14T11:55:22.658208+0000","last_fullsized":"2024-09-14T11:55:22.658208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:40.009813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446796+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:07.446796+0000","last_peered":"2024-09-14T11:57:07.446796+0000","last_clean":"2024-09-14T11:57:07.446796+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:07.446796+0000","last_undegraded":"2024-09-14T11:57:07.446796+0000","last_fullsized":"2024-09-14T11:57:07.446796+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:22.648516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'765","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.878498+0000","last_change":"2024-09-14T10:56:41.694599+0000","last_active":"2024-09-14T11:58:09.878498+0000","last_peered":"2024-09-14T11:58:09.878498+0000","last_clean":"2024-09-14T11:58:09.878498+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:09.878498+0000","last_undegraded":"2024-09-14T11:58:09.878498+0000","last_fullsized":"2024-09-14T11:58:09.878498+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:34.020278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'374","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.474807+0000","last_change":"2024-09-14T10:56:39.682095+0000","last_active":"2024-09-14T11:58:38.474807+0000","last_peered":"2024-09-14T11:58:38.474807+0000","last_clean":"2024-09-14T11:58:38.474807+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:38.474807+0000","last_undegraded":"2024-09-14T11:58:38.474807+0000","last_fullsized":"2024-09-14T11:58:38.474807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:36.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905080,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":665,"num_read_kb":27548,"num_write":1208,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536865+0000","last_change":"2024-09-14T10:56:43.707450+0000","last_active":"2024-09-14T11:55:17.536865+0000","last_peered":"2024-09-14T11:55:17.536865+0000","last_clean":"2024-09-14T11:55:17.536865+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:55:17.536865+0000","last_undegraded":"2024-09-14T11:55:17.536865+0000","last_fullsized":"2024-09-14T11:55:17.536865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:10.147136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'346","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.913274+0000","last_change":"2024-09-14T10:56:45.709793+0000","last_active":"2024-09-14T11:58:36.913274+0000","last_peered":"2024-09-14T11:58:36.913274+0000","last_clean":"2024-09-14T11:58:36.913274+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:36.913274+0000","last_undegraded":"2024-09-14T11:58:36.913274+0000","last_fullsized":"2024-09-14T11:58:36.913274+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:43.142877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'753","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.590126+0000","last_change":"2024-09-14T10:56:47.728010+0000","last_active":"2024-09-14T11:58:36.590126+0000","last_peered":"2024-09-14T11:58:36.590126+0000","last_clean":"2024-09-14T11:58:36.590126+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:58:36.590126+0000","last_undegraded":"2024-09-14T11:58:36.590126+0000","last_fullsized":"2024-09-14T11:58:36.590126+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:16.673244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'120","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.768184+0000","last_change":"2024-09-14T10:56:49.746163+0000","last_active":"2024-09-14T11:56:50.768184+0000","last_peered":"2024-09-14T11:56:50.768184+0000","last_clean":"2024-09-14T11:56:50.768184+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:56:50.768184+0000","last_undegraded":"2024-09-14T11:56:50.768184+0000","last_fullsized":"2024-09-14T11:56:50.768184+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:25.956197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.312517+0000","last_change":"2024-09-14T10:56:41.687409+0000","last_active":"2024-09-14T11:56:49.312517+0000","last_peered":"2024-09-14T11:56:49.312517+0000","last_clean":"2024-09-14T11:56:49.312517+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:56:49.312517+0000","last_undegraded":"2024-09-14T11:56:49.312517+0000","last_fullsized":"2024-09-14T11:56:49.312517+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:52.835617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'344","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.294542+0000","last_change":"2024-09-14T10:56:39.683292+0000","last_active":"2024-09-14T11:58:38.294542+0000","last_peered":"2024-09-14T11:58:38.294542+0000","last_clean":"2024-09-14T11:58:38.294542+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:38.294542+0000","last_undegraded":"2024-09-14T11:58:38.294542+0000","last_fullsized":"2024-09-14T11:58:38.294542+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:04.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190475,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":538,"num_read_kb":90386,"num_write":1094,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.167037+0000","last_change":"2024-09-14T10:56:43.701046+0000","last_active":"2024-09-14T11:58:36.167037+0000","last_peered":"2024-09-14T11:58:36.167037+0000","last_clean":"2024-09-14T11:58:36.167037+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:58:36.167037+0000","last_undegraded":"2024-09-14T11:58:36.167037+0000","last_fullsized":"2024-09-14T11:58:36.167037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'92","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.017399+0000","last_change":"2024-09-14T10:56:45.713884+0000","last_active":"2024-09-14T11:57:19.017399+0000","last_peered":"2024-09-14T11:57:19.017399+0000","last_clean":"2024-09-14T11:57:19.017399+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:57:19.017399+0000","last_undegraded":"2024-09-14T11:57:19.017399+0000","last_fullsized":"2024-09-14T11:57:19.017399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:23.564660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'775","reported_seq":2400,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.592193+0000","last_change":"2024-09-14T10:56:47.728790+0000","last_active":"2024-09-14T11:58:36.592193+0000","last_peered":"2024-09-14T11:58:36.592193+0000","last_clean":"2024-09-14T11:58:36.592193+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:58:36.592193+0000","last_undegraded":"2024-09-14T11:58:36.592193+0000","last_fullsized":"2024-09-14T11:58:36.592193+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.655451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.297030+0000","last_change":"2024-09-14T10:56:49.746716+0000","last_active":"2024-09-14T11:56:49.297030+0000","last_peered":"2024-09-14T11:56:49.297030+0000","last_clean":"2024-09-14T11:56:49.297030+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:56:49.297030+0000","last_undegraded":"2024-09-14T11:56:49.297030+0000","last_fullsized":"2024-09-14T11:56:49.297030+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.164615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'788","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782702+0000","last_change":"2024-09-14T10:56:41.698077+0000","last_active":"2024-09-14T11:56:52.782702+0000","last_peered":"2024-09-14T11:56:52.782702+0000","last_clean":"2024-09-14T11:56:52.782702+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:56:52.782702+0000","last_undegraded":"2024-09-14T11:56:52.782702+0000","last_fullsized":"2024-09-14T11:56:52.782702+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.788116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'292","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415724+0000","last_change":"2024-09-14T10:57:15.795505+0000","last_active":"2024-09-14T11:58:37.415724+0000","last_peered":"2024-09-14T11:58:37.415724+0000","last_clean":"2024-09-14T11:58:37.415724+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:37.415724+0000","last_undegraded":"2024-09-14T11:58:37.415724+0000","last_fullsized":"2024-09-14T11:58:37.415724+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.548600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101310,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":502,"num_read_kb":1389,"num_write":968,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.551662+0000","last_change":"2024-09-14T10:56:43.698906+0000","last_active":"2024-09-14T11:55:13.551662+0000","last_peered":"2024-09-14T11:55:13.551662+0000","last_clean":"2024-09-14T11:55:13.551662+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:55:13.551662+0000","last_undegraded":"2024-09-14T11:55:13.551662+0000","last_fullsized":"2024-09-14T11:55:13.551662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:39.807629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'391","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.293933+0000","last_change":"2024-09-14T10:56:45.719001+0000","last_active":"2024-09-14T11:58:11.293933+0000","last_peered":"2024-09-14T11:58:11.293933+0000","last_clean":"2024-09-14T11:58:11.293933+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:58:11.293933+0000","last_undegraded":"2024-09-14T11:58:11.293933+0000","last_fullsized":"2024-09-14T11:58:11.293933+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:08.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1226,"num_read_kb":1694,"num_write":1780,"num_write_kb":1621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672095+0000","last_change":"2024-09-14T10:56:47.735876+0000","last_active":"2024-09-14T11:55:18.672095+0000","last_peered":"2024-09-14T11:55:18.672095+0000","last_clean":"2024-09-14T11:55:18.672095+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:55:18.672095+0000","last_undegraded":"2024-09-14T11:55:18.672095+0000","last_fullsized":"2024-09-14T11:55:18.672095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:40.099775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.186925+0000","last_change":"2024-09-14T10:56:49.743347+0000","last_active":"2024-09-14T11:56:50.186925+0000","last_peered":"2024-09-14T11:56:50.186925+0000","last_clean":"2024-09-14T11:56:50.186925+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:56:50.186925+0000","last_undegraded":"2024-09-14T11:56:50.186925+0000","last_fullsized":"2024-09-14T11:56:50.186925+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'647","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817022+0000","last_change":"2024-09-14T10:56:41.692220+0000","last_active":"2024-09-14T11:55:53.817022+0000","last_peered":"2024-09-14T11:55:53.817022+0000","last_clean":"2024-09-14T11:55:53.817022+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:55:53.817022+0000","last_undegraded":"2024-09-14T11:55:53.817022+0000","last_fullsized":"2024-09-14T11:55:53.817022+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:11.440656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432896+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T11:56:37.432896+0000","last_peered":"2024-09-14T11:56:37.432896+0000","last_clean":"2024-09-14T11:56:37.432896+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:56:37.432896+0000","last_undegraded":"2024-09-14T11:56:37.432896+0000","last_fullsized":"2024-09-14T11:56:37.432896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.547015+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T11:54:52.547015+0000","last_peered":"2024-09-14T11:54:52.547015+0000","last_clean":"2024-09-14T11:54:52.547015+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:54:52.547015+0000","last_undegraded":"2024-09-14T11:54:52.547015+0000","last_fullsized":"2024-09-14T11:54:52.547015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'292","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.374926+0000","last_change":"2024-09-14T10:56:39.687055+0000","last_active":"2024-09-14T11:58:37.374926+0000","last_peered":"2024-09-14T11:58:37.374926+0000","last_clean":"2024-09-14T11:58:37.374926+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:37.374926+0000","last_undegraded":"2024-09-14T11:58:37.374926+0000","last_fullsized":"2024-09-14T11:58:37.374926+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:32.344503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13986456,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":596,"num_read_kb":39228,"num_write":965,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672300+0000","last_change":"2024-09-14T10:56:43.702002+0000","last_active":"2024-09-14T11:55:07.672300+0000","last_peered":"2024-09-14T11:55:07.672300+0000","last_clean":"2024-09-14T11:55:07.672300+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:55:07.672300+0000","last_undegraded":"2024-09-14T11:55:07.672300+0000","last_fullsized":"2024-09-14T11:55:07.672300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:33.474891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'786","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.734667+0000","last_change":"2024-09-14T10:56:45.716034+0000","last_active":"2024-09-14T11:58:36.734667+0000","last_peered":"2024-09-14T11:58:36.734667+0000","last_clean":"2024-09-14T11:58:36.734667+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:58:36.734667+0000","last_undegraded":"2024-09-14T11:58:36.734667+0000","last_fullsized":"2024-09-14T11:58:36.734667+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:25.384704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183012,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1531,"num_read_kb":3433,"num_write":1486,"num_write_kb":1341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.657591+0000","last_change":"2024-09-14T10:56:47.736084+0000","last_active":"2024-09-14T11:55:17.657591+0000","last_peered":"2024-09-14T11:55:17.657591+0000","last_clean":"2024-09-14T11:55:17.657591+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:55:17.657591+0000","last_undegraded":"2024-09-14T11:55:17.657591+0000","last_fullsized":"2024-09-14T11:55:17.657591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:49.305417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.811415+0000","last_change":"2024-09-14T10:56:49.743581+0000","last_active":"2024-09-14T11:56:52.811415+0000","last_peered":"2024-09-14T11:56:52.811415+0000","last_clean":"2024-09-14T11:56:52.811415+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:56:52.811415+0000","last_undegraded":"2024-09-14T11:56:52.811415+0000","last_fullsized":"2024-09-14T11:56:52.811415+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:57.012986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337471+0000","last_change":"2024-09-14T10:56:41.699990+0000","last_active":"2024-09-14T11:56:18.337471+0000","last_peered":"2024-09-14T11:56:18.337471+0000","last_clean":"2024-09-14T11:56:18.337471+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:56:18.337471+0000","last_undegraded":"2024-09-14T11:56:18.337471+0000","last_fullsized":"2024-09-14T11:56:18.337471+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:37.126708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.667394+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T11:54:37.667394+0000","last_peered":"2024-09-14T11:54:37.667394+0000","last_clean":"2024-09-14T11:54:37.667394+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:54:37.667394+0000","last_undegraded":"2024-09-14T11:54:37.667394+0000","last_fullsized":"2024-09-14T11:54:37.667394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'252","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417184+0000","last_change":"2024-09-14T10:56:39.691928+0000","last_active":"2024-09-14T11:58:37.417184+0000","last_peered":"2024-09-14T11:58:37.417184+0000","last_clean":"2024-09-14T11:58:37.417184+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:37.417184+0000","last_undegraded":"2024-09-14T11:58:37.417184+0000","last_fullsized":"2024-09-14T11:58:37.417184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956222,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":399,"num_read_kb":19285,"num_write":828,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.551105+0000","last_change":"2024-09-14T10:56:43.701669+0000","last_active":"2024-09-14T11:55:17.551105+0000","last_peered":"2024-09-14T11:55:17.551105+0000","last_clean":"2024-09-14T11:55:17.551105+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:55:17.551105+0000","last_undegraded":"2024-09-14T11:55:17.551105+0000","last_fullsized":"2024-09-14T11:55:17.551105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:32.330161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1320","reported_seq":2995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.211084+0000","last_change":"2024-09-14T10:56:45.719919+0000","last_active":"2024-09-14T11:58:37.211084+0000","last_peered":"2024-09-14T11:58:37.211084+0000","last_clean":"2024-09-14T11:58:37.211084+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:58:37.211084+0000","last_undegraded":"2024-09-14T11:58:37.211084+0000","last_fullsized":"2024-09-14T11:58:37.211084+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:28.154269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171063,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2082,"num_read_kb":3793,"num_write":1186,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.673250+0000","last_change":"2024-09-14T10:56:47.734554+0000","last_active":"2024-09-14T11:55:12.673250+0000","last_peered":"2024-09-14T11:55:12.673250+0000","last_clean":"2024-09-14T11:55:12.673250+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:55:12.673250+0000","last_undegraded":"2024-09-14T11:55:12.673250+0000","last_fullsized":"2024-09-14T11:55:12.673250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:20.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'94","reported_seq":590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.504531+0000","last_change":"2024-09-14T10:56:49.741143+0000","last_active":"2024-09-14T11:56:16.504531+0000","last_peered":"2024-09-14T11:56:16.504531+0000","last_clean":"2024-09-14T11:56:16.504531+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:56:16.504531+0000","last_undegraded":"2024-09-14T11:56:16.504531+0000","last_fullsized":"2024-09-14T11:56:16.504531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.919275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'936","reported_seq":2803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.816582+0000","last_change":"2024-09-14T10:56:41.698132+0000","last_active":"2024-09-14T11:55:53.816582+0000","last_peered":"2024-09-14T11:55:53.816582+0000","last_clean":"2024-09-14T11:55:53.816582+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:55:53.816582+0000","last_undegraded":"2024-09-14T11:55:53.816582+0000","last_fullsized":"2024-09-14T11:55:53.816582+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.829080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.733197+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T11:54:52.733197+0000","last_peered":"2024-09-14T11:54:52.733197+0000","last_clean":"2024-09-14T11:54:52.733197+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:54:52.733197+0000","last_undegraded":"2024-09-14T11:54:52.733197+0000","last_fullsized":"2024-09-14T11:54:52.733197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'274","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.337834+0000","last_change":"2024-09-14T10:56:39.677391+0000","last_active":"2024-09-14T11:58:37.337834+0000","last_peered":"2024-09-14T11:58:37.337834+0000","last_clean":"2024-09-14T11:58:37.337834+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:37.337834+0000","last_undegraded":"2024-09-14T11:58:37.337834+0000","last_fullsized":"2024-09-14T11:58:37.337834+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.834286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5317536,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":498,"num_read_kb":14745,"num_write":946,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737709+0000","last_change":"2024-09-14T10:56:43.701856+0000","last_active":"2024-09-14T11:55:17.737709+0000","last_peered":"2024-09-14T11:55:17.737709+0000","last_clean":"2024-09-14T11:55:17.737709+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:55:17.737709+0000","last_undegraded":"2024-09-14T11:55:17.737709+0000","last_fullsized":"2024-09-14T11:55:17.737709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:25.200569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'291","reported_seq":1564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.772091+0000","last_change":"2024-09-14T10:56:45.720189+0000","last_active":"2024-09-14T11:58:06.772091+0000","last_peered":"2024-09-14T11:58:06.772091+0000","last_clean":"2024-09-14T11:58:06.772091+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:58:06.772091+0000","last_undegraded":"2024-09-14T11:58:06.772091+0000","last_fullsized":"2024-09-14T11:58:06.772091+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:21.350299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656311+0000","last_change":"2024-09-14T10:56:47.737357+0000","last_active":"2024-09-14T11:55:07.656311+0000","last_peered":"2024-09-14T11:55:07.656311+0000","last_clean":"2024-09-14T11:55:07.656311+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:55:07.656311+0000","last_undegraded":"2024-09-14T11:55:07.656311+0000","last_fullsized":"2024-09-14T11:55:07.656311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:59.652704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.061479+0000","last_change":"2024-09-14T10:56:49.741618+0000","last_active":"2024-09-14T11:56:53.061479+0000","last_peered":"2024-09-14T11:56:53.061479+0000","last_clean":"2024-09-14T11:56:53.061479+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:56:53.061479+0000","last_undegraded":"2024-09-14T11:56:53.061479+0000","last_fullsized":"2024-09-14T11:56:53.061479+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:04.982419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'530","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.908964+0000","last_change":"2024-09-14T10:56:41.691332+0000","last_active":"2024-09-14T11:56:51.908964+0000","last_peered":"2024-09-14T11:56:51.908964+0000","last_clean":"2024-09-14T11:56:51.908964+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:56:51.908964+0000","last_undegraded":"2024-09-14T11:56:51.908964+0000","last_fullsized":"2024-09-14T11:56:51.908964+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:24.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.546981+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T11:54:52.546981+0000","last_peered":"2024-09-14T11:54:52.546981+0000","last_clean":"2024-09-14T11:54:52.546981+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:54:52.546981+0000","last_undegraded":"2024-09-14T11:54:52.546981+0000","last_fullsized":"2024-09-14T11:54:52.546981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'294","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.404337+0000","last_change":"2024-09-14T10:56:39.677476+0000","last_active":"2024-09-14T11:58:38.404337+0000","last_peered":"2024-09-14T11:58:38.404337+0000","last_clean":"2024-09-14T11:58:38.404337+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:38.404337+0000","last_undegraded":"2024-09-14T11:58:38.404337+0000","last_fullsized":"2024-09-14T11:58:38.404337+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:50.866073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759871,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":492,"num_read_kb":28769,"num_write":982,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656928+0000","last_change":"2024-09-14T10:56:43.703850+0000","last_active":"2024-09-14T11:55:12.656928+0000","last_peered":"2024-09-14T11:55:12.656928+0000","last_clean":"2024-09-14T11:55:12.656928+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:55:12.656928+0000","last_undegraded":"2024-09-14T11:55:12.656928+0000","last_fullsized":"2024-09-14T11:55:12.656928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.154206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'142","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.449373+0000","last_change":"2024-09-14T10:56:45.723094+0000","last_active":"2024-09-14T11:57:27.449373+0000","last_peered":"2024-09-14T11:57:27.449373+0000","last_clean":"2024-09-14T11:57:27.449373+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:57:27.449373+0000","last_undegraded":"2024-09-14T11:57:27.449373+0000","last_fullsized":"2024-09-14T11:57:27.449373+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:07.418105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672147+0000","last_change":"2024-09-14T10:56:47.735245+0000","last_active":"2024-09-14T11:55:18.672147+0000","last_peered":"2024-09-14T11:55:18.672147+0000","last_clean":"2024-09-14T11:55:18.672147+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:55:18.672147+0000","last_undegraded":"2024-09-14T11:55:18.672147+0000","last_fullsized":"2024-09-14T11:55:18.672147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:24.475897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.766817+0000","last_change":"2024-09-14T10:56:49.746061+0000","last_active":"2024-09-14T11:56:52.766817+0000","last_peered":"2024-09-14T11:56:52.766817+0000","last_clean":"2024-09-14T11:56:52.766817+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:56:52.766817+0000","last_undegraded":"2024-09-14T11:56:52.766817+0000","last_fullsized":"2024-09-14T11:56:52.766817+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:28.330851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'387","reported_seq":1839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.537862+0000","last_change":"2024-09-14T10:56:41.693401+0000","last_active":"2024-09-14T11:55:32.537862+0000","last_peered":"2024-09-14T11:55:32.537862+0000","last_clean":"2024-09-14T11:55:32.537862+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:55:32.537862+0000","last_undegraded":"2024-09-14T11:55:32.537862+0000","last_fullsized":"2024-09-14T11:55:32.537862+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:32.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'383","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417753+0000","last_change":"2024-09-14T10:56:39.690724+0000","last_active":"2024-09-14T11:58:37.417753+0000","last_peered":"2024-09-14T11:58:37.417753+0000","last_clean":"2024-09-14T11:58:37.417753+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:37.417753+0000","last_undegraded":"2024-09-14T11:58:37.417753+0000","last_fullsized":"2024-09-14T11:58:37.417753+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:30.610560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4548668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":648,"num_read_kb":3738,"num_write":1292,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.533548+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T11:54:52.533548+0000","last_peered":"2024-09-14T11:54:52.533548+0000","last_clean":"2024-09-14T11:54:52.533548+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:54:52.533548+0000","last_undegraded":"2024-09-14T11:54:52.533548+0000","last_fullsized":"2024-09-14T11:54:52.533548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656288+0000","last_change":"2024-09-14T10:56:43.700042+0000","last_active":"2024-09-14T11:55:07.656288+0000","last_peered":"2024-09-14T11:55:07.656288+0000","last_clean":"2024-09-14T11:55:07.656288+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:55:07.656288+0000","last_undegraded":"2024-09-14T11:55:07.656288+0000","last_fullsized":"2024-09-14T11:55:07.656288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:24.603692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'609","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.829544+0000","last_change":"2024-09-14T10:56:45.716237+0000","last_active":"2024-09-14T11:58:36.829544+0000","last_peered":"2024-09-14T11:58:36.829544+0000","last_clean":"2024-09-14T11:58:36.829544+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:58:36.829544+0000","last_undegraded":"2024-09-14T11:58:36.829544+0000","last_fullsized":"2024-09-14T11:58:36.829544+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:41.293686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114592,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":2166,"num_write":878,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550619+0000","last_change":"2024-09-14T10:56:47.732150+0000","last_active":"2024-09-14T11:55:08.550619+0000","last_peered":"2024-09-14T11:55:08.550619+0000","last_clean":"2024-09-14T11:55:08.550619+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:55:08.550619+0000","last_undegraded":"2024-09-14T11:55:08.550619+0000","last_fullsized":"2024-09-14T11:55:08.550619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:42.244231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'168","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.826154+0000","last_change":"2024-09-14T10:56:49.748121+0000","last_active":"2024-09-14T11:56:49.826154+0000","last_peered":"2024-09-14T11:56:49.826154+0000","last_clean":"2024-09-14T11:56:49.826154+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:56:49.826154+0000","last_undegraded":"2024-09-14T11:56:49.826154+0000","last_fullsized":"2024-09-14T11:56:49.826154+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:52.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754696+0000","last_change":"2024-09-14T10:56:41.700935+0000","last_active":"2024-09-14T11:56:12.754696+0000","last_peered":"2024-09-14T11:56:12.754696+0000","last_clean":"2024-09-14T11:56:12.754696+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:56:12.754696+0000","last_undegraded":"2024-09-14T11:56:12.754696+0000","last_fullsized":"2024-09-14T11:56:12.754696+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:51.471808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'278","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338194+0000","last_change":"2024-09-14T10:56:39.675452+0000","last_active":"2024-09-14T11:58:37.338194+0000","last_peered":"2024-09-14T11:58:37.338194+0000","last_clean":"2024-09-14T11:58:37.338194+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:37.338194+0000","last_undegraded":"2024-09-14T11:58:37.338194+0000","last_fullsized":"2024-09-14T11:58:37.338194+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:40.705030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27645,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":486,"num_read_kb":39755,"num_write":919,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670754+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T11:54:57.670754+0000","last_peered":"2024-09-14T11:54:57.670754+0000","last_clean":"2024-09-14T11:54:57.670754+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:54:57.670754+0000","last_undegraded":"2024-09-14T11:54:57.670754+0000","last_fullsized":"2024-09-14T11:54:57.670754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669698+0000","last_change":"2024-09-14T10:56:43.698284+0000","last_active":"2024-09-14T11:55:03.669698+0000","last_peered":"2024-09-14T11:55:03.669698+0000","last_clean":"2024-09-14T11:55:03.669698+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:55:03.669698+0000","last_undegraded":"2024-09-14T11:55:03.669698+0000","last_fullsized":"2024-09-14T11:55:03.669698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:00.094354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'191","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.127349+0000","last_change":"2024-09-14T10:56:45.711166+0000","last_active":"2024-09-14T11:57:19.127349+0000","last_peered":"2024-09-14T11:57:19.127349+0000","last_clean":"2024-09-14T11:57:19.127349+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:57:19.127349+0000","last_undegraded":"2024-09-14T11:57:19.127349+0000","last_fullsized":"2024-09-14T11:57:19.127349+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:47.059448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'796","reported_seq":2593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.587421+0000","last_change":"2024-09-14T10:56:47.728767+0000","last_active":"2024-09-14T11:58:36.587421+0000","last_peered":"2024-09-14T11:58:36.587421+0000","last_clean":"2024-09-14T11:58:36.587421+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:58:36.587421+0000","last_undegraded":"2024-09-14T11:58:36.587421+0000","last_fullsized":"2024-09-14T11:58:36.587421+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.533201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452881+0000","last_change":"2024-09-14T10:56:49.737155+0000","last_active":"2024-09-14T11:57:52.452881+0000","last_peered":"2024-09-14T11:57:52.452881+0000","last_clean":"2024-09-14T11:57:52.452881+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:57:52.452881+0000","last_undegraded":"2024-09-14T11:57:52.452881+0000","last_fullsized":"2024-09-14T11:57:52.452881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:24.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910688+0000","last_change":"2024-09-14T10:56:41.696110+0000","last_active":"2024-09-14T11:56:51.910688+0000","last_peered":"2024-09-14T11:56:51.910688+0000","last_clean":"2024-09-14T11:56:51.910688+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:56:51.910688+0000","last_undegraded":"2024-09-14T11:56:51.910688+0000","last_fullsized":"2024-09-14T11:56:51.910688+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:47.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.328058+0000","last_change":"2024-09-14T10:56:39.689300+0000","last_active":"2024-09-14T11:58:37.328058+0000","last_peered":"2024-09-14T11:58:37.328058+0000","last_clean":"2024-09-14T11:58:37.328058+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:37.328058+0000","last_undegraded":"2024-09-14T11:58:37.328058+0000","last_fullsized":"2024-09-14T11:58:37.328058+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:27.768196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5872509,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":651,"num_read_kb":30578,"num_write":1020,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.534766+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T11:55:02.534766+0000","last_peered":"2024-09-14T11:55:02.534766+0000","last_clean":"2024-09-14T11:55:02.534766+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:55:02.534766+0000","last_undegraded":"2024-09-14T11:55:02.534766+0000","last_fullsized":"2024-09-14T11:55:02.534766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549708+0000","last_change":"2024-09-14T10:56:43.703110+0000","last_active":"2024-09-14T11:55:03.549708+0000","last_peered":"2024-09-14T11:55:03.549708+0000","last_clean":"2024-09-14T11:55:03.549708+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:55:03.549708+0000","last_undegraded":"2024-09-14T11:55:03.549708+0000","last_fullsized":"2024-09-14T11:55:03.549708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:12.622307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'119","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.096817+0000","last_change":"2024-09-14T10:56:45.722824+0000","last_active":"2024-09-14T11:57:19.096817+0000","last_peered":"2024-09-14T11:57:19.096817+0000","last_clean":"2024-09-14T11:57:19.096817+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:57:19.096817+0000","last_undegraded":"2024-09-14T11:57:19.096817+0000","last_fullsized":"2024-09-14T11:57:19.096817+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:19.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'811","reported_seq":2996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.593571+0000","last_change":"2024-09-14T10:56:47.731609+0000","last_active":"2024-09-14T11:58:36.593571+0000","last_peered":"2024-09-14T11:58:36.593571+0000","last_clean":"2024-09-14T11:58:36.593571+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:58:36.593571+0000","last_undegraded":"2024-09-14T11:58:36.593571+0000","last_fullsized":"2024-09-14T11:58:36.593571+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.877641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'289","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.773375+0000","last_change":"2024-09-14T10:56:49.747406+0000","last_active":"2024-09-14T11:56:52.773375+0000","last_peered":"2024-09-14T11:56:52.773375+0000","last_clean":"2024-09-14T11:56:52.773375+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:56:52.773375+0000","last_undegraded":"2024-09-14T11:56:52.773375+0000","last_fullsized":"2024-09-14T11:56:52.773375+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.880523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518469+0000","last_change":"2024-09-14T10:56:41.691206+0000","last_active":"2024-09-14T11:56:16.518469+0000","last_peered":"2024-09-14T11:56:16.518469+0000","last_clean":"2024-09-14T11:56:16.518469+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:56:16.518469+0000","last_undegraded":"2024-09-14T11:56:16.518469+0000","last_fullsized":"2024-09-14T11:56:16.518469+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'412","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.343800+0000","last_change":"2024-09-14T10:56:39.692650+0000","last_active":"2024-09-14T11:58:37.343800+0000","last_peered":"2024-09-14T11:58:37.343800+0000","last_clean":"2024-09-14T11:58:37.343800+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:37.343800+0000","last_undegraded":"2024-09-14T11:58:37.343800+0000","last_fullsized":"2024-09-14T11:58:37.343800+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:04.303763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301611,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":968,"num_read_kb":14136,"num_write":1455,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669743+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T11:55:03.669743+0000","last_peered":"2024-09-14T11:55:03.669743+0000","last_clean":"2024-09-14T11:55:03.669743+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:55:03.669743+0000","last_undegraded":"2024-09-14T11:55:03.669743+0000","last_fullsized":"2024-09-14T11:55:03.669743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.655180+0000","last_change":"2024-09-14T10:56:43.703274+0000","last_active":"2024-09-14T11:54:57.655180+0000","last_peered":"2024-09-14T11:54:57.655180+0000","last_clean":"2024-09-14T11:54:57.655180+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:54:57.655180+0000","last_undegraded":"2024-09-14T11:54:57.655180+0000","last_fullsized":"2024-09-14T11:54:57.655180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:29.718912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'767","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.290965+0000","last_change":"2024-09-14T10:56:45.720876+0000","last_active":"2024-09-14T11:58:37.290965+0000","last_peered":"2024-09-14T11:58:37.290965+0000","last_clean":"2024-09-14T11:58:37.290965+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:58:37.290965+0000","last_undegraded":"2024-09-14T11:58:37.290965+0000","last_fullsized":"2024-09-14T11:58:37.290965+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202517,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":3195,"num_write":1122,"num_write_kb":955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656600+0000","last_change":"2024-09-14T10:56:47.731417+0000","last_active":"2024-09-14T11:55:07.656600+0000","last_peered":"2024-09-14T11:55:07.656600+0000","last_clean":"2024-09-14T11:55:07.656600+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:55:07.656600+0000","last_undegraded":"2024-09-14T11:55:07.656600+0000","last_fullsized":"2024-09-14T11:55:07.656600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:34.160341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'154","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.473141+0000","last_change":"2024-09-14T10:56:49.746978+0000","last_active":"2024-09-14T11:55:39.473141+0000","last_peered":"2024-09-14T11:55:39.473141+0000","last_clean":"2024-09-14T11:55:39.473141+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:55:39.473141+0000","last_undegraded":"2024-09-14T11:55:39.473141+0000","last_fullsized":"2024-09-14T11:55:39.473141+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:12.779368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'168","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.003254+0000","last_change":"2024-09-14T10:56:49.747311+0000","last_active":"2024-09-14T11:56:53.003254+0000","last_peered":"2024-09-14T11:56:53.003254+0000","last_clean":"2024-09-14T11:56:53.003254+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:56:53.003254+0000","last_undegraded":"2024-09-14T11:56:53.003254+0000","last_fullsized":"2024-09-14T11:56:53.003254+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:47.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1122","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447401+0000","last_change":"2024-09-14T10:56:41.687812+0000","last_active":"2024-09-14T11:57:23.447401+0000","last_peered":"2024-09-14T11:57:23.447401+0000","last_clean":"2024-09-14T11:57:23.447401+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:57:23.447401+0000","last_undegraded":"2024-09-14T11:57:23.447401+0000","last_fullsized":"2024-09-14T11:57:23.447401+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:02.391191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'396","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.388101+0000","last_change":"2024-09-14T10:56:39.670814+0000","last_active":"2024-09-14T11:58:38.388101+0000","last_peered":"2024-09-14T11:58:38.388101+0000","last_clean":"2024-09-14T11:58:38.388101+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:38.388101+0000","last_undegraded":"2024-09-14T11:58:38.388101+0000","last_fullsized":"2024-09-14T11:58:38.388101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":616,"num_read_kb":10191,"num_write":1178,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535277+0000","last_change":"2024-09-14T10:56:43.705030+0000","last_active":"2024-09-14T11:55:07.535277+0000","last_peered":"2024-09-14T11:55:07.535277+0000","last_clean":"2024-09-14T11:55:07.535277+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:55:07.535277+0000","last_undegraded":"2024-09-14T11:55:07.535277+0000","last_fullsized":"2024-09-14T11:55:07.535277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'329","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.298713+0000","last_change":"2024-09-14T10:56:45.717554+0000","last_active":"2024-09-14T11:58:11.298713+0000","last_peered":"2024-09-14T11:58:11.298713+0000","last_clean":"2024-09-14T11:58:11.298713+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:58:11.298713+0000","last_undegraded":"2024-09-14T11:58:11.298713+0000","last_fullsized":"2024-09-14T11:58:11.298713+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.209988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1261,"num_write":450,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656516+0000","last_change":"2024-09-14T10:56:47.725547+0000","last_active":"2024-09-14T11:55:07.656516+0000","last_peered":"2024-09-14T11:55:07.656516+0000","last_clean":"2024-09-14T11:55:07.656516+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:55:07.656516+0000","last_undegraded":"2024-09-14T11:55:07.656516+0000","last_fullsized":"2024-09-14T11:55:07.656516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.084006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.627089+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:55:30.627089+0000","last_peered":"2024-09-14T11:55:30.627089+0000","last_clean":"2024-09-14T11:55:30.627089+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:55:30.627089+0000","last_undegraded":"2024-09-14T11:55:30.627089+0000","last_fullsized":"2024-09-14T11:55:30.627089+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.809740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1055","reported_seq":2864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445536+0000","last_change":"2024-09-14T10:56:41.693098+0000","last_active":"2024-09-14T11:57:22.445536+0000","last_peered":"2024-09-14T11:57:22.445536+0000","last_clean":"2024-09-14T11:57:22.445536+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:57:22.445536+0000","last_undegraded":"2024-09-14T11:57:22.445536+0000","last_fullsized":"2024-09-14T11:57:22.445536+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:04.578146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426044+0000","last_change":"2024-09-14T10:56:39.696942+0000","last_active":"2024-09-14T11:58:37.426044+0000","last_peered":"2024-09-14T11:58:37.426044+0000","last_clean":"2024-09-14T11:58:37.426044+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:37.426044+0000","last_undegraded":"2024-09-14T11:58:37.426044+0000","last_fullsized":"2024-09-14T11:58:37.426044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:03.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14730799,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":790,"num_read_kb":46830,"num_write":1250,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656693+0000","last_change":"2024-09-14T10:56:43.695342+0000","last_active":"2024-09-14T11:55:07.656693+0000","last_peered":"2024-09-14T11:55:07.656693+0000","last_clean":"2024-09-14T11:55:07.656693+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:55:07.656693+0000","last_undegraded":"2024-09-14T11:55:07.656693+0000","last_fullsized":"2024-09-14T11:55:07.656693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:45.552140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.731707+0000","last_change":"2024-09-14T10:56:45.719223+0000","last_active":"2024-09-14T11:57:18.731707+0000","last_peered":"2024-09-14T11:57:18.731707+0000","last_clean":"2024-09-14T11:57:18.731707+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:57:18.731707+0000","last_undegraded":"2024-09-14T11:57:18.731707+0000","last_fullsized":"2024-09-14T11:57:18.731707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:12.736414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672205+0000","last_change":"2024-09-14T10:56:47.735092+0000","last_active":"2024-09-14T11:55:07.672205+0000","last_peered":"2024-09-14T11:55:07.672205+0000","last_clean":"2024-09-14T11:55:07.672205+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:55:07.672205+0000","last_undegraded":"2024-09-14T11:55:07.672205+0000","last_fullsized":"2024-09-14T11:55:07.672205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:26.157686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.919060+0000","last_change":"2024-09-14T10:56:49.748097+0000","last_active":"2024-09-14T11:56:51.919060+0000","last_peered":"2024-09-14T11:56:51.919060+0000","last_clean":"2024-09-14T11:56:51.919060+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:56:51.919060+0000","last_undegraded":"2024-09-14T11:56:51.919060+0000","last_fullsized":"2024-09-14T11:56:51.919060+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:32.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'555","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655868+0000","last_change":"2024-09-14T10:56:41.695455+0000","last_active":"2024-09-14T11:55:02.655868+0000","last_peered":"2024-09-14T11:55:02.655868+0000","last_clean":"2024-09-14T11:55:02.655868+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:55:02.655868+0000","last_undegraded":"2024-09-14T11:55:02.655868+0000","last_fullsized":"2024-09-14T11:55:02.655868+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:44.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'360","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.464257+0000","last_change":"2024-09-14T10:56:39.690454+0000","last_active":"2024-09-14T11:58:37.464257+0000","last_peered":"2024-09-14T11:58:37.464257+0000","last_clean":"2024-09-14T11:58:37.464257+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:37.464257+0000","last_undegraded":"2024-09-14T11:58:37.464257+0000","last_fullsized":"2024-09-14T11:58:37.464257+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:21.163573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270682,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":802,"num_read_kb":27462,"num_write":1372,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672163+0000","last_change":"2024-09-14T10:56:43.699062+0000","last_active":"2024-09-14T11:55:07.672163+0000","last_peered":"2024-09-14T11:55:07.672163+0000","last_clean":"2024-09-14T11:55:07.672163+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:55:07.672163+0000","last_undegraded":"2024-09-14T11:55:07.672163+0000","last_fullsized":"2024-09-14T11:55:07.672163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:26.963005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.284014+0000","last_change":"2024-09-14T10:56:45.715959+0000","last_active":"2024-09-14T11:58:11.284014+0000","last_peered":"2024-09-14T11:58:11.284014+0000","last_clean":"2024-09-14T11:58:11.284014+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:58:11.284014+0000","last_undegraded":"2024-09-14T11:58:11.284014+0000","last_fullsized":"2024-09-14T11:58:11.284014+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:05.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1077,"num_write":422,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670532+0000","last_change":"2024-09-14T10:56:47.732777+0000","last_active":"2024-09-14T11:55:08.670532+0000","last_peered":"2024-09-14T11:55:08.670532+0000","last_clean":"2024-09-14T11:55:08.670532+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:55:08.670532+0000","last_undegraded":"2024-09-14T11:55:08.670532+0000","last_fullsized":"2024-09-14T11:55:08.670532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:56.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'132","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:50.364550+0000","last_change":"2024-09-14T10:56:49.744968+0000","last_active":"2024-09-14T11:55:50.364550+0000","last_peered":"2024-09-14T11:55:50.364550+0000","last_clean":"2024-09-14T11:55:50.364550+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:55:50.364550+0000","last_undegraded":"2024-09-14T11:55:50.364550+0000","last_fullsized":"2024-09-14T11:55:50.364550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.920523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'545","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655810+0000","last_change":"2024-09-14T10:56:41.692451+0000","last_active":"2024-09-14T11:55:02.655810+0000","last_peered":"2024-09-14T11:55:02.655810+0000","last_clean":"2024-09-14T11:55:02.655810+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:55:02.655810+0000","last_undegraded":"2024-09-14T11:55:02.655810+0000","last_fullsized":"2024-09-14T11:55:02.655810+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:39.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'328","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.401708+0000","last_change":"2024-09-14T10:56:39.691385+0000","last_active":"2024-09-14T11:58:37.401708+0000","last_peered":"2024-09-14T11:58:37.401708+0000","last_clean":"2024-09-14T11:58:37.401708+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:37.401708+0000","last_undegraded":"2024-09-14T11:58:37.401708+0000","last_fullsized":"2024-09-14T11:58:37.401708+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15149076,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":674,"num_read_kb":41704,"num_write":1209,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669646+0000","last_change":"2024-09-14T10:56:43.704083+0000","last_active":"2024-09-14T11:55:03.669646+0000","last_peered":"2024-09-14T11:55:03.669646+0000","last_clean":"2024-09-14T11:55:03.669646+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:55:03.669646+0000","last_undegraded":"2024-09-14T11:55:03.669646+0000","last_fullsized":"2024-09-14T11:55:03.669646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.605990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'278","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.280355+0000","last_change":"2024-09-14T10:56:45.716753+0000","last_active":"2024-09-14T11:58:11.280355+0000","last_peered":"2024-09-14T11:58:11.280355+0000","last_clean":"2024-09-14T11:58:11.280355+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:58:11.280355+0000","last_undegraded":"2024-09-14T11:58:11.280355+0000","last_fullsized":"2024-09-14T11:58:11.280355+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:06.690939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":994,"num_write":372,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656266+0000","last_change":"2024-09-14T10:56:47.736112+0000","last_active":"2024-09-14T11:55:07.656266+0000","last_peered":"2024-09-14T11:55:07.656266+0000","last_clean":"2024-09-14T11:55:07.656266+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:55:07.656266+0000","last_undegraded":"2024-09-14T11:55:07.656266+0000","last_fullsized":"2024-09-14T11:55:07.656266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:10.784169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'481","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.461087+0000","last_change":"2024-09-14T10:56:41.690497+0000","last_active":"2024-09-14T11:56:10.461087+0000","last_peered":"2024-09-14T11:56:10.461087+0000","last_clean":"2024-09-14T11:56:10.461087+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:56:10.461087+0000","last_undegraded":"2024-09-14T11:56:10.461087+0000","last_fullsized":"2024-09-14T11:56:10.461087+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:04.625419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.232655+0000","last_change":"2024-09-14T10:56:39.680360+0000","last_active":"2024-09-14T11:58:37.232655+0000","last_peered":"2024-09-14T11:58:37.232655+0000","last_clean":"2024-09-14T11:58:37.232655+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:37.232655+0000","last_undegraded":"2024-09-14T11:58:37.232655+0000","last_fullsized":"2024-09-14T11:58:37.232655+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:47.696842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653223,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":524,"num_read_kb":63779,"num_write":845,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"37'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.156737+0000","last_change":"2024-09-14T10:56:43.698511+0000","last_active":"2024-09-14T11:58:36.156737+0000","last_peered":"2024-09-14T11:58:36.156737+0000","last_clean":"2024-09-14T11:58:36.156737+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:36.156737+0000","last_undegraded":"2024-09-14T11:58:36.156737+0000","last_fullsized":"2024-09-14T11:58:36.156737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.127093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'491","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.447584+0000","last_change":"2024-09-14T10:56:45.720443+0000","last_active":"2024-09-14T11:58:37.447584+0000","last_peered":"2024-09-14T11:58:37.447584+0000","last_clean":"2024-09-14T11:58:37.447584+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:58:37.447584+0000","last_undegraded":"2024-09-14T11:58:37.447584+0000","last_fullsized":"2024-09-14T11:58:37.447584+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.146179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":882,"num_read_kb":2032,"num_write":763,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541697+0000","last_change":"2024-09-14T10:56:47.731799+0000","last_active":"2024-09-14T11:54:17.541697+0000","last_peered":"2024-09-14T11:54:17.541697+0000","last_clean":"2024-09-14T11:54:17.541697+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:54:17.541697+0000","last_undegraded":"2024-09-14T11:54:17.541697+0000","last_fullsized":"2024-09-14T11:54:17.541697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.343090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'455","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266414+0000","last_change":"2024-09-14T10:56:41.691362+0000","last_active":"2024-09-14T11:55:58.266414+0000","last_peered":"2024-09-14T11:55:58.266414+0000","last_clean":"2024-09-14T11:55:58.266414+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:55:58.266414+0000","last_undegraded":"2024-09-14T11:55:58.266414+0000","last_fullsized":"2024-09-14T11:55:58.266414+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:01.380624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'300","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.372358+0000","last_change":"2024-09-14T10:56:39.673809+0000","last_active":"2024-09-14T11:58:37.372358+0000","last_peered":"2024-09-14T11:58:37.372358+0000","last_clean":"2024-09-14T11:58:37.372358+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:37.372358+0000","last_undegraded":"2024-09-14T11:58:37.372358+0000","last_fullsized":"2024-09-14T11:58:37.372358+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:32.335582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10492050,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":557,"num_read_kb":50717,"num_write":1006,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669754+0000","last_change":"2024-09-14T10:56:43.701698+0000","last_active":"2024-09-14T11:55:03.669754+0000","last_peered":"2024-09-14T11:55:03.669754+0000","last_clean":"2024-09-14T11:55:03.669754+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:55:03.669754+0000","last_undegraded":"2024-09-14T11:55:03.669754+0000","last_fullsized":"2024-09-14T11:55:03.669754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.260764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'310","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.281654+0000","last_change":"2024-09-14T10:56:45.719927+0000","last_active":"2024-09-14T11:58:11.281654+0000","last_peered":"2024-09-14T11:58:11.281654+0000","last_clean":"2024-09-14T11:58:11.281654+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:58:11.281654+0000","last_undegraded":"2024-09-14T11:58:11.281654+0000","last_fullsized":"2024-09-14T11:58:11.281654+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63343,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1061,"num_write":438,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529645+0000","last_change":"2024-09-14T10:56:47.726517+0000","last_active":"2024-09-14T11:54:17.529645+0000","last_peered":"2024-09-14T11:54:17.529645+0000","last_clean":"2024-09-14T11:54:17.529645+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:54:17.529645+0000","last_undegraded":"2024-09-14T11:54:17.529645+0000","last_fullsized":"2024-09-14T11:54:17.529645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:13.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'150","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.548609+0000","last_change":"2024-09-14T10:56:49.743152+0000","last_active":"2024-09-14T11:55:43.548609+0000","last_peered":"2024-09-14T11:55:43.548609+0000","last_clean":"2024-09-14T11:55:43.548609+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:55:43.548609+0000","last_undegraded":"2024-09-14T11:55:43.548609+0000","last_fullsized":"2024-09-14T11:55:43.548609+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:00.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'552","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.443381+0000","last_change":"2024-09-14T10:56:41.685799+0000","last_active":"2024-09-14T11:56:42.443381+0000","last_peered":"2024-09-14T11:56:42.443381+0000","last_clean":"2024-09-14T11:56:42.443381+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:56:42.443381+0000","last_undegraded":"2024-09-14T11:56:42.443381+0000","last_fullsized":"2024-09-14T11:56:42.443381+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'318","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.352316+0000","last_change":"2024-09-14T10:56:39.684773+0000","last_active":"2024-09-14T11:58:38.352316+0000","last_peered":"2024-09-14T11:58:38.352316+0000","last_clean":"2024-09-14T11:58:38.352316+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:38.352316+0000","last_undegraded":"2024-09-14T11:58:38.352316+0000","last_fullsized":"2024-09-14T11:58:38.352316+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.903799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190449,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":570,"num_read_kb":82907,"num_write":1067,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542445+0000","last_change":"2024-09-14T10:56:43.704594+0000","last_active":"2024-09-14T11:54:13.542445+0000","last_peered":"2024-09-14T11:54:13.542445+0000","last_clean":"2024-09-14T11:54:13.542445+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:54:13.542445+0000","last_undegraded":"2024-09-14T11:54:13.542445+0000","last_fullsized":"2024-09-14T11:54:13.542445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'302","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.303729+0000","last_change":"2024-09-14T10:56:45.713501+0000","last_active":"2024-09-14T11:58:11.303729+0000","last_peered":"2024-09-14T11:58:11.303729+0000","last_clean":"2024-09-14T11:58:11.303729+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:58:11.303729+0000","last_undegraded":"2024-09-14T11:58:11.303729+0000","last_fullsized":"2024-09-14T11:58:11.303729+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:35.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59479,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1009,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534180+0000","last_change":"2024-09-14T10:56:47.733388+0000","last_active":"2024-09-14T11:54:57.534180+0000","last_peered":"2024-09-14T11:54:57.534180+0000","last_clean":"2024-09-14T11:54:57.534180+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:54:57.534180+0000","last_undegraded":"2024-09-14T11:54:57.534180+0000","last_fullsized":"2024-09-14T11:54:57.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:57.789850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'166","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311096+0000","last_change":"2024-09-14T10:56:49.745862+0000","last_active":"2024-09-14T11:58:11.311096+0000","last_peered":"2024-09-14T11:58:11.311096+0000","last_clean":"2024-09-14T11:58:11.311096+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:58:11.311096+0000","last_undegraded":"2024-09-14T11:58:11.311096+0000","last_fullsized":"2024-09-14T11:58:11.311096+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.824927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'529","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.873131+0000","last_change":"2024-09-14T10:56:41.686220+0000","last_active":"2024-09-14T11:58:09.873131+0000","last_peered":"2024-09-14T11:58:09.873131+0000","last_clean":"2024-09-14T11:58:09.873131+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:09.873131+0000","last_undegraded":"2024-09-14T11:58:09.873131+0000","last_fullsized":"2024-09-14T11:58:09.873131+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:09.136596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'330","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426263+0000","last_change":"2024-09-14T10:57:16.216561+0000","last_active":"2024-09-14T11:58:37.426263+0000","last_peered":"2024-09-14T11:58:37.426263+0000","last_clean":"2024-09-14T11:58:37.426263+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:37.426263+0000","last_undegraded":"2024-09-14T11:58:37.426263+0000","last_fullsized":"2024-09-14T11:58:37.426263+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11708820,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":570,"num_read_kb":42073,"num_write":1097,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529656+0000","last_change":"2024-09-14T10:56:43.707654+0000","last_active":"2024-09-14T11:54:17.529656+0000","last_peered":"2024-09-14T11:54:17.529656+0000","last_clean":"2024-09-14T11:54:17.529656+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:54:17.529656+0000","last_undegraded":"2024-09-14T11:54:17.529656+0000","last_fullsized":"2024-09-14T11:54:17.529656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.644607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'102","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.120594+0000","last_change":"2024-09-14T10:56:45.723330+0000","last_active":"2024-09-14T11:57:19.120594+0000","last_peered":"2024-09-14T11:57:19.120594+0000","last_clean":"2024-09-14T11:57:19.120594+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:57:19.120594+0000","last_undegraded":"2024-09-14T11:57:19.120594+0000","last_fullsized":"2024-09-14T11:57:19.120594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.375494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'776","reported_seq":4308,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.587111+0000","last_change":"2024-09-14T10:56:47.725052+0000","last_active":"2024-09-14T11:58:36.587111+0000","last_peered":"2024-09-14T11:58:36.587111+0000","last_clean":"2024-09-14T11:58:36.587111+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:58:36.587111+0000","last_undegraded":"2024-09-14T11:58:36.587111+0000","last_fullsized":"2024-09-14T11:58:36.587111+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:47.209530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.919170+0000","last_change":"2024-09-14T10:56:49.751037+0000","last_active":"2024-09-14T11:56:52.919170+0000","last_peered":"2024-09-14T11:56:52.919170+0000","last_clean":"2024-09-14T11:56:52.919170+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:56:52.919170+0000","last_undegraded":"2024-09-14T11:56:52.919170+0000","last_fullsized":"2024-09-14T11:56:52.919170+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:10.690807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'413","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.748759+0000","last_change":"2024-09-14T10:56:41.697565+0000","last_active":"2024-09-14T11:56:52.748759+0000","last_peered":"2024-09-14T11:56:52.748759+0000","last_clean":"2024-09-14T11:56:52.748759+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:56:52.748759+0000","last_undegraded":"2024-09-14T11:56:52.748759+0000","last_fullsized":"2024-09-14T11:56:52.748759+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:10.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.486064+0000","last_change":"2024-09-14T10:56:39.680420+0000","last_active":"2024-09-14T11:58:37.486064+0000","last_peered":"2024-09-14T11:58:37.486064+0000","last_clean":"2024-09-14T11:58:37.486064+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:37.486064+0000","last_undegraded":"2024-09-14T11:58:37.486064+0000","last_fullsized":"2024-09-14T11:58:37.486064+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:32.687547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080169,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":440,"num_read_kb":9665,"num_write":951,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.664084+0000","last_change":"2024-09-14T10:56:43.698568+0000","last_active":"2024-09-14T11:54:17.664084+0000","last_peered":"2024-09-14T11:54:17.664084+0000","last_clean":"2024-09-14T11:54:17.664084+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:54:17.664084+0000","last_undegraded":"2024-09-14T11:54:17.664084+0000","last_fullsized":"2024-09-14T11:54:17.664084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:50.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'320","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.981914+0000","last_change":"2024-09-14T10:56:45.718845+0000","last_active":"2024-09-14T11:58:36.981914+0000","last_peered":"2024-09-14T11:58:36.981914+0000","last_clean":"2024-09-14T11:58:36.981914+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:58:36.981914+0000","last_undegraded":"2024-09-14T11:58:36.981914+0000","last_fullsized":"2024-09-14T11:58:36.981914+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:13.209858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653460+0000","last_change":"2024-09-14T10:56:47.733362+0000","last_active":"2024-09-14T11:54:47.653460+0000","last_peered":"2024-09-14T11:54:47.653460+0000","last_clean":"2024-09-14T11:54:47.653460+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:54:47.653460+0000","last_undegraded":"2024-09-14T11:54:47.653460+0000","last_fullsized":"2024-09-14T11:54:47.653460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:33.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'123","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.829287+0000","last_change":"2024-09-14T10:56:49.749682+0000","last_active":"2024-09-14T11:56:49.829287+0000","last_peered":"2024-09-14T11:56:49.829287+0000","last_clean":"2024-09-14T11:56:49.829287+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:56:49.829287+0000","last_undegraded":"2024-09-14T11:56:49.829287+0000","last_fullsized":"2024-09-14T11:56:49.829287+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:32.089427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'396","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.284146+0000","last_change":"2024-09-14T10:56:41.695266+0000","last_active":"2024-09-14T11:56:49.284146+0000","last_peered":"2024-09-14T11:56:49.284146+0000","last_clean":"2024-09-14T11:56:49.284146+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:56:49.284146+0000","last_undegraded":"2024-09-14T11:56:49.284146+0000","last_fullsized":"2024-09-14T11:56:49.284146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.489293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'281","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.526636+0000","last_change":"2024-09-14T10:56:39.681309+0000","last_active":"2024-09-14T11:58:37.526636+0000","last_peered":"2024-09-14T11:58:37.526636+0000","last_clean":"2024-09-14T11:58:37.526636+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:37.526636+0000","last_undegraded":"2024-09-14T11:58:37.526636+0000","last_fullsized":"2024-09-14T11:58:37.526636+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:25.783922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7295109,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":529,"num_read_kb":29813,"num_write":1032,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541668+0000","last_change":"2024-09-14T10:56:43.698362+0000","last_active":"2024-09-14T11:54:17.541668+0000","last_peered":"2024-09-14T11:54:17.541668+0000","last_clean":"2024-09-14T11:54:17.541668+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:54:17.541668+0000","last_undegraded":"2024-09-14T11:54:17.541668+0000","last_fullsized":"2024-09-14T11:54:17.541668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.790448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.069236+0000","last_change":"2024-09-14T10:56:45.714250+0000","last_active":"2024-09-14T11:58:37.069236+0000","last_peered":"2024-09-14T11:58:37.069236+0000","last_clean":"2024-09-14T11:58:37.069236+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:58:37.069236+0000","last_undegraded":"2024-09-14T11:58:37.069236+0000","last_fullsized":"2024-09-14T11:58:37.069236+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:33.117467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669009+0000","last_change":"2024-09-14T10:56:47.735191+0000","last_active":"2024-09-14T11:54:58.669009+0000","last_peered":"2024-09-14T11:54:58.669009+0000","last_clean":"2024-09-14T11:54:58.669009+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:54:58.669009+0000","last_undegraded":"2024-09-14T11:54:58.669009+0000","last_fullsized":"2024-09-14T11:54:58.669009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.084195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'105","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.049900+0000","last_change":"2024-09-14T10:56:49.737999+0000","last_active":"2024-09-14T11:56:00.049900+0000","last_peered":"2024-09-14T11:56:00.049900+0000","last_clean":"2024-09-14T11:56:00.049900+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:56:00.049900+0000","last_undegraded":"2024-09-14T11:56:00.049900+0000","last_fullsized":"2024-09-14T11:56:00.049900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.183467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'350","reported_seq":1779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553158+0000","last_change":"2024-09-14T10:57:15.793797+0000","last_active":"2024-09-14T11:55:32.553158+0000","last_peered":"2024-09-14T11:55:32.553158+0000","last_clean":"2024-09-14T11:55:32.553158+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:55:32.553158+0000","last_undegraded":"2024-09-14T11:55:32.553158+0000","last_fullsized":"2024-09-14T11:55:32.553158+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:28.436278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'366","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400385+0000","last_change":"2024-09-14T10:56:39.693756+0000","last_active":"2024-09-14T11:58:37.400385+0000","last_peered":"2024-09-14T11:58:37.400385+0000","last_clean":"2024-09-14T11:58:37.400385+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:37.400385+0000","last_undegraded":"2024-09-14T11:58:37.400385+0000","last_fullsized":"2024-09-14T11:58:37.400385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:17.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6398400,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":688,"num_read_kb":11025,"num_write":1228,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.546906+0000","last_change":"2024-09-14T10:56:43.701839+0000","last_active":"2024-09-14T11:54:43.546906+0000","last_peered":"2024-09-14T11:54:43.546906+0000","last_clean":"2024-09-14T11:54:43.546906+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:54:43.546906+0000","last_undegraded":"2024-09-14T11:54:43.546906+0000","last_fullsized":"2024-09-14T11:54:43.546906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:17.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'233","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.301001+0000","last_change":"2024-09-14T10:56:45.717972+0000","last_active":"2024-09-14T11:58:11.301001+0000","last_peered":"2024-09-14T11:58:11.301001+0000","last_clean":"2024-09-14T11:58:11.301001+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:58:11.301001+0000","last_undegraded":"2024-09-14T11:58:11.301001+0000","last_fullsized":"2024-09-14T11:58:11.301001+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:35.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61888,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":883,"num_write":320,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.543346+0000","last_change":"2024-09-14T10:56:47.727607+0000","last_active":"2024-09-14T11:54:18.543346+0000","last_peered":"2024-09-14T11:54:18.543346+0000","last_clean":"2024-09-14T11:54:18.543346+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:54:18.543346+0000","last_undegraded":"2024-09-14T11:54:18.543346+0000","last_fullsized":"2024-09-14T11:54:18.543346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:25.985367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'158","reported_seq":1613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.803159+0000","last_change":"2024-09-14T10:56:49.749341+0000","last_active":"2024-09-14T11:56:49.803159+0000","last_peered":"2024-09-14T11:56:49.803159+0000","last_clean":"2024-09-14T11:56:49.803159+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:56:49.803159+0000","last_undegraded":"2024-09-14T11:56:49.803159+0000","last_fullsized":"2024-09-14T11:56:49.803159+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:09.689856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'469","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313472+0000","last_change":"2024-09-14T10:56:41.688125+0000","last_active":"2024-09-14T11:56:49.313472+0000","last_peered":"2024-09-14T11:56:49.313472+0000","last_clean":"2024-09-14T11:56:49.313472+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:56:49.313472+0000","last_undegraded":"2024-09-14T11:56:49.313472+0000","last_fullsized":"2024-09-14T11:56:49.313472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:10.186168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'360","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.735738+0000","last_change":"2024-09-14T10:57:16.215872+0000","last_active":"2024-09-14T11:58:37.735738+0000","last_peered":"2024-09-14T11:58:37.735738+0000","last_clean":"2024-09-14T11:58:37.735738+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:37.735738+0000","last_undegraded":"2024-09-14T11:58:37.735738+0000","last_fullsized":"2024-09-14T11:58:37.735738+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:32.841426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058811,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":706,"num_read_kb":46942,"num_write":1256,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534114+0000","last_change":"2024-09-14T10:56:43.704444+0000","last_active":"2024-09-14T11:54:57.534114+0000","last_peered":"2024-09-14T11:54:57.534114+0000","last_clean":"2024-09-14T11:54:57.534114+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:54:57.534114+0000","last_undegraded":"2024-09-14T11:54:57.534114+0000","last_fullsized":"2024-09-14T11:54:57.534114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.463719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'297","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.304745+0000","last_change":"2024-09-14T10:56:45.721400+0000","last_active":"2024-09-14T11:58:11.304745+0000","last_peered":"2024-09-14T11:58:11.304745+0000","last_clean":"2024-09-14T11:58:11.304745+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:58:11.304745+0000","last_undegraded":"2024-09-14T11:58:11.304745+0000","last_fullsized":"2024-09-14T11:58:11.304745+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.182048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50315,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":473,"num_read_kb":960,"num_write":374,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.649773+0000","last_change":"2024-09-14T10:56:47.736437+0000","last_active":"2024-09-14T11:54:17.649773+0000","last_peered":"2024-09-14T11:54:17.649773+0000","last_clean":"2024-09-14T11:54:17.649773+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:54:17.649773+0000","last_undegraded":"2024-09-14T11:54:17.649773+0000","last_fullsized":"2024-09-14T11:54:17.649773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:00.826459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.871440+0000","last_change":"2024-09-14T10:56:49.747246+0000","last_active":"2024-09-14T11:58:09.871440+0000","last_peered":"2024-09-14T11:58:09.871440+0000","last_clean":"2024-09-14T11:58:09.871440+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:58:09.871440+0000","last_undegraded":"2024-09-14T11:58:09.871440+0000","last_fullsized":"2024-09-14T11:58:09.871440+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:08.836336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'582","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909450+0000","last_change":"2024-09-14T10:56:41.697790+0000","last_active":"2024-09-14T11:56:51.909450+0000","last_peered":"2024-09-14T11:56:51.909450+0000","last_clean":"2024-09-14T11:56:51.909450+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:56:51.909450+0000","last_undegraded":"2024-09-14T11:56:51.909450+0000","last_fullsized":"2024-09-14T11:56:51.909450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:08.908846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'330","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.506417+0000","last_change":"2024-09-14T10:56:39.673208+0000","last_active":"2024-09-14T11:58:38.506417+0000","last_peered":"2024-09-14T11:58:38.506417+0000","last_clean":"2024-09-14T11:58:38.506417+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:38.506417+0000","last_undegraded":"2024-09-14T11:58:38.506417+0000","last_fullsized":"2024-09-14T11:58:38.506417+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.389425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12223757,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":625,"num_read_kb":60949,"num_write":1061,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1051","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782289+0000","last_change":"2024-09-14T10:56:41.690469+0000","last_active":"2024-09-14T11:56:52.782289+0000","last_peered":"2024-09-14T11:56:52.782289+0000","last_clean":"2024-09-14T11:56:52.782289+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:56:52.782289+0000","last_undegraded":"2024-09-14T11:56:52.782289+0000","last_fullsized":"2024-09-14T11:56:52.782289+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1000,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:19.835570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'325","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.724368+0000","last_change":"2024-09-14T10:56:39.682932+0000","last_active":"2024-09-14T11:58:37.724368+0000","last_peered":"2024-09-14T11:58:37.724368+0000","last_clean":"2024-09-14T11:58:37.724368+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:37.724368+0000","last_undegraded":"2024-09-14T11:58:37.724368+0000","last_fullsized":"2024-09-14T11:58:37.724368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:56.634779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10224735,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":594,"num_read_kb":22759,"num_write":1100,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'997","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909714+0000","last_change":"2024-09-14T10:56:41.690506+0000","last_active":"2024-09-14T11:56:51.909714+0000","last_peered":"2024-09-14T11:56:51.909714+0000","last_clean":"2024-09-14T11:56:51.909714+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:56:51.909714+0000","last_undegraded":"2024-09-14T11:56:51.909714+0000","last_fullsized":"2024-09-14T11:56:51.909714+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:24.682037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'294","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.498509+0000","last_change":"2024-09-14T10:56:39.691542+0000","last_active":"2024-09-14T11:58:37.498509+0000","last_peered":"2024-09-14T11:58:37.498509+0000","last_clean":"2024-09-14T11:58:37.498509+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:37.498509+0000","last_undegraded":"2024-09-14T11:58:37.498509+0000","last_fullsized":"2024-09-14T11:58:37.498509+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:07.545833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13422990,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":944,"num_read_kb":42149,"num_write":1039,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'860","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.336478+0000","last_change":"2024-09-14T10:56:41.689333+0000","last_active":"2024-09-14T11:56:18.336478+0000","last_peered":"2024-09-14T11:56:18.336478+0000","last_clean":"2024-09-14T11:56:18.336478+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:56:18.336478+0000","last_undegraded":"2024-09-14T11:56:18.336478+0000","last_fullsized":"2024-09-14T11:56:18.336478+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:19.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'326","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.402352+0000","last_change":"2024-09-14T10:56:39.694580+0000","last_active":"2024-09-14T11:58:37.402352+0000","last_peered":"2024-09-14T11:58:37.402352+0000","last_clean":"2024-09-14T11:58:37.402352+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:37.402352+0000","last_undegraded":"2024-09-14T11:58:37.402352+0000","last_fullsized":"2024-09-14T11:58:37.402352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:23.950117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4582778,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":829,"num_read_kb":14120,"num_write":1200,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1634","reported_seq":3354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.881920+0000","last_change":"2024-09-14T10:56:41.696853+0000","last_active":"2024-09-14T11:58:09.881920+0000","last_peered":"2024-09-14T11:58:09.881920+0000","last_clean":"2024-09-14T11:58:09.881920+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:58:09.881920+0000","last_undegraded":"2024-09-14T11:58:09.881920+0000","last_fullsized":"2024-09-14T11:58:09.881920+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:47.117707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'355","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400797+0000","last_change":"2024-09-14T10:56:39.676793+0000","last_active":"2024-09-14T11:58:37.400797+0000","last_peered":"2024-09-14T11:58:37.400797+0000","last_clean":"2024-09-14T11:58:37.400797+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:37.400797+0000","last_undegraded":"2024-09-14T11:58:37.400797+0000","last_fullsized":"2024-09-14T11:58:37.400797+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2927610,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":715,"num_read_kb":3390,"num_write":1132,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.753104+0000","last_change":"2024-09-14T10:56:41.687648+0000","last_active":"2024-09-14T11:56:12.753104+0000","last_peered":"2024-09-14T11:56:12.753104+0000","last_clean":"2024-09-14T11:56:12.753104+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:56:12.753104+0000","last_undegraded":"2024-09-14T11:56:12.753104+0000","last_fullsized":"2024-09-14T11:56:12.753104+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:36.574356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'369","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.438453+0000","last_change":"2024-09-14T10:56:39.671687+0000","last_active":"2024-09-14T11:58:37.438453+0000","last_peered":"2024-09-14T11:58:37.438453+0000","last_clean":"2024-09-14T11:58:37.438453+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:37.438453+0000","last_undegraded":"2024-09-14T11:58:37.438453+0000","last_fullsized":"2024-09-14T11:58:37.438453+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:50.335751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595238,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1033,"num_read_kb":5070,"num_write":1198,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'774","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.874571+0000","last_change":"2024-09-14T10:56:41.691714+0000","last_active":"2024-09-14T11:58:09.874571+0000","last_peered":"2024-09-14T11:58:09.874571+0000","last_clean":"2024-09-14T11:58:09.874571+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:58:09.874571+0000","last_undegraded":"2024-09-14T11:58:09.874571+0000","last_fullsized":"2024-09-14T11:58:09.874571+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:17.443652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'346","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.542656+0000","last_change":"2024-09-14T10:56:39.686601+0000","last_active":"2024-09-14T11:58:38.542656+0000","last_peered":"2024-09-14T11:58:38.542656+0000","last_clean":"2024-09-14T11:58:38.542656+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:38.542656+0000","last_undegraded":"2024-09-14T11:58:38.542656+0000","last_fullsized":"2024-09-14T11:58:38.542656+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:57.339815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":600,"num_read_kb":6911,"num_write":1130,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'412","reported_seq":1943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.880186+0000","last_change":"2024-09-14T10:56:41.685678+0000","last_active":"2024-09-14T11:58:09.880186+0000","last_peered":"2024-09-14T11:58:09.880186+0000","last_clean":"2024-09-14T11:58:09.880186+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:09.880186+0000","last_undegraded":"2024-09-14T11:58:09.880186+0000","last_fullsized":"2024-09-14T11:58:09.880186+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:05.474990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'393","reported_seq":1253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.267236+0000","last_change":"2024-09-14T10:56:39.677501+0000","last_active":"2024-09-14T11:58:37.267236+0000","last_peered":"2024-09-14T11:58:37.267236+0000","last_clean":"2024-09-14T11:58:37.267236+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:37.267236+0000","last_undegraded":"2024-09-14T11:58:37.267236+0000","last_fullsized":"2024-09-14T11:58:37.267236+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:47.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12599751,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1272,"num_read_kb":48093,"num_write":1328,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'717","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445682+0000","last_change":"2024-09-14T10:56:41.697391+0000","last_active":"2024-09-14T11:57:22.445682+0000","last_peered":"2024-09-14T11:57:22.445682+0000","last_clean":"2024-09-14T11:57:22.445682+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:57:22.445682+0000","last_undegraded":"2024-09-14T11:57:22.445682+0000","last_fullsized":"2024-09-14T11:57:22.445682+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:49.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'371","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.475809+0000","last_change":"2024-09-14T10:56:39.680650+0000","last_active":"2024-09-14T11:58:37.475809+0000","last_peered":"2024-09-14T11:58:37.475809+0000","last_clean":"2024-09-14T11:58:37.475809+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:37.475809+0000","last_undegraded":"2024-09-14T11:58:37.475809+0000","last_fullsized":"2024-09-14T11:58:37.475809+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.313359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560019,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":847,"num_read_kb":12822,"num_write":1317,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781318+0000","last_change":"2024-09-14T10:56:41.694523+0000","last_active":"2024-09-14T11:56:52.781318+0000","last_peered":"2024-09-14T11:56:52.781318+0000","last_clean":"2024-09-14T11:56:52.781318+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:56:52.781318+0000","last_undegraded":"2024-09-14T11:56:52.781318+0000","last_fullsized":"2024-09-14T11:56:52.781318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:14.167389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'407","reported_seq":1247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.411894+0000","last_change":"2024-09-14T10:56:39.685874+0000","last_active":"2024-09-14T11:58:37.411894+0000","last_peered":"2024-09-14T11:58:37.411894+0000","last_clean":"2024-09-14T11:58:37.411894+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:37.411894+0000","last_undegraded":"2024-09-14T11:58:37.411894+0000","last_fullsized":"2024-09-14T11:58:37.411894+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:00.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224146,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1500,"num_read_kb":34980,"num_write":1337,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1164","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.335677+0000","last_change":"2024-09-14T10:56:41.684712+0000","last_active":"2024-09-14T11:56:18.335677+0000","last_peered":"2024-09-14T11:56:18.335677+0000","last_clean":"2024-09-14T11:56:18.335677+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:56:18.335677+0000","last_undegraded":"2024-09-14T11:56:18.335677+0000","last_fullsized":"2024-09-14T11:56:18.335677+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:54.887564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'282","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.559297+0000","last_change":"2024-09-14T10:56:39.692620+0000","last_active":"2024-09-14T11:58:37.559297+0000","last_peered":"2024-09-14T11:58:37.559297+0000","last_clean":"2024-09-14T11:58:37.559297+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:37.559297+0000","last_undegraded":"2024-09-14T11:58:37.559297+0000","last_fullsized":"2024-09-14T11:58:37.559297+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19437,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":448,"num_read_kb":3420,"num_write":962,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'618","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.780930+0000","last_change":"2024-09-14T10:56:41.688962+0000","last_active":"2024-09-14T11:56:52.780930+0000","last_peered":"2024-09-14T11:56:52.780930+0000","last_clean":"2024-09-14T11:56:52.780930+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:56:52.780930+0000","last_undegraded":"2024-09-14T11:56:52.780930+0000","last_fullsized":"2024-09-14T11:56:52.780930+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'295","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.327505+0000","last_change":"2024-09-14T10:57:16.314650+0000","last_active":"2024-09-14T11:58:37.327505+0000","last_peered":"2024-09-14T11:58:37.327505+0000","last_clean":"2024-09-14T11:58:37.327505+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:37.327505+0000","last_undegraded":"2024-09-14T11:58:37.327505+0000","last_fullsized":"2024-09-14T11:58:37.327505+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:28.239442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057405,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":573,"num_read_kb":7722,"num_write":987,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1674","reported_seq":3374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817636+0000","last_change":"2024-09-14T10:56:41.701632+0000","last_active":"2024-09-14T11:55:53.817636+0000","last_peered":"2024-09-14T11:55:53.817636+0000","last_clean":"2024-09-14T11:55:53.817636+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:55:53.817636+0000","last_undegraded":"2024-09-14T11:55:53.817636+0000","last_fullsized":"2024-09-14T11:55:53.817636+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:14.899433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'346","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.480854+0000","last_change":"2024-09-14T10:56:39.685631+0000","last_active":"2024-09-14T11:58:38.480854+0000","last_peered":"2024-09-14T11:58:38.480854+0000","last_clean":"2024-09-14T11:58:38.480854+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:38.480854+0000","last_undegraded":"2024-09-14T11:58:38.480854+0000","last_fullsized":"2024-09-14T11:58:38.480854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:18.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1758507,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":720,"num_read_kb":21069,"num_write":1103,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'702","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754801+0000","last_change":"2024-09-14T10:57:15.795049+0000","last_active":"2024-09-14T11:56:12.754801+0000","last_peered":"2024-09-14T11:56:12.754801+0000","last_clean":"2024-09-14T11:56:12.754801+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:56:12.754801+0000","last_undegraded":"2024-09-14T11:56:12.754801+0000","last_fullsized":"2024-09-14T11:56:12.754801+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:10.949204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'289","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.394915+0000","last_change":"2024-09-14T10:56:39.690542+0000","last_active":"2024-09-14T11:58:37.394915+0000","last_peered":"2024-09-14T11:58:37.394915+0000","last_clean":"2024-09-14T11:58:37.394915+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:37.394915+0000","last_undegraded":"2024-09-14T11:58:37.394915+0000","last_fullsized":"2024-09-14T11:58:37.394915+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.115794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243370,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":489,"num_read_kb":36238,"num_write":1018,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'409","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910480+0000","last_change":"2024-09-14T10:56:41.690216+0000","last_active":"2024-09-14T11:56:51.910480+0000","last_peered":"2024-09-14T11:56:51.910480+0000","last_clean":"2024-09-14T11:56:51.910480+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:56:51.910480+0000","last_undegraded":"2024-09-14T11:56:51.910480+0000","last_fullsized":"2024-09-14T11:56:51.910480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.654443+0000","last_change":"2024-09-14T10:57:16.215847+0000","last_active":"2024-09-14T11:58:37.654443+0000","last_peered":"2024-09-14T11:58:37.654443+0000","last_clean":"2024-09-14T11:58:37.654443+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:37.654443+0000","last_undegraded":"2024-09-14T11:58:37.654443+0000","last_fullsized":"2024-09-14T11:58:37.654443+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294118,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":838,"num_read_kb":32735,"num_write":1138,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'725","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337741+0000","last_change":"2024-09-14T10:56:41.695355+0000","last_active":"2024-09-14T11:56:18.337741+0000","last_peered":"2024-09-14T11:56:18.337741+0000","last_clean":"2024-09-14T11:56:18.337741+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:56:18.337741+0000","last_undegraded":"2024-09-14T11:56:18.337741+0000","last_fullsized":"2024-09-14T11:56:18.337741+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.776564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'314","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.550171+0000","last_change":"2024-09-14T10:56:39.685637+0000","last_active":"2024-09-14T11:58:37.550171+0000","last_peered":"2024-09-14T11:58:37.550171+0000","last_clean":"2024-09-14T11:58:37.550171+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:37.550171+0000","last_undegraded":"2024-09-14T11:58:37.550171+0000","last_fullsized":"2024-09-14T11:58:37.550171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:42.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247989,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":616,"num_read_kb":35324,"num_write":1042,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.568879+0000","last_change":"2024-09-14T10:56:39.685937+0000","last_active":"2024-09-14T11:58:37.568879+0000","last_peered":"2024-09-14T11:58:37.568879+0000","last_clean":"2024-09-14T11:58:37.568879+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:37.568879+0000","last_undegraded":"2024-09-14T11:58:37.568879+0000","last_fullsized":"2024-09-14T11:58:37.568879+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.470574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7512937,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":468,"num_read_kb":8144,"num_write":937,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'848","reported_seq":2539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.311836+0000","last_change":"2024-09-14T10:56:41.697673+0000","last_active":"2024-09-14T11:56:49.311836+0000","last_peered":"2024-09-14T11:56:49.311836+0000","last_clean":"2024-09-14T11:56:49.311836+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:56:49.311836+0000","last_undegraded":"2024-09-14T11:56:49.311836+0000","last_fullsized":"2024-09-14T11:56:49.311836+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:15.211850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'361","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.392872+0000","last_change":"2024-09-14T10:56:39.678521+0000","last_active":"2024-09-14T11:58:37.392872+0000","last_peered":"2024-09-14T11:58:37.392872+0000","last_clean":"2024-09-14T11:58:37.392872+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:37.392872+0000","last_undegraded":"2024-09-14T11:58:37.392872+0000","last_fullsized":"2024-09-14T11:58:37.392872+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:30.975047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384611,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":982,"num_read_kb":40288,"num_write":1276,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'389","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:04.142380+0000","last_change":"2024-09-14T10:56:41.693372+0000","last_active":"2024-09-14T11:56:04.142380+0000","last_peered":"2024-09-14T11:56:04.142380+0000","last_clean":"2024-09-14T11:56:04.142380+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:56:04.142380+0000","last_undegraded":"2024-09-14T11:56:04.142380+0000","last_fullsized":"2024-09-14T11:56:04.142380+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:08.940223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1898,"ondisk_log_size":1898,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":686,"ondisk_log_size":686,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1891177,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18358,"num_read_kb":36947,"num_write":15464,"num_write_kb":11997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2150400,"data_stored":1725828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2220,"ondisk_log_size":2220,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3597,"ondisk_log_size":3597,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":383898518,"num_objects":2727,"num_object_clones":0,"num_object_copies":10908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":42151,"num_read_kb":1932066,"num_write":71184,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":504643584,"data_stored":504643584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4128,"ondisk_log_size":4128,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":37809435,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":152,"num_read_kb":187491,"num_write":172,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74571776,"data_stored":74562102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":25166696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":178270,"num_write":182,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51376128,"data_stored":51369680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510194,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318456,"kb_used_data":38572,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94053384,"statfs":{"total":96636764160,"available":96310665216,"internally_reserved":0,"allocated":39497728,"data_stored":37549429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510191,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177584,"kb_used_data":70000,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94194256,"statfs":{"total":96636764160,"available":96454918144,"internally_reserved":0,"allocated":71680000,"data_stored":69749394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542893,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421844,"kb_used_data":111576,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93949996,"statfs":{"total":96636764160,"available":96204795904,"internally_reserved":0,"allocated":114253824,"data_stored":112204578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":317651402},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542896,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253824,"kb_used_data":96180,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94118016,"statfs":{"total":96636764160,"available":96376848384,"internally_reserved":0,"allocated":98488320,"data_stored":96444521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542894,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":402692,"kb_used_data":118728,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93969148,"statfs":{"total":96636764160,"available":96224407552,"internally_reserved":0,"allocated":121577472,"data_stored":119566800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542897,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208852,"kb_used_data":105420,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162988,"statfs":{"total":96636764160,"available":96422899712,"internally_reserved":0,"allocated":107950080,"data_stored":106022468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542895,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285796,"kb_used_data":101872,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94086044,"statfs":{"total":96636764160,"available":96344109056,"internally_reserved":0,"allocated":104316928,"data_stored":102342096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542894,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":390920,"kb_used_data":116788,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93980920,"statfs":{"total":96636764160,"available":96236462080,"internally_reserved":0,"allocated":119590912,"data_stored":117572619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81403904,"data_stored":81403904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65474560,"data_stored":65474560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46292992,"data_stored":46292992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":78364672,"data_stored":78364672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35192832,"data_stored":35192832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":80044032,"data_stored":80044032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34148352,"data_stored":34148352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":83722240,"data_stored":83722240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":222118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":225098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":40146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":100122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":376999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17817600,"data_stored":17817600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5255168,"data_stored":5251944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4190208,"data_stored":4190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4190208,"data_stored":4190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4198400,"data_stored":4195176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10493952,"data_stored":10493069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7335936,"data_stored":7335936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21032960,"data_stored":21028123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1105920,"data_stored":1101966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14688256,"data_stored":14688256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:40.092 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:58:40.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:40.452 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:58:40.462 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:58:40.465 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2124,"stamp":"2024-09-14T11:58:39.891893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":449373531,"num_objects":3216,"num_object_clones":0,"num_object_copies":11886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3216,"num_whiteouts":0,"num_read":310000,"num_read_kb":2562967,"num_write":163378,"num_write_kb":2614708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13827,"ondisk_log_size":13827,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2459968,"kb_used_data":759136,"kb_used_omap":12,"kb_used_meta":1699955,"kb_avail":752514752,"statfs":{"total":773094113280,"available":770575106048,"internally_reserved":0,"allocated":777355264,"data_stored":761451905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1740754480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-306507808,"num_objects":-1732,"num_object_clones":0,"num_object_copies":-6868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1732,"num_whiteouts":0,"num_read":1909,"num_read_kb":1366,"num_write":1821,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006012"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'8","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552583+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:55:27.552583+0000","last_peered":"2024-09-14T11:55:27.552583+0000","last_clean":"2024-09-14T11:55:27.552583+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:55:27.552583+0000","last_undegraded":"2024-09-14T11:55:27.552583+0000","last_fullsized":"2024-09-14T11:55:27.552583+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":13318,"num_write":13,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.732014+0000","last_change":"2024-09-14T11:32:11.437735+0000","last_active":"2024-09-14T11:54:42.732014+0000","last_peered":"2024-09-14T11:54:42.732014+0000","last_clean":"2024-09-14T11:54:42.732014+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:54:42.732014+0000","last_undegraded":"2024-09-14T11:54:42.732014+0000","last_fullsized":"2024-09-14T11:54:42.732014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:47.395141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.650977+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:58:36.650977+0000","last_peered":"2024-09-14T11:58:36.650977+0000","last_clean":"2024-09-14T11:58:36.650977+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:58:36.650977+0000","last_undegraded":"2024-09-14T11:58:36.650977+0000","last_fullsized":"2024-09-14T11:58:36.650977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.449688+0000","last_change":"2024-09-14T11:15:22.382182+0000","last_active":"2024-09-14T11:57:52.449688+0000","last_peered":"2024-09-14T11:57:52.449688+0000","last_clean":"2024-09-14T11:57:52.449688+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:57:52.449688+0000","last_undegraded":"2024-09-14T11:57:52.449688+0000","last_fullsized":"2024-09-14T11:57:52.449688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:17.002880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.732724+0000","last_change":"2024-09-14T11:12:39.149946+0000","last_active":"2024-09-14T11:54:47.732724+0000","last_peered":"2024-09-14T11:54:47.732724+0000","last_clean":"2024-09-14T11:54:47.732724+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:54:47.732724+0000","last_undegraded":"2024-09-14T11:54:47.732724+0000","last_fullsized":"2024-09-14T11:54:47.732724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:07.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.660125+0000","last_change":"2024-09-14T11:32:11.434861+0000","last_active":"2024-09-14T11:53:58.660125+0000","last_peered":"2024-09-14T11:53:58.660125+0000","last_clean":"2024-09-14T11:53:58.660125+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:58.660125+0000","last_undegraded":"2024-09-14T11:53:58.660125+0000","last_fullsized":"2024-09-14T11:53:58.660125+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:31.993353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655710+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:55:02.655710+0000","last_peered":"2024-09-14T11:55:02.655710+0000","last_clean":"2024-09-14T11:55:02.655710+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:55:02.655710+0000","last_undegraded":"2024-09-14T11:55:02.655710+0000","last_fullsized":"2024-09-14T11:55:02.655710+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:42.694530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738922+0000","last_change":"2024-09-14T11:15:22.378824+0000","last_active":"2024-09-14T11:55:27.738922+0000","last_peered":"2024-09-14T11:55:27.738922+0000","last_clean":"2024-09-14T11:55:27.738922+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:55:27.738922+0000","last_undegraded":"2024-09-14T11:55:27.738922+0000","last_fullsized":"2024-09-14T11:55:27.738922+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647590+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:53:57.647590+0000","last_peered":"2024-09-14T11:53:57.647590+0000","last_clean":"2024-09-14T11:53:57.647590+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:53:57.647590+0000","last_undegraded":"2024-09-14T11:53:57.647590+0000","last_fullsized":"2024-09-14T11:53:57.647590+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:18.964434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.450876+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:57:37.450876+0000","last_peered":"2024-09-14T11:57:37.450876+0000","last_clean":"2024-09-14T11:57:37.450876+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:57:37.450876+0000","last_undegraded":"2024-09-14T11:57:37.450876+0000","last_fullsized":"2024-09-14T11:57:37.450876+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":9,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'3","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:03.444017+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:57:03.444017+0000","last_peered":"2024-09-14T11:57:03.444017+0000","last_clean":"2024-09-14T11:57:03.444017+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:57:03.444017+0000","last_undegraded":"2024-09-14T11:57:03.444017+0000","last_fullsized":"2024-09-14T11:57:03.444017+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541604+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:54:17.541604+0000","last_peered":"2024-09-14T11:54:17.541604+0000","last_clean":"2024-09-14T11:54:17.541604+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:54:17.541604+0000","last_undegraded":"2024-09-14T11:54:17.541604+0000","last_fullsized":"2024-09-14T11:54:17.541604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.758307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.647995+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:54:02.647995+0000","last_peered":"2024-09-14T11:54:02.647995+0000","last_clean":"2024-09-14T11:54:02.647995+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:54:02.647995+0000","last_undegraded":"2024-09-14T11:54:02.647995+0000","last_fullsized":"2024-09-14T11:54:02.647995+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.355968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535330+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:55:07.535330+0000","last_peered":"2024-09-14T11:55:07.535330+0000","last_clean":"2024-09-14T11:55:07.535330+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:55:07.535330+0000","last_undegraded":"2024-09-14T11:55:07.535330+0000","last_fullsized":"2024-09-14T11:55:07.535330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:34.726917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.683250+0000","last_change":"2024-09-14T11:15:25.395023+0000","last_active":"2024-09-14T11:56:33.683250+0000","last_peered":"2024-09-14T11:56:33.683250+0000","last_clean":"2024-09-14T11:56:33.683250+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:56:33.683250+0000","last_undegraded":"2024-09-14T11:56:33.683250+0000","last_fullsized":"2024-09-14T11:56:33.683250+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:00.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":10232,"num_write":5,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.440709+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:56:43.440709+0000","last_peered":"2024-09-14T11:56:43.440709+0000","last_clean":"2024-09-14T11:56:43.440709+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:56:43.440709+0000","last_undegraded":"2024-09-14T11:56:43.440709+0000","last_fullsized":"2024-09-14T11:56:43.440709+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.328393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670510+0000","last_change":"2024-09-14T11:12:39.152199+0000","last_active":"2024-09-14T11:55:08.670510+0000","last_peered":"2024-09-14T11:55:08.670510+0000","last_clean":"2024-09-14T11:55:08.670510+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:55:08.670510+0000","last_undegraded":"2024-09-14T11:55:08.670510+0000","last_fullsized":"2024-09-14T11:55:08.670510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:33.862160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.673548+0000","last_change":"2024-09-14T11:15:25.385836+0000","last_active":"2024-09-14T11:55:28.673548+0000","last_peered":"2024-09-14T11:55:28.673548+0000","last_clean":"2024-09-14T11:55:28.673548+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:55:28.673548+0000","last_undegraded":"2024-09-14T11:55:28.673548+0000","last_fullsized":"2024-09-14T11:55:28.673548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:47.787237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.835728+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:58:36.835728+0000","last_peered":"2024-09-14T11:58:36.835728+0000","last_clean":"2024-09-14T11:58:36.835728+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:58:36.835728+0000","last_undegraded":"2024-09-14T11:58:36.835728+0000","last_fullsized":"2024-09-14T11:58:36.835728+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.646678+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:53:52.646678+0000","last_peered":"2024-09-14T11:53:52.646678+0000","last_clean":"2024-09-14T11:53:52.646678+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:53:52.646678+0000","last_undegraded":"2024-09-14T11:53:52.646678+0000","last_fullsized":"2024-09-14T11:53:52.646678+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:27.384797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659128+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:55:27.659128+0000","last_peered":"2024-09-14T11:55:27.659128+0000","last_clean":"2024-09-14T11:55:27.659128+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:55:27.659128+0000","last_undegraded":"2024-09-14T11:55:27.659128+0000","last_fullsized":"2024-09-14T11:55:27.659128+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.543032+0000","last_change":"2024-09-14T11:12:39.148861+0000","last_active":"2024-09-14T11:56:12.543032+0000","last_peered":"2024-09-14T11:56:12.543032+0000","last_clean":"2024-09-14T11:56:12.543032+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:56:12.543032+0000","last_undegraded":"2024-09-14T11:56:12.543032+0000","last_fullsized":"2024-09-14T11:56:12.543032+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:48.885213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.538794+0000","last_change":"2024-09-14T11:32:11.441324+0000","last_active":"2024-09-14T11:55:32.538794+0000","last_peered":"2024-09-14T11:55:32.538794+0000","last_clean":"2024-09-14T11:55:32.538794+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:55:32.538794+0000","last_undegraded":"2024-09-14T11:55:32.538794+0000","last_fullsized":"2024-09-14T11:55:32.538794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:40.912189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'2","reported_seq":37,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.654974+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:54:57.654974+0000","last_peered":"2024-09-14T11:54:57.654974+0000","last_clean":"2024-09-14T11:54:57.654974+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:54:57.654974+0000","last_undegraded":"2024-09-14T11:54:57.654974+0000","last_fullsized":"2024-09-14T11:54:57.654974+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":2,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.739392+0000","last_change":"2024-09-14T11:32:11.425898+0000","last_active":"2024-09-14T11:55:32.739392+0000","last_peered":"2024-09-14T11:55:32.739392+0000","last_clean":"2024-09-14T11:55:32.739392+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:55:32.739392+0000","last_undegraded":"2024-09-14T11:55:32.739392+0000","last_fullsized":"2024-09-14T11:55:32.739392+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:44.908579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.661902+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:54:02.661902+0000","last_peered":"2024-09-14T11:54:02.661902+0000","last_clean":"2024-09-14T11:54:02.661902+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:54:02.661902+0000","last_undegraded":"2024-09-14T11:54:02.661902+0000","last_fullsized":"2024-09-14T11:54:02.661902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:37.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'1","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:07.648976+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:54:07.648976+0000","last_peered":"2024-09-14T11:54:07.648976+0000","last_clean":"2024-09-14T11:54:07.648976+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:54:07.648976+0000","last_undegraded":"2024-09-14T11:54:07.648976+0000","last_fullsized":"2024-09-14T11:54:07.648976+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:25.067236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8184,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615637+0000","last_change":"2024-09-14T11:15:22.364016+0000","last_active":"2024-09-14T11:58:37.615637+0000","last_peered":"2024-09-14T11:58:37.615637+0000","last_clean":"2024-09-14T11:58:37.615637+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:58:37.615637+0000","last_undegraded":"2024-09-14T11:58:37.615637+0000","last_fullsized":"2024-09-14T11:58:37.615637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:25.332714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.743509+0000","last_change":"2024-09-14T11:12:39.148536+0000","last_active":"2024-09-14T11:56:12.743509+0000","last_peered":"2024-09-14T11:56:12.743509+0000","last_clean":"2024-09-14T11:56:12.743509+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:56:12.743509+0000","last_undegraded":"2024-09-14T11:56:12.743509+0000","last_fullsized":"2024-09-14T11:56:12.743509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:22.270515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.439116+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:56:33.439116+0000","last_peered":"2024-09-14T11:56:33.439116+0000","last_clean":"2024-09-14T11:56:33.439116+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:56:33.439116+0000","last_undegraded":"2024-09-14T11:56:33.439116+0000","last_fullsized":"2024-09-14T11:56:33.439116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:54.069010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'1","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.648099+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:54:02.648099+0000","last_peered":"2024-09-14T11:54:02.648099+0000","last_clean":"2024-09-14T11:54:02.648099+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:54:02.648099+0000","last_undegraded":"2024-09-14T11:54:02.648099+0000","last_fullsized":"2024-09-14T11:54:02.648099+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.960689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647680+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:53:57.647680+0000","last_peered":"2024-09-14T11:53:57.647680+0000","last_clean":"2024-09-14T11:53:57.647680+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:53:57.647680+0000","last_undegraded":"2024-09-14T11:53:57.647680+0000","last_fullsized":"2024-09-14T11:53:57.647680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:18.749825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'8","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446319+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:57:27.446319+0000","last_peered":"2024-09-14T11:57:27.446319+0000","last_clean":"2024-09-14T11:57:27.446319+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:57:27.446319+0000","last_undegraded":"2024-09-14T11:57:27.446319+0000","last_fullsized":"2024-09-14T11:57:27.446319+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":15350,"num_write":13,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447296+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:57:23.447296+0000","last_peered":"2024-09-14T11:57:23.447296+0000","last_clean":"2024-09-14T11:57:23.447296+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:57:23.447296+0000","last_undegraded":"2024-09-14T11:57:23.447296+0000","last_fullsized":"2024-09-14T11:57:23.447296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668344+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:54:42.668344+0000","last_peered":"2024-09-14T11:54:42.668344+0000","last_clean":"2024-09-14T11:54:42.668344+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:54:42.668344+0000","last_undegraded":"2024-09-14T11:54:42.668344+0000","last_fullsized":"2024-09-14T11:54:42.668344+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647472+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:53:57.647472+0000","last_peered":"2024-09-14T11:53:57.647472+0000","last_clean":"2024-09-14T11:53:57.647472+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:57.647472+0000","last_undegraded":"2024-09-14T11:53:57.647472+0000","last_fullsized":"2024-09-14T11:53:57.647472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:22.717875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446265+0000","last_change":"2024-09-14T11:15:25.391047+0000","last_active":"2024-09-14T11:57:27.446265+0000","last_peered":"2024-09-14T11:57:27.446265+0000","last_clean":"2024-09-14T11:57:27.446265+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:57:27.446265+0000","last_undegraded":"2024-09-14T11:57:27.446265+0000","last_fullsized":"2024-09-14T11:57:27.446265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:36.099082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652801+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:54:42.652801+0000","last_peered":"2024-09-14T11:54:42.652801+0000","last_clean":"2024-09-14T11:54:42.652801+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:54:42.652801+0000","last_undegraded":"2024-09-14T11:54:42.652801+0000","last_fullsized":"2024-09-14T11:54:42.652801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:54.823817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669689+0000","last_change":"2024-09-14T11:15:22.380265+0000","last_active":"2024-09-14T11:55:03.669689+0000","last_peered":"2024-09-14T11:55:03.669689+0000","last_clean":"2024-09-14T11:55:03.669689+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:55:03.669689+0000","last_undegraded":"2024-09-14T11:55:03.669689+0000","last_fullsized":"2024-09-14T11:55:03.669689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.546224+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:54:38.546224+0000","last_peered":"2024-09-14T11:54:38.546224+0000","last_clean":"2024-09-14T11:54:38.546224+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:54:38.546224+0000","last_undegraded":"2024-09-14T11:54:38.546224+0000","last_fullsized":"2024-09-14T11:54:38.546224+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647657+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:53:57.647657+0000","last_peered":"2024-09-14T11:53:57.647657+0000","last_clean":"2024-09-14T11:53:57.647657+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:53:57.647657+0000","last_undegraded":"2024-09-14T11:53:57.647657+0000","last_fullsized":"2024-09-14T11:53:57.647657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:43.844584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670462+0000","last_change":"2024-09-14T11:15:25.394352+0000","last_active":"2024-09-14T11:55:08.670462+0000","last_peered":"2024-09-14T11:55:08.670462+0000","last_clean":"2024-09-14T11:55:08.670462+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:55:08.670462+0000","last_undegraded":"2024-09-14T11:55:08.670462+0000","last_fullsized":"2024-09-14T11:55:08.670462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:35.832475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653140+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:54:42.653140+0000","last_peered":"2024-09-14T11:54:42.653140+0000","last_clean":"2024-09-14T11:54:42.653140+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:54:42.653140+0000","last_undegraded":"2024-09-14T11:54:42.653140+0000","last_fullsized":"2024-09-14T11:54:42.653140+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:29.954707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.742985+0000","last_change":"2024-09-14T11:32:11.425357+0000","last_active":"2024-09-14T11:56:07.742985+0000","last_peered":"2024-09-14T11:56:07.742985+0000","last_clean":"2024-09-14T11:56:07.742985+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:56:07.742985+0000","last_undegraded":"2024-09-14T11:56:07.742985+0000","last_fullsized":"2024-09-14T11:56:07.742985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:04.671224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.679588+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:55:52.679588+0000","last_peered":"2024-09-14T11:55:52.679588+0000","last_clean":"2024-09-14T11:55:52.679588+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:55:52.679588+0000","last_undegraded":"2024-09-14T11:55:52.679588+0000","last_fullsized":"2024-09-14T11:55:52.679588+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4968,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":3079,"num_write":5,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668319+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:54:42.668319+0000","last_peered":"2024-09-14T11:54:42.668319+0000","last_clean":"2024-09-14T11:54:42.668319+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:54:42.668319+0000","last_undegraded":"2024-09-14T11:54:42.668319+0000","last_fullsized":"2024-09-14T11:54:42.668319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:51.143671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'1","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662654+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:55:57.662654+0000","last_peered":"2024-09-14T11:55:57.662654+0000","last_clean":"2024-09-14T11:55:57.662654+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:55:57.662654+0000","last_undegraded":"2024-09-14T11:55:57.662654+0000","last_fullsized":"2024-09-14T11:55:57.662654+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.741529+0000","last_change":"2024-09-14T11:15:22.370925+0000","last_active":"2024-09-14T11:55:52.741529+0000","last_peered":"2024-09-14T11:55:52.741529+0000","last_clean":"2024-09-14T11:55:52.741529+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:55:52.741529+0000","last_undegraded":"2024-09-14T11:55:52.741529+0000","last_fullsized":"2024-09-14T11:55:52.741529+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.657676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.678742+0000","last_change":"2024-09-14T11:32:11.435885+0000","last_active":"2024-09-14T11:56:03.678742+0000","last_peered":"2024-09-14T11:56:03.678742+0000","last_clean":"2024-09-14T11:56:03.678742+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:56:03.678742+0000","last_undegraded":"2024-09-14T11:56:03.678742+0000","last_fullsized":"2024-09-14T11:56:03.678742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:04.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:27.454554+0000","last_change":"2024-09-14T11:15:25.389833+0000","last_active":"2024-09-14T11:58:27.454554+0000","last_peered":"2024-09-14T11:58:27.454554+0000","last_clean":"2024-09-14T11:58:27.454554+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:58:27.454554+0000","last_undegraded":"2024-09-14T11:58:27.454554+0000","last_fullsized":"2024-09-14T11:58:27.454554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.345624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672755+0000","last_change":"2024-09-14T11:12:39.147355+0000","last_active":"2024-09-14T11:55:23.672755+0000","last_peered":"2024-09-14T11:55:23.672755+0000","last_clean":"2024-09-14T11:55:23.672755+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:55:23.672755+0000","last_undegraded":"2024-09-14T11:55:23.672755+0000","last_fullsized":"2024-09-14T11:55:23.672755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:13.956283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.542021+0000","last_change":"2024-09-14T11:15:22.379118+0000","last_active":"2024-09-14T11:56:02.542021+0000","last_peered":"2024-09-14T11:56:02.542021+0000","last_clean":"2024-09-14T11:56:02.542021+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:56:02.542021+0000","last_undegraded":"2024-09-14T11:56:02.542021+0000","last_fullsized":"2024-09-14T11:56:02.542021+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.600963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738869+0000","last_change":"2024-09-14T11:12:39.149430+0000","last_active":"2024-09-14T11:55:27.738869+0000","last_peered":"2024-09-14T11:55:27.738869+0000","last_clean":"2024-09-14T11:55:27.738869+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:55:27.738869+0000","last_undegraded":"2024-09-14T11:55:27.738869+0000","last_fullsized":"2024-09-14T11:55:27.738869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653286+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:54:42.653286+0000","last_peered":"2024-09-14T11:54:42.653286+0000","last_clean":"2024-09-14T11:54:42.653286+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:54:42.653286+0000","last_undegraded":"2024-09-14T11:54:42.653286+0000","last_fullsized":"2024-09-14T11:54:42.653286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:15.841468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'3","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544712+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:54:28.544712+0000","last_peered":"2024-09-14T11:54:28.544712+0000","last_clean":"2024-09-14T11:54:28.544712+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:54:28.544712+0000","last_undegraded":"2024-09-14T11:54:28.544712+0000","last_fullsized":"2024-09-14T11:54:28.544712+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:36.393782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101966,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":2106,"num_write":3,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.650300+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:54:22.650300+0000","last_peered":"2024-09-14T11:54:22.650300+0000","last_clean":"2024-09-14T11:54:22.650300+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:54:22.650300+0000","last_undegraded":"2024-09-14T11:54:22.650300+0000","last_fullsized":"2024-09-14T11:54:22.650300+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:49.433106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9208,"num_write":3,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668478+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:54:42.668478+0000","last_peered":"2024-09-14T11:54:42.668478+0000","last_clean":"2024-09-14T11:54:42.668478+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:54:42.668478+0000","last_undegraded":"2024-09-14T11:54:42.668478+0000","last_fullsized":"2024-09-14T11:54:42.668478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.627281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'11","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665597+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:54:27.665597+0000","last_peered":"2024-09-14T11:54:27.665597+0000","last_clean":"2024-09-14T11:54:27.665597+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:54:27.665597+0000","last_undegraded":"2024-09-14T11:54:27.665597+0000","last_fullsized":"2024-09-14T11:54:27.665597+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.725661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":9238,"num_write":21,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'5","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.530112+0000","last_change":"2024-09-14T11:15:22.377316+0000","last_active":"2024-09-14T11:54:22.530112+0000","last_peered":"2024-09-14T11:54:22.530112+0000","last_clean":"2024-09-14T11:54:22.530112+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:54:22.530112+0000","last_undegraded":"2024-09-14T11:54:22.530112+0000","last_fullsized":"2024-09-14T11:54:22.530112+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:25.594786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3153920,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668371+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:54:42.668371+0000","last_peered":"2024-09-14T11:54:42.668371+0000","last_clean":"2024-09-14T11:54:42.668371+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:54:42.668371+0000","last_undegraded":"2024-09-14T11:54:42.668371+0000","last_fullsized":"2024-09-14T11:54:42.668371+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:37.210143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'1","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.650977+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:54:27.650977+0000","last_peered":"2024-09-14T11:54:27.650977+0000","last_clean":"2024-09-14T11:54:27.650977+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:54:27.650977+0000","last_undegraded":"2024-09-14T11:54:27.650977+0000","last_fullsized":"2024-09-14T11:54:27.650977+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:47.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1032,"num_write":1,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652877+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:54:42.652877+0000","last_peered":"2024-09-14T11:54:42.652877+0000","last_clean":"2024-09-14T11:54:42.652877+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:54:42.652877+0000","last_undegraded":"2024-09-14T11:54:42.652877+0000","last_fullsized":"2024-09-14T11:54:42.652877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:12.740126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'7","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.434370+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:56:47.434370+0000","last_peered":"2024-09-14T11:56:47.434370+0000","last_clean":"2024-09-14T11:56:47.434370+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:56:47.434370+0000","last_undegraded":"2024-09-14T11:56:47.434370+0000","last_fullsized":"2024-09-14T11:56:47.434370+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5251072,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":9236,"num_write":12,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.454028+0000","last_change":"2024-09-14T11:15:22.380025+0000","last_active":"2024-09-14T11:58:08.454028+0000","last_peered":"2024-09-14T11:58:08.454028+0000","last_clean":"2024-09-14T11:58:08.454028+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:58:08.454028+0000","last_undegraded":"2024-09-14T11:58:08.454028+0000","last_fullsized":"2024-09-14T11:58:08.454028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:46.350891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678034+0000","last_change":"2024-09-14T11:12:39.148220+0000","last_active":"2024-09-14T11:55:58.678034+0000","last_peered":"2024-09-14T11:55:58.678034+0000","last_clean":"2024-09-14T11:55:58.678034+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:55:58.678034+0000","last_undegraded":"2024-09-14T11:55:58.678034+0000","last_fullsized":"2024-09-14T11:55:58.678034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:39.515999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672229+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:55:07.672229+0000","last_peered":"2024-09-14T11:55:07.672229+0000","last_clean":"2024-09-14T11:55:07.672229+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:55:07.672229+0000","last_undegraded":"2024-09-14T11:55:07.672229+0000","last_fullsized":"2024-09-14T11:55:07.672229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:49.122371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656337+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:55:07.656337+0000","last_peered":"2024-09-14T11:55:07.656337+0000","last_clean":"2024-09-14T11:55:07.656337+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:55:07.656337+0000","last_undegraded":"2024-09-14T11:55:07.656337+0000","last_fullsized":"2024-09-14T11:55:07.656337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436876+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:57:02.436876+0000","last_peered":"2024-09-14T11:57:02.436876+0000","last_clean":"2024-09-14T11:57:02.436876+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:57:02.436876+0000","last_undegraded":"2024-09-14T11:57:02.436876+0000","last_fullsized":"2024-09-14T11:57:02.436876+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:13.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663286+0000","last_change":"2024-09-14T11:12:39.156458+0000","last_active":"2024-09-14T11:56:02.663286+0000","last_peered":"2024-09-14T11:56:02.663286+0000","last_clean":"2024-09-14T11:56:02.663286+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:56:02.663286+0000","last_undegraded":"2024-09-14T11:56:02.663286+0000","last_fullsized":"2024-09-14T11:56:02.663286+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:31.776422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.549256+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:55:07.549256+0000","last_peered":"2024-09-14T11:55:07.549256+0000","last_clean":"2024-09-14T11:55:07.549256+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:55:07.549256+0000","last_undegraded":"2024-09-14T11:55:07.549256+0000","last_fullsized":"2024-09-14T11:55:07.549256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:29.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'1","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655633+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:55:02.655633+0000","last_peered":"2024-09-14T11:55:02.655633+0000","last_clean":"2024-09-14T11:55:02.655633+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:55:02.655633+0000","last_undegraded":"2024-09-14T11:55:02.655633+0000","last_fullsized":"2024-09-14T11:55:02.655633+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:50.686182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'3","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.734284+0000","last_change":"2024-09-14T11:15:22.372158+0000","last_active":"2024-09-14T11:55:02.734284+0000","last_peered":"2024-09-14T11:55:02.734284+0000","last_clean":"2024-09-14T11:55:02.734284+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:55:02.734284+0000","last_undegraded":"2024-09-14T11:55:02.734284+0000","last_fullsized":"2024-09-14T11:55:02.734284+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.110739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678107+0000","last_change":"2024-09-14T11:12:39.150717+0000","last_active":"2024-09-14T11:55:58.678107+0000","last_peered":"2024-09-14T11:55:58.678107+0000","last_clean":"2024-09-14T11:55:58.678107+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:55:58.678107+0000","last_undegraded":"2024-09-14T11:55:58.678107+0000","last_fullsized":"2024-09-14T11:55:58.678107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:45.689240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665743+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:54:27.665743+0000","last_peered":"2024-09-14T11:54:27.665743+0000","last_clean":"2024-09-14T11:54:27.665743+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:54:27.665743+0000","last_undegraded":"2024-09-14T11:54:27.665743+0000","last_fullsized":"2024-09-14T11:54:27.665743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:26.826579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:22.542574+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:54:22.542574+0000","last_peered":"2024-09-14T11:54:22.542574+0000","last_clean":"2024-09-14T11:54:22.542574+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:54:22.542574+0000","last_undegraded":"2024-09-14T11:54:22.542574+0000","last_fullsized":"2024-09-14T11:54:22.542574+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":141,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665689+0000","last_change":"2024-09-14T11:12:39.152381+0000","last_active":"2024-09-14T11:54:27.665689+0000","last_peered":"2024-09-14T11:54:27.665689+0000","last_clean":"2024-09-14T11:54:27.665689+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:54:27.665689+0000","last_undegraded":"2024-09-14T11:54:27.665689+0000","last_fullsized":"2024-09-14T11:54:27.665689+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:49.106166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550583+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:55:08.550583+0000","last_peered":"2024-09-14T11:55:08.550583+0000","last_clean":"2024-09-14T11:55:08.550583+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:55:08.550583+0000","last_undegraded":"2024-09-14T11:55:08.550583+0000","last_fullsized":"2024-09-14T11:55:08.550583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:30.888765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544802+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:54:28.544802+0000","last_peered":"2024-09-14T11:54:28.544802+0000","last_clean":"2024-09-14T11:54:28.544802+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:54:28.544802+0000","last_undegraded":"2024-09-14T11:54:28.544802+0000","last_fullsized":"2024-09-14T11:54:28.544802+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.330595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.432156+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:56:32.432156+0000","last_peered":"2024-09-14T11:56:32.432156+0000","last_clean":"2024-09-14T11:56:32.432156+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:56:32.432156+0000","last_undegraded":"2024-09-14T11:56:32.432156+0000","last_fullsized":"2024-09-14T11:56:32.432156+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.438324+0000","last_change":"2024-09-14T11:12:39.147602+0000","last_active":"2024-09-14T11:56:27.438324+0000","last_peered":"2024-09-14T11:56:27.438324+0000","last_clean":"2024-09-14T11:56:27.438324+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:56:27.438324+0000","last_undegraded":"2024-09-14T11:56:27.438324+0000","last_fullsized":"2024-09-14T11:56:27.438324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:46.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.742512+0000","last_change":"2024-09-14T11:32:11.429687+0000","last_active":"2024-09-14T11:56:02.742512+0000","last_peered":"2024-09-14T11:56:02.742512+0000","last_clean":"2024-09-14T11:56:02.742512+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:56:02.742512+0000","last_undegraded":"2024-09-14T11:56:02.742512+0000","last_fullsized":"2024-09-14T11:56:02.742512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:04.011582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443285+0000","last_change":"2024-09-14T11:15:25.393792+0000","last_active":"2024-09-14T11:57:07.443285+0000","last_peered":"2024-09-14T11:57:07.443285+0000","last_clean":"2024-09-14T11:57:07.443285+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:57:07.443285+0000","last_undegraded":"2024-09-14T11:57:07.443285+0000","last_fullsized":"2024-09-14T11:57:07.443285+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:55.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":16376,"num_write":11,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'6","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.441510+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:57:32.441510+0000","last_peered":"2024-09-14T11:57:32.441510+0000","last_clean":"2024-09-14T11:57:32.441510+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:57:32.441510+0000","last_undegraded":"2024-09-14T11:57:32.441510+0000","last_fullsized":"2024-09-14T11:57:32.441510+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7164,"num_write":11,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'9","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:37.553896+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:55:37.553896+0000","last_peered":"2024-09-14T11:55:37.553896+0000","last_clean":"2024-09-14T11:55:37.553896+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:55:37.553896+0000","last_undegraded":"2024-09-14T11:55:37.553896+0000","last_fullsized":"2024-09-14T11:55:37.553896+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12313,"num_write":19,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670674+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:54:57.670674+0000","last_peered":"2024-09-14T11:54:57.670674+0000","last_clean":"2024-09-14T11:54:57.670674+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:54:57.670674+0000","last_undegraded":"2024-09-14T11:54:57.670674+0000","last_fullsized":"2024-09-14T11:54:57.670674+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.148504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.437717+0000","last_change":"2024-09-14T11:12:39.147615+0000","last_active":"2024-09-14T11:56:23.437717+0000","last_peered":"2024-09-14T11:56:23.437717+0000","last_clean":"2024-09-14T11:56:23.437717+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:56:23.437717+0000","last_undegraded":"2024-09-14T11:56:23.437717+0000","last_fullsized":"2024-09-14T11:56:23.437717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:19.785409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656302+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:55:07.656302+0000","last_peered":"2024-09-14T11:55:07.656302+0000","last_clean":"2024-09-14T11:55:07.656302+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:55:07.656302+0000","last_undegraded":"2024-09-14T11:55:07.656302+0000","last_fullsized":"2024-09-14T11:55:07.656302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:40.123052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669707+0000","last_change":"2024-09-14T11:15:25.396627+0000","last_active":"2024-09-14T11:55:03.669707+0000","last_peered":"2024-09-14T11:55:03.669707+0000","last_clean":"2024-09-14T11:55:03.669707+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:55:03.669707+0000","last_undegraded":"2024-09-14T11:55:03.669707+0000","last_fullsized":"2024-09-14T11:55:03.669707+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:23.471334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534143+0000","last_change":"2024-09-14T11:15:22.378471+0000","last_active":"2024-09-14T11:54:57.534143+0000","last_peered":"2024-09-14T11:54:57.534143+0000","last_clean":"2024-09-14T11:54:57.534143+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:54:57.534143+0000","last_undegraded":"2024-09-14T11:54:57.534143+0000","last_fullsized":"2024-09-14T11:54:57.534143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:11.906269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681832+0000","last_change":"2024-09-14T11:12:39.142992+0000","last_active":"2024-09-14T11:56:23.681832+0000","last_peered":"2024-09-14T11:56:23.681832+0000","last_clean":"2024-09-14T11:56:23.681832+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:56:23.681832+0000","last_undegraded":"2024-09-14T11:56:23.681832+0000","last_fullsized":"2024-09-14T11:56:23.681832+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.230213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672320+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:55:07.672320+0000","last_peered":"2024-09-14T11:55:07.672320+0000","last_clean":"2024-09-14T11:55:07.672320+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:55:07.672320+0000","last_undegraded":"2024-09-14T11:55:07.672320+0000","last_fullsized":"2024-09-14T11:55:07.672320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:44.097739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549751+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:55:03.549751+0000","last_peered":"2024-09-14T11:55:03.549751+0000","last_clean":"2024-09-14T11:55:03.549751+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:55:03.549751+0000","last_undegraded":"2024-09-14T11:55:03.549751+0000","last_fullsized":"2024-09-14T11:55:03.549751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669044+0000","last_change":"2024-09-14T11:15:22.376114+0000","last_active":"2024-09-14T11:54:58.669044+0000","last_peered":"2024-09-14T11:54:58.669044+0000","last_clean":"2024-09-14T11:54:58.669044+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:54:58.669044+0000","last_undegraded":"2024-09-14T11:54:58.669044+0000","last_fullsized":"2024-09-14T11:54:58.669044+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:22.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.668992+0000","last_change":"2024-09-14T11:12:39.149756+0000","last_active":"2024-09-14T11:54:47.668992+0000","last_peered":"2024-09-14T11:54:47.668992+0000","last_clean":"2024-09-14T11:54:47.668992+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:54:47.668992+0000","last_undegraded":"2024-09-14T11:54:47.668992+0000","last_fullsized":"2024-09-14T11:54:47.668992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:07.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'314","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400780+0000","last_change":"2024-09-14T10:56:39.693906+0000","last_active":"2024-09-14T11:58:37.400780+0000","last_peered":"2024-09-14T11:58:37.400780+0000","last_clean":"2024-09-14T11:58:37.400780+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:58:37.400780+0000","last_undegraded":"2024-09-14T11:58:37.400780+0000","last_fullsized":"2024-09-14T11:58:37.400780+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:28.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9490061,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":574,"num_read_kb":9138,"num_write":1077,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'440","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.264788+0000","last_change":"2024-09-14T10:56:41.690207+0000","last_active":"2024-09-14T11:55:58.264788+0000","last_peered":"2024-09-14T11:55:58.264788+0000","last_clean":"2024-09-14T11:55:58.264788+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:55:58.264788+0000","last_undegraded":"2024-09-14T11:55:58.264788+0000","last_fullsized":"2024-09-14T11:55:58.264788+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:16.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'306","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.354229+0000","last_change":"2024-09-14T10:56:39.680660+0000","last_active":"2024-09-14T11:58:37.354229+0000","last_peered":"2024-09-14T11:58:37.354229+0000","last_clean":"2024-09-14T11:58:37.354229+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:37.354229+0000","last_undegraded":"2024-09-14T11:58:37.354229+0000","last_fullsized":"2024-09-14T11:58:37.354229+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:39.615498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9815057,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":571,"num_read_kb":47838,"num_write":1145,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'490","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460547+0000","last_change":"2024-09-14T10:56:41.699684+0000","last_active":"2024-09-14T11:56:10.460547+0000","last_peered":"2024-09-14T11:56:10.460547+0000","last_clean":"2024-09-14T11:56:10.460547+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:56:10.460547+0000","last_undegraded":"2024-09-14T11:56:10.460547+0000","last_fullsized":"2024-09-14T11:56:10.460547+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'364","reported_seq":1050,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415833+0000","last_change":"2024-09-14T10:56:39.673016+0000","last_active":"2024-09-14T11:58:37.415833+0000","last_peered":"2024-09-14T11:58:37.415833+0000","last_clean":"2024-09-14T11:58:37.415833+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:37.415833+0000","last_undegraded":"2024-09-14T11:58:37.415833+0000","last_fullsized":"2024-09-14T11:58:37.415833+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:56.452286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10971206,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":789,"num_read_kb":44180,"num_write":1229,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'371","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337410+0000","last_change":"2024-09-14T10:56:41.694979+0000","last_active":"2024-09-14T11:56:18.337410+0000","last_peered":"2024-09-14T11:56:18.337410+0000","last_clean":"2024-09-14T11:56:18.337410+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:56:18.337410+0000","last_undegraded":"2024-09-14T11:56:18.337410+0000","last_fullsized":"2024-09-14T11:56:18.337410+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:14.514694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'436","reported_seq":1121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.539746+0000","last_change":"2024-09-14T10:56:39.693767+0000","last_active":"2024-09-14T11:58:37.539746+0000","last_peered":"2024-09-14T11:58:37.539746+0000","last_clean":"2024-09-14T11:58:37.539746+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:37.539746+0000","last_undegraded":"2024-09-14T11:58:37.539746+0000","last_fullsized":"2024-09-14T11:58:37.539746+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:57.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17561900,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":946,"num_read_kb":27790,"num_write":1275,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1224","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266363+0000","last_change":"2024-09-14T10:56:41.698071+0000","last_active":"2024-09-14T11:55:58.266363+0000","last_peered":"2024-09-14T11:55:58.266363+0000","last_clean":"2024-09-14T11:55:58.266363+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:55:58.266363+0000","last_undegraded":"2024-09-14T11:55:58.266363+0000","last_fullsized":"2024-09-14T11:55:58.266363+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:18.150057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'307","reported_seq":907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.378471+0000","last_change":"2024-09-14T10:56:39.695001+0000","last_active":"2024-09-14T11:58:37.378471+0000","last_peered":"2024-09-14T11:58:37.378471+0000","last_clean":"2024-09-14T11:58:37.378471+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:37.378471+0000","last_undegraded":"2024-09-14T11:58:37.378471+0000","last_fullsized":"2024-09-14T11:58:37.378471+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.100648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8382083,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":505,"num_read_kb":13771,"num_write":1043,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'575","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266908+0000","last_change":"2024-09-14T10:56:41.688774+0000","last_active":"2024-09-14T11:55:58.266908+0000","last_peered":"2024-09-14T11:55:58.266908+0000","last_clean":"2024-09-14T11:55:58.266908+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:55:58.266908+0000","last_undegraded":"2024-09-14T11:55:58.266908+0000","last_fullsized":"2024-09-14T11:55:58.266908+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:12.204837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'299","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.546748+0000","last_change":"2024-09-14T10:56:39.687131+0000","last_active":"2024-09-14T11:58:37.546748+0000","last_peered":"2024-09-14T11:58:37.546748+0000","last_clean":"2024-09-14T11:58:37.546748+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:37.546748+0000","last_undegraded":"2024-09-14T11:58:37.546748+0000","last_fullsized":"2024-09-14T11:58:37.546748+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:02.638600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5187176,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":460,"num_read_kb":13548,"num_write":1046,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'833","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313416+0000","last_change":"2024-09-14T10:56:41.692162+0000","last_active":"2024-09-14T11:56:49.313416+0000","last_peered":"2024-09-14T11:56:49.313416+0000","last_clean":"2024-09-14T11:56:49.313416+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:56:49.313416+0000","last_undegraded":"2024-09-14T11:56:49.313416+0000","last_fullsized":"2024-09-14T11:56:49.313416+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'284","reported_seq":916,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.342005+0000","last_change":"2024-09-14T10:56:39.695403+0000","last_active":"2024-09-14T11:58:37.342005+0000","last_peered":"2024-09-14T11:58:37.342005+0000","last_clean":"2024-09-14T11:58:37.342005+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:37.342005+0000","last_undegraded":"2024-09-14T11:58:37.342005+0000","last_fullsized":"2024-09-14T11:58:37.342005+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.933894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2785474,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":588,"num_read_kb":14446,"num_write":1020,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.821254+0000","last_change":"2024-09-14T10:56:41.689448+0000","last_active":"2024-09-14T11:55:44.821254+0000","last_peered":"2024-09-14T11:55:44.821254+0000","last_clean":"2024-09-14T11:55:44.821254+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:55:44.821254+0000","last_undegraded":"2024-09-14T11:55:44.821254+0000","last_fullsized":"2024-09-14T11:55:44.821254+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:26.618232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'303","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.349668+0000","last_change":"2024-09-14T10:56:39.676967+0000","last_active":"2024-09-14T11:58:37.349668+0000","last_peered":"2024-09-14T11:58:37.349668+0000","last_clean":"2024-09-14T11:58:37.349668+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:37.349668+0000","last_undegraded":"2024-09-14T11:58:37.349668+0000","last_fullsized":"2024-09-14T11:58:37.349668+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:55.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221114,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":615,"num_read_kb":23065,"num_write":1122,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'425","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518743+0000","last_change":"2024-09-14T10:56:41.681136+0000","last_active":"2024-09-14T11:56:16.518743+0000","last_peered":"2024-09-14T11:56:16.518743+0000","last_clean":"2024-09-14T11:56:16.518743+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:56:16.518743+0000","last_undegraded":"2024-09-14T11:56:16.518743+0000","last_fullsized":"2024-09-14T11:56:16.518743+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:35.914131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'454","reported_seq":1879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447330+0000","last_change":"2024-09-14T10:56:41.695103+0000","last_active":"2024-09-14T11:57:23.447330+0000","last_peered":"2024-09-14T11:57:23.447330+0000","last_clean":"2024-09-14T11:57:23.447330+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:57:23.447330+0000","last_undegraded":"2024-09-14T11:57:23.447330+0000","last_fullsized":"2024-09-14T11:57:23.447330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:47.177973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'381","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406182+0000","last_change":"2024-09-14T10:56:39.694286+0000","last_active":"2024-09-14T11:58:37.406182+0000","last_peered":"2024-09-14T11:58:37.406182+0000","last_clean":"2024-09-14T11:58:37.406182+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:37.406182+0000","last_undegraded":"2024-09-14T11:58:37.406182+0000","last_fullsized":"2024-09-14T11:58:37.406182+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:43.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6514601,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":884,"num_read_kb":12852,"num_write":1544,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'532","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.516606+0000","last_change":"2024-09-14T10:56:41.700369+0000","last_active":"2024-09-14T11:56:16.516606+0000","last_peered":"2024-09-14T11:56:16.516606+0000","last_clean":"2024-09-14T11:56:16.516606+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:56:16.516606+0000","last_undegraded":"2024-09-14T11:56:16.516606+0000","last_fullsized":"2024-09-14T11:56:16.516606+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.164622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'327","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.497127+0000","last_change":"2024-09-14T10:56:39.681268+0000","last_active":"2024-09-14T11:58:38.497127+0000","last_peered":"2024-09-14T11:58:38.497127+0000","last_clean":"2024-09-14T11:58:38.497127+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:38.497127+0000","last_undegraded":"2024-09-14T11:58:38.497127+0000","last_fullsized":"2024-09-14T11:58:38.497127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:31.116262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430153,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":503,"num_read_kb":13589,"num_write":1011,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'636","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910117+0000","last_change":"2024-09-14T10:56:41.684245+0000","last_active":"2024-09-14T11:56:51.910117+0000","last_peered":"2024-09-14T11:56:51.910117+0000","last_clean":"2024-09-14T11:56:51.910117+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:56:51.910117+0000","last_undegraded":"2024-09-14T11:56:51.910117+0000","last_fullsized":"2024-09-14T11:56:51.910117+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:41.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'377","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.527682+0000","last_change":"2024-09-14T10:56:39.689695+0000","last_active":"2024-09-14T11:58:38.527682+0000","last_peered":"2024-09-14T11:58:38.527682+0000","last_clean":"2024-09-14T11:58:38.527682+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:38.527682+0000","last_undegraded":"2024-09-14T11:58:38.527682+0000","last_fullsized":"2024-09-14T11:58:38.527682+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1054884,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":700,"num_read_kb":72218,"num_write":1241,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1144","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.775492+0000","last_change":"2024-09-14T10:56:41.690350+0000","last_active":"2024-09-14T11:57:45.775492+0000","last_peered":"2024-09-14T11:57:45.775492+0000","last_clean":"2024-09-14T11:57:45.775492+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:57:45.775492+0000","last_undegraded":"2024-09-14T11:57:45.775492+0000","last_fullsized":"2024-09-14T11:57:45.775492+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:17.084325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'334","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.338171+0000","last_change":"2024-09-14T10:56:39.673331+0000","last_active":"2024-09-14T11:58:38.338171+0000","last_peered":"2024-09-14T11:58:38.338171+0000","last_clean":"2024-09-14T11:58:38.338171+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:38.338171+0000","last_undegraded":"2024-09-14T11:58:38.338171+0000","last_fullsized":"2024-09-14T11:58:38.338171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:09.718190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":805,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":633,"num_read_kb":16353,"num_write":1183,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749815+0000","last_change":"2024-09-14T10:56:41.689989+0000","last_active":"2024-09-14T11:57:07.749815+0000","last_peered":"2024-09-14T11:57:07.749815+0000","last_clean":"2024-09-14T11:57:07.749815+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:57:07.749815+0000","last_undegraded":"2024-09-14T11:57:07.749815+0000","last_fullsized":"2024-09-14T11:57:07.749815+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:27.009017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'283","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.395153+0000","last_change":"2024-09-14T10:56:39.685439+0000","last_active":"2024-09-14T11:58:37.395153+0000","last_peered":"2024-09-14T11:58:37.395153+0000","last_clean":"2024-09-14T11:58:37.395153+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:37.395153+0000","last_undegraded":"2024-09-14T11:58:37.395153+0000","last_fullsized":"2024-09-14T11:58:37.395153+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4940556,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":506,"num_read_kb":6224,"num_write":1004,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'757","reported_seq":2336,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.905582+0000","last_change":"2024-09-14T10:56:41.699633+0000","last_active":"2024-09-14T11:58:09.905582+0000","last_peered":"2024-09-14T11:58:09.905582+0000","last_clean":"2024-09-14T11:58:09.905582+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:58:09.905582+0000","last_undegraded":"2024-09-14T11:58:09.905582+0000","last_fullsized":"2024-09-14T11:58:09.905582+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.536330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'325","reported_seq":955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338061+0000","last_change":"2024-09-14T10:56:39.686616+0000","last_active":"2024-09-14T11:58:37.338061+0000","last_peered":"2024-09-14T11:58:37.338061+0000","last_clean":"2024-09-14T11:58:37.338061+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:37.338061+0000","last_undegraded":"2024-09-14T11:58:37.338061+0000","last_fullsized":"2024-09-14T11:58:37.338061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.022385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1258263,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":612,"num_read_kb":11097,"num_write":1124,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'102","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.924904+0000","last_change":"2024-09-14T10:56:49.738494+0000","last_active":"2024-09-14T11:56:52.924904+0000","last_peered":"2024-09-14T11:56:52.924904+0000","last_clean":"2024-09-14T11:56:52.924904+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:56:52.924904+0000","last_undegraded":"2024-09-14T11:56:52.924904+0000","last_fullsized":"2024-09-14T11:56:52.924904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:00.728999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'435","reported_seq":2152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.887571+0000","last_change":"2024-09-14T10:56:41.692358+0000","last_active":"2024-09-14T11:58:09.887571+0000","last_peered":"2024-09-14T11:58:09.887571+0000","last_clean":"2024-09-14T11:58:09.887571+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:09.887571+0000","last_undegraded":"2024-09-14T11:58:09.887571+0000","last_fullsized":"2024-09-14T11:58:09.887571+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:23.909831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'313","reported_seq":984,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.260682+0000","last_change":"2024-09-14T10:56:39.690334+0000","last_active":"2024-09-14T11:58:37.260682+0000","last_peered":"2024-09-14T11:58:37.260682+0000","last_clean":"2024-09-14T11:58:37.260682+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:37.260682+0000","last_undegraded":"2024-09-14T11:58:37.260682+0000","last_fullsized":"2024-09-14T11:58:37.260682+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:01.620284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8705643,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":659,"num_read_kb":79858,"num_write":1085,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546248+0000","last_change":"2024-09-14T10:56:43.703574+0000","last_active":"2024-09-14T11:54:47.546248+0000","last_peered":"2024-09-14T11:54:47.546248+0000","last_clean":"2024-09-14T11:54:47.546248+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:54:47.546248+0000","last_undegraded":"2024-09-14T11:54:47.546248+0000","last_fullsized":"2024-09-14T11:54:47.546248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:13.211833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'334","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.292696+0000","last_change":"2024-09-14T10:56:45.717205+0000","last_active":"2024-09-14T11:58:11.292696+0000","last_peered":"2024-09-14T11:58:11.292696+0000","last_clean":"2024-09-14T11:58:11.292696+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:58:11.292696+0000","last_undegraded":"2024-09-14T11:58:11.292696+0000","last_fullsized":"2024-09-14T11:58:11.292696+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:15.199061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54475,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":537,"num_read_kb":1053,"num_write":424,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669188+0000","last_change":"2024-09-14T10:56:47.732016+0000","last_active":"2024-09-14T11:54:47.669188+0000","last_peered":"2024-09-14T11:54:47.669188+0000","last_clean":"2024-09-14T11:54:47.669188+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:54:47.669188+0000","last_undegraded":"2024-09-14T11:54:47.669188+0000","last_fullsized":"2024-09-14T11:54:47.669188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:03.581653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2511","reported_seq":4330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.571152+0000","last_change":"2024-09-14T10:56:49.748541+0000","last_active":"2024-09-14T11:57:32.571152+0000","last_peered":"2024-09-14T11:57:32.571152+0000","last_clean":"2024-09-14T11:57:32.571152+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:57:32.571152+0000","last_undegraded":"2024-09-14T11:57:32.571152+0000","last_fullsized":"2024-09-14T11:57:32.571152+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.702024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1504","reported_seq":3164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.567258+0000","last_change":"2024-09-14T10:56:41.690515+0000","last_active":"2024-09-14T11:57:07.567258+0000","last_peered":"2024-09-14T11:57:07.567258+0000","last_clean":"2024-09-14T11:57:07.567258+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:57:07.567258+0000","last_undegraded":"2024-09-14T11:57:07.567258+0000","last_fullsized":"2024-09-14T11:57:07.567258+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:30.187152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'304","reported_seq":923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.396571+0000","last_change":"2024-09-14T10:56:39.693720+0000","last_active":"2024-09-14T11:58:37.396571+0000","last_peered":"2024-09-14T11:58:37.396571+0000","last_clean":"2024-09-14T11:58:37.396571+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:37.396571+0000","last_undegraded":"2024-09-14T11:58:37.396571+0000","last_fullsized":"2024-09-14T11:58:37.396571+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:54.885183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2381958,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":536,"num_read_kb":7352,"num_write":1078,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.658029+0000","last_change":"2024-09-14T10:56:43.698968+0000","last_active":"2024-09-14T11:55:17.658029+0000","last_peered":"2024-09-14T11:55:17.658029+0000","last_clean":"2024-09-14T11:55:17.658029+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:55:17.658029+0000","last_undegraded":"2024-09-14T11:55:17.658029+0000","last_fullsized":"2024-09-14T11:55:17.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.047693+0000","last_change":"2024-09-14T10:56:45.722700+0000","last_active":"2024-09-14T11:57:19.047693+0000","last_peered":"2024-09-14T11:57:19.047693+0000","last_clean":"2024-09-14T11:57:19.047693+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:57:19.047693+0000","last_undegraded":"2024-09-14T11:57:19.047693+0000","last_fullsized":"2024-09-14T11:57:19.047693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:14.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.547649+0000","last_change":"2024-09-14T10:56:47.736072+0000","last_active":"2024-09-14T11:54:48.547649+0000","last_peered":"2024-09-14T11:54:48.547649+0000","last_clean":"2024-09-14T11:54:48.547649+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:54:48.547649+0000","last_undegraded":"2024-09-14T11:54:48.547649+0000","last_fullsized":"2024-09-14T11:54:48.547649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:39.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723799+0000","last_change":"2024-09-14T10:56:49.750882+0000","last_active":"2024-09-14T11:58:09.723799+0000","last_peered":"2024-09-14T11:58:09.723799+0000","last_clean":"2024-09-14T11:58:09.723799+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:58:09.723799+0000","last_undegraded":"2024-09-14T11:58:09.723799+0000","last_fullsized":"2024-09-14T11:58:09.723799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:22.830554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'632","reported_seq":2376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.885005+0000","last_change":"2024-09-14T10:56:41.694089+0000","last_active":"2024-09-14T11:58:09.885005+0000","last_peered":"2024-09-14T11:58:09.885005+0000","last_clean":"2024-09-14T11:58:09.885005+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:09.885005+0000","last_undegraded":"2024-09-14T11:58:09.885005+0000","last_fullsized":"2024-09-14T11:58:09.885005+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:57.336561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'319","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426043+0000","last_change":"2024-09-14T10:56:39.694928+0000","last_active":"2024-09-14T11:58:37.426043+0000","last_peered":"2024-09-14T11:58:37.426043+0000","last_clean":"2024-09-14T11:58:37.426043+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:37.426043+0000","last_undegraded":"2024-09-14T11:58:37.426043+0000","last_fullsized":"2024-09-14T11:58:37.426043+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:30.362849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11713341,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":563,"num_read_kb":77740,"num_write":1107,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653968+0000","last_change":"2024-09-14T10:56:43.701731+0000","last_active":"2024-09-14T11:54:47.653968+0000","last_peered":"2024-09-14T11:54:47.653968+0000","last_clean":"2024-09-14T11:54:47.653968+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:54:47.653968+0000","last_undegraded":"2024-09-14T11:54:47.653968+0000","last_fullsized":"2024-09-14T11:54:47.653968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:01.110895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'139","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.089458+0000","last_change":"2024-09-14T10:56:45.721500+0000","last_active":"2024-09-14T11:57:19.089458+0000","last_peered":"2024-09-14T11:57:19.089458+0000","last_clean":"2024-09-14T11:57:19.089458+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:57:19.089458+0000","last_undegraded":"2024-09-14T11:57:19.089458+0000","last_fullsized":"2024-09-14T11:57:19.089458+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.327884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'773","reported_seq":4514,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.588783+0000","last_change":"2024-09-14T10:56:47.731166+0000","last_active":"2024-09-14T11:58:36.588783+0000","last_peered":"2024-09-14T11:58:36.588783+0000","last_clean":"2024-09-14T11:58:36.588783+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:58:36.588783+0000","last_undegraded":"2024-09-14T11:58:36.588783+0000","last_fullsized":"2024-09-14T11:58:36.588783+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'210","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442305+0000","last_change":"2024-09-14T10:56:49.740657+0000","last_active":"2024-09-14T11:56:53.442305+0000","last_peered":"2024-09-14T11:56:53.442305+0000","last_clean":"2024-09-14T11:56:53.442305+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:56:53.442305+0000","last_undegraded":"2024-09-14T11:56:53.442305+0000","last_fullsized":"2024-09-14T11:56:53.442305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:29.712729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'435","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460767+0000","last_change":"2024-09-14T10:56:41.695277+0000","last_active":"2024-09-14T11:56:10.460767+0000","last_peered":"2024-09-14T11:56:10.460767+0000","last_clean":"2024-09-14T11:56:10.460767+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:56:10.460767+0000","last_undegraded":"2024-09-14T11:56:10.460767+0000","last_fullsized":"2024-09-14T11:56:10.460767+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.480333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'316","reported_seq":946,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.490305+0000","last_change":"2024-09-14T10:56:39.686745+0000","last_active":"2024-09-14T11:58:38.490305+0000","last_peered":"2024-09-14T11:58:38.490305+0000","last_clean":"2024-09-14T11:58:38.490305+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:38.490305+0000","last_undegraded":"2024-09-14T11:58:38.490305+0000","last_fullsized":"2024-09-14T11:58:38.490305+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:17.862362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":681,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":511,"num_read_kb":94667,"num_write":967,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546276+0000","last_change":"2024-09-14T10:56:43.702583+0000","last_active":"2024-09-14T11:54:47.546276+0000","last_peered":"2024-09-14T11:54:47.546276+0000","last_clean":"2024-09-14T11:54:47.546276+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:54:47.546276+0000","last_undegraded":"2024-09-14T11:54:47.546276+0000","last_fullsized":"2024-09-14T11:54:47.546276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:02.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'269","reported_seq":823,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.285054+0000","last_change":"2024-09-14T10:56:45.717333+0000","last_active":"2024-09-14T11:58:11.285054+0000","last_peered":"2024-09-14T11:58:11.285054+0000","last_clean":"2024-09-14T11:58:11.285054+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:58:11.285054+0000","last_undegraded":"2024-09-14T11:58:11.285054+0000","last_fullsized":"2024-09-14T11:58:11.285054+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:45.182188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53009,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":432,"num_read_kb":925,"num_write":352,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'809","reported_seq":2640,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594992+0000","last_change":"2024-09-14T10:56:47.734484+0000","last_active":"2024-09-14T11:58:36.594992+0000","last_peered":"2024-09-14T11:58:36.594992+0000","last_clean":"2024-09-14T11:58:36.594992+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:58:36.594992+0000","last_undegraded":"2024-09-14T11:58:36.594992+0000","last_fullsized":"2024-09-14T11:58:36.594992+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'658","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.883179+0000","last_change":"2024-09-14T10:56:41.690375+0000","last_active":"2024-09-14T11:58:09.883179+0000","last_peered":"2024-09-14T11:58:09.883179+0000","last_clean":"2024-09-14T11:58:09.883179+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:09.883179+0000","last_undegraded":"2024-09-14T11:58:09.883179+0000","last_fullsized":"2024-09-14T11:58:09.883179+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.339603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'310","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.379692+0000","last_change":"2024-09-14T10:56:39.698021+0000","last_active":"2024-09-14T11:58:37.379692+0000","last_peered":"2024-09-14T11:58:37.379692+0000","last_clean":"2024-09-14T11:58:37.379692+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:37.379692+0000","last_undegraded":"2024-09-14T11:58:37.379692+0000","last_fullsized":"2024-09-14T11:58:37.379692+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:46.013676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4894756,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":496,"num_read_kb":17523,"num_write":982,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.674155+0000","last_change":"2024-09-14T10:56:43.698774+0000","last_active":"2024-09-14T11:55:17.674155+0000","last_peered":"2024-09-14T11:55:17.674155+0000","last_clean":"2024-09-14T11:55:17.674155+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:55:17.674155+0000","last_undegraded":"2024-09-14T11:55:17.674155+0000","last_fullsized":"2024-09-14T11:55:17.674155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:15.883668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'408","reported_seq":1019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.297485+0000","last_change":"2024-09-14T10:56:45.715379+0000","last_active":"2024-09-14T11:58:11.297485+0000","last_peered":"2024-09-14T11:58:11.297485+0000","last_clean":"2024-09-14T11:58:11.297485+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:58:11.297485+0000","last_undegraded":"2024-09-14T11:58:11.297485+0000","last_fullsized":"2024-09-14T11:58:11.297485+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:11.970010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67367,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":668,"num_read_kb":1307,"num_write":536,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536831+0000","last_change":"2024-09-14T10:56:47.727987+0000","last_active":"2024-09-14T11:55:17.536831+0000","last_peered":"2024-09-14T11:55:17.536831+0000","last_clean":"2024-09-14T11:55:17.536831+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:55:17.536831+0000","last_undegraded":"2024-09-14T11:55:17.536831+0000","last_fullsized":"2024-09-14T11:55:17.536831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:35.450777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'581","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311916+0000","last_change":"2024-09-14T10:56:49.748529+0000","last_active":"2024-09-14T11:58:11.311916+0000","last_peered":"2024-09-14T11:58:11.311916+0000","last_clean":"2024-09-14T11:58:11.311916+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:58:11.311916+0000","last_undegraded":"2024-09-14T11:58:11.311916+0000","last_fullsized":"2024-09-14T11:58:11.311916+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.226410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'450","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909742+0000","last_change":"2024-09-14T10:56:41.699591+0000","last_active":"2024-09-14T11:56:51.909742+0000","last_peered":"2024-09-14T11:56:51.909742+0000","last_clean":"2024-09-14T11:56:51.909742+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:56:51.909742+0000","last_undegraded":"2024-09-14T11:56:51.909742+0000","last_fullsized":"2024-09-14T11:56:51.909742+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:55.170546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'325","reported_seq":975,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.406033+0000","last_change":"2024-09-14T10:56:39.691536+0000","last_active":"2024-09-14T11:58:37.406033+0000","last_peered":"2024-09-14T11:58:37.406033+0000","last_clean":"2024-09-14T11:58:37.406033+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:37.406033+0000","last_undegraded":"2024-09-14T11:58:37.406033+0000","last_fullsized":"2024-09-14T11:58:37.406033+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:03.544842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9459283,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":640,"num_read_kb":60976,"num_write":1158,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.155670+0000","last_change":"2024-09-14T10:56:43.702569+0000","last_active":"2024-09-14T11:58:36.155670+0000","last_peered":"2024-09-14T11:58:36.155670+0000","last_clean":"2024-09-14T11:58:36.155670+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:36.155670+0000","last_undegraded":"2024-09-14T11:58:36.155670+0000","last_fullsized":"2024-09-14T11:58:36.155670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'279","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.138032+0000","last_change":"2024-09-14T10:56:45.717223+0000","last_active":"2024-09-14T11:58:37.138032+0000","last_peered":"2024-09-14T11:58:37.138032+0000","last_clean":"2024-09-14T11:58:37.138032+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:58:37.138032+0000","last_undegraded":"2024-09-14T11:58:37.138032+0000","last_fullsized":"2024-09-14T11:58:37.138032+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:53.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659151+0000","last_change":"2024-09-14T10:56:47.728715+0000","last_active":"2024-09-14T11:55:27.659151+0000","last_peered":"2024-09-14T11:55:27.659151+0000","last_clean":"2024-09-14T11:55:27.659151+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:55:27.659151+0000","last_undegraded":"2024-09-14T11:55:27.659151+0000","last_fullsized":"2024-09-14T11:55:27.659151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:34.862116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'110","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.691270+0000","last_change":"2024-09-14T10:56:49.740475+0000","last_active":"2024-09-14T11:57:28.691270+0000","last_peered":"2024-09-14T11:57:28.691270+0000","last_clean":"2024-09-14T11:57:28.691270+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:57:28.691270+0000","last_undegraded":"2024-09-14T11:57:28.691270+0000","last_fullsized":"2024-09-14T11:57:28.691270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:13.870392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'435","reported_seq":1865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.886202+0000","last_change":"2024-09-14T10:56:41.699032+0000","last_active":"2024-09-14T11:58:09.886202+0000","last_peered":"2024-09-14T11:58:09.886202+0000","last_clean":"2024-09-14T11:58:09.886202+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:09.886202+0000","last_undegraded":"2024-09-14T11:58:09.886202+0000","last_fullsized":"2024-09-14T11:58:09.886202+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:20.716515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'281","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.329783+0000","last_change":"2024-09-14T10:56:39.695515+0000","last_active":"2024-09-14T11:58:37.329783+0000","last_peered":"2024-09-14T11:58:37.329783+0000","last_clean":"2024-09-14T11:58:37.329783+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:37.329783+0000","last_undegraded":"2024-09-14T11:58:37.329783+0000","last_fullsized":"2024-09-14T11:58:37.329783+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:30.996747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6248327,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":477,"num_read_kb":11457,"num_write":924,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737627+0000","last_change":"2024-09-14T10:56:43.701838+0000","last_active":"2024-09-14T11:55:17.737627+0000","last_peered":"2024-09-14T11:55:17.737627+0000","last_clean":"2024-09-14T11:55:17.737627+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:55:17.737627+0000","last_undegraded":"2024-09-14T11:55:17.737627+0000","last_fullsized":"2024-09-14T11:55:17.737627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.350355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'291","reported_seq":869,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.299748+0000","last_change":"2024-09-14T10:56:45.715385+0000","last_active":"2024-09-14T11:58:11.299748+0000","last_peered":"2024-09-14T11:58:11.299748+0000","last_clean":"2024-09-14T11:58:11.299748+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:58:11.299748+0000","last_undegraded":"2024-09-14T11:58:11.299748+0000","last_fullsized":"2024-09-14T11:58:11.299748+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.655994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52587,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":475,"num_read_kb":941,"num_write":372,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'794","reported_seq":2923,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.594937+0000","last_change":"2024-09-14T10:56:47.732668+0000","last_active":"2024-09-14T11:58:36.594937+0000","last_peered":"2024-09-14T11:58:36.594937+0000","last_clean":"2024-09-14T11:58:36.594937+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:58:36.594937+0000","last_undegraded":"2024-09-14T11:58:36.594937+0000","last_fullsized":"2024-09-14T11:58:36.594937+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:36.329167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'144","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723376+0000","last_change":"2024-09-14T10:56:49.751141+0000","last_active":"2024-09-14T11:58:09.723376+0000","last_peered":"2024-09-14T11:58:09.723376+0000","last_clean":"2024-09-14T11:58:09.723376+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:58:09.723376+0000","last_undegraded":"2024-09-14T11:58:09.723376+0000","last_fullsized":"2024-09-14T11:58:09.723376+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:59.575096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'437","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.698726+0000","last_change":"2024-09-14T10:56:41.699606+0000","last_active":"2024-09-14T11:55:28.698726+0000","last_peered":"2024-09-14T11:55:28.698726+0000","last_clean":"2024-09-14T11:55:28.698726+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:55:28.698726+0000","last_undegraded":"2024-09-14T11:55:28.698726+0000","last_fullsized":"2024-09-14T11:55:28.698726+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.073985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'310","reported_seq":960,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.678526+0000","last_change":"2024-09-14T10:57:16.313659+0000","last_active":"2024-09-14T11:58:37.678526+0000","last_peered":"2024-09-14T11:58:37.678526+0000","last_clean":"2024-09-14T11:58:37.678526+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:37.678526+0000","last_undegraded":"2024-09-14T11:58:37.678526+0000","last_fullsized":"2024-09-14T11:58:37.678526+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:49.985260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6974727,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":703,"num_read_kb":20707,"num_write":1054,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.738288+0000","last_change":"2024-09-14T10:56:43.700827+0000","last_active":"2024-09-14T11:55:22.738288+0000","last_peered":"2024-09-14T11:55:22.738288+0000","last_clean":"2024-09-14T11:55:22.738288+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:55:22.738288+0000","last_undegraded":"2024-09-14T11:55:22.738288+0000","last_fullsized":"2024-09-14T11:55:22.738288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:43.830453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'489","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.365214+0000","last_change":"2024-09-14T10:56:45.716585+0000","last_active":"2024-09-14T11:58:37.365214+0000","last_peered":"2024-09-14T11:58:37.365214+0000","last_clean":"2024-09-14T11:58:37.365214+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:58:37.365214+0000","last_undegraded":"2024-09-14T11:58:37.365214+0000","last_fullsized":"2024-09-14T11:58:37.365214+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:59.261412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":107667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":837,"num_read_kb":1985,"num_write":686,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737599+0000","last_change":"2024-09-14T10:56:47.727232+0000","last_active":"2024-09-14T11:55:17.737599+0000","last_peered":"2024-09-14T11:55:17.737599+0000","last_clean":"2024-09-14T11:55:17.737599+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:55:17.737599+0000","last_undegraded":"2024-09-14T11:55:17.737599+0000","last_fullsized":"2024-09-14T11:55:17.737599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.261352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'153","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.913275+0000","last_change":"2024-09-14T10:56:49.745209+0000","last_active":"2024-09-14T11:56:52.913275+0000","last_peered":"2024-09-14T11:56:52.913275+0000","last_clean":"2024-09-14T11:56:52.913275+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:56:52.913275+0000","last_undegraded":"2024-09-14T11:56:52.913275+0000","last_fullsized":"2024-09-14T11:56:52.913275+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:00.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'485","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781154+0000","last_change":"2024-09-14T10:56:41.695419+0000","last_active":"2024-09-14T11:56:52.781154+0000","last_peered":"2024-09-14T11:56:52.781154+0000","last_clean":"2024-09-14T11:56:52.781154+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:56:52.781154+0000","last_undegraded":"2024-09-14T11:56:52.781154+0000","last_fullsized":"2024-09-14T11:56:52.781154+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:25.326798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'341","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415777+0000","last_change":"2024-09-14T10:56:39.686597+0000","last_active":"2024-09-14T11:58:37.415777+0000","last_peered":"2024-09-14T11:58:37.415777+0000","last_clean":"2024-09-14T11:58:37.415777+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:37.415777+0000","last_undegraded":"2024-09-14T11:58:37.415777+0000","last_fullsized":"2024-09-14T11:58:37.415777+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.571169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14028949,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":678,"num_read_kb":26829,"num_write":1292,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737663+0000","last_change":"2024-09-14T10:56:43.702604+0000","last_active":"2024-09-14T11:55:17.737663+0000","last_peered":"2024-09-14T11:55:17.737663+0000","last_clean":"2024-09-14T11:55:17.737663+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:55:17.737663+0000","last_undegraded":"2024-09-14T11:55:17.737663+0000","last_fullsized":"2024-09-14T11:55:17.737663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:06.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'337","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.444929+0000","last_change":"2024-09-14T10:56:45.720877+0000","last_active":"2024-09-14T11:58:37.444929+0000","last_peered":"2024-09-14T11:58:37.444929+0000","last_clean":"2024-09-14T11:58:37.444929+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:58:37.444929+0000","last_undegraded":"2024-09-14T11:58:37.444929+0000","last_fullsized":"2024-09-14T11:58:37.444929+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:57.447381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658208+0000","last_change":"2024-09-14T10:56:47.732467+0000","last_active":"2024-09-14T11:55:22.658208+0000","last_peered":"2024-09-14T11:55:22.658208+0000","last_clean":"2024-09-14T11:55:22.658208+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:55:22.658208+0000","last_undegraded":"2024-09-14T11:55:22.658208+0000","last_fullsized":"2024-09-14T11:55:22.658208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:40.009813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446796+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:07.446796+0000","last_peered":"2024-09-14T11:57:07.446796+0000","last_clean":"2024-09-14T11:57:07.446796+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:07.446796+0000","last_undegraded":"2024-09-14T11:57:07.446796+0000","last_fullsized":"2024-09-14T11:57:07.446796+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:22.648516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'765","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.878498+0000","last_change":"2024-09-14T10:56:41.694599+0000","last_active":"2024-09-14T11:58:09.878498+0000","last_peered":"2024-09-14T11:58:09.878498+0000","last_clean":"2024-09-14T11:58:09.878498+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:09.878498+0000","last_undegraded":"2024-09-14T11:58:09.878498+0000","last_fullsized":"2024-09-14T11:58:09.878498+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:34.020278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'374","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.474807+0000","last_change":"2024-09-14T10:56:39.682095+0000","last_active":"2024-09-14T11:58:38.474807+0000","last_peered":"2024-09-14T11:58:38.474807+0000","last_clean":"2024-09-14T11:58:38.474807+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:38.474807+0000","last_undegraded":"2024-09-14T11:58:38.474807+0000","last_fullsized":"2024-09-14T11:58:38.474807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:36.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1905080,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":665,"num_read_kb":27548,"num_write":1208,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536865+0000","last_change":"2024-09-14T10:56:43.707450+0000","last_active":"2024-09-14T11:55:17.536865+0000","last_peered":"2024-09-14T11:55:17.536865+0000","last_clean":"2024-09-14T11:55:17.536865+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:55:17.536865+0000","last_undegraded":"2024-09-14T11:55:17.536865+0000","last_fullsized":"2024-09-14T11:55:17.536865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:10.147136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'346","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.913274+0000","last_change":"2024-09-14T10:56:45.709793+0000","last_active":"2024-09-14T11:58:36.913274+0000","last_peered":"2024-09-14T11:58:36.913274+0000","last_clean":"2024-09-14T11:58:36.913274+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:36.913274+0000","last_undegraded":"2024-09-14T11:58:36.913274+0000","last_fullsized":"2024-09-14T11:58:36.913274+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:43.142877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'753","reported_seq":2330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.590126+0000","last_change":"2024-09-14T10:56:47.728010+0000","last_active":"2024-09-14T11:58:36.590126+0000","last_peered":"2024-09-14T11:58:36.590126+0000","last_clean":"2024-09-14T11:58:36.590126+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:58:36.590126+0000","last_undegraded":"2024-09-14T11:58:36.590126+0000","last_fullsized":"2024-09-14T11:58:36.590126+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:16.673244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'120","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.768184+0000","last_change":"2024-09-14T10:56:49.746163+0000","last_active":"2024-09-14T11:56:50.768184+0000","last_peered":"2024-09-14T11:56:50.768184+0000","last_clean":"2024-09-14T11:56:50.768184+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:56:50.768184+0000","last_undegraded":"2024-09-14T11:56:50.768184+0000","last_fullsized":"2024-09-14T11:56:50.768184+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:25.956197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.312517+0000","last_change":"2024-09-14T10:56:41.687409+0000","last_active":"2024-09-14T11:56:49.312517+0000","last_peered":"2024-09-14T11:56:49.312517+0000","last_clean":"2024-09-14T11:56:49.312517+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:56:49.312517+0000","last_undegraded":"2024-09-14T11:56:49.312517+0000","last_fullsized":"2024-09-14T11:56:49.312517+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:52.835617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'344","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.294542+0000","last_change":"2024-09-14T10:56:39.683292+0000","last_active":"2024-09-14T11:58:38.294542+0000","last_peered":"2024-09-14T11:58:38.294542+0000","last_clean":"2024-09-14T11:58:38.294542+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:38.294542+0000","last_undegraded":"2024-09-14T11:58:38.294542+0000","last_fullsized":"2024-09-14T11:58:38.294542+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:04.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190475,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":538,"num_read_kb":90386,"num_write":1094,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.167037+0000","last_change":"2024-09-14T10:56:43.701046+0000","last_active":"2024-09-14T11:58:36.167037+0000","last_peered":"2024-09-14T11:58:36.167037+0000","last_clean":"2024-09-14T11:58:36.167037+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:58:36.167037+0000","last_undegraded":"2024-09-14T11:58:36.167037+0000","last_fullsized":"2024-09-14T11:58:36.167037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'92","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.017399+0000","last_change":"2024-09-14T10:56:45.713884+0000","last_active":"2024-09-14T11:57:19.017399+0000","last_peered":"2024-09-14T11:57:19.017399+0000","last_clean":"2024-09-14T11:57:19.017399+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:57:19.017399+0000","last_undegraded":"2024-09-14T11:57:19.017399+0000","last_fullsized":"2024-09-14T11:57:19.017399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:23.564660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'775","reported_seq":2400,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.592193+0000","last_change":"2024-09-14T10:56:47.728790+0000","last_active":"2024-09-14T11:58:36.592193+0000","last_peered":"2024-09-14T11:58:36.592193+0000","last_clean":"2024-09-14T11:58:36.592193+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:58:36.592193+0000","last_undegraded":"2024-09-14T11:58:36.592193+0000","last_fullsized":"2024-09-14T11:58:36.592193+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.655451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.297030+0000","last_change":"2024-09-14T10:56:49.746716+0000","last_active":"2024-09-14T11:56:49.297030+0000","last_peered":"2024-09-14T11:56:49.297030+0000","last_clean":"2024-09-14T11:56:49.297030+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:56:49.297030+0000","last_undegraded":"2024-09-14T11:56:49.297030+0000","last_fullsized":"2024-09-14T11:56:49.297030+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.164615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'788","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782702+0000","last_change":"2024-09-14T10:56:41.698077+0000","last_active":"2024-09-14T11:56:52.782702+0000","last_peered":"2024-09-14T11:56:52.782702+0000","last_clean":"2024-09-14T11:56:52.782702+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:56:52.782702+0000","last_undegraded":"2024-09-14T11:56:52.782702+0000","last_fullsized":"2024-09-14T11:56:52.782702+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.788116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'292","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.415724+0000","last_change":"2024-09-14T10:57:15.795505+0000","last_active":"2024-09-14T11:58:37.415724+0000","last_peered":"2024-09-14T11:58:37.415724+0000","last_clean":"2024-09-14T11:58:37.415724+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:37.415724+0000","last_undegraded":"2024-09-14T11:58:37.415724+0000","last_fullsized":"2024-09-14T11:58:37.415724+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.548600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1101310,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":502,"num_read_kb":1389,"num_write":968,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.551662+0000","last_change":"2024-09-14T10:56:43.698906+0000","last_active":"2024-09-14T11:55:13.551662+0000","last_peered":"2024-09-14T11:55:13.551662+0000","last_clean":"2024-09-14T11:55:13.551662+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:55:13.551662+0000","last_undegraded":"2024-09-14T11:55:13.551662+0000","last_fullsized":"2024-09-14T11:55:13.551662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:39.807629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'391","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.293933+0000","last_change":"2024-09-14T10:56:45.719001+0000","last_active":"2024-09-14T11:58:11.293933+0000","last_peered":"2024-09-14T11:58:11.293933+0000","last_clean":"2024-09-14T11:58:11.293933+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:58:11.293933+0000","last_undegraded":"2024-09-14T11:58:11.293933+0000","last_fullsized":"2024-09-14T11:58:11.293933+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:08.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49106,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1226,"num_read_kb":1694,"num_write":1780,"num_write_kb":1621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672095+0000","last_change":"2024-09-14T10:56:47.735876+0000","last_active":"2024-09-14T11:55:18.672095+0000","last_peered":"2024-09-14T11:55:18.672095+0000","last_clean":"2024-09-14T11:55:18.672095+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:55:18.672095+0000","last_undegraded":"2024-09-14T11:55:18.672095+0000","last_fullsized":"2024-09-14T11:55:18.672095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:40.099775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.186925+0000","last_change":"2024-09-14T10:56:49.743347+0000","last_active":"2024-09-14T11:56:50.186925+0000","last_peered":"2024-09-14T11:56:50.186925+0000","last_clean":"2024-09-14T11:56:50.186925+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:56:50.186925+0000","last_undegraded":"2024-09-14T11:56:50.186925+0000","last_fullsized":"2024-09-14T11:56:50.186925+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'647","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817022+0000","last_change":"2024-09-14T10:56:41.692220+0000","last_active":"2024-09-14T11:55:53.817022+0000","last_peered":"2024-09-14T11:55:53.817022+0000","last_clean":"2024-09-14T11:55:53.817022+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:55:53.817022+0000","last_undegraded":"2024-09-14T11:55:53.817022+0000","last_fullsized":"2024-09-14T11:55:53.817022+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:11.440656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432896+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T11:56:37.432896+0000","last_peered":"2024-09-14T11:56:37.432896+0000","last_clean":"2024-09-14T11:56:37.432896+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:56:37.432896+0000","last_undegraded":"2024-09-14T11:56:37.432896+0000","last_fullsized":"2024-09-14T11:56:37.432896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.547015+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T11:54:52.547015+0000","last_peered":"2024-09-14T11:54:52.547015+0000","last_clean":"2024-09-14T11:54:52.547015+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:54:52.547015+0000","last_undegraded":"2024-09-14T11:54:52.547015+0000","last_fullsized":"2024-09-14T11:54:52.547015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'292","reported_seq":948,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.374926+0000","last_change":"2024-09-14T10:56:39.687055+0000","last_active":"2024-09-14T11:58:37.374926+0000","last_peered":"2024-09-14T11:58:37.374926+0000","last_clean":"2024-09-14T11:58:37.374926+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:37.374926+0000","last_undegraded":"2024-09-14T11:58:37.374926+0000","last_fullsized":"2024-09-14T11:58:37.374926+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:32.344503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13986456,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":596,"num_read_kb":39228,"num_write":965,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672300+0000","last_change":"2024-09-14T10:56:43.702002+0000","last_active":"2024-09-14T11:55:07.672300+0000","last_peered":"2024-09-14T11:55:07.672300+0000","last_clean":"2024-09-14T11:55:07.672300+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:55:07.672300+0000","last_undegraded":"2024-09-14T11:55:07.672300+0000","last_fullsized":"2024-09-14T11:55:07.672300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:33.474891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'786","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.734667+0000","last_change":"2024-09-14T10:56:45.716034+0000","last_active":"2024-09-14T11:58:36.734667+0000","last_peered":"2024-09-14T11:58:36.734667+0000","last_clean":"2024-09-14T11:58:36.734667+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:58:36.734667+0000","last_undegraded":"2024-09-14T11:58:36.734667+0000","last_fullsized":"2024-09-14T11:58:36.734667+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:25.384704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183012,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1531,"num_read_kb":3433,"num_write":1486,"num_write_kb":1341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.657591+0000","last_change":"2024-09-14T10:56:47.736084+0000","last_active":"2024-09-14T11:55:17.657591+0000","last_peered":"2024-09-14T11:55:17.657591+0000","last_clean":"2024-09-14T11:55:17.657591+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:55:17.657591+0000","last_undegraded":"2024-09-14T11:55:17.657591+0000","last_fullsized":"2024-09-14T11:55:17.657591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:49.305417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.811415+0000","last_change":"2024-09-14T10:56:49.743581+0000","last_active":"2024-09-14T11:56:52.811415+0000","last_peered":"2024-09-14T11:56:52.811415+0000","last_clean":"2024-09-14T11:56:52.811415+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:56:52.811415+0000","last_undegraded":"2024-09-14T11:56:52.811415+0000","last_fullsized":"2024-09-14T11:56:52.811415+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:57.012986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337471+0000","last_change":"2024-09-14T10:56:41.699990+0000","last_active":"2024-09-14T11:56:18.337471+0000","last_peered":"2024-09-14T11:56:18.337471+0000","last_clean":"2024-09-14T11:56:18.337471+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:56:18.337471+0000","last_undegraded":"2024-09-14T11:56:18.337471+0000","last_fullsized":"2024-09-14T11:56:18.337471+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:37.126708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":512,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:37.667394+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T11:54:37.667394+0000","last_peered":"2024-09-14T11:54:37.667394+0000","last_clean":"2024-09-14T11:54:37.667394+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:54:37.667394+0000","last_undegraded":"2024-09-14T11:54:37.667394+0000","last_fullsized":"2024-09-14T11:54:37.667394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'252","reported_seq":848,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417184+0000","last_change":"2024-09-14T10:56:39.691928+0000","last_active":"2024-09-14T11:58:37.417184+0000","last_peered":"2024-09-14T11:58:37.417184+0000","last_clean":"2024-09-14T11:58:37.417184+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:37.417184+0000","last_undegraded":"2024-09-14T11:58:37.417184+0000","last_fullsized":"2024-09-14T11:58:37.417184+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":956222,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":399,"num_read_kb":19285,"num_write":828,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.551105+0000","last_change":"2024-09-14T10:56:43.701669+0000","last_active":"2024-09-14T11:55:17.551105+0000","last_peered":"2024-09-14T11:55:17.551105+0000","last_clean":"2024-09-14T11:55:17.551105+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:55:17.551105+0000","last_undegraded":"2024-09-14T11:55:17.551105+0000","last_fullsized":"2024-09-14T11:55:17.551105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:32.330161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1320","reported_seq":2995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.211084+0000","last_change":"2024-09-14T10:56:45.719919+0000","last_active":"2024-09-14T11:58:37.211084+0000","last_peered":"2024-09-14T11:58:37.211084+0000","last_clean":"2024-09-14T11:58:37.211084+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:58:37.211084+0000","last_undegraded":"2024-09-14T11:58:37.211084+0000","last_fullsized":"2024-09-14T11:58:37.211084+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:28.154269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171063,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2082,"num_read_kb":3793,"num_write":1186,"num_write_kb":997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.673250+0000","last_change":"2024-09-14T10:56:47.734554+0000","last_active":"2024-09-14T11:55:12.673250+0000","last_peered":"2024-09-14T11:55:12.673250+0000","last_clean":"2024-09-14T11:55:12.673250+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:55:12.673250+0000","last_undegraded":"2024-09-14T11:55:12.673250+0000","last_fullsized":"2024-09-14T11:55:12.673250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:20.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'94","reported_seq":590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.504531+0000","last_change":"2024-09-14T10:56:49.741143+0000","last_active":"2024-09-14T11:56:16.504531+0000","last_peered":"2024-09-14T11:56:16.504531+0000","last_clean":"2024-09-14T11:56:16.504531+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:56:16.504531+0000","last_undegraded":"2024-09-14T11:56:16.504531+0000","last_fullsized":"2024-09-14T11:56:16.504531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.919275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'936","reported_seq":2803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.816582+0000","last_change":"2024-09-14T10:56:41.698132+0000","last_active":"2024-09-14T11:55:53.816582+0000","last_peered":"2024-09-14T11:55:53.816582+0000","last_clean":"2024-09-14T11:55:53.816582+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:55:53.816582+0000","last_undegraded":"2024-09-14T11:55:53.816582+0000","last_fullsized":"2024-09-14T11:55:53.816582+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.829080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.733197+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T11:54:52.733197+0000","last_peered":"2024-09-14T11:54:52.733197+0000","last_clean":"2024-09-14T11:54:52.733197+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:54:52.733197+0000","last_undegraded":"2024-09-14T11:54:52.733197+0000","last_fullsized":"2024-09-14T11:54:52.733197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'274","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.337834+0000","last_change":"2024-09-14T10:56:39.677391+0000","last_active":"2024-09-14T11:58:37.337834+0000","last_peered":"2024-09-14T11:58:37.337834+0000","last_clean":"2024-09-14T11:58:37.337834+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:37.337834+0000","last_undegraded":"2024-09-14T11:58:37.337834+0000","last_fullsized":"2024-09-14T11:58:37.337834+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.834286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5317536,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":498,"num_read_kb":14745,"num_write":946,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737709+0000","last_change":"2024-09-14T10:56:43.701856+0000","last_active":"2024-09-14T11:55:17.737709+0000","last_peered":"2024-09-14T11:55:17.737709+0000","last_clean":"2024-09-14T11:55:17.737709+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:55:17.737709+0000","last_undegraded":"2024-09-14T11:55:17.737709+0000","last_fullsized":"2024-09-14T11:55:17.737709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:25.200569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'291","reported_seq":1564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.772091+0000","last_change":"2024-09-14T10:56:45.720189+0000","last_active":"2024-09-14T11:58:06.772091+0000","last_peered":"2024-09-14T11:58:06.772091+0000","last_clean":"2024-09-14T11:58:06.772091+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:58:06.772091+0000","last_undegraded":"2024-09-14T11:58:06.772091+0000","last_fullsized":"2024-09-14T11:58:06.772091+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:21.350299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656311+0000","last_change":"2024-09-14T10:56:47.737357+0000","last_active":"2024-09-14T11:55:07.656311+0000","last_peered":"2024-09-14T11:55:07.656311+0000","last_clean":"2024-09-14T11:55:07.656311+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:55:07.656311+0000","last_undegraded":"2024-09-14T11:55:07.656311+0000","last_fullsized":"2024-09-14T11:55:07.656311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:59.652704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.061479+0000","last_change":"2024-09-14T10:56:49.741618+0000","last_active":"2024-09-14T11:56:53.061479+0000","last_peered":"2024-09-14T11:56:53.061479+0000","last_clean":"2024-09-14T11:56:53.061479+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:56:53.061479+0000","last_undegraded":"2024-09-14T11:56:53.061479+0000","last_fullsized":"2024-09-14T11:56:53.061479+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:04.982419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'530","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.908964+0000","last_change":"2024-09-14T10:56:41.691332+0000","last_active":"2024-09-14T11:56:51.908964+0000","last_peered":"2024-09-14T11:56:51.908964+0000","last_clean":"2024-09-14T11:56:51.908964+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:56:51.908964+0000","last_undegraded":"2024-09-14T11:56:51.908964+0000","last_fullsized":"2024-09-14T11:56:51.908964+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:24.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.546981+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T11:54:52.546981+0000","last_peered":"2024-09-14T11:54:52.546981+0000","last_clean":"2024-09-14T11:54:52.546981+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:54:52.546981+0000","last_undegraded":"2024-09-14T11:54:52.546981+0000","last_fullsized":"2024-09-14T11:54:52.546981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'294","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.404337+0000","last_change":"2024-09-14T10:56:39.677476+0000","last_active":"2024-09-14T11:58:38.404337+0000","last_peered":"2024-09-14T11:58:38.404337+0000","last_clean":"2024-09-14T11:58:38.404337+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:38.404337+0000","last_undegraded":"2024-09-14T11:58:38.404337+0000","last_fullsized":"2024-09-14T11:58:38.404337+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:50.866073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":759871,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":492,"num_read_kb":28769,"num_write":982,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656928+0000","last_change":"2024-09-14T10:56:43.703850+0000","last_active":"2024-09-14T11:55:12.656928+0000","last_peered":"2024-09-14T11:55:12.656928+0000","last_clean":"2024-09-14T11:55:12.656928+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:55:12.656928+0000","last_undegraded":"2024-09-14T11:55:12.656928+0000","last_fullsized":"2024-09-14T11:55:12.656928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.154206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'142","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.449373+0000","last_change":"2024-09-14T10:56:45.723094+0000","last_active":"2024-09-14T11:57:27.449373+0000","last_peered":"2024-09-14T11:57:27.449373+0000","last_clean":"2024-09-14T11:57:27.449373+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:57:27.449373+0000","last_undegraded":"2024-09-14T11:57:27.449373+0000","last_fullsized":"2024-09-14T11:57:27.449373+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:07.418105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672147+0000","last_change":"2024-09-14T10:56:47.735245+0000","last_active":"2024-09-14T11:55:18.672147+0000","last_peered":"2024-09-14T11:55:18.672147+0000","last_clean":"2024-09-14T11:55:18.672147+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:55:18.672147+0000","last_undegraded":"2024-09-14T11:55:18.672147+0000","last_fullsized":"2024-09-14T11:55:18.672147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:24.475897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.766817+0000","last_change":"2024-09-14T10:56:49.746061+0000","last_active":"2024-09-14T11:56:52.766817+0000","last_peered":"2024-09-14T11:56:52.766817+0000","last_clean":"2024-09-14T11:56:52.766817+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:56:52.766817+0000","last_undegraded":"2024-09-14T11:56:52.766817+0000","last_fullsized":"2024-09-14T11:56:52.766817+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:28.330851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'387","reported_seq":1839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.537862+0000","last_change":"2024-09-14T10:56:41.693401+0000","last_active":"2024-09-14T11:55:32.537862+0000","last_peered":"2024-09-14T11:55:32.537862+0000","last_clean":"2024-09-14T11:55:32.537862+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:55:32.537862+0000","last_undegraded":"2024-09-14T11:55:32.537862+0000","last_fullsized":"2024-09-14T11:55:32.537862+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:32.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'383","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.417753+0000","last_change":"2024-09-14T10:56:39.690724+0000","last_active":"2024-09-14T11:58:37.417753+0000","last_peered":"2024-09-14T11:58:37.417753+0000","last_clean":"2024-09-14T11:58:37.417753+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:37.417753+0000","last_undegraded":"2024-09-14T11:58:37.417753+0000","last_fullsized":"2024-09-14T11:58:37.417753+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:30.610560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4548668,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":648,"num_read_kb":3738,"num_write":1292,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.533548+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T11:54:52.533548+0000","last_peered":"2024-09-14T11:54:52.533548+0000","last_clean":"2024-09-14T11:54:52.533548+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:54:52.533548+0000","last_undegraded":"2024-09-14T11:54:52.533548+0000","last_fullsized":"2024-09-14T11:54:52.533548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656288+0000","last_change":"2024-09-14T10:56:43.700042+0000","last_active":"2024-09-14T11:55:07.656288+0000","last_peered":"2024-09-14T11:55:07.656288+0000","last_clean":"2024-09-14T11:55:07.656288+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:55:07.656288+0000","last_undegraded":"2024-09-14T11:55:07.656288+0000","last_fullsized":"2024-09-14T11:55:07.656288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:24.603692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'609","reported_seq":1274,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.829544+0000","last_change":"2024-09-14T10:56:45.716237+0000","last_active":"2024-09-14T11:58:36.829544+0000","last_peered":"2024-09-14T11:58:36.829544+0000","last_clean":"2024-09-14T11:58:36.829544+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:58:36.829544+0000","last_undegraded":"2024-09-14T11:58:36.829544+0000","last_fullsized":"2024-09-14T11:58:36.829544+0000","mapping_epoch":31,"log_start":"263'500","ondisk_log_start":"263'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":500,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:41.293686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114592,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1010,"num_read_kb":2166,"num_write":878,"num_write_kb":703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550619+0000","last_change":"2024-09-14T10:56:47.732150+0000","last_active":"2024-09-14T11:55:08.550619+0000","last_peered":"2024-09-14T11:55:08.550619+0000","last_clean":"2024-09-14T11:55:08.550619+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:55:08.550619+0000","last_undegraded":"2024-09-14T11:55:08.550619+0000","last_fullsized":"2024-09-14T11:55:08.550619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:42.244231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'168","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.826154+0000","last_change":"2024-09-14T10:56:49.748121+0000","last_active":"2024-09-14T11:56:49.826154+0000","last_peered":"2024-09-14T11:56:49.826154+0000","last_clean":"2024-09-14T11:56:49.826154+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:56:49.826154+0000","last_undegraded":"2024-09-14T11:56:49.826154+0000","last_fullsized":"2024-09-14T11:56:49.826154+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:52.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754696+0000","last_change":"2024-09-14T10:56:41.700935+0000","last_active":"2024-09-14T11:56:12.754696+0000","last_peered":"2024-09-14T11:56:12.754696+0000","last_clean":"2024-09-14T11:56:12.754696+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:56:12.754696+0000","last_undegraded":"2024-09-14T11:56:12.754696+0000","last_fullsized":"2024-09-14T11:56:12.754696+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:51.471808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'278","reported_seq":900,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.338194+0000","last_change":"2024-09-14T10:56:39.675452+0000","last_active":"2024-09-14T11:58:37.338194+0000","last_peered":"2024-09-14T11:58:37.338194+0000","last_clean":"2024-09-14T11:58:37.338194+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:37.338194+0000","last_undegraded":"2024-09-14T11:58:37.338194+0000","last_fullsized":"2024-09-14T11:58:37.338194+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:40.705030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27645,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":486,"num_read_kb":39755,"num_write":919,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670754+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T11:54:57.670754+0000","last_peered":"2024-09-14T11:54:57.670754+0000","last_clean":"2024-09-14T11:54:57.670754+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:54:57.670754+0000","last_undegraded":"2024-09-14T11:54:57.670754+0000","last_fullsized":"2024-09-14T11:54:57.670754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669698+0000","last_change":"2024-09-14T10:56:43.698284+0000","last_active":"2024-09-14T11:55:03.669698+0000","last_peered":"2024-09-14T11:55:03.669698+0000","last_clean":"2024-09-14T11:55:03.669698+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:55:03.669698+0000","last_undegraded":"2024-09-14T11:55:03.669698+0000","last_fullsized":"2024-09-14T11:55:03.669698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:00.094354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'191","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.127349+0000","last_change":"2024-09-14T10:56:45.711166+0000","last_active":"2024-09-14T11:57:19.127349+0000","last_peered":"2024-09-14T11:57:19.127349+0000","last_clean":"2024-09-14T11:57:19.127349+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:57:19.127349+0000","last_undegraded":"2024-09-14T11:57:19.127349+0000","last_fullsized":"2024-09-14T11:57:19.127349+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:47.059448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'796","reported_seq":2593,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.587421+0000","last_change":"2024-09-14T10:56:47.728767+0000","last_active":"2024-09-14T11:58:36.587421+0000","last_peered":"2024-09-14T11:58:36.587421+0000","last_clean":"2024-09-14T11:58:36.587421+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:58:36.587421+0000","last_undegraded":"2024-09-14T11:58:36.587421+0000","last_fullsized":"2024-09-14T11:58:36.587421+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.533201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452881+0000","last_change":"2024-09-14T10:56:49.737155+0000","last_active":"2024-09-14T11:57:52.452881+0000","last_peered":"2024-09-14T11:57:52.452881+0000","last_clean":"2024-09-14T11:57:52.452881+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:57:52.452881+0000","last_undegraded":"2024-09-14T11:57:52.452881+0000","last_fullsized":"2024-09-14T11:57:52.452881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:24.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910688+0000","last_change":"2024-09-14T10:56:41.696110+0000","last_active":"2024-09-14T11:56:51.910688+0000","last_peered":"2024-09-14T11:56:51.910688+0000","last_clean":"2024-09-14T11:56:51.910688+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:56:51.910688+0000","last_undegraded":"2024-09-14T11:56:51.910688+0000","last_fullsized":"2024-09-14T11:56:51.910688+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:47.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'310","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.328058+0000","last_change":"2024-09-14T10:56:39.689300+0000","last_active":"2024-09-14T11:58:37.328058+0000","last_peered":"2024-09-14T11:58:37.328058+0000","last_clean":"2024-09-14T11:58:37.328058+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:37.328058+0000","last_undegraded":"2024-09-14T11:58:37.328058+0000","last_fullsized":"2024-09-14T11:58:37.328058+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:27.768196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5872509,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":651,"num_read_kb":30578,"num_write":1020,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.534766+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T11:55:02.534766+0000","last_peered":"2024-09-14T11:55:02.534766+0000","last_clean":"2024-09-14T11:55:02.534766+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:55:02.534766+0000","last_undegraded":"2024-09-14T11:55:02.534766+0000","last_fullsized":"2024-09-14T11:55:02.534766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549708+0000","last_change":"2024-09-14T10:56:43.703110+0000","last_active":"2024-09-14T11:55:03.549708+0000","last_peered":"2024-09-14T11:55:03.549708+0000","last_clean":"2024-09-14T11:55:03.549708+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:55:03.549708+0000","last_undegraded":"2024-09-14T11:55:03.549708+0000","last_fullsized":"2024-09-14T11:55:03.549708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:12.622307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'119","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.096817+0000","last_change":"2024-09-14T10:56:45.722824+0000","last_active":"2024-09-14T11:57:19.096817+0000","last_peered":"2024-09-14T11:57:19.096817+0000","last_clean":"2024-09-14T11:57:19.096817+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:57:19.096817+0000","last_undegraded":"2024-09-14T11:57:19.096817+0000","last_fullsized":"2024-09-14T11:57:19.096817+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:19.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'811","reported_seq":2996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.593571+0000","last_change":"2024-09-14T10:56:47.731609+0000","last_active":"2024-09-14T11:58:36.593571+0000","last_peered":"2024-09-14T11:58:36.593571+0000","last_clean":"2024-09-14T11:58:36.593571+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:58:36.593571+0000","last_undegraded":"2024-09-14T11:58:36.593571+0000","last_fullsized":"2024-09-14T11:58:36.593571+0000","mapping_epoch":33,"log_start":"263'701","ondisk_log_start":"263'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.877641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'289","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.773375+0000","last_change":"2024-09-14T10:56:49.747406+0000","last_active":"2024-09-14T11:56:52.773375+0000","last_peered":"2024-09-14T11:56:52.773375+0000","last_clean":"2024-09-14T11:56:52.773375+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:56:52.773375+0000","last_undegraded":"2024-09-14T11:56:52.773375+0000","last_fullsized":"2024-09-14T11:56:52.773375+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.880523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518469+0000","last_change":"2024-09-14T10:56:41.691206+0000","last_active":"2024-09-14T11:56:16.518469+0000","last_peered":"2024-09-14T11:56:16.518469+0000","last_clean":"2024-09-14T11:56:16.518469+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:56:16.518469+0000","last_undegraded":"2024-09-14T11:56:16.518469+0000","last_fullsized":"2024-09-14T11:56:16.518469+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'412","reported_seq":1129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.343800+0000","last_change":"2024-09-14T10:56:39.692650+0000","last_active":"2024-09-14T11:58:37.343800+0000","last_peered":"2024-09-14T11:58:37.343800+0000","last_clean":"2024-09-14T11:58:37.343800+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:37.343800+0000","last_undegraded":"2024-09-14T11:58:37.343800+0000","last_fullsized":"2024-09-14T11:58:37.343800+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:04.303763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5301611,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":968,"num_read_kb":14136,"num_write":1455,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669743+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T11:55:03.669743+0000","last_peered":"2024-09-14T11:55:03.669743+0000","last_clean":"2024-09-14T11:55:03.669743+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:55:03.669743+0000","last_undegraded":"2024-09-14T11:55:03.669743+0000","last_fullsized":"2024-09-14T11:55:03.669743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.655180+0000","last_change":"2024-09-14T10:56:43.703274+0000","last_active":"2024-09-14T11:54:57.655180+0000","last_peered":"2024-09-14T11:54:57.655180+0000","last_clean":"2024-09-14T11:54:57.655180+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:54:57.655180+0000","last_undegraded":"2024-09-14T11:54:57.655180+0000","last_fullsized":"2024-09-14T11:54:57.655180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:29.718912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'767","reported_seq":1474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.290965+0000","last_change":"2024-09-14T10:56:45.720876+0000","last_active":"2024-09-14T11:58:37.290965+0000","last_peered":"2024-09-14T11:58:37.290965+0000","last_clean":"2024-09-14T11:58:37.290965+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:58:37.290965+0000","last_undegraded":"2024-09-14T11:58:37.290965+0000","last_fullsized":"2024-09-14T11:58:37.290965+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":700,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202517,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1364,"num_read_kb":3195,"num_write":1122,"num_write_kb":955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656600+0000","last_change":"2024-09-14T10:56:47.731417+0000","last_active":"2024-09-14T11:55:07.656600+0000","last_peered":"2024-09-14T11:55:07.656600+0000","last_clean":"2024-09-14T11:55:07.656600+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:55:07.656600+0000","last_undegraded":"2024-09-14T11:55:07.656600+0000","last_fullsized":"2024-09-14T11:55:07.656600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:34.160341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'154","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.473141+0000","last_change":"2024-09-14T10:56:49.746978+0000","last_active":"2024-09-14T11:55:39.473141+0000","last_peered":"2024-09-14T11:55:39.473141+0000","last_clean":"2024-09-14T11:55:39.473141+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:55:39.473141+0000","last_undegraded":"2024-09-14T11:55:39.473141+0000","last_fullsized":"2024-09-14T11:55:39.473141+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:12.779368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'168","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.003254+0000","last_change":"2024-09-14T10:56:49.747311+0000","last_active":"2024-09-14T11:56:53.003254+0000","last_peered":"2024-09-14T11:56:53.003254+0000","last_clean":"2024-09-14T11:56:53.003254+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:56:53.003254+0000","last_undegraded":"2024-09-14T11:56:53.003254+0000","last_fullsized":"2024-09-14T11:56:53.003254+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:47.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1122","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447401+0000","last_change":"2024-09-14T10:56:41.687812+0000","last_active":"2024-09-14T11:57:23.447401+0000","last_peered":"2024-09-14T11:57:23.447401+0000","last_clean":"2024-09-14T11:57:23.447401+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:57:23.447401+0000","last_undegraded":"2024-09-14T11:57:23.447401+0000","last_fullsized":"2024-09-14T11:57:23.447401+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:02.391191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'396","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.388101+0000","last_change":"2024-09-14T10:56:39.670814+0000","last_active":"2024-09-14T11:58:38.388101+0000","last_peered":"2024-09-14T11:58:38.388101+0000","last_clean":"2024-09-14T11:58:38.388101+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:38.388101+0000","last_undegraded":"2024-09-14T11:58:38.388101+0000","last_fullsized":"2024-09-14T11:58:38.388101+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":877,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":616,"num_read_kb":10191,"num_write":1178,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535277+0000","last_change":"2024-09-14T10:56:43.705030+0000","last_active":"2024-09-14T11:55:07.535277+0000","last_peered":"2024-09-14T11:55:07.535277+0000","last_clean":"2024-09-14T11:55:07.535277+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:55:07.535277+0000","last_undegraded":"2024-09-14T11:55:07.535277+0000","last_fullsized":"2024-09-14T11:55:07.535277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'329","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.298713+0000","last_change":"2024-09-14T10:56:45.717554+0000","last_active":"2024-09-14T11:58:11.298713+0000","last_peered":"2024-09-14T11:58:11.298713+0000","last_clean":"2024-09-14T11:58:11.298713+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:58:11.298713+0000","last_undegraded":"2024-09-14T11:58:11.298713+0000","last_fullsized":"2024-09-14T11:58:11.298713+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.209988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":108084,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":539,"num_read_kb":1261,"num_write":450,"num_write_kb":400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656516+0000","last_change":"2024-09-14T10:56:47.725547+0000","last_active":"2024-09-14T11:55:07.656516+0000","last_peered":"2024-09-14T11:55:07.656516+0000","last_clean":"2024-09-14T11:55:07.656516+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:55:07.656516+0000","last_undegraded":"2024-09-14T11:55:07.656516+0000","last_fullsized":"2024-09-14T11:55:07.656516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.084006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.627089+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:55:30.627089+0000","last_peered":"2024-09-14T11:55:30.627089+0000","last_clean":"2024-09-14T11:55:30.627089+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:55:30.627089+0000","last_undegraded":"2024-09-14T11:55:30.627089+0000","last_fullsized":"2024-09-14T11:55:30.627089+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.809740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1055","reported_seq":2864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445536+0000","last_change":"2024-09-14T10:56:41.693098+0000","last_active":"2024-09-14T11:57:22.445536+0000","last_peered":"2024-09-14T11:57:22.445536+0000","last_clean":"2024-09-14T11:57:22.445536+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:57:22.445536+0000","last_undegraded":"2024-09-14T11:57:22.445536+0000","last_fullsized":"2024-09-14T11:57:22.445536+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:04.578146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'396","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426044+0000","last_change":"2024-09-14T10:56:39.696942+0000","last_active":"2024-09-14T11:58:37.426044+0000","last_peered":"2024-09-14T11:58:37.426044+0000","last_clean":"2024-09-14T11:58:37.426044+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:37.426044+0000","last_undegraded":"2024-09-14T11:58:37.426044+0000","last_fullsized":"2024-09-14T11:58:37.426044+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:03.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14730799,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":790,"num_read_kb":46830,"num_write":1250,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656693+0000","last_change":"2024-09-14T10:56:43.695342+0000","last_active":"2024-09-14T11:55:07.656693+0000","last_peered":"2024-09-14T11:55:07.656693+0000","last_clean":"2024-09-14T11:55:07.656693+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:55:07.656693+0000","last_undegraded":"2024-09-14T11:55:07.656693+0000","last_fullsized":"2024-09-14T11:55:07.656693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:45.552140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.731707+0000","last_change":"2024-09-14T10:56:45.719223+0000","last_active":"2024-09-14T11:57:18.731707+0000","last_peered":"2024-09-14T11:57:18.731707+0000","last_clean":"2024-09-14T11:57:18.731707+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:57:18.731707+0000","last_undegraded":"2024-09-14T11:57:18.731707+0000","last_fullsized":"2024-09-14T11:57:18.731707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:12.736414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672205+0000","last_change":"2024-09-14T10:56:47.735092+0000","last_active":"2024-09-14T11:55:07.672205+0000","last_peered":"2024-09-14T11:55:07.672205+0000","last_clean":"2024-09-14T11:55:07.672205+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:55:07.672205+0000","last_undegraded":"2024-09-14T11:55:07.672205+0000","last_fullsized":"2024-09-14T11:55:07.672205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:26.157686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.919060+0000","last_change":"2024-09-14T10:56:49.748097+0000","last_active":"2024-09-14T11:56:51.919060+0000","last_peered":"2024-09-14T11:56:51.919060+0000","last_clean":"2024-09-14T11:56:51.919060+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:56:51.919060+0000","last_undegraded":"2024-09-14T11:56:51.919060+0000","last_fullsized":"2024-09-14T11:56:51.919060+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:32.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'555","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655868+0000","last_change":"2024-09-14T10:56:41.695455+0000","last_active":"2024-09-14T11:55:02.655868+0000","last_peered":"2024-09-14T11:55:02.655868+0000","last_clean":"2024-09-14T11:55:02.655868+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:55:02.655868+0000","last_undegraded":"2024-09-14T11:55:02.655868+0000","last_fullsized":"2024-09-14T11:55:02.655868+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:44.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'360","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.464257+0000","last_change":"2024-09-14T10:56:39.690454+0000","last_active":"2024-09-14T11:58:37.464257+0000","last_peered":"2024-09-14T11:58:37.464257+0000","last_clean":"2024-09-14T11:58:37.464257+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:37.464257+0000","last_undegraded":"2024-09-14T11:58:37.464257+0000","last_fullsized":"2024-09-14T11:58:37.464257+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:21.163573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5270682,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":802,"num_read_kb":27462,"num_write":1372,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672163+0000","last_change":"2024-09-14T10:56:43.699062+0000","last_active":"2024-09-14T11:55:07.672163+0000","last_peered":"2024-09-14T11:55:07.672163+0000","last_clean":"2024-09-14T11:55:07.672163+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:55:07.672163+0000","last_undegraded":"2024-09-14T11:55:07.672163+0000","last_fullsized":"2024-09-14T11:55:07.672163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:26.963005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'323","reported_seq":913,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.284014+0000","last_change":"2024-09-14T10:56:45.715959+0000","last_active":"2024-09-14T11:58:11.284014+0000","last_peered":"2024-09-14T11:58:11.284014+0000","last_clean":"2024-09-14T11:58:11.284014+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:58:11.284014+0000","last_undegraded":"2024-09-14T11:58:11.284014+0000","last_fullsized":"2024-09-14T11:58:11.284014+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:05.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58278,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":529,"num_read_kb":1077,"num_write":422,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670532+0000","last_change":"2024-09-14T10:56:47.732777+0000","last_active":"2024-09-14T11:55:08.670532+0000","last_peered":"2024-09-14T11:55:08.670532+0000","last_clean":"2024-09-14T11:55:08.670532+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:55:08.670532+0000","last_undegraded":"2024-09-14T11:55:08.670532+0000","last_fullsized":"2024-09-14T11:55:08.670532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:56.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'132","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:50.364550+0000","last_change":"2024-09-14T10:56:49.744968+0000","last_active":"2024-09-14T11:55:50.364550+0000","last_peered":"2024-09-14T11:55:50.364550+0000","last_clean":"2024-09-14T11:55:50.364550+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:55:50.364550+0000","last_undegraded":"2024-09-14T11:55:50.364550+0000","last_fullsized":"2024-09-14T11:55:50.364550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.920523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'545","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655810+0000","last_change":"2024-09-14T10:56:41.692451+0000","last_active":"2024-09-14T11:55:02.655810+0000","last_peered":"2024-09-14T11:55:02.655810+0000","last_clean":"2024-09-14T11:55:02.655810+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:55:02.655810+0000","last_undegraded":"2024-09-14T11:55:02.655810+0000","last_fullsized":"2024-09-14T11:55:02.655810+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:39.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'328","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.401708+0000","last_change":"2024-09-14T10:56:39.691385+0000","last_active":"2024-09-14T11:58:37.401708+0000","last_peered":"2024-09-14T11:58:37.401708+0000","last_clean":"2024-09-14T11:58:37.401708+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:37.401708+0000","last_undegraded":"2024-09-14T11:58:37.401708+0000","last_fullsized":"2024-09-14T11:58:37.401708+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15149076,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":674,"num_read_kb":41704,"num_write":1209,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669646+0000","last_change":"2024-09-14T10:56:43.704083+0000","last_active":"2024-09-14T11:55:03.669646+0000","last_peered":"2024-09-14T11:55:03.669646+0000","last_clean":"2024-09-14T11:55:03.669646+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:55:03.669646+0000","last_undegraded":"2024-09-14T11:55:03.669646+0000","last_fullsized":"2024-09-14T11:55:03.669646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.605990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'278","reported_seq":833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.280355+0000","last_change":"2024-09-14T10:56:45.716753+0000","last_active":"2024-09-14T11:58:11.280355+0000","last_peered":"2024-09-14T11:58:11.280355+0000","last_clean":"2024-09-14T11:58:11.280355+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:58:11.280355+0000","last_undegraded":"2024-09-14T11:58:11.280355+0000","last_fullsized":"2024-09-14T11:58:11.280355+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:06.690939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60433,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":455,"num_read_kb":994,"num_write":372,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656266+0000","last_change":"2024-09-14T10:56:47.736112+0000","last_active":"2024-09-14T11:55:07.656266+0000","last_peered":"2024-09-14T11:55:07.656266+0000","last_clean":"2024-09-14T11:55:07.656266+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:55:07.656266+0000","last_undegraded":"2024-09-14T11:55:07.656266+0000","last_fullsized":"2024-09-14T11:55:07.656266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:10.784169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'481","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.461087+0000","last_change":"2024-09-14T10:56:41.690497+0000","last_active":"2024-09-14T11:56:10.461087+0000","last_peered":"2024-09-14T11:56:10.461087+0000","last_clean":"2024-09-14T11:56:10.461087+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:56:10.461087+0000","last_undegraded":"2024-09-14T11:56:10.461087+0000","last_fullsized":"2024-09-14T11:56:10.461087+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:04.625419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'263","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.232655+0000","last_change":"2024-09-14T10:56:39.680360+0000","last_active":"2024-09-14T11:58:37.232655+0000","last_peered":"2024-09-14T11:58:37.232655+0000","last_clean":"2024-09-14T11:58:37.232655+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:37.232655+0000","last_undegraded":"2024-09-14T11:58:37.232655+0000","last_fullsized":"2024-09-14T11:58:37.232655+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:47.696842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653223,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":524,"num_read_kb":63779,"num_write":845,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"37'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.156737+0000","last_change":"2024-09-14T10:56:43.698511+0000","last_active":"2024-09-14T11:58:36.156737+0000","last_peered":"2024-09-14T11:58:36.156737+0000","last_clean":"2024-09-14T11:58:36.156737+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:36.156737+0000","last_undegraded":"2024-09-14T11:58:36.156737+0000","last_fullsized":"2024-09-14T11:58:36.156737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.127093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'491","reported_seq":1118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.447584+0000","last_change":"2024-09-14T10:56:45.720443+0000","last_active":"2024-09-14T11:58:37.447584+0000","last_peered":"2024-09-14T11:58:37.447584+0000","last_clean":"2024-09-14T11:58:37.447584+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:58:37.447584+0000","last_undegraded":"2024-09-14T11:58:37.447584+0000","last_fullsized":"2024-09-14T11:58:37.447584+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.146179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126332,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":882,"num_read_kb":2032,"num_write":763,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541697+0000","last_change":"2024-09-14T10:56:47.731799+0000","last_active":"2024-09-14T11:54:17.541697+0000","last_peered":"2024-09-14T11:54:17.541697+0000","last_clean":"2024-09-14T11:54:17.541697+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:54:17.541697+0000","last_undegraded":"2024-09-14T11:54:17.541697+0000","last_fullsized":"2024-09-14T11:54:17.541697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.343090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'455","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266414+0000","last_change":"2024-09-14T10:56:41.691362+0000","last_active":"2024-09-14T11:55:58.266414+0000","last_peered":"2024-09-14T11:55:58.266414+0000","last_clean":"2024-09-14T11:55:58.266414+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:55:58.266414+0000","last_undegraded":"2024-09-14T11:55:58.266414+0000","last_fullsized":"2024-09-14T11:55:58.266414+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:01.380624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'300","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.372358+0000","last_change":"2024-09-14T10:56:39.673809+0000","last_active":"2024-09-14T11:58:37.372358+0000","last_peered":"2024-09-14T11:58:37.372358+0000","last_clean":"2024-09-14T11:58:37.372358+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:37.372358+0000","last_undegraded":"2024-09-14T11:58:37.372358+0000","last_fullsized":"2024-09-14T11:58:37.372358+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:32.335582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10492050,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":557,"num_read_kb":50717,"num_write":1006,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669754+0000","last_change":"2024-09-14T10:56:43.701698+0000","last_active":"2024-09-14T11:55:03.669754+0000","last_peered":"2024-09-14T11:55:03.669754+0000","last_clean":"2024-09-14T11:55:03.669754+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:55:03.669754+0000","last_undegraded":"2024-09-14T11:55:03.669754+0000","last_fullsized":"2024-09-14T11:55:03.669754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.260764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'310","reported_seq":884,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.281654+0000","last_change":"2024-09-14T10:56:45.719927+0000","last_active":"2024-09-14T11:58:11.281654+0000","last_peered":"2024-09-14T11:58:11.281654+0000","last_clean":"2024-09-14T11:58:11.281654+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:58:11.281654+0000","last_undegraded":"2024-09-14T11:58:11.281654+0000","last_fullsized":"2024-09-14T11:58:11.281654+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63343,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":527,"num_read_kb":1061,"num_write":438,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529645+0000","last_change":"2024-09-14T10:56:47.726517+0000","last_active":"2024-09-14T11:54:17.529645+0000","last_peered":"2024-09-14T11:54:17.529645+0000","last_clean":"2024-09-14T11:54:17.529645+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:54:17.529645+0000","last_undegraded":"2024-09-14T11:54:17.529645+0000","last_fullsized":"2024-09-14T11:54:17.529645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:13.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'150","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.548609+0000","last_change":"2024-09-14T10:56:49.743152+0000","last_active":"2024-09-14T11:55:43.548609+0000","last_peered":"2024-09-14T11:55:43.548609+0000","last_clean":"2024-09-14T11:55:43.548609+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:55:43.548609+0000","last_undegraded":"2024-09-14T11:55:43.548609+0000","last_fullsized":"2024-09-14T11:55:43.548609+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:00.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'552","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.443381+0000","last_change":"2024-09-14T10:56:41.685799+0000","last_active":"2024-09-14T11:56:42.443381+0000","last_peered":"2024-09-14T11:56:42.443381+0000","last_clean":"2024-09-14T11:56:42.443381+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:56:42.443381+0000","last_undegraded":"2024-09-14T11:56:42.443381+0000","last_fullsized":"2024-09-14T11:56:42.443381+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'318","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.352316+0000","last_change":"2024-09-14T10:56:39.684773+0000","last_active":"2024-09-14T11:58:38.352316+0000","last_peered":"2024-09-14T11:58:38.352316+0000","last_clean":"2024-09-14T11:58:38.352316+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:38.352316+0000","last_undegraded":"2024-09-14T11:58:38.352316+0000","last_fullsized":"2024-09-14T11:58:38.352316+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.903799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190449,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":570,"num_read_kb":82907,"num_write":1067,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542445+0000","last_change":"2024-09-14T10:56:43.704594+0000","last_active":"2024-09-14T11:54:13.542445+0000","last_peered":"2024-09-14T11:54:13.542445+0000","last_clean":"2024-09-14T11:54:13.542445+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:54:13.542445+0000","last_undegraded":"2024-09-14T11:54:13.542445+0000","last_fullsized":"2024-09-14T11:54:13.542445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'302","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.303729+0000","last_change":"2024-09-14T10:56:45.713501+0000","last_active":"2024-09-14T11:58:11.303729+0000","last_peered":"2024-09-14T11:58:11.303729+0000","last_clean":"2024-09-14T11:58:11.303729+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:58:11.303729+0000","last_undegraded":"2024-09-14T11:58:11.303729+0000","last_fullsized":"2024-09-14T11:58:11.303729+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:35.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59479,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":478,"num_read_kb":1009,"num_write":390,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534180+0000","last_change":"2024-09-14T10:56:47.733388+0000","last_active":"2024-09-14T11:54:57.534180+0000","last_peered":"2024-09-14T11:54:57.534180+0000","last_clean":"2024-09-14T11:54:57.534180+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:54:57.534180+0000","last_undegraded":"2024-09-14T11:54:57.534180+0000","last_fullsized":"2024-09-14T11:54:57.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:57.789850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'166","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311096+0000","last_change":"2024-09-14T10:56:49.745862+0000","last_active":"2024-09-14T11:58:11.311096+0000","last_peered":"2024-09-14T11:58:11.311096+0000","last_clean":"2024-09-14T11:58:11.311096+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:58:11.311096+0000","last_undegraded":"2024-09-14T11:58:11.311096+0000","last_fullsized":"2024-09-14T11:58:11.311096+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.824927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'529","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.873131+0000","last_change":"2024-09-14T10:56:41.686220+0000","last_active":"2024-09-14T11:58:09.873131+0000","last_peered":"2024-09-14T11:58:09.873131+0000","last_clean":"2024-09-14T11:58:09.873131+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:09.873131+0000","last_undegraded":"2024-09-14T11:58:09.873131+0000","last_fullsized":"2024-09-14T11:58:09.873131+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:09.136596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'330","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.426263+0000","last_change":"2024-09-14T10:57:16.216561+0000","last_active":"2024-09-14T11:58:37.426263+0000","last_peered":"2024-09-14T11:58:37.426263+0000","last_clean":"2024-09-14T11:58:37.426263+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:37.426263+0000","last_undegraded":"2024-09-14T11:58:37.426263+0000","last_fullsized":"2024-09-14T11:58:37.426263+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11708820,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":570,"num_read_kb":42073,"num_write":1097,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529656+0000","last_change":"2024-09-14T10:56:43.707654+0000","last_active":"2024-09-14T11:54:17.529656+0000","last_peered":"2024-09-14T11:54:17.529656+0000","last_clean":"2024-09-14T11:54:17.529656+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:54:17.529656+0000","last_undegraded":"2024-09-14T11:54:17.529656+0000","last_fullsized":"2024-09-14T11:54:17.529656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.644607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'102","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.120594+0000","last_change":"2024-09-14T10:56:45.723330+0000","last_active":"2024-09-14T11:57:19.120594+0000","last_peered":"2024-09-14T11:57:19.120594+0000","last_clean":"2024-09-14T11:57:19.120594+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:57:19.120594+0000","last_undegraded":"2024-09-14T11:57:19.120594+0000","last_fullsized":"2024-09-14T11:57:19.120594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.375494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'776","reported_seq":4308,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.587111+0000","last_change":"2024-09-14T10:56:47.725052+0000","last_active":"2024-09-14T11:58:36.587111+0000","last_peered":"2024-09-14T11:58:36.587111+0000","last_clean":"2024-09-14T11:58:36.587111+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:58:36.587111+0000","last_undegraded":"2024-09-14T11:58:36.587111+0000","last_fullsized":"2024-09-14T11:58:36.587111+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:47.209530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.919170+0000","last_change":"2024-09-14T10:56:49.751037+0000","last_active":"2024-09-14T11:56:52.919170+0000","last_peered":"2024-09-14T11:56:52.919170+0000","last_clean":"2024-09-14T11:56:52.919170+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:56:52.919170+0000","last_undegraded":"2024-09-14T11:56:52.919170+0000","last_fullsized":"2024-09-14T11:56:52.919170+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:10.690807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'413","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.748759+0000","last_change":"2024-09-14T10:56:41.697565+0000","last_active":"2024-09-14T11:56:52.748759+0000","last_peered":"2024-09-14T11:56:52.748759+0000","last_clean":"2024-09-14T11:56:52.748759+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:56:52.748759+0000","last_undegraded":"2024-09-14T11:56:52.748759+0000","last_fullsized":"2024-09-14T11:56:52.748759+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:10.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'267","reported_seq":853,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.486064+0000","last_change":"2024-09-14T10:56:39.680420+0000","last_active":"2024-09-14T11:58:37.486064+0000","last_peered":"2024-09-14T11:58:37.486064+0000","last_clean":"2024-09-14T11:58:37.486064+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:37.486064+0000","last_undegraded":"2024-09-14T11:58:37.486064+0000","last_fullsized":"2024-09-14T11:58:37.486064+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:32.687547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1080169,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":440,"num_read_kb":9665,"num_write":951,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.664084+0000","last_change":"2024-09-14T10:56:43.698568+0000","last_active":"2024-09-14T11:54:17.664084+0000","last_peered":"2024-09-14T11:54:17.664084+0000","last_clean":"2024-09-14T11:54:17.664084+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:54:17.664084+0000","last_undegraded":"2024-09-14T11:54:17.664084+0000","last_fullsized":"2024-09-14T11:54:17.664084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:50.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'320","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.981914+0000","last_change":"2024-09-14T10:56:45.718845+0000","last_active":"2024-09-14T11:58:36.981914+0000","last_peered":"2024-09-14T11:58:36.981914+0000","last_clean":"2024-09-14T11:58:36.981914+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:58:36.981914+0000","last_undegraded":"2024-09-14T11:58:36.981914+0000","last_fullsized":"2024-09-14T11:58:36.981914+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:13.209858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653460+0000","last_change":"2024-09-14T10:56:47.733362+0000","last_active":"2024-09-14T11:54:47.653460+0000","last_peered":"2024-09-14T11:54:47.653460+0000","last_clean":"2024-09-14T11:54:47.653460+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:54:47.653460+0000","last_undegraded":"2024-09-14T11:54:47.653460+0000","last_fullsized":"2024-09-14T11:54:47.653460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:33.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'123","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.829287+0000","last_change":"2024-09-14T10:56:49.749682+0000","last_active":"2024-09-14T11:56:49.829287+0000","last_peered":"2024-09-14T11:56:49.829287+0000","last_clean":"2024-09-14T11:56:49.829287+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:56:49.829287+0000","last_undegraded":"2024-09-14T11:56:49.829287+0000","last_fullsized":"2024-09-14T11:56:49.829287+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:32.089427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'396","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.284146+0000","last_change":"2024-09-14T10:56:41.695266+0000","last_active":"2024-09-14T11:56:49.284146+0000","last_peered":"2024-09-14T11:56:49.284146+0000","last_clean":"2024-09-14T11:56:49.284146+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:56:49.284146+0000","last_undegraded":"2024-09-14T11:56:49.284146+0000","last_fullsized":"2024-09-14T11:56:49.284146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.489293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'281","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.526636+0000","last_change":"2024-09-14T10:56:39.681309+0000","last_active":"2024-09-14T11:58:37.526636+0000","last_peered":"2024-09-14T11:58:37.526636+0000","last_clean":"2024-09-14T11:58:37.526636+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:37.526636+0000","last_undegraded":"2024-09-14T11:58:37.526636+0000","last_fullsized":"2024-09-14T11:58:37.526636+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:25.783922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7295109,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":529,"num_read_kb":29813,"num_write":1032,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541668+0000","last_change":"2024-09-14T10:56:43.698362+0000","last_active":"2024-09-14T11:54:17.541668+0000","last_peered":"2024-09-14T11:54:17.541668+0000","last_clean":"2024-09-14T11:54:17.541668+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:54:17.541668+0000","last_undegraded":"2024-09-14T11:54:17.541668+0000","last_fullsized":"2024-09-14T11:54:17.541668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.790448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.069236+0000","last_change":"2024-09-14T10:56:45.714250+0000","last_active":"2024-09-14T11:58:37.069236+0000","last_peered":"2024-09-14T11:58:37.069236+0000","last_clean":"2024-09-14T11:58:37.069236+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:58:37.069236+0000","last_undegraded":"2024-09-14T11:58:37.069236+0000","last_fullsized":"2024-09-14T11:58:37.069236+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:33.117467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669009+0000","last_change":"2024-09-14T10:56:47.735191+0000","last_active":"2024-09-14T11:54:58.669009+0000","last_peered":"2024-09-14T11:54:58.669009+0000","last_clean":"2024-09-14T11:54:58.669009+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:54:58.669009+0000","last_undegraded":"2024-09-14T11:54:58.669009+0000","last_fullsized":"2024-09-14T11:54:58.669009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.084195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'105","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.049900+0000","last_change":"2024-09-14T10:56:49.737999+0000","last_active":"2024-09-14T11:56:00.049900+0000","last_peered":"2024-09-14T11:56:00.049900+0000","last_clean":"2024-09-14T11:56:00.049900+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:56:00.049900+0000","last_undegraded":"2024-09-14T11:56:00.049900+0000","last_fullsized":"2024-09-14T11:56:00.049900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.183467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'350","reported_seq":1779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553158+0000","last_change":"2024-09-14T10:57:15.793797+0000","last_active":"2024-09-14T11:55:32.553158+0000","last_peered":"2024-09-14T11:55:32.553158+0000","last_clean":"2024-09-14T11:55:32.553158+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:55:32.553158+0000","last_undegraded":"2024-09-14T11:55:32.553158+0000","last_fullsized":"2024-09-14T11:55:32.553158+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:28.436278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'366","reported_seq":1029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400385+0000","last_change":"2024-09-14T10:56:39.693756+0000","last_active":"2024-09-14T11:58:37.400385+0000","last_peered":"2024-09-14T11:58:37.400385+0000","last_clean":"2024-09-14T11:58:37.400385+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:37.400385+0000","last_undegraded":"2024-09-14T11:58:37.400385+0000","last_fullsized":"2024-09-14T11:58:37.400385+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:17.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6398400,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":688,"num_read_kb":11025,"num_write":1228,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.546906+0000","last_change":"2024-09-14T10:56:43.701839+0000","last_active":"2024-09-14T11:54:43.546906+0000","last_peered":"2024-09-14T11:54:43.546906+0000","last_clean":"2024-09-14T11:54:43.546906+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:54:43.546906+0000","last_undegraded":"2024-09-14T11:54:43.546906+0000","last_fullsized":"2024-09-14T11:54:43.546906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:17.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'233","reported_seq":783,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.301001+0000","last_change":"2024-09-14T10:56:45.717972+0000","last_active":"2024-09-14T11:58:11.301001+0000","last_peered":"2024-09-14T11:58:11.301001+0000","last_clean":"2024-09-14T11:58:11.301001+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:58:11.301001+0000","last_undegraded":"2024-09-14T11:58:11.301001+0000","last_fullsized":"2024-09-14T11:58:11.301001+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:35.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61888,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":385,"num_read_kb":883,"num_write":320,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.543346+0000","last_change":"2024-09-14T10:56:47.727607+0000","last_active":"2024-09-14T11:54:18.543346+0000","last_peered":"2024-09-14T11:54:18.543346+0000","last_clean":"2024-09-14T11:54:18.543346+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:54:18.543346+0000","last_undegraded":"2024-09-14T11:54:18.543346+0000","last_fullsized":"2024-09-14T11:54:18.543346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:25.985367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'158","reported_seq":1613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.803159+0000","last_change":"2024-09-14T10:56:49.749341+0000","last_active":"2024-09-14T11:56:49.803159+0000","last_peered":"2024-09-14T11:56:49.803159+0000","last_clean":"2024-09-14T11:56:49.803159+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:56:49.803159+0000","last_undegraded":"2024-09-14T11:56:49.803159+0000","last_fullsized":"2024-09-14T11:56:49.803159+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:09.689856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'469","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313472+0000","last_change":"2024-09-14T10:56:41.688125+0000","last_active":"2024-09-14T11:56:49.313472+0000","last_peered":"2024-09-14T11:56:49.313472+0000","last_clean":"2024-09-14T11:56:49.313472+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:56:49.313472+0000","last_undegraded":"2024-09-14T11:56:49.313472+0000","last_fullsized":"2024-09-14T11:56:49.313472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:10.186168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'360","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.735738+0000","last_change":"2024-09-14T10:57:16.215872+0000","last_active":"2024-09-14T11:58:37.735738+0000","last_peered":"2024-09-14T11:58:37.735738+0000","last_clean":"2024-09-14T11:58:37.735738+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:37.735738+0000","last_undegraded":"2024-09-14T11:58:37.735738+0000","last_fullsized":"2024-09-14T11:58:37.735738+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:32.841426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1058811,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":706,"num_read_kb":46942,"num_write":1256,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534114+0000","last_change":"2024-09-14T10:56:43.704444+0000","last_active":"2024-09-14T11:54:57.534114+0000","last_peered":"2024-09-14T11:54:57.534114+0000","last_clean":"2024-09-14T11:54:57.534114+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:54:57.534114+0000","last_undegraded":"2024-09-14T11:54:57.534114+0000","last_fullsized":"2024-09-14T11:54:57.534114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.463719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'297","reported_seq":883,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.304745+0000","last_change":"2024-09-14T10:56:45.721400+0000","last_active":"2024-09-14T11:58:11.304745+0000","last_peered":"2024-09-14T11:58:11.304745+0000","last_clean":"2024-09-14T11:58:11.304745+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:58:11.304745+0000","last_undegraded":"2024-09-14T11:58:11.304745+0000","last_fullsized":"2024-09-14T11:58:11.304745+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.182048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50315,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":473,"num_read_kb":960,"num_write":374,"num_write_kb":271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.649773+0000","last_change":"2024-09-14T10:56:47.736437+0000","last_active":"2024-09-14T11:54:17.649773+0000","last_peered":"2024-09-14T11:54:17.649773+0000","last_clean":"2024-09-14T11:54:17.649773+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:54:17.649773+0000","last_undegraded":"2024-09-14T11:54:17.649773+0000","last_fullsized":"2024-09-14T11:54:17.649773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:00.826459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.871440+0000","last_change":"2024-09-14T10:56:49.747246+0000","last_active":"2024-09-14T11:58:09.871440+0000","last_peered":"2024-09-14T11:58:09.871440+0000","last_clean":"2024-09-14T11:58:09.871440+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:58:09.871440+0000","last_undegraded":"2024-09-14T11:58:09.871440+0000","last_fullsized":"2024-09-14T11:58:09.871440+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:08.836336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'582","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909450+0000","last_change":"2024-09-14T10:56:41.697790+0000","last_active":"2024-09-14T11:56:51.909450+0000","last_peered":"2024-09-14T11:56:51.909450+0000","last_clean":"2024-09-14T11:56:51.909450+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:56:51.909450+0000","last_undegraded":"2024-09-14T11:56:51.909450+0000","last_fullsized":"2024-09-14T11:56:51.909450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:08.908846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'330","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.506417+0000","last_change":"2024-09-14T10:56:39.673208+0000","last_active":"2024-09-14T11:58:38.506417+0000","last_peered":"2024-09-14T11:58:38.506417+0000","last_clean":"2024-09-14T11:58:38.506417+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:38.506417+0000","last_undegraded":"2024-09-14T11:58:38.506417+0000","last_fullsized":"2024-09-14T11:58:38.506417+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.389425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12223757,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":625,"num_read_kb":60949,"num_write":1061,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1051","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782289+0000","last_change":"2024-09-14T10:56:41.690469+0000","last_active":"2024-09-14T11:56:52.782289+0000","last_peered":"2024-09-14T11:56:52.782289+0000","last_clean":"2024-09-14T11:56:52.782289+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:56:52.782289+0000","last_undegraded":"2024-09-14T11:56:52.782289+0000","last_fullsized":"2024-09-14T11:56:52.782289+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1000,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:19.835570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'325","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.724368+0000","last_change":"2024-09-14T10:56:39.682932+0000","last_active":"2024-09-14T11:58:37.724368+0000","last_peered":"2024-09-14T11:58:37.724368+0000","last_clean":"2024-09-14T11:58:37.724368+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:37.724368+0000","last_undegraded":"2024-09-14T11:58:37.724368+0000","last_fullsized":"2024-09-14T11:58:37.724368+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:56.634779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10224735,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":594,"num_read_kb":22759,"num_write":1100,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'997","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909714+0000","last_change":"2024-09-14T10:56:41.690506+0000","last_active":"2024-09-14T11:56:51.909714+0000","last_peered":"2024-09-14T11:56:51.909714+0000","last_clean":"2024-09-14T11:56:51.909714+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:56:51.909714+0000","last_undegraded":"2024-09-14T11:56:51.909714+0000","last_fullsized":"2024-09-14T11:56:51.909714+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:24.682037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'294","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.498509+0000","last_change":"2024-09-14T10:56:39.691542+0000","last_active":"2024-09-14T11:58:37.498509+0000","last_peered":"2024-09-14T11:58:37.498509+0000","last_clean":"2024-09-14T11:58:37.498509+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:37.498509+0000","last_undegraded":"2024-09-14T11:58:37.498509+0000","last_fullsized":"2024-09-14T11:58:37.498509+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:07.545833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13422990,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":944,"num_read_kb":42149,"num_write":1039,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'860","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.336478+0000","last_change":"2024-09-14T10:56:41.689333+0000","last_active":"2024-09-14T11:56:18.336478+0000","last_peered":"2024-09-14T11:56:18.336478+0000","last_clean":"2024-09-14T11:56:18.336478+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:56:18.336478+0000","last_undegraded":"2024-09-14T11:56:18.336478+0000","last_fullsized":"2024-09-14T11:56:18.336478+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:19.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'326","reported_seq":1027,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.402352+0000","last_change":"2024-09-14T10:56:39.694580+0000","last_active":"2024-09-14T11:58:37.402352+0000","last_peered":"2024-09-14T11:58:37.402352+0000","last_clean":"2024-09-14T11:58:37.402352+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:37.402352+0000","last_undegraded":"2024-09-14T11:58:37.402352+0000","last_fullsized":"2024-09-14T11:58:37.402352+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:23.950117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4582778,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":829,"num_read_kb":14120,"num_write":1200,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1634","reported_seq":3354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.881920+0000","last_change":"2024-09-14T10:56:41.696853+0000","last_active":"2024-09-14T11:58:09.881920+0000","last_peered":"2024-09-14T11:58:09.881920+0000","last_clean":"2024-09-14T11:58:09.881920+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:58:09.881920+0000","last_undegraded":"2024-09-14T11:58:09.881920+0000","last_fullsized":"2024-09-14T11:58:09.881920+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:47.117707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'355","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.400797+0000","last_change":"2024-09-14T10:56:39.676793+0000","last_active":"2024-09-14T11:58:37.400797+0000","last_peered":"2024-09-14T11:58:37.400797+0000","last_clean":"2024-09-14T11:58:37.400797+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:37.400797+0000","last_undegraded":"2024-09-14T11:58:37.400797+0000","last_fullsized":"2024-09-14T11:58:37.400797+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2927610,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":715,"num_read_kb":3390,"num_write":1132,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.753104+0000","last_change":"2024-09-14T10:56:41.687648+0000","last_active":"2024-09-14T11:56:12.753104+0000","last_peered":"2024-09-14T11:56:12.753104+0000","last_clean":"2024-09-14T11:56:12.753104+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:56:12.753104+0000","last_undegraded":"2024-09-14T11:56:12.753104+0000","last_fullsized":"2024-09-14T11:56:12.753104+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:36.574356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'369","reported_seq":1108,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.438453+0000","last_change":"2024-09-14T10:56:39.671687+0000","last_active":"2024-09-14T11:58:37.438453+0000","last_peered":"2024-09-14T11:58:37.438453+0000","last_clean":"2024-09-14T11:58:37.438453+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:37.438453+0000","last_undegraded":"2024-09-14T11:58:37.438453+0000","last_fullsized":"2024-09-14T11:58:37.438453+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:50.335751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5595238,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":1033,"num_read_kb":5070,"num_write":1198,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'774","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.874571+0000","last_change":"2024-09-14T10:56:41.691714+0000","last_active":"2024-09-14T11:58:09.874571+0000","last_peered":"2024-09-14T11:58:09.874571+0000","last_clean":"2024-09-14T11:58:09.874571+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:58:09.874571+0000","last_undegraded":"2024-09-14T11:58:09.874571+0000","last_fullsized":"2024-09-14T11:58:09.874571+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:17.443652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'346","reported_seq":977,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.542656+0000","last_change":"2024-09-14T10:56:39.686601+0000","last_active":"2024-09-14T11:58:38.542656+0000","last_peered":"2024-09-14T11:58:38.542656+0000","last_clean":"2024-09-14T11:58:38.542656+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:38.542656+0000","last_undegraded":"2024-09-14T11:58:38.542656+0000","last_fullsized":"2024-09-14T11:58:38.542656+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:57.339815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2274,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":600,"num_read_kb":6911,"num_write":1130,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'412","reported_seq":1943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.880186+0000","last_change":"2024-09-14T10:56:41.685678+0000","last_active":"2024-09-14T11:58:09.880186+0000","last_peered":"2024-09-14T11:58:09.880186+0000","last_clean":"2024-09-14T11:58:09.880186+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:09.880186+0000","last_undegraded":"2024-09-14T11:58:09.880186+0000","last_fullsized":"2024-09-14T11:58:09.880186+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:05.474990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'393","reported_seq":1253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.267236+0000","last_change":"2024-09-14T10:56:39.677501+0000","last_active":"2024-09-14T11:58:37.267236+0000","last_peered":"2024-09-14T11:58:37.267236+0000","last_clean":"2024-09-14T11:58:37.267236+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:37.267236+0000","last_undegraded":"2024-09-14T11:58:37.267236+0000","last_fullsized":"2024-09-14T11:58:37.267236+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:47.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12599751,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":1272,"num_read_kb":48093,"num_write":1328,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'717","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445682+0000","last_change":"2024-09-14T10:56:41.697391+0000","last_active":"2024-09-14T11:57:22.445682+0000","last_peered":"2024-09-14T11:57:22.445682+0000","last_clean":"2024-09-14T11:57:22.445682+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:57:22.445682+0000","last_undegraded":"2024-09-14T11:57:22.445682+0000","last_fullsized":"2024-09-14T11:57:22.445682+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:49.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'371","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.475809+0000","last_change":"2024-09-14T10:56:39.680650+0000","last_active":"2024-09-14T11:58:37.475809+0000","last_peered":"2024-09-14T11:58:37.475809+0000","last_clean":"2024-09-14T11:58:37.475809+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:37.475809+0000","last_undegraded":"2024-09-14T11:58:37.475809+0000","last_fullsized":"2024-09-14T11:58:37.475809+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.313359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11560019,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":847,"num_read_kb":12822,"num_write":1317,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781318+0000","last_change":"2024-09-14T10:56:41.694523+0000","last_active":"2024-09-14T11:56:52.781318+0000","last_peered":"2024-09-14T11:56:52.781318+0000","last_clean":"2024-09-14T11:56:52.781318+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:56:52.781318+0000","last_undegraded":"2024-09-14T11:56:52.781318+0000","last_fullsized":"2024-09-14T11:56:52.781318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:14.167389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'407","reported_seq":1247,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.411894+0000","last_change":"2024-09-14T10:56:39.685874+0000","last_active":"2024-09-14T11:58:37.411894+0000","last_peered":"2024-09-14T11:58:37.411894+0000","last_clean":"2024-09-14T11:58:37.411894+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:37.411894+0000","last_undegraded":"2024-09-14T11:58:37.411894+0000","last_fullsized":"2024-09-14T11:58:37.411894+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:00.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4224146,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":1500,"num_read_kb":34980,"num_write":1337,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1164","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.335677+0000","last_change":"2024-09-14T10:56:41.684712+0000","last_active":"2024-09-14T11:56:18.335677+0000","last_peered":"2024-09-14T11:56:18.335677+0000","last_clean":"2024-09-14T11:56:18.335677+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:56:18.335677+0000","last_undegraded":"2024-09-14T11:56:18.335677+0000","last_fullsized":"2024-09-14T11:56:18.335677+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:54.887564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'282","reported_seq":866,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.559297+0000","last_change":"2024-09-14T10:56:39.692620+0000","last_active":"2024-09-14T11:58:37.559297+0000","last_peered":"2024-09-14T11:58:37.559297+0000","last_clean":"2024-09-14T11:58:37.559297+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:37.559297+0000","last_undegraded":"2024-09-14T11:58:37.559297+0000","last_fullsized":"2024-09-14T11:58:37.559297+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19437,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":448,"num_read_kb":3420,"num_write":962,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'618","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.780930+0000","last_change":"2024-09-14T10:56:41.688962+0000","last_active":"2024-09-14T11:56:52.780930+0000","last_peered":"2024-09-14T11:56:52.780930+0000","last_clean":"2024-09-14T11:56:52.780930+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:56:52.780930+0000","last_undegraded":"2024-09-14T11:56:52.780930+0000","last_fullsized":"2024-09-14T11:56:52.780930+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'295","reported_seq":939,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.327505+0000","last_change":"2024-09-14T10:57:16.314650+0000","last_active":"2024-09-14T11:58:37.327505+0000","last_peered":"2024-09-14T11:58:37.327505+0000","last_clean":"2024-09-14T11:58:37.327505+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:37.327505+0000","last_undegraded":"2024-09-14T11:58:37.327505+0000","last_fullsized":"2024-09-14T11:58:37.327505+0000","mapping_epoch":38,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:28.239442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057405,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":573,"num_read_kb":7722,"num_write":987,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1674","reported_seq":3374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817636+0000","last_change":"2024-09-14T10:56:41.701632+0000","last_active":"2024-09-14T11:55:53.817636+0000","last_peered":"2024-09-14T11:55:53.817636+0000","last_clean":"2024-09-14T11:55:53.817636+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:55:53.817636+0000","last_undegraded":"2024-09-14T11:55:53.817636+0000","last_fullsized":"2024-09-14T11:55:53.817636+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:14.899433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'346","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.480854+0000","last_change":"2024-09-14T10:56:39.685631+0000","last_active":"2024-09-14T11:58:38.480854+0000","last_peered":"2024-09-14T11:58:38.480854+0000","last_clean":"2024-09-14T11:58:38.480854+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:38.480854+0000","last_undegraded":"2024-09-14T11:58:38.480854+0000","last_fullsized":"2024-09-14T11:58:38.480854+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:18.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1758507,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":720,"num_read_kb":21069,"num_write":1103,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'702","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754801+0000","last_change":"2024-09-14T10:57:15.795049+0000","last_active":"2024-09-14T11:56:12.754801+0000","last_peered":"2024-09-14T11:56:12.754801+0000","last_clean":"2024-09-14T11:56:12.754801+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:56:12.754801+0000","last_undegraded":"2024-09-14T11:56:12.754801+0000","last_fullsized":"2024-09-14T11:56:12.754801+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:10.949204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'289","reported_seq":891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.394915+0000","last_change":"2024-09-14T10:56:39.690542+0000","last_active":"2024-09-14T11:58:37.394915+0000","last_peered":"2024-09-14T11:58:37.394915+0000","last_clean":"2024-09-14T11:58:37.394915+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:37.394915+0000","last_undegraded":"2024-09-14T11:58:37.394915+0000","last_fullsized":"2024-09-14T11:58:37.394915+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.115794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243370,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":489,"num_read_kb":36238,"num_write":1018,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'409","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910480+0000","last_change":"2024-09-14T10:56:41.690216+0000","last_active":"2024-09-14T11:56:51.910480+0000","last_peered":"2024-09-14T11:56:51.910480+0000","last_clean":"2024-09-14T11:56:51.910480+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:56:51.910480+0000","last_undegraded":"2024-09-14T11:56:51.910480+0000","last_fullsized":"2024-09-14T11:56:51.910480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'327","reported_seq":1057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.654443+0000","last_change":"2024-09-14T10:57:16.215847+0000","last_active":"2024-09-14T11:58:37.654443+0000","last_peered":"2024-09-14T11:58:37.654443+0000","last_clean":"2024-09-14T11:58:37.654443+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:37.654443+0000","last_undegraded":"2024-09-14T11:58:37.654443+0000","last_fullsized":"2024-09-14T11:58:37.654443+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294118,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":838,"num_read_kb":32735,"num_write":1138,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'725","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337741+0000","last_change":"2024-09-14T10:56:41.695355+0000","last_active":"2024-09-14T11:56:18.337741+0000","last_peered":"2024-09-14T11:56:18.337741+0000","last_clean":"2024-09-14T11:56:18.337741+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:56:18.337741+0000","last_undegraded":"2024-09-14T11:56:18.337741+0000","last_fullsized":"2024-09-14T11:56:18.337741+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.776564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'314","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.550171+0000","last_change":"2024-09-14T10:56:39.685637+0000","last_active":"2024-09-14T11:58:37.550171+0000","last_peered":"2024-09-14T11:58:37.550171+0000","last_clean":"2024-09-14T11:58:37.550171+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:37.550171+0000","last_undegraded":"2024-09-14T11:58:37.550171+0000","last_fullsized":"2024-09-14T11:58:37.550171+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:42.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5247989,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":616,"num_read_kb":35324,"num_write":1042,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'269","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.568879+0000","last_change":"2024-09-14T10:56:39.685937+0000","last_active":"2024-09-14T11:58:37.568879+0000","last_peered":"2024-09-14T11:58:37.568879+0000","last_clean":"2024-09-14T11:58:37.568879+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:37.568879+0000","last_undegraded":"2024-09-14T11:58:37.568879+0000","last_fullsized":"2024-09-14T11:58:37.568879+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.470574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7512937,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":468,"num_read_kb":8144,"num_write":937,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'848","reported_seq":2539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.311836+0000","last_change":"2024-09-14T10:56:41.697673+0000","last_active":"2024-09-14T11:56:49.311836+0000","last_peered":"2024-09-14T11:56:49.311836+0000","last_clean":"2024-09-14T11:56:49.311836+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:56:49.311836+0000","last_undegraded":"2024-09-14T11:56:49.311836+0000","last_fullsized":"2024-09-14T11:56:49.311836+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:15.211850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'361","reported_seq":1127,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.392872+0000","last_change":"2024-09-14T10:56:39.678521+0000","last_active":"2024-09-14T11:58:37.392872+0000","last_peered":"2024-09-14T11:58:37.392872+0000","last_clean":"2024-09-14T11:58:37.392872+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:37.392872+0000","last_undegraded":"2024-09-14T11:58:37.392872+0000","last_fullsized":"2024-09-14T11:58:37.392872+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:30.975047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10384611,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":982,"num_read_kb":40288,"num_write":1276,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'389","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:04.142380+0000","last_change":"2024-09-14T10:56:41.693372+0000","last_active":"2024-09-14T11:56:04.142380+0000","last_peered":"2024-09-14T11:56:04.142380+0000","last_clean":"2024-09-14T11:56:04.142380+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:56:04.142380+0000","last_undegraded":"2024-09-14T11:56:04.142380+0000","last_fullsized":"2024-09-14T11:56:04.142380+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:08.940223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1898,"ondisk_log_size":1898,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":686,"ondisk_log_size":686,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1891177,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18358,"num_read_kb":36947,"num_write":15464,"num_write_kb":11997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2150400,"data_stored":1725828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2220,"ondisk_log_size":2220,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3597,"ondisk_log_size":3597,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":383898518,"num_objects":2727,"num_object_clones":0,"num_object_copies":10908,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2727,"num_whiteouts":0,"num_read":42151,"num_read_kb":1932066,"num_write":71184,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":504643584,"data_stored":504643584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4128,"ondisk_log_size":4128,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":37809435,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":152,"num_read_kb":187491,"num_write":172,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":74571776,"data_stored":74562102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":25166696,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":178270,"num_write":182,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51376128,"data_stored":51369680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510194,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":318456,"kb_used_data":38572,"kb_used_omap":1,"kb_used_meta":279678,"kb_avail":94053384,"statfs":{"total":96636764160,"available":96310665216,"internally_reserved":0,"allocated":39497728,"data_stored":37549429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":286390726},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510191,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177584,"kb_used_data":70000,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94194256,"statfs":{"total":96636764160,"available":96454918144,"internally_reserved":0,"allocated":71680000,"data_stored":69749394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542893,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":421844,"kb_used_data":111576,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":93949996,"statfs":{"total":96636764160,"available":96204795904,"internally_reserved":0,"allocated":114253824,"data_stored":112204578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":317651402},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542896,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253824,"kb_used_data":96180,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94118016,"statfs":{"total":96636764160,"available":96376848384,"internally_reserved":0,"allocated":98488320,"data_stored":96444521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542894,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":402692,"kb_used_data":118728,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":93969148,"statfs":{"total":96636764160,"available":96224407552,"internally_reserved":0,"allocated":121577472,"data_stored":119566800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":290650567},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542897,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":208852,"kb_used_data":105420,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94162988,"statfs":{"total":96636764160,"available":96422899712,"internally_reserved":0,"allocated":107950080,"data_stored":106022468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542895,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285796,"kb_used_data":101872,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94086044,"statfs":{"total":96636764160,"available":96344109056,"internally_reserved":0,"allocated":104316928,"data_stored":102342096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542894,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":390920,"kb_used_data":116788,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93980920,"statfs":{"total":96636764160,"available":96236462080,"internally_reserved":0,"allocated":119590912,"data_stored":117572619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81403904,"data_stored":81403904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65474560,"data_stored":65474560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":46292992,"data_stored":46292992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":78364672,"data_stored":78364672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35192832,"data_stored":35192832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":80044032,"data_stored":80044032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34148352,"data_stored":34148352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":83722240,"data_stored":83722240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":222118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":274432,"data_stored":225098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":36555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":319549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":40146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":487424,"data_stored":405241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":100122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":376999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17817600,"data_stored":17817600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7344128,"data_stored":7344128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8380416,"data_stored":8380416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5255168,"data_stored":5251944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4190208,"data_stored":4190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4190208,"data_stored":4190208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4198400,"data_stored":4195176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10493952,"data_stored":10493069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7335936,"data_stored":7335936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21032960,"data_stored":21028123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1105920,"data_stored":1101966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9433088,"data_stored":9433088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14688256,"data_stored":14688256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:40.477 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:58:40.816 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:58:40.817 INFO:teuthology.orchestra.run.smithi029.stdout:{"epoch":263,"fsid":"e989b7a3-862f-4ff0-8d06-d31959c32218","created":"2024-09-14T10:56:10.174491+0000","modified":"2024-09-14T11:32:12.417888+0000","last_up_change":"2024-09-14T10:56:22.575106+0000","last_in_change":"2024-09-14T10:56:12.719139+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:56:22.422947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:56:28.667570+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:56:37.647018+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:56:40.013473+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:56:41.864059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:56:43.755568+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:56:45.724599+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:56:47.789878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:12:37.678825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"252","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:15:20.448942+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"255","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:15:24.118917+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"258","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:32:10.348117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69016441-5c87-42ed-b731-a9248b80f866","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6809","nonce":1395949130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6810","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6811","nonce":1395949130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6814","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6815","nonce":1395949130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":1395949130},{"type":"v1","addr":"172.21.15.29:6813","nonce":1395949130}]},"public_addr":"172.21.15.29:6809/1395949130","cluster_addr":"172.21.15.29:6811/1395949130","heartbeat_back_addr":"172.21.15.29:6815/1395949130","heartbeat_front_addr":"172.21.15.29:6813/1395949130","state":["exists","up"]},{"osd":1,"uuid":"99dd9457-a79a-41d3-9825-68fcae988978","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6801","nonce":277470273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6802","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6803","nonce":277470273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6806","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6807","nonce":277470273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":277470273},{"type":"v1","addr":"172.21.15.29:6805","nonce":277470273}]},"public_addr":"172.21.15.29:6801/277470273","cluster_addr":"172.21.15.29:6803/277470273","heartbeat_back_addr":"172.21.15.29:6807/277470273","heartbeat_front_addr":"172.21.15.29:6805/277470273","state":["exists","up"]},{"osd":2,"uuid":"9b83928e-8f2b-4f39-9bd8-6a365f21cb75","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6825","nonce":2902667139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6827","nonce":2902667139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6831","nonce":2902667139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":2902667139},{"type":"v1","addr":"172.21.15.29:6829","nonce":2902667139}]},"public_addr":"172.21.15.29:6825/2902667139","cluster_addr":"172.21.15.29:6827/2902667139","heartbeat_back_addr":"172.21.15.29:6831/2902667139","heartbeat_front_addr":"172.21.15.29:6829/2902667139","state":["exists","up"]},{"osd":3,"uuid":"fa187967-d17c-4f9b-8d7c-31a1ab7b1f70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6817","nonce":4274424687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6819","nonce":4274424687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6823","nonce":4274424687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":4274424687},{"type":"v1","addr":"172.21.15.29:6821","nonce":4274424687}]},"public_addr":"172.21.15.29:6817/4274424687","cluster_addr":"172.21.15.29:6819/4274424687","heartbeat_back_addr":"172.21.15.29:6823/4274424687","heartbeat_front_addr":"172.21.15.29:6821/4274424687","state":["exists","up"]},{"osd":4,"uuid":"14dec141-026f-4ab3-8ff4-d95380b5c43c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6825","nonce":2654257519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6827","nonce":2654257519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6831","nonce":2654257519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2654257519},{"type":"v1","addr":"172.21.15.73:6829","nonce":2654257519}]},"public_addr":"172.21.15.73:6825/2654257519","cluster_addr":"172.21.15.73:6827/2654257519","heartbeat_back_addr":"172.21.15.73:6831/2654257519","heartbeat_front_addr":"172.21.15.73:6829/2654257519","state":["exists","up"]},{"osd":5,"uuid":"6e41ff57-9f1b-467b-bb4d-14011ba77ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6817","nonce":3705727448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6819","nonce":3705727448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6823","nonce":3705727448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3705727448},{"type":"v1","addr":"172.21.15.73:6821","nonce":3705727448}]},"public_addr":"172.21.15.73:6817/3705727448","cluster_addr":"172.21.15.73:6819/3705727448","heartbeat_back_addr":"172.21.15.73:6823/3705727448","heartbeat_front_addr":"172.21.15.73:6821/3705727448","state":["exists","up"]},{"osd":6,"uuid":"e5a5965b-d805-4a69-b2fe-dc96dfb37997","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6809","nonce":1291450503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6811","nonce":1291450503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6815","nonce":1291450503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1291450503},{"type":"v1","addr":"172.21.15.73:6813","nonce":1291450503}]},"public_addr":"172.21.15.73:6809/1291450503","cluster_addr":"172.21.15.73:6811/1291450503","heartbeat_back_addr":"172.21.15.73:6815/1291450503","heartbeat_front_addr":"172.21.15.73:6813/1291450503","state":["exists","up"]},{"osd":7,"uuid":"a31cc6f9-8715-4b42-916c-66a956178c8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":261,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6801","nonce":3037189412}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6803","nonce":3037189412}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6807","nonce":3037189412}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3037189412},{"type":"v1","addr":"172.21.15.73:6805","nonce":3037189412}]},"public_addr":"172.21.15.73:6801/3037189412","cluster_addr":"172.21.15.73:6803/3037189412","heartbeat_back_addr":"172.21.15.73:6807/3037189412","heartbeat_front_addr":"172.21.15.73:6805/3037189412","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.038491+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.794972+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.227653+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.715192+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.810378+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.282202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:19.436323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:56:18.587160+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":7,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1b","mappings":[{"from":4,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":3},{"from":4,"to":1},{"from":0,"to":2}]},{"pgid":"3.2b","mappings":[{"from":7,"to":2}]},{"pgid":"3.2e","mappings":[{"from":6,"to":3}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"4.2a","mappings":[{"from":1,"to":2}]},{"pgid":"67.15","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:58:41.830 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:58:41.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:41.989 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:41.989 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:41.989 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:42.000 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:58:42.313 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:58:42.327 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:58:42.327 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:42.469 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:42.469 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:42.469 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:42.480 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:58:42.794 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:58:42.808 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:58:42.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:42.950 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:42.950 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:42.950 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:42.961 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:58:43.276 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:58:43.338 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:58:43.338 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:43.479 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:43.480 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:43.480 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:43.490 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:58:43.808 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:58:43.821 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:58:43.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:43.964 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:43.964 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:43.964 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:43.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:58:44.291 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:58:44.305 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:58:44.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:44.447 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:44.447 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:44.447 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:44.458 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:58:44.774 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:58:44.788 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:58:44.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:44.930 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:44.930 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:44.930 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:44.941 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:58:45.270 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:58:45.284 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:58:45.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi029.stdout:{ 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi029.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi029.stdout:} 2024-09-14T11:58:45.438 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:58:45.767 INFO:teuthology.orchestra.run.smithi029.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:58:45.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:58:46.118 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:58:46.130 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:58:46.132 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2127,"stamp":"2024-09-14T11:58:45.894824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45414219,"num_objects":743,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":312784,"num_read_kb":2565821,"num_write":166013,"num_write_kb":2614752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13035,"ondisk_log_size":13035,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1823696,"kb_used_data":92112,"kb_used_omap":12,"kb_used_meta":1730483,"kb_avail":753151024,"statfs":{"total":773094113280,"available":771226648576,"internally_reserved":0,"allocated":94322688,"data_stored":78604974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1772015152},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-710467120,"num_objects":-4205,"num_object_clones":0,"num_object_copies":-16708,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4205,"num_whiteouts":0,"num_read":4693,"num_read_kb":4220,"num_write":4456,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006300"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.574819+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:57:57.574819+0000","last_peered":"2024-09-14T11:57:57.574819+0000","last_clean":"2024-09-14T11:57:57.574819+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:57:57.574819+0000","last_undegraded":"2024-09-14T11:57:57.574819+0000","last_fullsized":"2024-09-14T11:57:57.574819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13318,"num_write":14,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.732014+0000","last_change":"2024-09-14T11:32:11.437735+0000","last_active":"2024-09-14T11:54:42.732014+0000","last_peered":"2024-09-14T11:54:42.732014+0000","last_clean":"2024-09-14T11:54:42.732014+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:54:42.732014+0000","last_undegraded":"2024-09-14T11:54:42.732014+0000","last_fullsized":"2024-09-14T11:54:42.732014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:47.395141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.650977+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:58:36.650977+0000","last_peered":"2024-09-14T11:58:36.650977+0000","last_clean":"2024-09-14T11:58:36.650977+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:58:36.650977+0000","last_undegraded":"2024-09-14T11:58:36.650977+0000","last_fullsized":"2024-09-14T11:58:36.650977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.449688+0000","last_change":"2024-09-14T11:15:22.382182+0000","last_active":"2024-09-14T11:57:52.449688+0000","last_peered":"2024-09-14T11:57:52.449688+0000","last_clean":"2024-09-14T11:57:52.449688+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:57:52.449688+0000","last_undegraded":"2024-09-14T11:57:52.449688+0000","last_fullsized":"2024-09-14T11:57:52.449688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:17.002880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.732724+0000","last_change":"2024-09-14T11:12:39.149946+0000","last_active":"2024-09-14T11:54:47.732724+0000","last_peered":"2024-09-14T11:54:47.732724+0000","last_clean":"2024-09-14T11:54:47.732724+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:54:47.732724+0000","last_undegraded":"2024-09-14T11:54:47.732724+0000","last_fullsized":"2024-09-14T11:54:47.732724+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:07.883423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:58.660125+0000","last_change":"2024-09-14T11:32:11.434861+0000","last_active":"2024-09-14T11:53:58.660125+0000","last_peered":"2024-09-14T11:53:58.660125+0000","last_clean":"2024-09-14T11:53:58.660125+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:58.660125+0000","last_undegraded":"2024-09-14T11:53:58.660125+0000","last_fullsized":"2024-09-14T11:53:58.660125+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:31.993353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655710+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:55:02.655710+0000","last_peered":"2024-09-14T11:55:02.655710+0000","last_clean":"2024-09-14T11:55:02.655710+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:55:02.655710+0000","last_undegraded":"2024-09-14T11:55:02.655710+0000","last_fullsized":"2024-09-14T11:55:02.655710+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:42.694530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738922+0000","last_change":"2024-09-14T11:15:22.378824+0000","last_active":"2024-09-14T11:55:27.738922+0000","last_peered":"2024-09-14T11:55:27.738922+0000","last_clean":"2024-09-14T11:55:27.738922+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:55:27.738922+0000","last_undegraded":"2024-09-14T11:55:27.738922+0000","last_fullsized":"2024-09-14T11:55:27.738922+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647590+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:53:57.647590+0000","last_peered":"2024-09-14T11:53:57.647590+0000","last_clean":"2024-09-14T11:53:57.647590+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:53:57.647590+0000","last_undegraded":"2024-09-14T11:53:57.647590+0000","last_fullsized":"2024-09-14T11:53:57.647590+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:18.964434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.987782+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:58:36.987782+0000","last_peered":"2024-09-14T11:58:36.987782+0000","last_clean":"2024-09-14T11:58:36.987782+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:58:36.987782+0000","last_undegraded":"2024-09-14T11:58:36.987782+0000","last_fullsized":"2024-09-14T11:58:36.987782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615750+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:58:37.615750+0000","last_peered":"2024-09-14T11:58:37.615750+0000","last_clean":"2024-09-14T11:58:37.615750+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:58:37.615750+0000","last_undegraded":"2024-09-14T11:58:37.615750+0000","last_fullsized":"2024-09-14T11:58:37.615750+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541604+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:54:17.541604+0000","last_peered":"2024-09-14T11:54:17.541604+0000","last_clean":"2024-09-14T11:54:17.541604+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:54:17.541604+0000","last_undegraded":"2024-09-14T11:54:17.541604+0000","last_fullsized":"2024-09-14T11:54:17.541604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.758307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.647995+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:54:02.647995+0000","last_peered":"2024-09-14T11:54:02.647995+0000","last_clean":"2024-09-14T11:54:02.647995+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:54:02.647995+0000","last_undegraded":"2024-09-14T11:54:02.647995+0000","last_fullsized":"2024-09-14T11:54:02.647995+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:50.355968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535330+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:55:07.535330+0000","last_peered":"2024-09-14T11:55:07.535330+0000","last_clean":"2024-09-14T11:55:07.535330+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:55:07.535330+0000","last_undegraded":"2024-09-14T11:55:07.535330+0000","last_fullsized":"2024-09-14T11:55:07.535330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:34.726917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.700301+0000","last_change":"2024-09-14T11:15:25.395023+0000","last_active":"2024-09-14T11:58:37.700301+0000","last_peered":"2024-09-14T11:58:37.700301+0000","last_clean":"2024-09-14T11:58:37.700301+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:58:37.700301+0000","last_undegraded":"2024-09-14T11:58:37.700301+0000","last_fullsized":"2024-09-14T11:58:37.700301+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:00.482510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10232,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.440709+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:56:43.440709+0000","last_peered":"2024-09-14T11:56:43.440709+0000","last_clean":"2024-09-14T11:56:43.440709+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:56:43.440709+0000","last_undegraded":"2024-09-14T11:56:43.440709+0000","last_fullsized":"2024-09-14T11:56:43.440709+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.328393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670510+0000","last_change":"2024-09-14T11:12:39.152199+0000","last_active":"2024-09-14T11:55:08.670510+0000","last_peered":"2024-09-14T11:55:08.670510+0000","last_clean":"2024-09-14T11:55:08.670510+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:55:08.670510+0000","last_undegraded":"2024-09-14T11:55:08.670510+0000","last_fullsized":"2024-09-14T11:55:08.670510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:33.862160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.673548+0000","last_change":"2024-09-14T11:15:25.385836+0000","last_active":"2024-09-14T11:55:28.673548+0000","last_peered":"2024-09-14T11:55:28.673548+0000","last_clean":"2024-09-14T11:55:28.673548+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:55:28.673548+0000","last_undegraded":"2024-09-14T11:55:28.673548+0000","last_fullsized":"2024-09-14T11:55:28.673548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:47.787237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.835728+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:58:36.835728+0000","last_peered":"2024-09-14T11:58:36.835728+0000","last_clean":"2024-09-14T11:58:36.835728+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:58:36.835728+0000","last_undegraded":"2024-09-14T11:58:36.835728+0000","last_fullsized":"2024-09-14T11:58:36.835728+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:52.646678+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:53:52.646678+0000","last_peered":"2024-09-14T11:53:52.646678+0000","last_clean":"2024-09-14T11:53:52.646678+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:53:52.646678+0000","last_undegraded":"2024-09-14T11:53:52.646678+0000","last_fullsized":"2024-09-14T11:53:52.646678+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:27.384797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.453375+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:57:57.453375+0000","last_peered":"2024-09-14T11:57:57.453375+0000","last_clean":"2024-09-14T11:57:57.453375+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:57:57.453375+0000","last_undegraded":"2024-09-14T11:57:57.453375+0000","last_fullsized":"2024-09-14T11:57:57.453375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.543032+0000","last_change":"2024-09-14T11:12:39.148861+0000","last_active":"2024-09-14T11:56:12.543032+0000","last_peered":"2024-09-14T11:56:12.543032+0000","last_clean":"2024-09-14T11:56:12.543032+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:56:12.543032+0000","last_undegraded":"2024-09-14T11:56:12.543032+0000","last_fullsized":"2024-09-14T11:56:12.543032+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:48.885213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.538794+0000","last_change":"2024-09-14T11:32:11.441324+0000","last_active":"2024-09-14T11:55:32.538794+0000","last_peered":"2024-09-14T11:55:32.538794+0000","last_clean":"2024-09-14T11:55:32.538794+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:55:32.538794+0000","last_undegraded":"2024-09-14T11:55:32.538794+0000","last_fullsized":"2024-09-14T11:55:32.538794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:40.912189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.700036+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:58:37.700036+0000","last_peered":"2024-09-14T11:58:37.700036+0000","last_clean":"2024-09-14T11:58:37.700036+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:58:37.700036+0000","last_undegraded":"2024-09-14T11:58:37.700036+0000","last_fullsized":"2024-09-14T11:58:37.700036+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.739392+0000","last_change":"2024-09-14T11:32:11.425898+0000","last_active":"2024-09-14T11:55:32.739392+0000","last_peered":"2024-09-14T11:55:32.739392+0000","last_clean":"2024-09-14T11:55:32.739392+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:55:32.739392+0000","last_undegraded":"2024-09-14T11:55:32.739392+0000","last_fullsized":"2024-09-14T11:55:32.739392+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:44.908579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:02.661902+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:54:02.661902+0000","last_peered":"2024-09-14T11:54:02.661902+0000","last_clean":"2024-09-14T11:54:02.661902+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:54:02.661902+0000","last_undegraded":"2024-09-14T11:54:02.661902+0000","last_fullsized":"2024-09-14T11:54:02.661902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:58:37.068240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.442281+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:56:32.442281+0000","last_peered":"2024-09-14T11:56:32.442281+0000","last_clean":"2024-09-14T11:56:32.442281+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:56:32.442281+0000","last_undegraded":"2024-09-14T11:56:32.442281+0000","last_fullsized":"2024-09-14T11:56:32.442281+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:25.067236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615637+0000","last_change":"2024-09-14T11:15:22.364016+0000","last_active":"2024-09-14T11:58:37.615637+0000","last_peered":"2024-09-14T11:58:37.615637+0000","last_clean":"2024-09-14T11:58:37.615637+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:58:37.615637+0000","last_undegraded":"2024-09-14T11:58:37.615637+0000","last_fullsized":"2024-09-14T11:58:37.615637+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:25.332714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.743509+0000","last_change":"2024-09-14T11:12:39.148536+0000","last_active":"2024-09-14T11:56:12.743509+0000","last_peered":"2024-09-14T11:56:12.743509+0000","last_clean":"2024-09-14T11:56:12.743509+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:56:12.743509+0000","last_undegraded":"2024-09-14T11:56:12.743509+0000","last_fullsized":"2024-09-14T11:56:12.743509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:22.270515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:33.439116+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:56:33.439116+0000","last_peered":"2024-09-14T11:56:33.439116+0000","last_clean":"2024-09-14T11:56:33.439116+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:56:33.439116+0000","last_undegraded":"2024-09-14T11:56:33.439116+0000","last_fullsized":"2024-09-14T11:56:33.439116+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:54.069010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666164+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:56:27.666164+0000","last_peered":"2024-09-14T11:56:27.666164+0000","last_clean":"2024-09-14T11:56:27.666164+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:56:27.666164+0000","last_undegraded":"2024-09-14T11:56:27.666164+0000","last_fullsized":"2024-09-14T11:56:27.666164+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:57.960689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647680+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:53:57.647680+0000","last_peered":"2024-09-14T11:53:57.647680+0000","last_clean":"2024-09-14T11:53:57.647680+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:53:57.647680+0000","last_undegraded":"2024-09-14T11:53:57.647680+0000","last_fullsized":"2024-09-14T11:53:57.647680+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:18.749825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.651118+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:58:36.651118+0000","last_peered":"2024-09-14T11:58:36.651118+0000","last_clean":"2024-09-14T11:58:36.651118+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:58:36.651118+0000","last_undegraded":"2024-09-14T11:58:36.651118+0000","last_fullsized":"2024-09-14T11:58:36.651118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447296+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:57:23.447296+0000","last_peered":"2024-09-14T11:57:23.447296+0000","last_clean":"2024-09-14T11:57:23.447296+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:57:23.447296+0000","last_undegraded":"2024-09-14T11:57:23.447296+0000","last_fullsized":"2024-09-14T11:57:23.447296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668344+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:54:42.668344+0000","last_peered":"2024-09-14T11:54:42.668344+0000","last_clean":"2024-09-14T11:54:42.668344+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:54:42.668344+0000","last_undegraded":"2024-09-14T11:54:42.668344+0000","last_fullsized":"2024-09-14T11:54:42.668344+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647472+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:53:57.647472+0000","last_peered":"2024-09-14T11:53:57.647472+0000","last_clean":"2024-09-14T11:53:57.647472+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:53:57.647472+0000","last_undegraded":"2024-09-14T11:53:57.647472+0000","last_fullsized":"2024-09-14T11:53:57.647472+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:22.717875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446265+0000","last_change":"2024-09-14T11:15:25.391047+0000","last_active":"2024-09-14T11:57:27.446265+0000","last_peered":"2024-09-14T11:57:27.446265+0000","last_clean":"2024-09-14T11:57:27.446265+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:57:27.446265+0000","last_undegraded":"2024-09-14T11:57:27.446265+0000","last_fullsized":"2024-09-14T11:57:27.446265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:36.099082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652801+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:54:42.652801+0000","last_peered":"2024-09-14T11:54:42.652801+0000","last_clean":"2024-09-14T11:54:42.652801+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:54:42.652801+0000","last_undegraded":"2024-09-14T11:54:42.652801+0000","last_fullsized":"2024-09-14T11:54:42.652801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:54.823817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669689+0000","last_change":"2024-09-14T11:15:22.380265+0000","last_active":"2024-09-14T11:55:03.669689+0000","last_peered":"2024-09-14T11:55:03.669689+0000","last_clean":"2024-09-14T11:55:03.669689+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:55:03.669689+0000","last_undegraded":"2024-09-14T11:55:03.669689+0000","last_fullsized":"2024-09-14T11:55:03.669689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.546224+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:54:38.546224+0000","last_peered":"2024-09-14T11:54:38.546224+0000","last_clean":"2024-09-14T11:54:38.546224+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:54:38.546224+0000","last_undegraded":"2024-09-14T11:54:38.546224+0000","last_fullsized":"2024-09-14T11:54:38.546224+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:53:57.647657+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:53:57.647657+0000","last_peered":"2024-09-14T11:53:57.647657+0000","last_clean":"2024-09-14T11:53:57.647657+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:53:57.647657+0000","last_undegraded":"2024-09-14T11:53:57.647657+0000","last_fullsized":"2024-09-14T11:53:57.647657+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:43.844584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670462+0000","last_change":"2024-09-14T11:15:25.394352+0000","last_active":"2024-09-14T11:55:08.670462+0000","last_peered":"2024-09-14T11:55:08.670462+0000","last_clean":"2024-09-14T11:55:08.670462+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:55:08.670462+0000","last_undegraded":"2024-09-14T11:55:08.670462+0000","last_fullsized":"2024-09-14T11:55:08.670462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:35.832475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653140+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:54:42.653140+0000","last_peered":"2024-09-14T11:54:42.653140+0000","last_clean":"2024-09-14T11:54:42.653140+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:54:42.653140+0000","last_undegraded":"2024-09-14T11:54:42.653140+0000","last_fullsized":"2024-09-14T11:54:42.653140+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:29.954707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.742985+0000","last_change":"2024-09-14T11:32:11.425357+0000","last_active":"2024-09-14T11:56:07.742985+0000","last_peered":"2024-09-14T11:56:07.742985+0000","last_clean":"2024-09-14T11:56:07.742985+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:56:07.742985+0000","last_undegraded":"2024-09-14T11:56:07.742985+0000","last_fullsized":"2024-09-14T11:56:07.742985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:04.671224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.447013+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:58:07.447013+0000","last_peered":"2024-09-14T11:58:07.447013+0000","last_clean":"2024-09-14T11:58:07.447013+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:58:07.447013+0000","last_undegraded":"2024-09-14T11:58:07.447013+0000","last_fullsized":"2024-09-14T11:58:07.447013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3079,"num_write":6,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668319+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:54:42.668319+0000","last_peered":"2024-09-14T11:54:42.668319+0000","last_clean":"2024-09-14T11:54:42.668319+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:54:42.668319+0000","last_undegraded":"2024-09-14T11:54:42.668319+0000","last_fullsized":"2024-09-14T11:54:42.668319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:51.143671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:12.455130+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:58:12.455130+0000","last_peered":"2024-09-14T11:58:12.455130+0000","last_clean":"2024-09-14T11:58:12.455130+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:58:12.455130+0000","last_undegraded":"2024-09-14T11:58:12.455130+0000","last_fullsized":"2024-09-14T11:58:12.455130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.741529+0000","last_change":"2024-09-14T11:15:22.370925+0000","last_active":"2024-09-14T11:55:52.741529+0000","last_peered":"2024-09-14T11:55:52.741529+0000","last_clean":"2024-09-14T11:55:52.741529+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:55:52.741529+0000","last_undegraded":"2024-09-14T11:55:52.741529+0000","last_fullsized":"2024-09-14T11:55:52.741529+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.657676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.678742+0000","last_change":"2024-09-14T11:32:11.435885+0000","last_active":"2024-09-14T11:56:03.678742+0000","last_peered":"2024-09-14T11:56:03.678742+0000","last_clean":"2024-09-14T11:56:03.678742+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:56:03.678742+0000","last_undegraded":"2024-09-14T11:56:03.678742+0000","last_fullsized":"2024-09-14T11:56:03.678742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:04.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:27.454554+0000","last_change":"2024-09-14T11:15:25.389833+0000","last_active":"2024-09-14T11:58:27.454554+0000","last_peered":"2024-09-14T11:58:27.454554+0000","last_clean":"2024-09-14T11:58:27.454554+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:58:27.454554+0000","last_undegraded":"2024-09-14T11:58:27.454554+0000","last_fullsized":"2024-09-14T11:58:27.454554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.345624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672755+0000","last_change":"2024-09-14T11:12:39.147355+0000","last_active":"2024-09-14T11:55:23.672755+0000","last_peered":"2024-09-14T11:55:23.672755+0000","last_clean":"2024-09-14T11:55:23.672755+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:55:23.672755+0000","last_undegraded":"2024-09-14T11:55:23.672755+0000","last_fullsized":"2024-09-14T11:55:23.672755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:13.956283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.542021+0000","last_change":"2024-09-14T11:15:22.379118+0000","last_active":"2024-09-14T11:56:02.542021+0000","last_peered":"2024-09-14T11:56:02.542021+0000","last_clean":"2024-09-14T11:56:02.542021+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:56:02.542021+0000","last_undegraded":"2024-09-14T11:56:02.542021+0000","last_fullsized":"2024-09-14T11:56:02.542021+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.600963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738869+0000","last_change":"2024-09-14T11:12:39.149430+0000","last_active":"2024-09-14T11:55:27.738869+0000","last_peered":"2024-09-14T11:55:27.738869+0000","last_clean":"2024-09-14T11:55:27.738869+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:55:27.738869+0000","last_undegraded":"2024-09-14T11:55:27.738869+0000","last_fullsized":"2024-09-14T11:55:27.738869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653286+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:54:42.653286+0000","last_peered":"2024-09-14T11:54:42.653286+0000","last_clean":"2024-09-14T11:54:42.653286+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:54:42.653286+0000","last_undegraded":"2024-09-14T11:54:42.653286+0000","last_fullsized":"2024-09-14T11:54:42.653286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:15.841468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.943709+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:58:38.943709+0000","last_peered":"2024-09-14T11:58:38.943709+0000","last_clean":"2024-09-14T11:58:38.943709+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:58:38.943709+0000","last_undegraded":"2024-09-14T11:58:38.943709+0000","last_fullsized":"2024-09-14T11:58:38.943709+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:36.393782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2106,"num_write":6,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.616499+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:58:37.616499+0000","last_peered":"2024-09-14T11:58:37.616499+0000","last_clean":"2024-09-14T11:58:37.616499+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:58:37.616499+0000","last_undegraded":"2024-09-14T11:58:37.616499+0000","last_fullsized":"2024-09-14T11:58:37.616499+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668478+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:54:42.668478+0000","last_peered":"2024-09-14T11:54:42.668478+0000","last_clean":"2024-09-14T11:54:42.668478+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:54:42.668478+0000","last_undegraded":"2024-09-14T11:54:42.668478+0000","last_fullsized":"2024-09-14T11:54:42.668478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.627281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'12","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432860+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:56:37.432860+0000","last_peered":"2024-09-14T11:56:37.432860+0000","last_clean":"2024-09-14T11:56:37.432860+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:56:37.432860+0000","last_undegraded":"2024-09-14T11:56:37.432860+0000","last_fullsized":"2024-09-14T11:56:37.432860+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:51.725661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9238,"num_write":22,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.020902+0000","last_change":"2024-09-14T11:15:22.377316+0000","last_active":"2024-09-14T11:58:38.020902+0000","last_peered":"2024-09-14T11:58:38.020902+0000","last_clean":"2024-09-14T11:58:38.020902+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:58:38.020902+0000","last_undegraded":"2024-09-14T11:58:38.020902+0000","last_fullsized":"2024-09-14T11:58:38.020902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:25.594786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668371+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:54:42.668371+0000","last_peered":"2024-09-14T11:54:42.668371+0000","last_clean":"2024-09-14T11:54:42.668371+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:54:42.668371+0000","last_undegraded":"2024-09-14T11:54:42.668371+0000","last_fullsized":"2024-09-14T11:54:42.668371+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:37.210143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.439492+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:56:42.439492+0000","last_peered":"2024-09-14T11:56:42.439492+0000","last_clean":"2024-09-14T11:56:42.439492+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:56:42.439492+0000","last_undegraded":"2024-09-14T11:56:42.439492+0000","last_fullsized":"2024-09-14T11:56:42.439492+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:47.870518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652877+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:54:42.652877+0000","last_peered":"2024-09-14T11:54:42.652877+0000","last_clean":"2024-09-14T11:54:42.652877+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:54:42.652877+0000","last_undegraded":"2024-09-14T11:54:42.652877+0000","last_fullsized":"2024-09-14T11:54:42.652877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:12.740126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.937667+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:58:37.937667+0000","last_peered":"2024-09-14T11:58:37.937667+0000","last_clean":"2024-09-14T11:58:37.937667+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:58:37.937667+0000","last_undegraded":"2024-09-14T11:58:37.937667+0000","last_fullsized":"2024-09-14T11:58:37.937667+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.475766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9236,"num_write":14,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.454028+0000","last_change":"2024-09-14T11:15:22.380025+0000","last_active":"2024-09-14T11:58:08.454028+0000","last_peered":"2024-09-14T11:58:08.454028+0000","last_clean":"2024-09-14T11:58:08.454028+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:58:08.454028+0000","last_undegraded":"2024-09-14T11:58:08.454028+0000","last_fullsized":"2024-09-14T11:58:08.454028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:46.350891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678034+0000","last_change":"2024-09-14T11:12:39.148220+0000","last_active":"2024-09-14T11:55:58.678034+0000","last_peered":"2024-09-14T11:55:58.678034+0000","last_clean":"2024-09-14T11:55:58.678034+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:55:58.678034+0000","last_undegraded":"2024-09-14T11:55:58.678034+0000","last_fullsized":"2024-09-14T11:55:58.678034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:39.515999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672229+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:55:07.672229+0000","last_peered":"2024-09-14T11:55:07.672229+0000","last_clean":"2024-09-14T11:55:07.672229+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:55:07.672229+0000","last_undegraded":"2024-09-14T11:55:07.672229+0000","last_fullsized":"2024-09-14T11:55:07.672229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:49.122371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656337+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:55:07.656337+0000","last_peered":"2024-09-14T11:55:07.656337+0000","last_clean":"2024-09-14T11:55:07.656337+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:55:07.656337+0000","last_undegraded":"2024-09-14T11:55:07.656337+0000","last_fullsized":"2024-09-14T11:55:07.656337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436876+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:57:02.436876+0000","last_peered":"2024-09-14T11:57:02.436876+0000","last_clean":"2024-09-14T11:57:02.436876+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:57:02.436876+0000","last_undegraded":"2024-09-14T11:57:02.436876+0000","last_fullsized":"2024-09-14T11:57:02.436876+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:13.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663286+0000","last_change":"2024-09-14T11:12:39.156458+0000","last_active":"2024-09-14T11:56:02.663286+0000","last_peered":"2024-09-14T11:56:02.663286+0000","last_clean":"2024-09-14T11:56:02.663286+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:56:02.663286+0000","last_undegraded":"2024-09-14T11:56:02.663286+0000","last_fullsized":"2024-09-14T11:56:02.663286+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:31.776422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.549256+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:55:07.549256+0000","last_peered":"2024-09-14T11:55:07.549256+0000","last_clean":"2024-09-14T11:55:07.549256+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:55:07.549256+0000","last_undegraded":"2024-09-14T11:55:07.549256+0000","last_fullsized":"2024-09-14T11:55:07.549256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:29.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443164+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:57:07.443164+0000","last_peered":"2024-09-14T11:57:07.443164+0000","last_clean":"2024-09-14T11:57:07.443164+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:57:07.443164+0000","last_undegraded":"2024-09-14T11:57:07.443164+0000","last_fullsized":"2024-09-14T11:57:07.443164+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:50.686182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749827+0000","last_change":"2024-09-14T11:15:22.372158+0000","last_active":"2024-09-14T11:57:07.749827+0000","last_peered":"2024-09-14T11:57:07.749827+0000","last_clean":"2024-09-14T11:57:07.749827+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:57:07.749827+0000","last_undegraded":"2024-09-14T11:57:07.749827+0000","last_fullsized":"2024-09-14T11:57:07.749827+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.110739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678107+0000","last_change":"2024-09-14T11:12:39.150717+0000","last_active":"2024-09-14T11:55:58.678107+0000","last_peered":"2024-09-14T11:55:58.678107+0000","last_clean":"2024-09-14T11:55:58.678107+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:55:58.678107+0000","last_undegraded":"2024-09-14T11:55:58.678107+0000","last_fullsized":"2024-09-14T11:55:58.678107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:45.689240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:27.665743+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:54:27.665743+0000","last_peered":"2024-09-14T11:54:27.665743+0000","last_clean":"2024-09-14T11:54:27.665743+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:54:27.665743+0000","last_undegraded":"2024-09-14T11:54:27.665743+0000","last_fullsized":"2024-09-14T11:54:27.665743+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:26.826579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562172+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:56:32.562172+0000","last_peered":"2024-09-14T11:56:32.562172+0000","last_clean":"2024-09-14T11:56:32.562172+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:56:32.562172+0000","last_undegraded":"2024-09-14T11:56:32.562172+0000","last_fullsized":"2024-09-14T11:56:32.562172+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432976+0000","last_change":"2024-09-14T11:12:39.152381+0000","last_active":"2024-09-14T11:56:37.432976+0000","last_peered":"2024-09-14T11:56:37.432976+0000","last_clean":"2024-09-14T11:56:37.432976+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:56:37.432976+0000","last_undegraded":"2024-09-14T11:56:37.432976+0000","last_fullsized":"2024-09-14T11:56:37.432976+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:49.106166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550583+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:55:08.550583+0000","last_peered":"2024-09-14T11:55:08.550583+0000","last_clean":"2024-09-14T11:55:08.550583+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:55:08.550583+0000","last_undegraded":"2024-09-14T11:55:08.550583+0000","last_fullsized":"2024-09-14T11:55:08.550583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:30.888765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:28.544802+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:54:28.544802+0000","last_peered":"2024-09-14T11:54:28.544802+0000","last_clean":"2024-09-14T11:54:28.544802+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:54:28.544802+0000","last_undegraded":"2024-09-14T11:54:28.544802+0000","last_fullsized":"2024-09-14T11:54:28.544802+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:52:42.330595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144134+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:58:37.144134+0000","last_peered":"2024-09-14T11:58:37.144134+0000","last_clean":"2024-09-14T11:58:37.144134+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:58:37.144134+0000","last_undegraded":"2024-09-14T11:58:37.144134+0000","last_fullsized":"2024-09-14T11:58:37.144134+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.438324+0000","last_change":"2024-09-14T11:12:39.147602+0000","last_active":"2024-09-14T11:56:27.438324+0000","last_peered":"2024-09-14T11:56:27.438324+0000","last_clean":"2024-09-14T11:56:27.438324+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:56:27.438324+0000","last_undegraded":"2024-09-14T11:56:27.438324+0000","last_fullsized":"2024-09-14T11:56:27.438324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:46.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.742512+0000","last_change":"2024-09-14T11:32:11.429687+0000","last_active":"2024-09-14T11:56:02.742512+0000","last_peered":"2024-09-14T11:56:02.742512+0000","last_clean":"2024-09-14T11:56:02.742512+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:56:02.742512+0000","last_undegraded":"2024-09-14T11:56:02.742512+0000","last_fullsized":"2024-09-14T11:56:02.742512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:04.011582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.990265+0000","last_change":"2024-09-14T11:15:25.393792+0000","last_active":"2024-09-14T11:58:36.990265+0000","last_peered":"2024-09-14T11:58:36.990265+0000","last_clean":"2024-09-14T11:58:36.990265+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:58:36.990265+0000","last_undegraded":"2024-09-14T11:58:36.990265+0000","last_fullsized":"2024-09-14T11:58:36.990265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:55.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16376,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.836852+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:58:36.836852+0000","last_peered":"2024-09-14T11:58:36.836852+0000","last_clean":"2024-09-14T11:58:36.836852+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:58:36.836852+0000","last_undegraded":"2024-09-14T11:58:36.836852+0000","last_fullsized":"2024-09-14T11:58:36.836852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7164,"num_write":12,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'10","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.571869+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:57:37.571869+0000","last_peered":"2024-09-14T11:57:37.571869+0000","last_clean":"2024-09-14T11:57:37.571869+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:57:37.571869+0000","last_undegraded":"2024-09-14T11:57:37.571869+0000","last_fullsized":"2024-09-14T11:57:37.571869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12313,"num_write":20,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670674+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:54:57.670674+0000","last_peered":"2024-09-14T11:54:57.670674+0000","last_clean":"2024-09-14T11:54:57.670674+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:54:57.670674+0000","last_undegraded":"2024-09-14T11:54:57.670674+0000","last_fullsized":"2024-09-14T11:54:57.670674+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.148504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.437717+0000","last_change":"2024-09-14T11:12:39.147615+0000","last_active":"2024-09-14T11:56:23.437717+0000","last_peered":"2024-09-14T11:56:23.437717+0000","last_clean":"2024-09-14T11:56:23.437717+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:56:23.437717+0000","last_undegraded":"2024-09-14T11:56:23.437717+0000","last_fullsized":"2024-09-14T11:56:23.437717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:19.785409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656302+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:55:07.656302+0000","last_peered":"2024-09-14T11:55:07.656302+0000","last_clean":"2024-09-14T11:55:07.656302+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:55:07.656302+0000","last_undegraded":"2024-09-14T11:55:07.656302+0000","last_fullsized":"2024-09-14T11:55:07.656302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:40.123052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669707+0000","last_change":"2024-09-14T11:15:25.396627+0000","last_active":"2024-09-14T11:55:03.669707+0000","last_peered":"2024-09-14T11:55:03.669707+0000","last_clean":"2024-09-14T11:55:03.669707+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:55:03.669707+0000","last_undegraded":"2024-09-14T11:55:03.669707+0000","last_fullsized":"2024-09-14T11:55:03.669707+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:23.471334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534143+0000","last_change":"2024-09-14T11:15:22.378471+0000","last_active":"2024-09-14T11:54:57.534143+0000","last_peered":"2024-09-14T11:54:57.534143+0000","last_clean":"2024-09-14T11:54:57.534143+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:54:57.534143+0000","last_undegraded":"2024-09-14T11:54:57.534143+0000","last_fullsized":"2024-09-14T11:54:57.534143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:11.906269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681832+0000","last_change":"2024-09-14T11:12:39.142992+0000","last_active":"2024-09-14T11:56:23.681832+0000","last_peered":"2024-09-14T11:56:23.681832+0000","last_clean":"2024-09-14T11:56:23.681832+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:56:23.681832+0000","last_undegraded":"2024-09-14T11:56:23.681832+0000","last_fullsized":"2024-09-14T11:56:23.681832+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.230213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672320+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:55:07.672320+0000","last_peered":"2024-09-14T11:55:07.672320+0000","last_clean":"2024-09-14T11:55:07.672320+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:55:07.672320+0000","last_undegraded":"2024-09-14T11:55:07.672320+0000","last_fullsized":"2024-09-14T11:55:07.672320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:44.097739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549751+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:55:03.549751+0000","last_peered":"2024-09-14T11:55:03.549751+0000","last_clean":"2024-09-14T11:55:03.549751+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:55:03.549751+0000","last_undegraded":"2024-09-14T11:55:03.549751+0000","last_fullsized":"2024-09-14T11:55:03.549751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669044+0000","last_change":"2024-09-14T11:15:22.376114+0000","last_active":"2024-09-14T11:54:58.669044+0000","last_peered":"2024-09-14T11:54:58.669044+0000","last_clean":"2024-09-14T11:54:58.669044+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:54:58.669044+0000","last_undegraded":"2024-09-14T11:54:58.669044+0000","last_fullsized":"2024-09-14T11:54:58.669044+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:22.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.668992+0000","last_change":"2024-09-14T11:12:39.149756+0000","last_active":"2024-09-14T11:54:47.668992+0000","last_peered":"2024-09-14T11:54:47.668992+0000","last_clean":"2024-09-14T11:54:47.668992+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:54:47.668992+0000","last_undegraded":"2024-09-14T11:54:47.668992+0000","last_fullsized":"2024-09-14T11:54:47.668992+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:07.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'362","reported_seq":1005,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.218009+0000","last_change":"2024-09-14T10:56:39.693906+0000","last_active":"2024-09-14T11:58:39.218009+0000","last_peered":"2024-09-14T11:58:39.218009+0000","last_clean":"2024-09-14T11:58:39.218009+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:58:39.218009+0000","last_undegraded":"2024-09-14T11:58:39.218009+0000","last_fullsized":"2024-09-14T11:58:39.218009+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:28.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":9138,"num_write":1125,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'440","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.264788+0000","last_change":"2024-09-14T10:56:41.690207+0000","last_active":"2024-09-14T11:55:58.264788+0000","last_peered":"2024-09-14T11:55:58.264788+0000","last_clean":"2024-09-14T11:55:58.264788+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:55:58.264788+0000","last_undegraded":"2024-09-14T11:55:58.264788+0000","last_fullsized":"2024-09-14T11:55:58.264788+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:16.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'360","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.207081+0000","last_change":"2024-09-14T10:56:39.680660+0000","last_active":"2024-09-14T11:58:39.207081+0000","last_peered":"2024-09-14T11:58:39.207081+0000","last_clean":"2024-09-14T11:58:39.207081+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:39.207081+0000","last_undegraded":"2024-09-14T11:58:39.207081+0000","last_fullsized":"2024-09-14T11:58:39.207081+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:39.615498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7650412,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":625,"num_read_kb":47838,"num_write":1199,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'490","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460547+0000","last_change":"2024-09-14T10:56:41.699684+0000","last_active":"2024-09-14T11:56:10.460547+0000","last_peered":"2024-09-14T11:56:10.460547+0000","last_clean":"2024-09-14T11:56:10.460547+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:56:10.460547+0000","last_undegraded":"2024-09-14T11:56:10.460547+0000","last_fullsized":"2024-09-14T11:56:10.460547+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'408","reported_seq":1094,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.192653+0000","last_change":"2024-09-14T10:56:39.673016+0000","last_active":"2024-09-14T11:58:39.192653+0000","last_peered":"2024-09-14T11:58:39.192653+0000","last_clean":"2024-09-14T11:58:39.192653+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:39.192653+0000","last_undegraded":"2024-09-14T11:58:39.192653+0000","last_fullsized":"2024-09-14T11:58:39.192653+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:56.452286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":833,"num_read_kb":44180,"num_write":1273,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'371","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337410+0000","last_change":"2024-09-14T10:56:41.694979+0000","last_active":"2024-09-14T11:56:18.337410+0000","last_peered":"2024-09-14T11:56:18.337410+0000","last_clean":"2024-09-14T11:56:18.337410+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:56:18.337410+0000","last_undegraded":"2024-09-14T11:56:18.337410+0000","last_fullsized":"2024-09-14T11:56:18.337410+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:14.514694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'478","reported_seq":1163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.250875+0000","last_change":"2024-09-14T10:56:39.693767+0000","last_active":"2024-09-14T11:58:39.250875+0000","last_peered":"2024-09-14T11:58:39.250875+0000","last_clean":"2024-09-14T11:58:39.250875+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:39.250875+0000","last_undegraded":"2024-09-14T11:58:39.250875+0000","last_fullsized":"2024-09-14T11:58:39.250875+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:57.996821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730156,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":988,"num_read_kb":27790,"num_write":1317,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1224","reported_seq":2907,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266363+0000","last_change":"2024-09-14T10:56:41.698071+0000","last_active":"2024-09-14T11:55:58.266363+0000","last_peered":"2024-09-14T11:55:58.266363+0000","last_clean":"2024-09-14T11:55:58.266363+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:55:58.266363+0000","last_undegraded":"2024-09-14T11:55:58.266363+0000","last_fullsized":"2024-09-14T11:55:58.266363+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":1200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:18.150057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'356","reported_seq":956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.142189+0000","last_change":"2024-09-14T10:56:39.695001+0000","last_active":"2024-09-14T11:58:39.142189+0000","last_peered":"2024-09-14T11:58:39.142189+0000","last_clean":"2024-09-14T11:58:39.142189+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:39.142189+0000","last_undegraded":"2024-09-14T11:58:39.142189+0000","last_fullsized":"2024-09-14T11:58:39.142189+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:19.100648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":13771,"num_write":1092,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'575","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266908+0000","last_change":"2024-09-14T10:56:41.688774+0000","last_active":"2024-09-14T11:55:58.266908+0000","last_peered":"2024-09-14T11:55:58.266908+0000","last_clean":"2024-09-14T11:55:58.266908+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:55:58.266908+0000","last_undegraded":"2024-09-14T11:55:58.266908+0000","last_fullsized":"2024-09-14T11:55:58.266908+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:12.204837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'342","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.160647+0000","last_change":"2024-09-14T10:56:39.687131+0000","last_active":"2024-09-14T11:58:39.160647+0000","last_peered":"2024-09-14T11:58:39.160647+0000","last_clean":"2024-09-14T11:58:39.160647+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:39.160647+0000","last_undegraded":"2024-09-14T11:58:39.160647+0000","last_fullsized":"2024-09-14T11:58:39.160647+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:02.638600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":503,"num_read_kb":13548,"num_write":1089,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'833","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313416+0000","last_change":"2024-09-14T10:56:41.692162+0000","last_active":"2024-09-14T11:56:49.313416+0000","last_peered":"2024-09-14T11:56:49.313416+0000","last_clean":"2024-09-14T11:56:49.313416+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:56:49.313416+0000","last_undegraded":"2024-09-14T11:56:49.313416+0000","last_fullsized":"2024-09-14T11:56:49.313416+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'331","reported_seq":963,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.243021+0000","last_change":"2024-09-14T10:56:39.695403+0000","last_active":"2024-09-14T11:58:39.243021+0000","last_peered":"2024-09-14T11:58:39.243021+0000","last_clean":"2024-09-14T11:58:39.243021+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:39.243021+0000","last_undegraded":"2024-09-14T11:58:39.243021+0000","last_fullsized":"2024-09-14T11:58:39.243021+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.933894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730161,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":635,"num_read_kb":14446,"num_write":1067,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.821254+0000","last_change":"2024-09-14T10:56:41.689448+0000","last_active":"2024-09-14T11:55:44.821254+0000","last_peered":"2024-09-14T11:55:44.821254+0000","last_clean":"2024-09-14T11:55:44.821254+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:55:44.821254+0000","last_undegraded":"2024-09-14T11:55:44.821254+0000","last_fullsized":"2024-09-14T11:55:44.821254+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:26.618232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'348","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.245654+0000","last_change":"2024-09-14T10:56:39.676967+0000","last_active":"2024-09-14T11:58:39.245654+0000","last_peered":"2024-09-14T11:58:39.245654+0000","last_clean":"2024-09-14T11:58:39.245654+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:39.245654+0000","last_undegraded":"2024-09-14T11:58:39.245654+0000","last_fullsized":"2024-09-14T11:58:39.245654+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:11:55.062662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":23067,"num_write":1167,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'425","reported_seq":1872,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518743+0000","last_change":"2024-09-14T10:56:41.681136+0000","last_active":"2024-09-14T11:56:16.518743+0000","last_peered":"2024-09-14T11:56:16.518743+0000","last_clean":"2024-09-14T11:56:16.518743+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:56:16.518743+0000","last_undegraded":"2024-09-14T11:56:16.518743+0000","last_fullsized":"2024-09-14T11:56:16.518743+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:18:35.914131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'454","reported_seq":1879,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447330+0000","last_change":"2024-09-14T10:56:41.695103+0000","last_active":"2024-09-14T11:57:23.447330+0000","last_peered":"2024-09-14T11:57:23.447330+0000","last_clean":"2024-09-14T11:57:23.447330+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:57:23.447330+0000","last_undegraded":"2024-09-14T11:57:23.447330+0000","last_fullsized":"2024-09-14T11:57:23.447330+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:47.177973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'433","reported_seq":1156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.234085+0000","last_change":"2024-09-14T10:56:39.694286+0000","last_active":"2024-09-14T11:58:39.234085+0000","last_peered":"2024-09-14T11:58:39.234085+0000","last_clean":"2024-09-14T11:58:39.234085+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:39.234085+0000","last_undegraded":"2024-09-14T11:58:39.234085+0000","last_fullsized":"2024-09-14T11:58:39.234085+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:43.679086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":936,"num_read_kb":12852,"num_write":1596,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'532","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.516606+0000","last_change":"2024-09-14T10:56:41.700369+0000","last_active":"2024-09-14T11:56:16.516606+0000","last_peered":"2024-09-14T11:56:16.516606+0000","last_clean":"2024-09-14T11:56:16.516606+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:56:16.516606+0000","last_undegraded":"2024-09-14T11:56:16.516606+0000","last_fullsized":"2024-09-14T11:56:16.516606+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:19.164622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'342","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.235769+0000","last_change":"2024-09-14T10:56:39.681268+0000","last_active":"2024-09-14T11:58:39.235769+0000","last_peered":"2024-09-14T11:58:39.235769+0000","last_clean":"2024-09-14T11:58:39.235769+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:39.235769+0000","last_undegraded":"2024-09-14T11:58:39.235769+0000","last_fullsized":"2024-09-14T11:58:39.235769+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:31.116262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":13589,"num_write":1026,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'636","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910117+0000","last_change":"2024-09-14T10:56:41.684245+0000","last_active":"2024-09-14T11:56:51.910117+0000","last_peered":"2024-09-14T11:56:51.910117+0000","last_clean":"2024-09-14T11:56:51.910117+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:56:51.910117+0000","last_undegraded":"2024-09-14T11:56:51.910117+0000","last_fullsized":"2024-09-14T11:56:51.910117+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:41.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'390","reported_seq":1058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.156508+0000","last_change":"2024-09-14T10:56:39.689695+0000","last_active":"2024-09-14T11:58:39.156508+0000","last_peered":"2024-09-14T11:58:39.156508+0000","last_clean":"2024-09-14T11:58:39.156508+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:39.156508+0000","last_undegraded":"2024-09-14T11:58:39.156508+0000","last_fullsized":"2024-09-14T11:58:39.156508+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":713,"num_read_kb":72218,"num_write":1254,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1144","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:45.775492+0000","last_change":"2024-09-14T10:56:41.690350+0000","last_active":"2024-09-14T11:57:45.775492+0000","last_peered":"2024-09-14T11:57:45.775492+0000","last_clean":"2024-09-14T11:57:45.775492+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:57:45.775492+0000","last_undegraded":"2024-09-14T11:57:45.775492+0000","last_fullsized":"2024-09-14T11:57:45.775492+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":1100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:17.084325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'354","reported_seq":995,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.147815+0000","last_change":"2024-09-14T10:56:39.673331+0000","last_active":"2024-09-14T11:58:39.147815+0000","last_peered":"2024-09-14T11:58:39.147815+0000","last_clean":"2024-09-14T11:58:39.147815+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:39.147815+0000","last_undegraded":"2024-09-14T11:58:39.147815+0000","last_fullsized":"2024-09-14T11:58:39.147815+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:09.718190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":653,"num_read_kb":16353,"num_write":1203,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'434","reported_seq":2052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749815+0000","last_change":"2024-09-14T10:56:41.689989+0000","last_active":"2024-09-14T11:57:07.749815+0000","last_peered":"2024-09-14T11:57:07.749815+0000","last_clean":"2024-09-14T11:57:07.749815+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:57:07.749815+0000","last_undegraded":"2024-09-14T11:57:07.749815+0000","last_fullsized":"2024-09-14T11:57:07.749815+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:27.009017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'325","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.206786+0000","last_change":"2024-09-14T10:56:39.685439+0000","last_active":"2024-09-14T11:58:39.206786+0000","last_peered":"2024-09-14T11:58:39.206786+0000","last_clean":"2024-09-14T11:58:39.206786+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:39.206786+0000","last_undegraded":"2024-09-14T11:58:39.206786+0000","last_fullsized":"2024-09-14T11:58:39.206786+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730152,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":6224,"num_write":1046,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'757","reported_seq":2336,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.905582+0000","last_change":"2024-09-14T10:56:41.699633+0000","last_active":"2024-09-14T11:58:09.905582+0000","last_peered":"2024-09-14T11:58:09.905582+0000","last_clean":"2024-09-14T11:58:09.905582+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:58:09.905582+0000","last_undegraded":"2024-09-14T11:58:09.905582+0000","last_fullsized":"2024-09-14T11:58:09.905582+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.536330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'370","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.247957+0000","last_change":"2024-09-14T10:56:39.686616+0000","last_active":"2024-09-14T11:58:39.247957+0000","last_peered":"2024-09-14T11:58:39.247957+0000","last_clean":"2024-09-14T11:58:39.247957+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:39.247957+0000","last_undegraded":"2024-09-14T11:58:39.247957+0000","last_fullsized":"2024-09-14T11:58:39.247957+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:04.022385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170217,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":11097,"num_write":1169,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'102","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.924904+0000","last_change":"2024-09-14T10:56:49.738494+0000","last_active":"2024-09-14T11:56:52.924904+0000","last_peered":"2024-09-14T11:56:52.924904+0000","last_clean":"2024-09-14T11:56:52.924904+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:56:52.924904+0000","last_undegraded":"2024-09-14T11:56:52.924904+0000","last_fullsized":"2024-09-14T11:56:52.924904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:00.728999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'435","reported_seq":2152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.887571+0000","last_change":"2024-09-14T10:56:41.692358+0000","last_active":"2024-09-14T11:58:09.887571+0000","last_peered":"2024-09-14T11:58:09.887571+0000","last_clean":"2024-09-14T11:58:09.887571+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:09.887571+0000","last_undegraded":"2024-09-14T11:58:09.887571+0000","last_fullsized":"2024-09-14T11:58:09.887571+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:23.909831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'363","reported_seq":1034,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.192768+0000","last_change":"2024-09-14T10:56:39.690334+0000","last_active":"2024-09-14T11:58:39.192768+0000","last_peered":"2024-09-14T11:58:39.192768+0000","last_clean":"2024-09-14T11:58:39.192768+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:39.192768+0000","last_undegraded":"2024-09-14T11:58:39.192768+0000","last_fullsized":"2024-09-14T11:58:39.192768+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:01.620284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":709,"num_read_kb":79863,"num_write":1135,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546248+0000","last_change":"2024-09-14T10:56:43.703574+0000","last_active":"2024-09-14T11:54:47.546248+0000","last_peered":"2024-09-14T11:54:47.546248+0000","last_clean":"2024-09-14T11:54:47.546248+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:54:47.546248+0000","last_undegraded":"2024-09-14T11:54:47.546248+0000","last_fullsized":"2024-09-14T11:54:47.546248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:13.211833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'338","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.315902+0000","last_change":"2024-09-14T10:56:45.717205+0000","last_active":"2024-09-14T11:58:38.315902+0000","last_peered":"2024-09-14T11:58:38.315902+0000","last_clean":"2024-09-14T11:58:38.315902+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:58:38.315902+0000","last_undegraded":"2024-09-14T11:58:38.315902+0000","last_fullsized":"2024-09-14T11:58:38.315902+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:15.199061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1166,"num_write":430,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669188+0000","last_change":"2024-09-14T10:56:47.732016+0000","last_active":"2024-09-14T11:54:47.669188+0000","last_peered":"2024-09-14T11:54:47.669188+0000","last_clean":"2024-09-14T11:54:47.669188+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:54:47.669188+0000","last_undegraded":"2024-09-14T11:54:47.669188+0000","last_fullsized":"2024-09-14T11:54:47.669188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:03.581653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2511","reported_seq":4330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.571152+0000","last_change":"2024-09-14T10:56:49.748541+0000","last_active":"2024-09-14T11:57:32.571152+0000","last_peered":"2024-09-14T11:57:32.571152+0000","last_clean":"2024-09-14T11:57:32.571152+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:57:32.571152+0000","last_undegraded":"2024-09-14T11:57:32.571152+0000","last_fullsized":"2024-09-14T11:57:32.571152+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.702024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1504","reported_seq":3164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.567258+0000","last_change":"2024-09-14T10:56:41.690515+0000","last_active":"2024-09-14T11:57:07.567258+0000","last_peered":"2024-09-14T11:57:07.567258+0000","last_clean":"2024-09-14T11:57:07.567258+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:57:07.567258+0000","last_undegraded":"2024-09-14T11:57:07.567258+0000","last_fullsized":"2024-09-14T11:57:07.567258+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":1400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:30.187152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'351","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.142110+0000","last_change":"2024-09-14T10:56:39.693720+0000","last_active":"2024-09-14T11:58:39.142110+0000","last_peered":"2024-09-14T11:58:39.142110+0000","last_clean":"2024-09-14T11:58:39.142110+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:39.142110+0000","last_undegraded":"2024-09-14T11:58:39.142110+0000","last_fullsized":"2024-09-14T11:58:39.142110+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:54.885183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":7357,"num_write":1125,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.658029+0000","last_change":"2024-09-14T10:56:43.698968+0000","last_active":"2024-09-14T11:55:17.658029+0000","last_peered":"2024-09-14T11:55:17.658029+0000","last_clean":"2024-09-14T11:55:17.658029+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:55:17.658029+0000","last_undegraded":"2024-09-14T11:55:17.658029+0000","last_fullsized":"2024-09-14T11:55:17.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.047693+0000","last_change":"2024-09-14T10:56:45.722700+0000","last_active":"2024-09-14T11:57:19.047693+0000","last_peered":"2024-09-14T11:57:19.047693+0000","last_clean":"2024-09-14T11:57:19.047693+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:57:19.047693+0000","last_undegraded":"2024-09-14T11:57:19.047693+0000","last_fullsized":"2024-09-14T11:57:19.047693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:14.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.547649+0000","last_change":"2024-09-14T10:56:47.736072+0000","last_active":"2024-09-14T11:54:48.547649+0000","last_peered":"2024-09-14T11:54:48.547649+0000","last_clean":"2024-09-14T11:54:48.547649+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:54:48.547649+0000","last_undegraded":"2024-09-14T11:54:48.547649+0000","last_fullsized":"2024-09-14T11:54:48.547649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:39.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723799+0000","last_change":"2024-09-14T10:56:49.750882+0000","last_active":"2024-09-14T11:58:09.723799+0000","last_peered":"2024-09-14T11:58:09.723799+0000","last_clean":"2024-09-14T11:58:09.723799+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:58:09.723799+0000","last_undegraded":"2024-09-14T11:58:09.723799+0000","last_fullsized":"2024-09-14T11:58:09.723799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:22.830554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'632","reported_seq":2376,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.885005+0000","last_change":"2024-09-14T10:56:41.694089+0000","last_active":"2024-09-14T11:58:09.885005+0000","last_peered":"2024-09-14T11:58:09.885005+0000","last_clean":"2024-09-14T11:58:09.885005+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:09.885005+0000","last_undegraded":"2024-09-14T11:58:09.885005+0000","last_fullsized":"2024-09-14T11:58:09.885005+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":600,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:57.336561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'372","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.259177+0000","last_change":"2024-09-14T10:56:39.694928+0000","last_active":"2024-09-14T11:58:39.259177+0000","last_peered":"2024-09-14T11:58:39.259177+0000","last_clean":"2024-09-14T11:58:39.259177+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:39.259177+0000","last_undegraded":"2024-09-14T11:58:39.259177+0000","last_fullsized":"2024-09-14T11:58:39.259177+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:30.362849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":77744,"num_write":1160,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653968+0000","last_change":"2024-09-14T10:56:43.701731+0000","last_active":"2024-09-14T11:54:47.653968+0000","last_peered":"2024-09-14T11:54:47.653968+0000","last_clean":"2024-09-14T11:54:47.653968+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:54:47.653968+0000","last_undegraded":"2024-09-14T11:54:47.653968+0000","last_fullsized":"2024-09-14T11:54:47.653968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:01.110895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'139","reported_seq":682,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.089458+0000","last_change":"2024-09-14T10:56:45.721500+0000","last_active":"2024-09-14T11:57:19.089458+0000","last_peered":"2024-09-14T11:57:19.089458+0000","last_clean":"2024-09-14T11:57:19.089458+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:57:19.089458+0000","last_undegraded":"2024-09-14T11:57:19.089458+0000","last_fullsized":"2024-09-14T11:57:19.089458+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:20.327884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'776","reported_seq":4517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.387193+0000","last_change":"2024-09-14T10:56:47.731166+0000","last_active":"2024-09-14T11:58:38.387193+0000","last_peered":"2024-09-14T11:58:38.387193+0000","last_clean":"2024-09-14T11:58:38.387193+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:58:38.387193+0000","last_undegraded":"2024-09-14T11:58:38.387193+0000","last_fullsized":"2024-09-14T11:58:38.387193+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'210","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442305+0000","last_change":"2024-09-14T10:56:49.740657+0000","last_active":"2024-09-14T11:56:53.442305+0000","last_peered":"2024-09-14T11:56:53.442305+0000","last_clean":"2024-09-14T11:56:53.442305+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:56:53.442305+0000","last_undegraded":"2024-09-14T11:56:53.442305+0000","last_fullsized":"2024-09-14T11:56:53.442305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:29.712729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'435","reported_seq":2055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460767+0000","last_change":"2024-09-14T10:56:41.695277+0000","last_active":"2024-09-14T11:56:10.460767+0000","last_peered":"2024-09-14T11:56:10.460767+0000","last_clean":"2024-09-14T11:56:10.460767+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:56:10.460767+0000","last_undegraded":"2024-09-14T11:56:10.460767+0000","last_fullsized":"2024-09-14T11:56:10.460767+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.480333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'327","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.182753+0000","last_change":"2024-09-14T10:56:39.686745+0000","last_active":"2024-09-14T11:58:39.182753+0000","last_peered":"2024-09-14T11:58:39.182753+0000","last_clean":"2024-09-14T11:58:39.182753+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:39.182753+0000","last_undegraded":"2024-09-14T11:58:39.182753+0000","last_fullsized":"2024-09-14T11:58:39.182753+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:17.862362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":94667,"num_write":978,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546276+0000","last_change":"2024-09-14T10:56:43.702583+0000","last_active":"2024-09-14T11:54:47.546276+0000","last_peered":"2024-09-14T11:54:47.546276+0000","last_clean":"2024-09-14T11:54:47.546276+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:54:47.546276+0000","last_undegraded":"2024-09-14T11:54:47.546276+0000","last_fullsized":"2024-09-14T11:54:47.546276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:02.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'273","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.928198+0000","last_change":"2024-09-14T10:56:45.717333+0000","last_active":"2024-09-14T11:58:37.928198+0000","last_peered":"2024-09-14T11:58:37.928198+0000","last_clean":"2024-09-14T11:58:37.928198+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:58:37.928198+0000","last_undegraded":"2024-09-14T11:58:37.928198+0000","last_fullsized":"2024-09-14T11:58:37.928198+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:45.182188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47840,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":445,"num_read_kb":1034,"num_write":358,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'811","reported_seq":2642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.358724+0000","last_change":"2024-09-14T10:56:47.734484+0000","last_active":"2024-09-14T11:58:38.358724+0000","last_peered":"2024-09-14T11:58:38.358724+0000","last_clean":"2024-09-14T11:58:38.358724+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:58:38.358724+0000","last_undegraded":"2024-09-14T11:58:38.358724+0000","last_fullsized":"2024-09-14T11:58:38.358724+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'658","reported_seq":2019,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.883179+0000","last_change":"2024-09-14T10:56:41.690375+0000","last_active":"2024-09-14T11:58:09.883179+0000","last_peered":"2024-09-14T11:58:09.883179+0000","last_clean":"2024-09-14T11:58:09.883179+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:09.883179+0000","last_undegraded":"2024-09-14T11:58:09.883179+0000","last_fullsized":"2024-09-14T11:58:09.883179+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":600,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:42.339603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'344","reported_seq":962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.183653+0000","last_change":"2024-09-14T10:56:39.698021+0000","last_active":"2024-09-14T11:58:39.183653+0000","last_peered":"2024-09-14T11:58:39.183653+0000","last_clean":"2024-09-14T11:58:39.183653+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:39.183653+0000","last_undegraded":"2024-09-14T11:58:39.183653+0000","last_fullsized":"2024-09-14T11:58:39.183653+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:46.013676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730185,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17523,"num_write":1016,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.674155+0000","last_change":"2024-09-14T10:56:43.698774+0000","last_active":"2024-09-14T11:55:17.674155+0000","last_peered":"2024-09-14T11:55:17.674155+0000","last_clean":"2024-09-14T11:55:17.674155+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:55:17.674155+0000","last_undegraded":"2024-09-14T11:55:17.674155+0000","last_fullsized":"2024-09-14T11:55:17.674155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:15.883668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'412","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.797251+0000","last_change":"2024-09-14T10:56:45.715379+0000","last_active":"2024-09-14T11:58:38.797251+0000","last_peered":"2024-09-14T11:58:38.797251+0000","last_clean":"2024-09-14T11:58:38.797251+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:58:38.797251+0000","last_undegraded":"2024-09-14T11:58:38.797251+0000","last_fullsized":"2024-09-14T11:58:38.797251+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:11.970010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46953,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":681,"num_read_kb":1474,"num_write":542,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536831+0000","last_change":"2024-09-14T10:56:47.727987+0000","last_active":"2024-09-14T11:55:17.536831+0000","last_peered":"2024-09-14T11:55:17.536831+0000","last_clean":"2024-09-14T11:55:17.536831+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:55:17.536831+0000","last_undegraded":"2024-09-14T11:55:17.536831+0000","last_fullsized":"2024-09-14T11:55:17.536831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:35.450777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'581","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311916+0000","last_change":"2024-09-14T10:56:49.748529+0000","last_active":"2024-09-14T11:58:11.311916+0000","last_peered":"2024-09-14T11:58:11.311916+0000","last_clean":"2024-09-14T11:58:11.311916+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:58:11.311916+0000","last_undegraded":"2024-09-14T11:58:11.311916+0000","last_fullsized":"2024-09-14T11:58:11.311916+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.226410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'450","reported_seq":2119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909742+0000","last_change":"2024-09-14T10:56:41.699591+0000","last_active":"2024-09-14T11:56:51.909742+0000","last_peered":"2024-09-14T11:56:51.909742+0000","last_clean":"2024-09-14T11:56:51.909742+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:56:51.909742+0000","last_undegraded":"2024-09-14T11:56:51.909742+0000","last_fullsized":"2024-09-14T11:56:51.909742+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:55.170546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'367","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.250127+0000","last_change":"2024-09-14T10:56:39.691536+0000","last_active":"2024-09-14T11:58:39.250127+0000","last_peered":"2024-09-14T11:58:39.250127+0000","last_clean":"2024-09-14T11:58:39.250127+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:39.250127+0000","last_undegraded":"2024-09-14T11:58:39.250127+0000","last_fullsized":"2024-09-14T11:58:39.250127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:03.544842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":60976,"num_write":1200,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"37'5","reported_seq":982,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.155670+0000","last_change":"2024-09-14T10:56:43.702569+0000","last_active":"2024-09-14T11:58:36.155670+0000","last_peered":"2024-09-14T11:58:36.155670+0000","last_clean":"2024-09-14T11:58:36.155670+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:36.155670+0000","last_undegraded":"2024-09-14T11:58:36.155670+0000","last_fullsized":"2024-09-14T11:58:36.155670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:38.967506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'279","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.138032+0000","last_change":"2024-09-14T10:56:45.717223+0000","last_active":"2024-09-14T11:58:37.138032+0000","last_peered":"2024-09-14T11:58:37.138032+0000","last_clean":"2024-09-14T11:58:37.138032+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:58:37.138032+0000","last_undegraded":"2024-09-14T11:58:37.138032+0000","last_fullsized":"2024-09-14T11:58:37.138032+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:53.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659151+0000","last_change":"2024-09-14T10:56:47.728715+0000","last_active":"2024-09-14T11:55:27.659151+0000","last_peered":"2024-09-14T11:55:27.659151+0000","last_clean":"2024-09-14T11:55:27.659151+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:55:27.659151+0000","last_undegraded":"2024-09-14T11:55:27.659151+0000","last_fullsized":"2024-09-14T11:55:27.659151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:34.862116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'110","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.691270+0000","last_change":"2024-09-14T10:56:49.740475+0000","last_active":"2024-09-14T11:57:28.691270+0000","last_peered":"2024-09-14T11:57:28.691270+0000","last_clean":"2024-09-14T11:57:28.691270+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:57:28.691270+0000","last_undegraded":"2024-09-14T11:57:28.691270+0000","last_fullsized":"2024-09-14T11:57:28.691270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:13.870392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'435","reported_seq":1865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.886202+0000","last_change":"2024-09-14T10:56:41.699032+0000","last_active":"2024-09-14T11:58:09.886202+0000","last_peered":"2024-09-14T11:58:09.886202+0000","last_clean":"2024-09-14T11:58:09.886202+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:09.886202+0000","last_undegraded":"2024-09-14T11:58:09.886202+0000","last_fullsized":"2024-09-14T11:58:09.886202+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:20.716515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'324","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.218197+0000","last_change":"2024-09-14T10:56:39.695515+0000","last_active":"2024-09-14T11:58:39.218197+0000","last_peered":"2024-09-14T11:58:39.218197+0000","last_clean":"2024-09-14T11:58:39.218197+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:39.218197+0000","last_undegraded":"2024-09-14T11:58:39.218197+0000","last_fullsized":"2024-09-14T11:58:39.218197+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:30.996747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":11458,"num_write":967,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737627+0000","last_change":"2024-09-14T10:56:43.701838+0000","last_active":"2024-09-14T11:55:17.737627+0000","last_peered":"2024-09-14T11:55:17.737627+0000","last_clean":"2024-09-14T11:55:17.737627+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:55:17.737627+0000","last_undegraded":"2024-09-14T11:55:17.737627+0000","last_fullsized":"2024-09-14T11:55:17.737627+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:45.350355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'295","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.937603+0000","last_change":"2024-09-14T10:56:45.715385+0000","last_active":"2024-09-14T11:58:38.937603+0000","last_peered":"2024-09-14T11:58:38.937603+0000","last_clean":"2024-09-14T11:58:38.937603+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:58:38.937603+0000","last_undegraded":"2024-09-14T11:58:38.937603+0000","last_fullsized":"2024-09-14T11:58:38.937603+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.655994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50465,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":1040,"num_write":378,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.540322+0000","last_change":"2024-09-14T10:56:47.732668+0000","last_active":"2024-09-14T11:58:38.540322+0000","last_peered":"2024-09-14T11:58:38.540322+0000","last_clean":"2024-09-14T11:58:38.540322+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:58:38.540322+0000","last_undegraded":"2024-09-14T11:58:38.540322+0000","last_fullsized":"2024-09-14T11:58:38.540322+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:36.329167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'144","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723376+0000","last_change":"2024-09-14T10:56:49.751141+0000","last_active":"2024-09-14T11:58:09.723376+0000","last_peered":"2024-09-14T11:58:09.723376+0000","last_clean":"2024-09-14T11:58:09.723376+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:58:09.723376+0000","last_undegraded":"2024-09-14T11:58:09.723376+0000","last_fullsized":"2024-09-14T11:58:09.723376+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:59.575096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'437","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.698726+0000","last_change":"2024-09-14T10:56:41.699606+0000","last_active":"2024-09-14T11:55:28.698726+0000","last_peered":"2024-09-14T11:55:28.698726+0000","last_clean":"2024-09-14T11:55:28.698726+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:55:28.698726+0000","last_undegraded":"2024-09-14T11:55:28.698726+0000","last_fullsized":"2024-09-14T11:55:28.698726+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:32.073985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.241374+0000","last_change":"2024-09-14T10:57:16.313659+0000","last_active":"2024-09-14T11:58:39.241374+0000","last_peered":"2024-09-14T11:58:39.241374+0000","last_clean":"2024-09-14T11:58:39.241374+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:39.241374+0000","last_undegraded":"2024-09-14T11:58:39.241374+0000","last_fullsized":"2024-09-14T11:58:39.241374+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:49.985260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730158,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":20707,"num_write":1086,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.738288+0000","last_change":"2024-09-14T10:56:43.700827+0000","last_active":"2024-09-14T11:55:22.738288+0000","last_peered":"2024-09-14T11:55:22.738288+0000","last_clean":"2024-09-14T11:55:22.738288+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:55:22.738288+0000","last_undegraded":"2024-09-14T11:55:22.738288+0000","last_fullsized":"2024-09-14T11:55:22.738288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:43.830453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'493","reported_seq":1124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.062029+0000","last_change":"2024-09-14T10:56:45.716585+0000","last_active":"2024-09-14T11:58:39.062029+0000","last_peered":"2024-09-14T11:58:39.062029+0000","last_clean":"2024-09-14T11:58:39.062029+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:58:39.062029+0000","last_undegraded":"2024-09-14T11:58:39.062029+0000","last_fullsized":"2024-09-14T11:58:39.062029+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:59.261412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104584,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":850,"num_read_kb":2088,"num_write":692,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737599+0000","last_change":"2024-09-14T10:56:47.727232+0000","last_active":"2024-09-14T11:55:17.737599+0000","last_peered":"2024-09-14T11:55:17.737599+0000","last_clean":"2024-09-14T11:55:17.737599+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:55:17.737599+0000","last_undegraded":"2024-09-14T11:55:17.737599+0000","last_fullsized":"2024-09-14T11:55:17.737599+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:19.261352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'153","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.913275+0000","last_change":"2024-09-14T10:56:49.745209+0000","last_active":"2024-09-14T11:56:52.913275+0000","last_peered":"2024-09-14T11:56:52.913275+0000","last_clean":"2024-09-14T11:56:52.913275+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:56:52.913275+0000","last_undegraded":"2024-09-14T11:56:52.913275+0000","last_fullsized":"2024-09-14T11:56:52.913275+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:00.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'485","reported_seq":2262,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781154+0000","last_change":"2024-09-14T10:56:41.695419+0000","last_active":"2024-09-14T11:56:52.781154+0000","last_peered":"2024-09-14T11:56:52.781154+0000","last_clean":"2024-09-14T11:56:52.781154+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:56:52.781154+0000","last_undegraded":"2024-09-14T11:56:52.781154+0000","last_fullsized":"2024-09-14T11:56:52.781154+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:25.326798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'383","reported_seq":1055,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.217485+0000","last_change":"2024-09-14T10:56:39.686597+0000","last_active":"2024-09-14T11:58:39.217485+0000","last_peered":"2024-09-14T11:58:39.217485+0000","last_clean":"2024-09-14T11:58:39.217485+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:39.217485+0000","last_undegraded":"2024-09-14T11:58:39.217485+0000","last_fullsized":"2024-09-14T11:58:39.217485+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:52.571169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460262,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":720,"num_read_kb":26829,"num_write":1334,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737663+0000","last_change":"2024-09-14T10:56:43.702604+0000","last_active":"2024-09-14T11:55:17.737663+0000","last_peered":"2024-09-14T11:55:17.737663+0000","last_clean":"2024-09-14T11:55:17.737663+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:55:17.737663+0000","last_undegraded":"2024-09-14T11:55:17.737663+0000","last_fullsized":"2024-09-14T11:55:17.737663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:06.675596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'337","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.444929+0000","last_change":"2024-09-14T10:56:45.720877+0000","last_active":"2024-09-14T11:58:37.444929+0000","last_peered":"2024-09-14T11:58:37.444929+0000","last_clean":"2024-09-14T11:58:37.444929+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:58:37.444929+0000","last_undegraded":"2024-09-14T11:58:37.444929+0000","last_fullsized":"2024-09-14T11:58:37.444929+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:57.447381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658208+0000","last_change":"2024-09-14T10:56:47.732467+0000","last_active":"2024-09-14T11:55:22.658208+0000","last_peered":"2024-09-14T11:55:22.658208+0000","last_clean":"2024-09-14T11:55:22.658208+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:55:22.658208+0000","last_undegraded":"2024-09-14T11:55:22.658208+0000","last_fullsized":"2024-09-14T11:55:22.658208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:40.009813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446796+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:07.446796+0000","last_peered":"2024-09-14T11:57:07.446796+0000","last_clean":"2024-09-14T11:57:07.446796+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:07.446796+0000","last_undegraded":"2024-09-14T11:57:07.446796+0000","last_fullsized":"2024-09-14T11:57:07.446796+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:22.648516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'765","reported_seq":2677,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.878498+0000","last_change":"2024-09-14T10:56:41.694599+0000","last_active":"2024-09-14T11:58:09.878498+0000","last_peered":"2024-09-14T11:58:09.878498+0000","last_clean":"2024-09-14T11:58:09.878498+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:09.878498+0000","last_undegraded":"2024-09-14T11:58:09.878498+0000","last_fullsized":"2024-09-14T11:58:09.878498+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":700,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:34.020278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'396","reported_seq":1054,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.259572+0000","last_change":"2024-09-14T10:56:39.682095+0000","last_active":"2024-09-14T11:58:39.259572+0000","last_peered":"2024-09-14T11:58:39.259572+0000","last_clean":"2024-09-14T11:58:39.259572+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:39.259572+0000","last_undegraded":"2024-09-14T11:58:39.259572+0000","last_fullsized":"2024-09-14T11:58:39.259572+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:36.566585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":27548,"num_write":1230,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536865+0000","last_change":"2024-09-14T10:56:43.707450+0000","last_active":"2024-09-14T11:55:17.536865+0000","last_peered":"2024-09-14T11:55:17.536865+0000","last_clean":"2024-09-14T11:55:17.536865+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:55:17.536865+0000","last_undegraded":"2024-09-14T11:55:17.536865+0000","last_fullsized":"2024-09-14T11:55:17.536865+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:10.147136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'346","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.913274+0000","last_change":"2024-09-14T10:56:45.709793+0000","last_active":"2024-09-14T11:58:36.913274+0000","last_peered":"2024-09-14T11:58:36.913274+0000","last_clean":"2024-09-14T11:58:36.913274+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:36.913274+0000","last_undegraded":"2024-09-14T11:58:36.913274+0000","last_fullsized":"2024-09-14T11:58:36.913274+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:43.142877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'754","reported_seq":2331,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.591352+0000","last_change":"2024-09-14T10:56:47.728010+0000","last_active":"2024-09-14T11:58:36.591352+0000","last_peered":"2024-09-14T11:58:36.591352+0000","last_clean":"2024-09-14T11:58:36.591352+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:58:36.591352+0000","last_undegraded":"2024-09-14T11:58:36.591352+0000","last_fullsized":"2024-09-14T11:58:36.591352+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:16.673244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'120","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.768184+0000","last_change":"2024-09-14T10:56:49.746163+0000","last_active":"2024-09-14T11:56:50.768184+0000","last_peered":"2024-09-14T11:56:50.768184+0000","last_clean":"2024-09-14T11:56:50.768184+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:56:50.768184+0000","last_undegraded":"2024-09-14T11:56:50.768184+0000","last_fullsized":"2024-09-14T11:56:50.768184+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:25.956197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'746","reported_seq":2259,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.312517+0000","last_change":"2024-09-14T10:56:41.687409+0000","last_active":"2024-09-14T11:56:49.312517+0000","last_peered":"2024-09-14T11:56:49.312517+0000","last_clean":"2024-09-14T11:56:49.312517+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:56:49.312517+0000","last_undegraded":"2024-09-14T11:56:49.312517+0000","last_fullsized":"2024-09-14T11:56:49.312517+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":700,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:52.835617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":999,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.184678+0000","last_change":"2024-09-14T10:56:39.683292+0000","last_active":"2024-09-14T11:58:39.184678+0000","last_peered":"2024-09-14T11:58:39.184678+0000","last_clean":"2024-09-14T11:58:39.184678+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:39.184678+0000","last_undegraded":"2024-09-14T11:58:39.184678+0000","last_fullsized":"2024-09-14T11:58:39.184678+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:10:04.713834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":90386,"num_write":1114,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.167037+0000","last_change":"2024-09-14T10:56:43.701046+0000","last_active":"2024-09-14T11:58:36.167037+0000","last_peered":"2024-09-14T11:58:36.167037+0000","last_clean":"2024-09-14T11:58:36.167037+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:58:36.167037+0000","last_undegraded":"2024-09-14T11:58:36.167037+0000","last_fullsized":"2024-09-14T11:58:36.167037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'92","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.017399+0000","last_change":"2024-09-14T10:56:45.713884+0000","last_active":"2024-09-14T11:57:19.017399+0000","last_peered":"2024-09-14T11:57:19.017399+0000","last_clean":"2024-09-14T11:57:19.017399+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:57:19.017399+0000","last_undegraded":"2024-09-14T11:57:19.017399+0000","last_fullsized":"2024-09-14T11:57:19.017399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:23.564660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'776","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.122049+0000","last_change":"2024-09-14T10:56:47.728790+0000","last_active":"2024-09-14T11:58:38.122049+0000","last_peered":"2024-09-14T11:58:38.122049+0000","last_clean":"2024-09-14T11:58:38.122049+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:58:38.122049+0000","last_undegraded":"2024-09-14T11:58:38.122049+0000","last_fullsized":"2024-09-14T11:58:38.122049+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.655451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.297030+0000","last_change":"2024-09-14T10:56:49.746716+0000","last_active":"2024-09-14T11:56:49.297030+0000","last_peered":"2024-09-14T11:56:49.297030+0000","last_clean":"2024-09-14T11:56:49.297030+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:56:49.297030+0000","last_undegraded":"2024-09-14T11:56:49.297030+0000","last_fullsized":"2024-09-14T11:56:49.297030+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.164615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'788","reported_seq":2342,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782702+0000","last_change":"2024-09-14T10:56:41.698077+0000","last_active":"2024-09-14T11:56:52.782702+0000","last_peered":"2024-09-14T11:56:52.782702+0000","last_clean":"2024-09-14T11:56:52.782702+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:56:52.782702+0000","last_undegraded":"2024-09-14T11:56:52.782702+0000","last_fullsized":"2024-09-14T11:56:52.782702+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:01.788116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'328","reported_seq":926,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.212978+0000","last_change":"2024-09-14T10:57:15.795505+0000","last_active":"2024-09-14T11:58:39.212978+0000","last_peered":"2024-09-14T11:58:39.212978+0000","last_clean":"2024-09-14T11:58:39.212978+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:39.212978+0000","last_undegraded":"2024-09-14T11:58:39.212978+0000","last_fullsized":"2024-09-14T11:58:39.212978+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:56.548600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029101,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1389,"num_write":1004,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.551662+0000","last_change":"2024-09-14T10:56:43.698906+0000","last_active":"2024-09-14T11:55:13.551662+0000","last_peered":"2024-09-14T11:55:13.551662+0000","last_clean":"2024-09-14T11:55:13.551662+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:55:13.551662+0000","last_undegraded":"2024-09-14T11:55:13.551662+0000","last_fullsized":"2024-09-14T11:55:13.551662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:39.807629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'395","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.375762+0000","last_change":"2024-09-14T10:56:45.719001+0000","last_active":"2024-09-14T11:58:38.375762+0000","last_peered":"2024-09-14T11:58:38.375762+0000","last_clean":"2024-09-14T11:58:38.375762+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:58:38.375762+0000","last_undegraded":"2024-09-14T11:58:38.375762+0000","last_fullsized":"2024-09-14T11:58:38.375762+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:08.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45959,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1239,"num_read_kb":1795,"num_write":1786,"num_write_kb":1623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":477,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672095+0000","last_change":"2024-09-14T10:56:47.735876+0000","last_active":"2024-09-14T11:55:18.672095+0000","last_peered":"2024-09-14T11:55:18.672095+0000","last_clean":"2024-09-14T11:55:18.672095+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:55:18.672095+0000","last_undegraded":"2024-09-14T11:55:18.672095+0000","last_fullsized":"2024-09-14T11:55:18.672095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:40.099775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.186925+0000","last_change":"2024-09-14T10:56:49.743347+0000","last_active":"2024-09-14T11:56:50.186925+0000","last_peered":"2024-09-14T11:56:50.186925+0000","last_clean":"2024-09-14T11:56:50.186925+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:56:50.186925+0000","last_undegraded":"2024-09-14T11:56:50.186925+0000","last_fullsized":"2024-09-14T11:56:50.186925+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'647","reported_seq":2123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817022+0000","last_change":"2024-09-14T10:56:41.692220+0000","last_active":"2024-09-14T11:55:53.817022+0000","last_peered":"2024-09-14T11:55:53.817022+0000","last_clean":"2024-09-14T11:55:53.817022+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:55:53.817022+0000","last_undegraded":"2024-09-14T11:55:53.817022+0000","last_fullsized":"2024-09-14T11:55:53.817022+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:11.440656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":604,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432896+0000","last_change":"2024-09-14T10:56:23.584976+0000","last_active":"2024-09-14T11:56:37.432896+0000","last_peered":"2024-09-14T11:56:37.432896+0000","last_clean":"2024-09-14T11:56:37.432896+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:56:37.432896+0000","last_undegraded":"2024-09-14T11:56:37.432896+0000","last_fullsized":"2024-09-14T11:56:37.432896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:22.575106+0000","last_clean_scrub_stamp":"2024-09-14T10:56:22.575106+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:01.892336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":515,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.547015+0000","last_change":"2024-09-14T10:56:32.616291+0000","last_active":"2024-09-14T11:54:52.547015+0000","last_peered":"2024-09-14T11:54:52.547015+0000","last_clean":"2024-09-14T11:54:52.547015+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:54:52.547015+0000","last_undegraded":"2024-09-14T11:54:52.547015+0000","last_fullsized":"2024-09-14T11:54:52.547015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:30.836304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'352","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.250182+0000","last_change":"2024-09-14T10:56:39.687055+0000","last_active":"2024-09-14T11:58:39.250182+0000","last_peered":"2024-09-14T11:58:39.250182+0000","last_clean":"2024-09-14T11:58:39.250182+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:39.250182+0000","last_undegraded":"2024-09-14T11:58:39.250182+0000","last_fullsized":"2024-09-14T11:58:39.250182+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:32.344503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":656,"num_read_kb":39235,"num_write":1025,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672300+0000","last_change":"2024-09-14T10:56:43.702002+0000","last_active":"2024-09-14T11:55:07.672300+0000","last_peered":"2024-09-14T11:55:07.672300+0000","last_clean":"2024-09-14T11:55:07.672300+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:55:07.672300+0000","last_undegraded":"2024-09-14T11:55:07.672300+0000","last_fullsized":"2024-09-14T11:55:07.672300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:33.474891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'794","reported_seq":1492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.510335+0000","last_change":"2024-09-14T10:56:45.716034+0000","last_active":"2024-09-14T11:58:38.510335+0000","last_peered":"2024-09-14T11:58:38.510335+0000","last_clean":"2024-09-14T11:58:38.510335+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:58:38.510335+0000","last_undegraded":"2024-09-14T11:58:38.510335+0000","last_fullsized":"2024-09-14T11:58:38.510335+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:25.384704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159942,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1557,"num_read_kb":3699,"num_write":1498,"num_write_kb":1345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.657591+0000","last_change":"2024-09-14T10:56:47.736084+0000","last_active":"2024-09-14T11:55:17.657591+0000","last_peered":"2024-09-14T11:55:17.657591+0000","last_clean":"2024-09-14T11:55:17.657591+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:55:17.657591+0000","last_undegraded":"2024-09-14T11:55:17.657591+0000","last_fullsized":"2024-09-14T11:55:17.657591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:49.305417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.811415+0000","last_change":"2024-09-14T10:56:49.743581+0000","last_active":"2024-09-14T11:56:52.811415+0000","last_peered":"2024-09-14T11:56:52.811415+0000","last_clean":"2024-09-14T11:56:52.811415+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:56:52.811415+0000","last_undegraded":"2024-09-14T11:56:52.811415+0000","last_fullsized":"2024-09-14T11:56:52.811415+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:57.012986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337471+0000","last_change":"2024-09-14T10:56:41.699990+0000","last_active":"2024-09-14T11:56:18.337471+0000","last_peered":"2024-09-14T11:56:18.337471+0000","last_clean":"2024-09-14T11:56:18.337471+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:56:18.337471+0000","last_undegraded":"2024-09-14T11:56:18.337471+0000","last_fullsized":"2024-09-14T11:56:18.337471+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:37.126708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.433604+0000","last_change":"2024-09-14T10:56:33.001184+0000","last_active":"2024-09-14T11:56:42.433604+0000","last_peered":"2024-09-14T11:56:42.433604+0000","last_clean":"2024-09-14T11:56:42.433604+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:56:42.433604+0000","last_undegraded":"2024-09-14T11:56:42.433604+0000","last_fullsized":"2024-09-14T11:56:42.433604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:14.444796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'294","reported_seq":890,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.161378+0000","last_change":"2024-09-14T10:56:39.691928+0000","last_active":"2024-09-14T11:58:39.161378+0000","last_peered":"2024-09-14T11:58:39.161378+0000","last_clean":"2024-09-14T11:58:39.161378+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:39.161378+0000","last_undegraded":"2024-09-14T11:58:39.161378+0000","last_fullsized":"2024-09-14T11:58:39.161378+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:30.565224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":19285,"num_write":870,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.551105+0000","last_change":"2024-09-14T10:56:43.701669+0000","last_active":"2024-09-14T11:55:17.551105+0000","last_peered":"2024-09-14T11:55:17.551105+0000","last_clean":"2024-09-14T11:55:17.551105+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:55:17.551105+0000","last_undegraded":"2024-09-14T11:55:17.551105+0000","last_fullsized":"2024-09-14T11:55:17.551105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:32.330161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1329","reported_seq":3014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.441017+0000","last_change":"2024-09-14T10:56:45.719919+0000","last_active":"2024-09-14T11:58:38.441017+0000","last_peered":"2024-09-14T11:58:38.441017+0000","last_clean":"2024-09-14T11:58:38.441017+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:58:38.441017+0000","last_undegraded":"2024-09-14T11:58:38.441017+0000","last_fullsized":"2024-09-14T11:58:38.441017+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":1300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:28.154269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147529,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":4061,"num_write":1198,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.673250+0000","last_change":"2024-09-14T10:56:47.734554+0000","last_active":"2024-09-14T11:55:12.673250+0000","last_peered":"2024-09-14T11:55:12.673250+0000","last_clean":"2024-09-14T11:55:12.673250+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:55:12.673250+0000","last_undegraded":"2024-09-14T11:55:12.673250+0000","last_fullsized":"2024-09-14T11:55:12.673250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:20.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'94","reported_seq":590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.504531+0000","last_change":"2024-09-14T10:56:49.741143+0000","last_active":"2024-09-14T11:56:16.504531+0000","last_peered":"2024-09-14T11:56:16.504531+0000","last_clean":"2024-09-14T11:56:16.504531+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:56:16.504531+0000","last_undegraded":"2024-09-14T11:56:16.504531+0000","last_fullsized":"2024-09-14T11:56:16.504531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.919275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'936","reported_seq":2803,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.816582+0000","last_change":"2024-09-14T10:56:41.698132+0000","last_active":"2024-09-14T11:55:53.816582+0000","last_peered":"2024-09-14T11:55:53.816582+0000","last_clean":"2024-09-14T11:55:53.816582+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:55:53.816582+0000","last_undegraded":"2024-09-14T11:55:53.816582+0000","last_fullsized":"2024-09-14T11:55:53.816582+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":900,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:05.829080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.733197+0000","last_change":"2024-09-14T10:56:32.613030+0000","last_active":"2024-09-14T11:54:52.733197+0000","last_peered":"2024-09-14T11:54:52.733197+0000","last_clean":"2024-09-14T11:54:52.733197+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:54:52.733197+0000","last_undegraded":"2024-09-14T11:54:52.733197+0000","last_fullsized":"2024-09-14T11:54:52.733197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:46.117168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":941,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.229022+0000","last_change":"2024-09-14T10:56:39.677391+0000","last_active":"2024-09-14T11:58:39.229022+0000","last_peered":"2024-09-14T11:58:39.229022+0000","last_clean":"2024-09-14T11:58:39.229022+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:39.229022+0000","last_undegraded":"2024-09-14T11:58:39.229022+0000","last_fullsized":"2024-09-14T11:58:39.229022+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:02.834286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":14745,"num_write":993,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.737709+0000","last_change":"2024-09-14T10:56:43.701856+0000","last_active":"2024-09-14T11:55:17.737709+0000","last_peered":"2024-09-14T11:55:17.737709+0000","last_clean":"2024-09-14T11:55:17.737709+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:55:17.737709+0000","last_undegraded":"2024-09-14T11:55:17.737709+0000","last_fullsized":"2024-09-14T11:55:17.737709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:25.200569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'291","reported_seq":1564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.772091+0000","last_change":"2024-09-14T10:56:45.720189+0000","last_active":"2024-09-14T11:58:06.772091+0000","last_peered":"2024-09-14T11:58:06.772091+0000","last_clean":"2024-09-14T11:58:06.772091+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:58:06.772091+0000","last_undegraded":"2024-09-14T11:58:06.772091+0000","last_fullsized":"2024-09-14T11:58:06.772091+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:21.350299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656311+0000","last_change":"2024-09-14T10:56:47.737357+0000","last_active":"2024-09-14T11:55:07.656311+0000","last_peered":"2024-09-14T11:55:07.656311+0000","last_clean":"2024-09-14T11:55:07.656311+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:55:07.656311+0000","last_undegraded":"2024-09-14T11:55:07.656311+0000","last_fullsized":"2024-09-14T11:55:07.656311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:59.652704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.061479+0000","last_change":"2024-09-14T10:56:49.741618+0000","last_active":"2024-09-14T11:56:53.061479+0000","last_peered":"2024-09-14T11:56:53.061479+0000","last_clean":"2024-09-14T11:56:53.061479+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:56:53.061479+0000","last_undegraded":"2024-09-14T11:56:53.061479+0000","last_fullsized":"2024-09-14T11:56:53.061479+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:04.982419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'530","reported_seq":2135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.908964+0000","last_change":"2024-09-14T10:56:41.691332+0000","last_active":"2024-09-14T11:56:51.908964+0000","last_peered":"2024-09-14T11:56:51.908964+0000","last_clean":"2024-09-14T11:56:51.908964+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:56:51.908964+0000","last_undegraded":"2024-09-14T11:56:51.908964+0000","last_fullsized":"2024-09-14T11:56:51.908964+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:24.956318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":516,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.546981+0000","last_change":"2024-09-14T10:56:32.617027+0000","last_active":"2024-09-14T11:54:52.546981+0000","last_peered":"2024-09-14T11:54:52.546981+0000","last_clean":"2024-09-14T11:54:52.546981+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:54:52.546981+0000","last_undegraded":"2024-09-14T11:54:52.546981+0000","last_fullsized":"2024-09-14T11:54:52.546981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:44:17.423322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'318","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.198457+0000","last_change":"2024-09-14T10:56:39.677476+0000","last_active":"2024-09-14T11:58:39.198457+0000","last_peered":"2024-09-14T11:58:39.198457+0000","last_clean":"2024-09-14T11:58:39.198457+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:39.198457+0000","last_undegraded":"2024-09-14T11:58:39.198457+0000","last_fullsized":"2024-09-14T11:58:39.198457+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:50.866073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":28769,"num_write":1006,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656928+0000","last_change":"2024-09-14T10:56:43.703850+0000","last_active":"2024-09-14T11:55:12.656928+0000","last_peered":"2024-09-14T11:55:12.656928+0000","last_clean":"2024-09-14T11:55:12.656928+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:55:12.656928+0000","last_undegraded":"2024-09-14T11:55:12.656928+0000","last_fullsized":"2024-09-14T11:55:12.656928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.154206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'142","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.449373+0000","last_change":"2024-09-14T10:56:45.723094+0000","last_active":"2024-09-14T11:57:27.449373+0000","last_peered":"2024-09-14T11:57:27.449373+0000","last_clean":"2024-09-14T11:57:27.449373+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:57:27.449373+0000","last_undegraded":"2024-09-14T11:57:27.449373+0000","last_fullsized":"2024-09-14T11:57:27.449373+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:07.418105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:18.672147+0000","last_change":"2024-09-14T10:56:47.735245+0000","last_active":"2024-09-14T11:55:18.672147+0000","last_peered":"2024-09-14T11:55:18.672147+0000","last_clean":"2024-09-14T11:55:18.672147+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:55:18.672147+0000","last_undegraded":"2024-09-14T11:55:18.672147+0000","last_fullsized":"2024-09-14T11:55:18.672147+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:24.475897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.766817+0000","last_change":"2024-09-14T10:56:49.746061+0000","last_active":"2024-09-14T11:56:52.766817+0000","last_peered":"2024-09-14T11:56:52.766817+0000","last_clean":"2024-09-14T11:56:52.766817+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:56:52.766817+0000","last_undegraded":"2024-09-14T11:56:52.766817+0000","last_fullsized":"2024-09-14T11:56:52.766817+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:28.330851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'387","reported_seq":1839,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.537862+0000","last_change":"2024-09-14T10:56:41.693401+0000","last_active":"2024-09-14T11:55:32.537862+0000","last_peered":"2024-09-14T11:55:32.537862+0000","last_clean":"2024-09-14T11:55:32.537862+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:55:32.537862+0000","last_undegraded":"2024-09-14T11:55:32.537862+0000","last_fullsized":"2024-09-14T11:55:32.537862+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:32.103997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'431","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.215676+0000","last_change":"2024-09-14T10:56:39.690724+0000","last_active":"2024-09-14T11:58:39.215676+0000","last_peered":"2024-09-14T11:58:39.215676+0000","last_clean":"2024-09-14T11:58:39.215676+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:39.215676+0000","last_undegraded":"2024-09-14T11:58:39.215676+0000","last_fullsized":"2024-09-14T11:58:39.215676+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:30.610560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":3743,"num_write":1340,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":524,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:52.533548+0000","last_change":"2024-09-14T10:56:32.612538+0000","last_active":"2024-09-14T11:54:52.533548+0000","last_peered":"2024-09-14T11:54:52.533548+0000","last_clean":"2024-09-14T11:54:52.533548+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:54:52.533548+0000","last_undegraded":"2024-09-14T11:54:52.533548+0000","last_fullsized":"2024-09-14T11:54:52.533548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:14.011869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656288+0000","last_change":"2024-09-14T10:56:43.700042+0000","last_active":"2024-09-14T11:55:07.656288+0000","last_peered":"2024-09-14T11:55:07.656288+0000","last_clean":"2024-09-14T11:55:07.656288+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:55:07.656288+0000","last_undegraded":"2024-09-14T11:55:07.656288+0000","last_fullsized":"2024-09-14T11:55:07.656288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:04:24.603692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'613","reported_seq":1283,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.012772+0000","last_change":"2024-09-14T10:56:45.716237+0000","last_active":"2024-09-14T11:58:38.012772+0000","last_peered":"2024-09-14T11:58:38.012772+0000","last_clean":"2024-09-14T11:58:38.012772+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:58:38.012772+0000","last_undegraded":"2024-09-14T11:58:38.012772+0000","last_fullsized":"2024-09-14T11:58:38.012772+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:41.293686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":2305,"num_write":884,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550619+0000","last_change":"2024-09-14T10:56:47.732150+0000","last_active":"2024-09-14T11:55:08.550619+0000","last_peered":"2024-09-14T11:55:08.550619+0000","last_clean":"2024-09-14T11:55:08.550619+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:55:08.550619+0000","last_undegraded":"2024-09-14T11:55:08.550619+0000","last_fullsized":"2024-09-14T11:55:08.550619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:42.244231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'168","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.826154+0000","last_change":"2024-09-14T10:56:49.748121+0000","last_active":"2024-09-14T11:56:49.826154+0000","last_peered":"2024-09-14T11:56:49.826154+0000","last_clean":"2024-09-14T11:56:49.826154+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:56:49.826154+0000","last_undegraded":"2024-09-14T11:56:49.826154+0000","last_fullsized":"2024-09-14T11:56:49.826154+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:52.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754696+0000","last_change":"2024-09-14T10:56:41.700935+0000","last_active":"2024-09-14T11:56:12.754696+0000","last_peered":"2024-09-14T11:56:12.754696+0000","last_clean":"2024-09-14T11:56:12.754696+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:56:12.754696+0000","last_undegraded":"2024-09-14T11:56:12.754696+0000","last_fullsized":"2024-09-14T11:56:12.754696+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:51.471808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":928,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.216225+0000","last_change":"2024-09-14T10:56:39.675452+0000","last_active":"2024-09-14T11:58:39.216225+0000","last_peered":"2024-09-14T11:58:39.216225+0000","last_clean":"2024-09-14T11:58:39.216225+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:39.216225+0000","last_undegraded":"2024-09-14T11:58:39.216225+0000","last_fullsized":"2024-09-14T11:58:39.216225+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:40.705030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":39755,"num_write":947,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670754+0000","last_change":"2024-09-14T10:56:33.001269+0000","last_active":"2024-09-14T11:54:57.670754+0000","last_peered":"2024-09-14T11:54:57.670754+0000","last_clean":"2024-09-14T11:54:57.670754+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:54:57.670754+0000","last_undegraded":"2024-09-14T11:54:57.670754+0000","last_fullsized":"2024-09-14T11:54:57.670754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:54.922287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669698+0000","last_change":"2024-09-14T10:56:43.698284+0000","last_active":"2024-09-14T11:55:03.669698+0000","last_peered":"2024-09-14T11:55:03.669698+0000","last_clean":"2024-09-14T11:55:03.669698+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:55:03.669698+0000","last_undegraded":"2024-09-14T11:55:03.669698+0000","last_fullsized":"2024-09-14T11:55:03.669698+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:00.094354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'191","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.127349+0000","last_change":"2024-09-14T10:56:45.711166+0000","last_active":"2024-09-14T11:57:19.127349+0000","last_peered":"2024-09-14T11:57:19.127349+0000","last_clean":"2024-09-14T11:57:19.127349+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:57:19.127349+0000","last_undegraded":"2024-09-14T11:57:19.127349+0000","last_fullsized":"2024-09-14T11:57:19.127349+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:47.059448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'799","reported_seq":2596,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.375498+0000","last_change":"2024-09-14T10:56:47.728767+0000","last_active":"2024-09-14T11:58:38.375498+0000","last_peered":"2024-09-14T11:58:38.375498+0000","last_clean":"2024-09-14T11:58:38.375498+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:58:38.375498+0000","last_undegraded":"2024-09-14T11:58:38.375498+0000","last_fullsized":"2024-09-14T11:58:38.375498+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.533201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452881+0000","last_change":"2024-09-14T10:56:49.737155+0000","last_active":"2024-09-14T11:57:52.452881+0000","last_peered":"2024-09-14T11:57:52.452881+0000","last_clean":"2024-09-14T11:57:52.452881+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:57:52.452881+0000","last_undegraded":"2024-09-14T11:57:52.452881+0000","last_fullsized":"2024-09-14T11:57:52.452881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:24.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910688+0000","last_change":"2024-09-14T10:56:41.696110+0000","last_active":"2024-09-14T11:56:51.910688+0000","last_peered":"2024-09-14T11:56:51.910688+0000","last_clean":"2024-09-14T11:56:51.910688+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:56:51.910688+0000","last_undegraded":"2024-09-14T11:56:51.910688+0000","last_fullsized":"2024-09-14T11:56:51.910688+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:47.127491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'358","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.195568+0000","last_change":"2024-09-14T10:56:39.689300+0000","last_active":"2024-09-14T11:58:39.195568+0000","last_peered":"2024-09-14T11:58:39.195568+0000","last_clean":"2024-09-14T11:58:39.195568+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:39.195568+0000","last_undegraded":"2024-09-14T11:58:39.195568+0000","last_fullsized":"2024-09-14T11:58:39.195568+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:49:27.768196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":699,"num_read_kb":30583,"num_write":1068,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":523,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.534766+0000","last_change":"2024-09-14T10:56:32.612393+0000","last_active":"2024-09-14T11:55:02.534766+0000","last_peered":"2024-09-14T11:55:02.534766+0000","last_clean":"2024-09-14T11:55:02.534766+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:55:02.534766+0000","last_undegraded":"2024-09-14T11:55:02.534766+0000","last_fullsized":"2024-09-14T11:55:02.534766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:38.943214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549708+0000","last_change":"2024-09-14T10:56:43.703110+0000","last_active":"2024-09-14T11:55:03.549708+0000","last_peered":"2024-09-14T11:55:03.549708+0000","last_clean":"2024-09-14T11:55:03.549708+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:55:03.549708+0000","last_undegraded":"2024-09-14T11:55:03.549708+0000","last_fullsized":"2024-09-14T11:55:03.549708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:12.622307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'119","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.096817+0000","last_change":"2024-09-14T10:56:45.722824+0000","last_active":"2024-09-14T11:57:19.096817+0000","last_peered":"2024-09-14T11:57:19.096817+0000","last_clean":"2024-09-14T11:57:19.096817+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:57:19.096817+0000","last_undegraded":"2024-09-14T11:57:19.096817+0000","last_fullsized":"2024-09-14T11:57:19.096817+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:19.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'813","reported_seq":2998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.359107+0000","last_change":"2024-09-14T10:56:47.731609+0000","last_active":"2024-09-14T11:58:38.359107+0000","last_peered":"2024-09-14T11:58:38.359107+0000","last_clean":"2024-09-14T11:58:38.359107+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:58:38.359107+0000","last_undegraded":"2024-09-14T11:58:38.359107+0000","last_fullsized":"2024-09-14T11:58:38.359107+0000","mapping_epoch":33,"log_start":"263'801","ondisk_log_start":"263'801","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":801,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.877641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'289","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.773375+0000","last_change":"2024-09-14T10:56:49.747406+0000","last_active":"2024-09-14T11:56:52.773375+0000","last_peered":"2024-09-14T11:56:52.773375+0000","last_clean":"2024-09-14T11:56:52.773375+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:56:52.773375+0000","last_undegraded":"2024-09-14T11:56:52.773375+0000","last_fullsized":"2024-09-14T11:56:52.773375+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.880523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2449,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.518469+0000","last_change":"2024-09-14T10:56:41.691206+0000","last_active":"2024-09-14T11:56:16.518469+0000","last_peered":"2024-09-14T11:56:16.518469+0000","last_clean":"2024-09-14T11:56:16.518469+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:56:16.518469+0000","last_undegraded":"2024-09-14T11:56:16.518469+0000","last_fullsized":"2024-09-14T11:56:16.518469+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:09.595419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'458","reported_seq":1175,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.222932+0000","last_change":"2024-09-14T10:56:39.692650+0000","last_active":"2024-09-14T11:58:39.222932+0000","last_peered":"2024-09-14T11:58:39.222932+0000","last_clean":"2024-09-14T11:58:39.222932+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:39.222932+0000","last_undegraded":"2024-09-14T11:58:39.222932+0000","last_fullsized":"2024-09-14T11:58:39.222932+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:04.303763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1014,"num_read_kb":14136,"num_write":1501,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":513,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669743+0000","last_change":"2024-09-14T10:56:33.000969+0000","last_active":"2024-09-14T11:55:03.669743+0000","last_peered":"2024-09-14T11:55:03.669743+0000","last_clean":"2024-09-14T11:55:03.669743+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:55:03.669743+0000","last_undegraded":"2024-09-14T11:55:03.669743+0000","last_fullsized":"2024-09-14T11:55:03.669743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:29.591030+0000","last_clean_scrub_stamp":"2024-09-14T10:56:29.591030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:31.288783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.655180+0000","last_change":"2024-09-14T10:56:43.703274+0000","last_active":"2024-09-14T11:54:57.655180+0000","last_peered":"2024-09-14T11:54:57.655180+0000","last_clean":"2024-09-14T11:54:57.655180+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:54:57.655180+0000","last_undegraded":"2024-09-14T11:54:57.655180+0000","last_fullsized":"2024-09-14T11:54:57.655180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:29.718912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'775","reported_seq":1492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.251600+0000","last_change":"2024-09-14T10:56:45.720876+0000","last_active":"2024-09-14T11:58:38.251600+0000","last_peered":"2024-09-14T11:58:38.251600+0000","last_clean":"2024-09-14T11:58:38.251600+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:58:38.251600+0000","last_undegraded":"2024-09-14T11:58:38.251600+0000","last_fullsized":"2024-09-14T11:58:38.251600+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1390,"num_read_kb":3483,"num_write":1134,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656600+0000","last_change":"2024-09-14T10:56:47.731417+0000","last_active":"2024-09-14T11:55:07.656600+0000","last_peered":"2024-09-14T11:55:07.656600+0000","last_clean":"2024-09-14T11:55:07.656600+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:55:07.656600+0000","last_undegraded":"2024-09-14T11:55:07.656600+0000","last_fullsized":"2024-09-14T11:55:07.656600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:34.160341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'154","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.473141+0000","last_change":"2024-09-14T10:56:49.746978+0000","last_active":"2024-09-14T11:55:39.473141+0000","last_peered":"2024-09-14T11:55:39.473141+0000","last_clean":"2024-09-14T11:55:39.473141+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:55:39.473141+0000","last_undegraded":"2024-09-14T11:55:39.473141+0000","last_fullsized":"2024-09-14T11:55:39.473141+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:12.779368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'168","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.003254+0000","last_change":"2024-09-14T10:56:49.747311+0000","last_active":"2024-09-14T11:56:53.003254+0000","last_peered":"2024-09-14T11:56:53.003254+0000","last_clean":"2024-09-14T11:56:53.003254+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:56:53.003254+0000","last_undegraded":"2024-09-14T11:56:53.003254+0000","last_fullsized":"2024-09-14T11:56:53.003254+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:47.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1122","reported_seq":2681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447401+0000","last_change":"2024-09-14T10:56:41.687812+0000","last_active":"2024-09-14T11:57:23.447401+0000","last_peered":"2024-09-14T11:57:23.447401+0000","last_clean":"2024-09-14T11:57:23.447401+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:57:23.447401+0000","last_undegraded":"2024-09-14T11:57:23.447401+0000","last_fullsized":"2024-09-14T11:57:23.447401+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":1100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:02.391191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'419","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.246205+0000","last_change":"2024-09-14T10:56:39.670814+0000","last_active":"2024-09-14T11:58:39.246205+0000","last_peered":"2024-09-14T11:58:39.246205+0000","last_clean":"2024-09-14T11:58:39.246205+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:39.246205+0000","last_undegraded":"2024-09-14T11:58:39.246205+0000","last_fullsized":"2024-09-14T11:58:39.246205+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:59:31.664149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":639,"num_read_kb":10191,"num_write":1201,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535277+0000","last_change":"2024-09-14T10:56:43.705030+0000","last_active":"2024-09-14T11:55:07.535277+0000","last_peered":"2024-09-14T11:55:07.535277+0000","last_clean":"2024-09-14T11:55:07.535277+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:55:07.535277+0000","last_undegraded":"2024-09-14T11:55:07.535277+0000","last_fullsized":"2024-09-14T11:55:07.535277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:56.829359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'333","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.878388+0000","last_change":"2024-09-14T10:56:45.717554+0000","last_active":"2024-09-14T11:58:38.878388+0000","last_peered":"2024-09-14T11:58:38.878388+0000","last_clean":"2024-09-14T11:58:38.878388+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:58:38.878388+0000","last_undegraded":"2024-09-14T11:58:38.878388+0000","last_fullsized":"2024-09-14T11:58:38.878388+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.209988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":1418,"num_write":456,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656516+0000","last_change":"2024-09-14T10:56:47.725547+0000","last_active":"2024-09-14T11:55:07.656516+0000","last_peered":"2024-09-14T11:55:07.656516+0000","last_clean":"2024-09-14T11:55:07.656516+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:55:07.656516+0000","last_undegraded":"2024-09-14T11:55:07.656516+0000","last_fullsized":"2024-09-14T11:55:07.656516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.084006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.627089+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:55:30.627089+0000","last_peered":"2024-09-14T11:55:30.627089+0000","last_clean":"2024-09-14T11:55:30.627089+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:55:30.627089+0000","last_undegraded":"2024-09-14T11:55:30.627089+0000","last_fullsized":"2024-09-14T11:55:30.627089+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.809740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1055","reported_seq":2864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445536+0000","last_change":"2024-09-14T10:56:41.693098+0000","last_active":"2024-09-14T11:57:22.445536+0000","last_peered":"2024-09-14T11:57:22.445536+0000","last_clean":"2024-09-14T11:57:22.445536+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:57:22.445536+0000","last_undegraded":"2024-09-14T11:57:22.445536+0000","last_fullsized":"2024-09-14T11:57:22.445536+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1000,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:04.578146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'438","reported_seq":1115,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.259216+0000","last_change":"2024-09-14T10:56:39.696942+0000","last_active":"2024-09-14T11:58:39.259216+0000","last_peered":"2024-09-14T11:58:39.259216+0000","last_clean":"2024-09-14T11:58:39.259216+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:39.259216+0000","last_undegraded":"2024-09-14T11:58:39.259216+0000","last_fullsized":"2024-09-14T11:58:39.259216+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:03.017295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":832,"num_read_kb":46830,"num_write":1292,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656693+0000","last_change":"2024-09-14T10:56:43.695342+0000","last_active":"2024-09-14T11:55:07.656693+0000","last_peered":"2024-09-14T11:55:07.656693+0000","last_clean":"2024-09-14T11:55:07.656693+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:55:07.656693+0000","last_undegraded":"2024-09-14T11:55:07.656693+0000","last_fullsized":"2024-09-14T11:55:07.656693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:45.552140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.731707+0000","last_change":"2024-09-14T10:56:45.719223+0000","last_active":"2024-09-14T11:57:18.731707+0000","last_peered":"2024-09-14T11:57:18.731707+0000","last_clean":"2024-09-14T11:57:18.731707+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:57:18.731707+0000","last_undegraded":"2024-09-14T11:57:18.731707+0000","last_fullsized":"2024-09-14T11:57:18.731707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:12.736414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672205+0000","last_change":"2024-09-14T10:56:47.735092+0000","last_active":"2024-09-14T11:55:07.672205+0000","last_peered":"2024-09-14T11:55:07.672205+0000","last_clean":"2024-09-14T11:55:07.672205+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:55:07.672205+0000","last_undegraded":"2024-09-14T11:55:07.672205+0000","last_fullsized":"2024-09-14T11:55:07.672205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:26.157686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.919060+0000","last_change":"2024-09-14T10:56:49.748097+0000","last_active":"2024-09-14T11:56:51.919060+0000","last_peered":"2024-09-14T11:56:51.919060+0000","last_clean":"2024-09-14T11:56:51.919060+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:56:51.919060+0000","last_undegraded":"2024-09-14T11:56:51.919060+0000","last_fullsized":"2024-09-14T11:56:51.919060+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:32.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'555","reported_seq":2134,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655868+0000","last_change":"2024-09-14T10:56:41.695455+0000","last_active":"2024-09-14T11:55:02.655868+0000","last_peered":"2024-09-14T11:55:02.655868+0000","last_clean":"2024-09-14T11:55:02.655868+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:55:02.655868+0000","last_undegraded":"2024-09-14T11:55:02.655868+0000","last_fullsized":"2024-09-14T11:55:02.655868+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:23:44.292580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'400","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.264400+0000","last_change":"2024-09-14T10:56:39.690454+0000","last_active":"2024-09-14T11:58:39.264400+0000","last_peered":"2024-09-14T11:58:39.264400+0000","last_clean":"2024-09-14T11:58:39.264400+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:39.264400+0000","last_undegraded":"2024-09-14T11:58:39.264400+0000","last_fullsized":"2024-09-14T11:58:39.264400+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:21.163573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":842,"num_read_kb":27462,"num_write":1412,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672163+0000","last_change":"2024-09-14T10:56:43.699062+0000","last_active":"2024-09-14T11:55:07.672163+0000","last_peered":"2024-09-14T11:55:07.672163+0000","last_clean":"2024-09-14T11:55:07.672163+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:55:07.672163+0000","last_undegraded":"2024-09-14T11:55:07.672163+0000","last_fullsized":"2024-09-14T11:55:07.672163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:26.963005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'327","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.855084+0000","last_change":"2024-09-14T10:56:45.715959+0000","last_active":"2024-09-14T11:58:37.855084+0000","last_peered":"2024-09-14T11:58:37.855084+0000","last_clean":"2024-09-14T11:58:37.855084+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:58:37.855084+0000","last_undegraded":"2024-09-14T11:58:37.855084+0000","last_fullsized":"2024-09-14T11:58:37.855084+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:05.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1216,"num_write":428,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670532+0000","last_change":"2024-09-14T10:56:47.732777+0000","last_active":"2024-09-14T11:55:08.670532+0000","last_peered":"2024-09-14T11:55:08.670532+0000","last_clean":"2024-09-14T11:55:08.670532+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:55:08.670532+0000","last_undegraded":"2024-09-14T11:55:08.670532+0000","last_fullsized":"2024-09-14T11:55:08.670532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:56.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'132","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:50.364550+0000","last_change":"2024-09-14T10:56:49.744968+0000","last_active":"2024-09-14T11:55:50.364550+0000","last_peered":"2024-09-14T11:55:50.364550+0000","last_clean":"2024-09-14T11:55:50.364550+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:55:50.364550+0000","last_undegraded":"2024-09-14T11:55:50.364550+0000","last_fullsized":"2024-09-14T11:55:50.364550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.920523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'545","reported_seq":2232,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655810+0000","last_change":"2024-09-14T10:56:41.692451+0000","last_active":"2024-09-14T11:55:02.655810+0000","last_peered":"2024-09-14T11:55:02.655810+0000","last_clean":"2024-09-14T11:55:02.655810+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:55:02.655810+0000","last_undegraded":"2024-09-14T11:55:02.655810+0000","last_fullsized":"2024-09-14T11:55:02.655810+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:39.672416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'377","reported_seq":1035,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.259243+0000","last_change":"2024-09-14T10:56:39.691385+0000","last_active":"2024-09-14T11:58:39.259243+0000","last_peered":"2024-09-14T11:58:39.259243+0000","last_clean":"2024-09-14T11:58:39.259243+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:39.259243+0000","last_undegraded":"2024-09-14T11:58:39.259243+0000","last_fullsized":"2024-09-14T11:58:39.259243+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:17.578995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":41704,"num_write":1258,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669646+0000","last_change":"2024-09-14T10:56:43.704083+0000","last_active":"2024-09-14T11:55:03.669646+0000","last_peered":"2024-09-14T11:55:03.669646+0000","last_clean":"2024-09-14T11:55:03.669646+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:55:03.669646+0000","last_undegraded":"2024-09-14T11:55:03.669646+0000","last_fullsized":"2024-09-14T11:55:03.669646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:53.605990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'282","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.608467+0000","last_change":"2024-09-14T10:56:45.716753+0000","last_active":"2024-09-14T11:58:37.608467+0000","last_peered":"2024-09-14T11:58:37.608467+0000","last_clean":"2024-09-14T11:58:37.608467+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:58:37.608467+0000","last_undegraded":"2024-09-14T11:58:37.608467+0000","last_fullsized":"2024-09-14T11:58:37.608467+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:06.690939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1119,"num_write":378,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656266+0000","last_change":"2024-09-14T10:56:47.736112+0000","last_active":"2024-09-14T11:55:07.656266+0000","last_peered":"2024-09-14T11:55:07.656266+0000","last_clean":"2024-09-14T11:55:07.656266+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:55:07.656266+0000","last_undegraded":"2024-09-14T11:55:07.656266+0000","last_fullsized":"2024-09-14T11:55:07.656266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:10.784169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'481","reported_seq":2276,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.461087+0000","last_change":"2024-09-14T10:56:41.690497+0000","last_active":"2024-09-14T11:56:10.461087+0000","last_peered":"2024-09-14T11:56:10.461087+0000","last_clean":"2024-09-14T11:56:10.461087+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:56:10.461087+0000","last_undegraded":"2024-09-14T11:56:10.461087+0000","last_fullsized":"2024-09-14T11:56:10.461087+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:04.625419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'309","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.231290+0000","last_change":"2024-09-14T10:56:39.680360+0000","last_active":"2024-09-14T11:58:39.231290+0000","last_peered":"2024-09-14T11:58:39.231290+0000","last_clean":"2024-09-14T11:58:39.231290+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:39.231290+0000","last_undegraded":"2024-09-14T11:58:39.231290+0000","last_fullsized":"2024-09-14T11:58:39.231290+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:47.696842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":570,"num_read_kb":63784,"num_write":891,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"37'3","reported_seq":976,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.156737+0000","last_change":"2024-09-14T10:56:43.698511+0000","last_active":"2024-09-14T11:58:36.156737+0000","last_peered":"2024-09-14T11:58:36.156737+0000","last_clean":"2024-09-14T11:58:36.156737+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:36.156737+0000","last_undegraded":"2024-09-14T11:58:36.156737+0000","last_fullsized":"2024-09-14T11:58:36.156737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.127093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'498","reported_seq":1131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.281601+0000","last_change":"2024-09-14T10:56:45.720443+0000","last_active":"2024-09-14T11:58:39.281601+0000","last_peered":"2024-09-14T11:58:39.281601+0000","last_clean":"2024-09-14T11:58:39.281601+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:58:39.281601+0000","last_undegraded":"2024-09-14T11:58:39.281601+0000","last_fullsized":"2024-09-14T11:58:39.281601+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.146179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":902,"num_read_kb":2267,"num_write":774,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541697+0000","last_change":"2024-09-14T10:56:47.731799+0000","last_active":"2024-09-14T11:54:17.541697+0000","last_peered":"2024-09-14T11:54:17.541697+0000","last_clean":"2024-09-14T11:54:17.541697+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:54:17.541697+0000","last_undegraded":"2024-09-14T11:54:17.541697+0000","last_fullsized":"2024-09-14T11:54:17.541697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.343090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'455","reported_seq":2079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.266414+0000","last_change":"2024-09-14T10:56:41.691362+0000","last_active":"2024-09-14T11:55:58.266414+0000","last_peered":"2024-09-14T11:55:58.266414+0000","last_clean":"2024-09-14T11:55:58.266414+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:55:58.266414+0000","last_undegraded":"2024-09-14T11:55:58.266414+0000","last_fullsized":"2024-09-14T11:55:58.266414+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:01.380624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'347","reported_seq":983,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.179667+0000","last_change":"2024-09-14T10:56:39.673809+0000","last_active":"2024-09-14T11:58:39.179667+0000","last_peered":"2024-09-14T11:58:39.179667+0000","last_clean":"2024-09-14T11:58:39.179667+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:39.179667+0000","last_undegraded":"2024-09-14T11:58:39.179667+0000","last_fullsized":"2024-09-14T11:58:39.179667+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:41:32.335582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":604,"num_read_kb":50717,"num_write":1053,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669754+0000","last_change":"2024-09-14T10:56:43.701698+0000","last_active":"2024-09-14T11:55:03.669754+0000","last_peered":"2024-09-14T11:55:03.669754+0000","last_clean":"2024-09-14T11:55:03.669754+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:55:03.669754+0000","last_undegraded":"2024-09-14T11:55:03.669754+0000","last_fullsized":"2024-09-14T11:55:03.669754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:12.260764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'314","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.693526+0000","last_change":"2024-09-14T10:56:45.719927+0000","last_active":"2024-09-14T11:58:37.693526+0000","last_peered":"2024-09-14T11:58:37.693526+0000","last_clean":"2024-09-14T11:58:37.693526+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:58:37.693526+0000","last_undegraded":"2024-09-14T11:58:37.693526+0000","last_fullsized":"2024-09-14T11:58:37.693526+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51994,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":540,"num_read_kb":1196,"num_write":444,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529645+0000","last_change":"2024-09-14T10:56:47.726517+0000","last_active":"2024-09-14T11:54:17.529645+0000","last_peered":"2024-09-14T11:54:17.529645+0000","last_clean":"2024-09-14T11:54:17.529645+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:54:17.529645+0000","last_undegraded":"2024-09-14T11:54:17.529645+0000","last_fullsized":"2024-09-14T11:54:17.529645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:13.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'150","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.548609+0000","last_change":"2024-09-14T10:56:49.743152+0000","last_active":"2024-09-14T11:55:43.548609+0000","last_peered":"2024-09-14T11:55:43.548609+0000","last_clean":"2024-09-14T11:55:43.548609+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:55:43.548609+0000","last_undegraded":"2024-09-14T11:55:43.548609+0000","last_fullsized":"2024-09-14T11:55:43.548609+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:00.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'552","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.443381+0000","last_change":"2024-09-14T10:56:41.685799+0000","last_active":"2024-09-14T11:56:42.443381+0000","last_peered":"2024-09-14T11:56:42.443381+0000","last_clean":"2024-09-14T11:56:42.443381+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:56:42.443381+0000","last_undegraded":"2024-09-14T11:56:42.443381+0000","last_fullsized":"2024-09-14T11:56:42.443381+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'339","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.240998+0000","last_change":"2024-09-14T10:56:39.684773+0000","last_active":"2024-09-14T11:58:39.240998+0000","last_peered":"2024-09-14T11:58:39.240998+0000","last_clean":"2024-09-14T11:58:39.240998+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:39.240998+0000","last_undegraded":"2024-09-14T11:58:39.240998+0000","last_fullsized":"2024-09-14T11:58:39.240998+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.903799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":82907,"num_write":1088,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542445+0000","last_change":"2024-09-14T10:56:43.704594+0000","last_active":"2024-09-14T11:54:13.542445+0000","last_peered":"2024-09-14T11:54:13.542445+0000","last_clean":"2024-09-14T11:54:13.542445+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:54:13.542445+0000","last_undegraded":"2024-09-14T11:54:13.542445+0000","last_fullsized":"2024-09-14T11:54:13.542445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'306","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.135590+0000","last_change":"2024-09-14T10:56:45.713501+0000","last_active":"2024-09-14T11:58:39.135590+0000","last_peered":"2024-09-14T11:58:39.135590+0000","last_clean":"2024-09-14T11:58:39.135590+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:58:39.135590+0000","last_undegraded":"2024-09-14T11:58:39.135590+0000","last_fullsized":"2024-09-14T11:58:39.135590+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:35.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1144,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534180+0000","last_change":"2024-09-14T10:56:47.733388+0000","last_active":"2024-09-14T11:54:57.534180+0000","last_peered":"2024-09-14T11:54:57.534180+0000","last_clean":"2024-09-14T11:54:57.534180+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:54:57.534180+0000","last_undegraded":"2024-09-14T11:54:57.534180+0000","last_fullsized":"2024-09-14T11:54:57.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:15:57.789850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'166","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311096+0000","last_change":"2024-09-14T10:56:49.745862+0000","last_active":"2024-09-14T11:58:11.311096+0000","last_peered":"2024-09-14T11:58:11.311096+0000","last_clean":"2024-09-14T11:58:11.311096+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:58:11.311096+0000","last_undegraded":"2024-09-14T11:58:11.311096+0000","last_fullsized":"2024-09-14T11:58:11.311096+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.824927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'529","reported_seq":2209,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.873131+0000","last_change":"2024-09-14T10:56:41.686220+0000","last_active":"2024-09-14T11:58:09.873131+0000","last_peered":"2024-09-14T11:58:09.873131+0000","last_clean":"2024-09-14T11:58:09.873131+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:09.873131+0000","last_undegraded":"2024-09-14T11:58:09.873131+0000","last_fullsized":"2024-09-14T11:58:09.873131+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:42:09.136596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'377","reported_seq":1030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.184949+0000","last_change":"2024-09-14T10:57:16.216561+0000","last_active":"2024-09-14T11:58:39.184949+0000","last_peered":"2024-09-14T11:58:39.184949+0000","last_clean":"2024-09-14T11:58:39.184949+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:39.184949+0000","last_undegraded":"2024-09-14T11:58:39.184949+0000","last_fullsized":"2024-09-14T11:58:39.184949+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:35.906606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":42073,"num_write":1144,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529656+0000","last_change":"2024-09-14T10:56:43.707654+0000","last_active":"2024-09-14T11:54:17.529656+0000","last_peered":"2024-09-14T11:54:17.529656+0000","last_clean":"2024-09-14T11:54:17.529656+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:54:17.529656+0000","last_undegraded":"2024-09-14T11:54:17.529656+0000","last_fullsized":"2024-09-14T11:54:17.529656+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:47.644607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'102","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.120594+0000","last_change":"2024-09-14T10:56:45.723330+0000","last_active":"2024-09-14T11:57:19.120594+0000","last_peered":"2024-09-14T11:57:19.120594+0000","last_clean":"2024-09-14T11:57:19.120594+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:57:19.120594+0000","last_undegraded":"2024-09-14T11:57:19.120594+0000","last_fullsized":"2024-09-14T11:57:19.120594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.375494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'777","reported_seq":4309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.123160+0000","last_change":"2024-09-14T10:56:47.725052+0000","last_active":"2024-09-14T11:58:38.123160+0000","last_peered":"2024-09-14T11:58:38.123160+0000","last_clean":"2024-09-14T11:58:38.123160+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:58:38.123160+0000","last_undegraded":"2024-09-14T11:58:38.123160+0000","last_fullsized":"2024-09-14T11:58:38.123160+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:47.209530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.919170+0000","last_change":"2024-09-14T10:56:49.751037+0000","last_active":"2024-09-14T11:56:52.919170+0000","last_peered":"2024-09-14T11:56:52.919170+0000","last_clean":"2024-09-14T11:56:52.919170+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:56:52.919170+0000","last_undegraded":"2024-09-14T11:56:52.919170+0000","last_fullsized":"2024-09-14T11:56:52.919170+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:10.690807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'413","reported_seq":2028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.748759+0000","last_change":"2024-09-14T10:56:41.697565+0000","last_active":"2024-09-14T11:56:52.748759+0000","last_peered":"2024-09-14T11:56:52.748759+0000","last_clean":"2024-09-14T11:56:52.748759+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:56:52.748759+0000","last_undegraded":"2024-09-14T11:56:52.748759+0000","last_fullsized":"2024-09-14T11:56:52.748759+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:10.886767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'292","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.153058+0000","last_change":"2024-09-14T10:56:39.680420+0000","last_active":"2024-09-14T11:58:39.153058+0000","last_peered":"2024-09-14T11:58:39.153058+0000","last_clean":"2024-09-14T11:58:39.153058+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:39.153058+0000","last_undegraded":"2024-09-14T11:58:39.153058+0000","last_fullsized":"2024-09-14T11:58:39.153058+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:32.687547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":9665,"num_write":976,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.664084+0000","last_change":"2024-09-14T10:56:43.698568+0000","last_active":"2024-09-14T11:54:17.664084+0000","last_peered":"2024-09-14T11:54:17.664084+0000","last_clean":"2024-09-14T11:54:17.664084+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:54:17.664084+0000","last_undegraded":"2024-09-14T11:54:17.664084+0000","last_fullsized":"2024-09-14T11:54:17.664084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:50.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'320","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.981914+0000","last_change":"2024-09-14T10:56:45.718845+0000","last_active":"2024-09-14T11:58:36.981914+0000","last_peered":"2024-09-14T11:58:36.981914+0000","last_clean":"2024-09-14T11:58:36.981914+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:58:36.981914+0000","last_undegraded":"2024-09-14T11:58:36.981914+0000","last_fullsized":"2024-09-14T11:58:36.981914+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:13.209858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653460+0000","last_change":"2024-09-14T10:56:47.733362+0000","last_active":"2024-09-14T11:54:47.653460+0000","last_peered":"2024-09-14T11:54:47.653460+0000","last_clean":"2024-09-14T11:54:47.653460+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:54:47.653460+0000","last_undegraded":"2024-09-14T11:54:47.653460+0000","last_fullsized":"2024-09-14T11:54:47.653460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:33.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'123","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.829287+0000","last_change":"2024-09-14T10:56:49.749682+0000","last_active":"2024-09-14T11:56:49.829287+0000","last_peered":"2024-09-14T11:56:49.829287+0000","last_clean":"2024-09-14T11:56:49.829287+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:56:49.829287+0000","last_undegraded":"2024-09-14T11:56:49.829287+0000","last_fullsized":"2024-09-14T11:56:49.829287+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:32.089427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'396","reported_seq":1833,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.284146+0000","last_change":"2024-09-14T10:56:41.695266+0000","last_active":"2024-09-14T11:56:49.284146+0000","last_peered":"2024-09-14T11:56:49.284146+0000","last_clean":"2024-09-14T11:56:49.284146+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:56:49.284146+0000","last_undegraded":"2024-09-14T11:56:49.284146+0000","last_fullsized":"2024-09-14T11:56:49.284146+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:18.489293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'329","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.194183+0000","last_change":"2024-09-14T10:56:39.681309+0000","last_active":"2024-09-14T11:58:39.194183+0000","last_peered":"2024-09-14T11:58:39.194183+0000","last_clean":"2024-09-14T11:58:39.194183+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:39.194183+0000","last_undegraded":"2024-09-14T11:58:39.194183+0000","last_fullsized":"2024-09-14T11:58:39.194183+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:25:25.783922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":577,"num_read_kb":29813,"num_write":1080,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541668+0000","last_change":"2024-09-14T10:56:43.698362+0000","last_active":"2024-09-14T11:54:17.541668+0000","last_peered":"2024-09-14T11:54:17.541668+0000","last_clean":"2024-09-14T11:54:17.541668+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:54:17.541668+0000","last_undegraded":"2024-09-14T11:54:17.541668+0000","last_fullsized":"2024-09-14T11:54:17.541668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.790448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.069236+0000","last_change":"2024-09-14T10:56:45.714250+0000","last_active":"2024-09-14T11:58:37.069236+0000","last_peered":"2024-09-14T11:58:37.069236+0000","last_clean":"2024-09-14T11:58:37.069236+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:58:37.069236+0000","last_undegraded":"2024-09-14T11:58:37.069236+0000","last_fullsized":"2024-09-14T11:58:37.069236+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:33.117467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669009+0000","last_change":"2024-09-14T10:56:47.735191+0000","last_active":"2024-09-14T11:54:58.669009+0000","last_peered":"2024-09-14T11:54:58.669009+0000","last_clean":"2024-09-14T11:54:58.669009+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:54:58.669009+0000","last_undegraded":"2024-09-14T11:54:58.669009+0000","last_fullsized":"2024-09-14T11:54:58.669009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.084195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'105","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.049900+0000","last_change":"2024-09-14T10:56:49.737999+0000","last_active":"2024-09-14T11:56:00.049900+0000","last_peered":"2024-09-14T11:56:00.049900+0000","last_clean":"2024-09-14T11:56:00.049900+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:56:00.049900+0000","last_undegraded":"2024-09-14T11:56:00.049900+0000","last_fullsized":"2024-09-14T11:56:00.049900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.183467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'350","reported_seq":1779,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553158+0000","last_change":"2024-09-14T10:57:15.793797+0000","last_active":"2024-09-14T11:55:32.553158+0000","last_peered":"2024-09-14T11:55:32.553158+0000","last_clean":"2024-09-14T11:55:32.553158+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:55:32.553158+0000","last_undegraded":"2024-09-14T11:55:32.553158+0000","last_fullsized":"2024-09-14T11:55:32.553158+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:28.436278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'405","reported_seq":1068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.178812+0000","last_change":"2024-09-14T10:56:39.693756+0000","last_active":"2024-09-14T11:58:39.178812+0000","last_peered":"2024-09-14T11:58:39.178812+0000","last_clean":"2024-09-14T11:58:39.178812+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:39.178812+0000","last_undegraded":"2024-09-14T11:58:39.178812+0000","last_fullsized":"2024-09-14T11:58:39.178812+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:17.761828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":727,"num_read_kb":11025,"num_write":1267,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.546906+0000","last_change":"2024-09-14T10:56:43.701839+0000","last_active":"2024-09-14T11:54:43.546906+0000","last_peered":"2024-09-14T11:54:43.546906+0000","last_clean":"2024-09-14T11:54:43.546906+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:54:43.546906+0000","last_undegraded":"2024-09-14T11:54:43.546906+0000","last_fullsized":"2024-09-14T11:54:43.546906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:17.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'237","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.003074+0000","last_change":"2024-09-14T10:56:45.717972+0000","last_active":"2024-09-14T11:58:39.003074+0000","last_peered":"2024-09-14T11:58:39.003074+0000","last_clean":"2024-09-14T11:58:39.003074+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:58:39.003074+0000","last_undegraded":"2024-09-14T11:58:39.003074+0000","last_fullsized":"2024-09-14T11:58:39.003074+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:35.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":992,"num_write":326,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.543346+0000","last_change":"2024-09-14T10:56:47.727607+0000","last_active":"2024-09-14T11:54:18.543346+0000","last_peered":"2024-09-14T11:54:18.543346+0000","last_clean":"2024-09-14T11:54:18.543346+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:54:18.543346+0000","last_undegraded":"2024-09-14T11:54:18.543346+0000","last_fullsized":"2024-09-14T11:54:18.543346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:25.985367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'158","reported_seq":1613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.803159+0000","last_change":"2024-09-14T10:56:49.749341+0000","last_active":"2024-09-14T11:56:49.803159+0000","last_peered":"2024-09-14T11:56:49.803159+0000","last_clean":"2024-09-14T11:56:49.803159+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:56:49.803159+0000","last_undegraded":"2024-09-14T11:56:49.803159+0000","last_fullsized":"2024-09-14T11:56:49.803159+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:09.689856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'469","reported_seq":2224,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313472+0000","last_change":"2024-09-14T10:56:41.688125+0000","last_active":"2024-09-14T11:56:49.313472+0000","last_peered":"2024-09-14T11:56:49.313472+0000","last_clean":"2024-09-14T11:56:49.313472+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:56:49.313472+0000","last_undegraded":"2024-09-14T11:56:49.313472+0000","last_fullsized":"2024-09-14T11:56:49.313472+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:10.186168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'401","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.118802+0000","last_change":"2024-09-14T10:57:16.215872+0000","last_active":"2024-09-14T11:58:39.118802+0000","last_peered":"2024-09-14T11:58:39.118802+0000","last_clean":"2024-09-14T11:58:39.118802+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:39.118802+0000","last_undegraded":"2024-09-14T11:58:39.118802+0000","last_fullsized":"2024-09-14T11:58:39.118802+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:32.841426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":747,"num_read_kb":46945,"num_write":1297,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534114+0000","last_change":"2024-09-14T10:56:43.704444+0000","last_active":"2024-09-14T11:54:57.534114+0000","last_peered":"2024-09-14T11:54:57.534114+0000","last_clean":"2024-09-14T11:54:57.534114+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:54:57.534114+0000","last_undegraded":"2024-09-14T11:54:57.534114+0000","last_fullsized":"2024-09-14T11:54:57.534114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:01.463719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'301","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.200076+0000","last_change":"2024-09-14T10:56:45.721400+0000","last_active":"2024-09-14T11:58:39.200076+0000","last_peered":"2024-09-14T11:58:39.200076+0000","last_clean":"2024-09-14T11:58:39.200076+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:58:39.200076+0000","last_undegraded":"2024-09-14T11:58:39.200076+0000","last_fullsized":"2024-09-14T11:58:39.200076+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.182048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1073,"num_write":380,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.649773+0000","last_change":"2024-09-14T10:56:47.736437+0000","last_active":"2024-09-14T11:54:17.649773+0000","last_peered":"2024-09-14T11:54:17.649773+0000","last_clean":"2024-09-14T11:54:17.649773+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:54:17.649773+0000","last_undegraded":"2024-09-14T11:54:17.649773+0000","last_fullsized":"2024-09-14T11:54:17.649773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:00.826459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.871440+0000","last_change":"2024-09-14T10:56:49.747246+0000","last_active":"2024-09-14T11:58:09.871440+0000","last_peered":"2024-09-14T11:58:09.871440+0000","last_clean":"2024-09-14T11:58:09.871440+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:58:09.871440+0000","last_undegraded":"2024-09-14T11:58:09.871440+0000","last_fullsized":"2024-09-14T11:58:09.871440+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:08.836336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'582","reported_seq":2253,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909450+0000","last_change":"2024-09-14T10:56:41.697790+0000","last_active":"2024-09-14T11:56:51.909450+0000","last_peered":"2024-09-14T11:56:51.909450+0000","last_clean":"2024-09-14T11:56:51.909450+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:56:51.909450+0000","last_undegraded":"2024-09-14T11:56:51.909450+0000","last_fullsized":"2024-09-14T11:56:51.909450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:34:08.908846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'351","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.271174+0000","last_change":"2024-09-14T10:56:39.673208+0000","last_active":"2024-09-14T11:58:39.271174+0000","last_peered":"2024-09-14T11:58:39.271174+0000","last_clean":"2024-09-14T11:58:39.271174+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:39.271174+0000","last_undegraded":"2024-09-14T11:58:39.271174+0000","last_fullsized":"2024-09-14T11:58:39.271174+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:40.389425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":646,"num_read_kb":60949,"num_write":1082,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1051","reported_seq":2932,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.782289+0000","last_change":"2024-09-14T10:56:41.690469+0000","last_active":"2024-09-14T11:56:52.782289+0000","last_peered":"2024-09-14T11:56:52.782289+0000","last_clean":"2024-09-14T11:56:52.782289+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:56:52.782289+0000","last_undegraded":"2024-09-14T11:56:52.782289+0000","last_fullsized":"2024-09-14T11:56:52.782289+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":1000,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:54:19.835570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'359","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.217963+0000","last_change":"2024-09-14T10:56:39.682932+0000","last_active":"2024-09-14T11:58:39.217963+0000","last_peered":"2024-09-14T11:58:39.217963+0000","last_clean":"2024-09-14T11:58:39.217963+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:39.217963+0000","last_undegraded":"2024-09-14T11:58:39.217963+0000","last_fullsized":"2024-09-14T11:58:39.217963+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:56.634779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":22760,"num_write":1134,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'997","reported_seq":2611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.909714+0000","last_change":"2024-09-14T10:56:41.690506+0000","last_active":"2024-09-14T11:56:51.909714+0000","last_peered":"2024-09-14T11:56:51.909714+0000","last_clean":"2024-09-14T11:56:51.909714+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:56:51.909714+0000","last_undegraded":"2024-09-14T11:56:51.909714+0000","last_fullsized":"2024-09-14T11:56:51.909714+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":900,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:24.682037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'338","reported_seq":1070,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.277622+0000","last_change":"2024-09-14T10:56:39.691542+0000","last_active":"2024-09-14T11:58:39.277622+0000","last_peered":"2024-09-14T11:58:39.277622+0000","last_clean":"2024-09-14T11:58:39.277622+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:39.277622+0000","last_undegraded":"2024-09-14T11:58:39.277622+0000","last_fullsized":"2024-09-14T11:58:39.277622+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:07.545833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":988,"num_read_kb":42151,"num_write":1083,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'860","reported_seq":2442,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.336478+0000","last_change":"2024-09-14T10:56:41.689333+0000","last_active":"2024-09-14T11:56:18.336478+0000","last_peered":"2024-09-14T11:56:18.336478+0000","last_clean":"2024-09-14T11:56:18.336478+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:56:18.336478+0000","last_undegraded":"2024-09-14T11:56:18.336478+0000","last_fullsized":"2024-09-14T11:56:18.336478+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:19.787509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1073,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.175619+0000","last_change":"2024-09-14T10:56:39.694580+0000","last_active":"2024-09-14T11:58:39.175619+0000","last_peered":"2024-09-14T11:58:39.175619+0000","last_clean":"2024-09-14T11:58:39.175619+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:39.175619+0000","last_undegraded":"2024-09-14T11:58:39.175619+0000","last_fullsized":"2024-09-14T11:58:39.175619+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:23.950117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":875,"num_read_kb":14120,"num_write":1246,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1634","reported_seq":3354,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.881920+0000","last_change":"2024-09-14T10:56:41.696853+0000","last_active":"2024-09-14T11:58:09.881920+0000","last_peered":"2024-09-14T11:58:09.881920+0000","last_clean":"2024-09-14T11:58:09.881920+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:58:09.881920+0000","last_undegraded":"2024-09-14T11:58:09.881920+0000","last_fullsized":"2024-09-14T11:58:09.881920+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1600,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:47.117707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'410","reported_seq":1071,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.224452+0000","last_change":"2024-09-14T10:56:39.676793+0000","last_active":"2024-09-14T11:58:39.224452+0000","last_peered":"2024-09-14T11:58:39.224452+0000","last_clean":"2024-09-14T11:58:39.224452+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:39.224452+0000","last_undegraded":"2024-09-14T11:58:39.224452+0000","last_fullsized":"2024-09-14T11:58:39.224452+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:03.840083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":770,"num_read_kb":3391,"num_write":1187,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'525","reported_seq":2238,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.753104+0000","last_change":"2024-09-14T10:56:41.687648+0000","last_active":"2024-09-14T11:56:12.753104+0000","last_peered":"2024-09-14T11:56:12.753104+0000","last_clean":"2024-09-14T11:56:12.753104+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:56:12.753104+0000","last_undegraded":"2024-09-14T11:56:12.753104+0000","last_fullsized":"2024-09-14T11:56:12.753104+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:36.574356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'413","reported_seq":1152,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.249002+0000","last_change":"2024-09-14T10:56:39.671687+0000","last_active":"2024-09-14T11:58:39.249002+0000","last_peered":"2024-09-14T11:58:39.249002+0000","last_clean":"2024-09-14T11:58:39.249002+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:39.249002+0000","last_undegraded":"2024-09-14T11:58:39.249002+0000","last_fullsized":"2024-09-14T11:58:39.249002+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:50.335751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1077,"num_read_kb":5071,"num_write":1242,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'774","reported_seq":2302,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.874571+0000","last_change":"2024-09-14T10:56:41.691714+0000","last_active":"2024-09-14T11:58:09.874571+0000","last_peered":"2024-09-14T11:58:09.874571+0000","last_clean":"2024-09-14T11:58:09.874571+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:58:09.874571+0000","last_undegraded":"2024-09-14T11:58:09.874571+0000","last_fullsized":"2024-09-14T11:58:09.874571+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:17.443652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'362","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.217716+0000","last_change":"2024-09-14T10:56:39.686601+0000","last_active":"2024-09-14T11:58:39.217716+0000","last_peered":"2024-09-14T11:58:39.217716+0000","last_clean":"2024-09-14T11:58:39.217716+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:39.217716+0000","last_undegraded":"2024-09-14T11:58:39.217716+0000","last_fullsized":"2024-09-14T11:58:39.217716+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:31:57.339815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":6911,"num_write":1146,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'412","reported_seq":1943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.880186+0000","last_change":"2024-09-14T10:56:41.685678+0000","last_active":"2024-09-14T11:58:09.880186+0000","last_peered":"2024-09-14T11:58:09.880186+0000","last_clean":"2024-09-14T11:58:09.880186+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:09.880186+0000","last_undegraded":"2024-09-14T11:58:09.880186+0000","last_fullsized":"2024-09-14T11:58:09.880186+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:05.474990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'437","reported_seq":1297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.259282+0000","last_change":"2024-09-14T10:56:39.677501+0000","last_active":"2024-09-14T11:58:39.259282+0000","last_peered":"2024-09-14T11:58:39.259282+0000","last_clean":"2024-09-14T11:58:39.259282+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:39.259282+0000","last_undegraded":"2024-09-14T11:58:39.259282+0000","last_fullsized":"2024-09-14T11:58:39.259282+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:47.976042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1316,"num_read_kb":48095,"num_write":1372,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'717","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445682+0000","last_change":"2024-09-14T10:56:41.697391+0000","last_active":"2024-09-14T11:57:22.445682+0000","last_peered":"2024-09-14T11:57:22.445682+0000","last_clean":"2024-09-14T11:57:22.445682+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:57:22.445682+0000","last_undegraded":"2024-09-14T11:57:22.445682+0000","last_fullsized":"2024-09-14T11:57:22.445682+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:49.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'420","reported_seq":1124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.224435+0000","last_change":"2024-09-14T10:56:39.680650+0000","last_active":"2024-09-14T11:58:39.224435+0000","last_peered":"2024-09-14T11:58:39.224435+0000","last_clean":"2024-09-14T11:58:39.224435+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:39.224435+0000","last_undegraded":"2024-09-14T11:58:39.224435+0000","last_fullsized":"2024-09-14T11:58:39.224435+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:41.313359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":12822,"num_write":1366,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'498","reported_seq":2137,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.781318+0000","last_change":"2024-09-14T10:56:41.694523+0000","last_active":"2024-09-14T11:56:52.781318+0000","last_peered":"2024-09-14T11:56:52.781318+0000","last_clean":"2024-09-14T11:56:52.781318+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:56:52.781318+0000","last_undegraded":"2024-09-14T11:56:52.781318+0000","last_fullsized":"2024-09-14T11:56:52.781318+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:14.167389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'451","reported_seq":1291,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.171570+0000","last_change":"2024-09-14T10:56:39.685874+0000","last_active":"2024-09-14T11:58:39.171570+0000","last_peered":"2024-09-14T11:58:39.171570+0000","last_clean":"2024-09-14T11:58:39.171570+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:39.171570+0000","last_undegraded":"2024-09-14T11:58:39.171570+0000","last_fullsized":"2024-09-14T11:58:39.171570+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:00.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1544,"num_read_kb":34981,"num_write":1381,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1164","reported_seq":2724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.335677+0000","last_change":"2024-09-14T10:56:41.684712+0000","last_active":"2024-09-14T11:56:18.335677+0000","last_peered":"2024-09-14T11:56:18.335677+0000","last_clean":"2024-09-14T11:56:18.335677+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:56:18.335677+0000","last_undegraded":"2024-09-14T11:56:18.335677+0000","last_fullsized":"2024-09-14T11:56:18.335677+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":1100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:54.887564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'313","reported_seq":897,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.241799+0000","last_change":"2024-09-14T10:56:39.692620+0000","last_active":"2024-09-14T11:58:39.241799+0000","last_peered":"2024-09-14T11:58:39.241799+0000","last_clean":"2024-09-14T11:58:39.241799+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:39.241799+0000","last_undegraded":"2024-09-14T11:58:39.241799+0000","last_fullsized":"2024-09-14T11:58:39.241799+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:34.930510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":3420,"num_write":993,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'618","reported_seq":2432,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.780930+0000","last_change":"2024-09-14T10:56:41.688962+0000","last_active":"2024-09-14T11:56:52.780930+0000","last_peered":"2024-09-14T11:56:52.780930+0000","last_clean":"2024-09-14T11:56:52.780930+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:56:52.780930+0000","last_undegraded":"2024-09-14T11:56:52.780930+0000","last_fullsized":"2024-09-14T11:56:52.780930+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":600,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'341","reported_seq":985,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.187409+0000","last_change":"2024-09-14T10:57:16.314650+0000","last_active":"2024-09-14T11:58:39.187409+0000","last_peered":"2024-09-14T11:58:39.187409+0000","last_clean":"2024-09-14T11:58:39.187409+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:39.187409+0000","last_undegraded":"2024-09-14T11:58:39.187409+0000","last_fullsized":"2024-09-14T11:58:39.187409+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:28.239442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":7722,"num_write":1033,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1674","reported_seq":3374,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:53.817636+0000","last_change":"2024-09-14T10:56:41.701632+0000","last_active":"2024-09-14T11:55:53.817636+0000","last_peered":"2024-09-14T11:55:53.817636+0000","last_clean":"2024-09-14T11:55:53.817636+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:55:53.817636+0000","last_undegraded":"2024-09-14T11:55:53.817636+0000","last_fullsized":"2024-09-14T11:55:53.817636+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1600,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:14.899433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'359","reported_seq":1096,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.244008+0000","last_change":"2024-09-14T10:56:39.685631+0000","last_active":"2024-09-14T11:58:39.244008+0000","last_peered":"2024-09-14T11:58:39.244008+0000","last_clean":"2024-09-14T11:58:39.244008+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:39.244008+0000","last_undegraded":"2024-09-14T11:58:39.244008+0000","last_fullsized":"2024-09-14T11:58:39.244008+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:08:18.579809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":21069,"num_write":1116,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'702","reported_seq":2110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.754801+0000","last_change":"2024-09-14T10:57:15.795049+0000","last_active":"2024-09-14T11:56:12.754801+0000","last_peered":"2024-09-14T11:56:12.754801+0000","last_clean":"2024-09-14T11:56:12.754801+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:56:12.754801+0000","last_undegraded":"2024-09-14T11:56:12.754801+0000","last_fullsized":"2024-09-14T11:56:12.754801+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":600,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:10.949204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'327","reported_seq":929,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.232591+0000","last_change":"2024-09-14T10:56:39.690542+0000","last_active":"2024-09-14T11:58:39.232591+0000","last_peered":"2024-09-14T11:58:39.232591+0000","last_clean":"2024-09-14T11:58:39.232591+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:39.232591+0000","last_undegraded":"2024-09-14T11:58:39.232591+0000","last_fullsized":"2024-09-14T11:58:39.232591+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:29.115794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":36238,"num_write":1055,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'409","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910480+0000","last_change":"2024-09-14T10:56:41.690216+0000","last_active":"2024-09-14T11:56:51.910480+0000","last_peered":"2024-09-14T11:56:51.910480+0000","last_clean":"2024-09-14T11:56:51.910480+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:56:51.910480+0000","last_undegraded":"2024-09-14T11:56:51.910480+0000","last_fullsized":"2024-09-14T11:56:51.910480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'371","reported_seq":1101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.235484+0000","last_change":"2024-09-14T10:57:16.215847+0000","last_active":"2024-09-14T11:58:39.235484+0000","last_peered":"2024-09-14T11:58:39.235484+0000","last_clean":"2024-09-14T11:58:39.235484+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:39.235484+0000","last_undegraded":"2024-09-14T11:58:39.235484+0000","last_fullsized":"2024-09-14T11:58:39.235484+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:31.860521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":882,"num_read_kb":32736,"num_write":1182,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'725","reported_seq":2252,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337741+0000","last_change":"2024-09-14T10:56:41.695355+0000","last_active":"2024-09-14T11:56:18.337741+0000","last_peered":"2024-09-14T11:56:18.337741+0000","last_clean":"2024-09-14T11:56:18.337741+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:56:18.337741+0000","last_undegraded":"2024-09-14T11:56:18.337741+0000","last_fullsized":"2024-09-14T11:56:18.337741+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:11.776564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'355","reported_seq":1012,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.246341+0000","last_change":"2024-09-14T10:56:39.685637+0000","last_active":"2024-09-14T11:58:39.246341+0000","last_peered":"2024-09-14T11:58:39.246341+0000","last_clean":"2024-09-14T11:58:39.246341+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:39.246341+0000","last_undegraded":"2024-09-14T11:58:39.246341+0000","last_fullsized":"2024-09-14T11:58:39.246341+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:42.995946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":35326,"num_write":1083,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'299","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.212173+0000","last_change":"2024-09-14T10:56:39.685937+0000","last_active":"2024-09-14T11:58:39.212173+0000","last_peered":"2024-09-14T11:58:39.212173+0000","last_clean":"2024-09-14T11:58:39.212173+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:39.212173+0000","last_undegraded":"2024-09-14T11:58:39.212173+0000","last_fullsized":"2024-09-14T11:58:39.212173+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:34:14.470574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":8144,"num_write":967,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'848","reported_seq":2539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.311836+0000","last_change":"2024-09-14T10:56:41.697673+0000","last_active":"2024-09-14T11:56:49.311836+0000","last_peered":"2024-09-14T11:56:49.311836+0000","last_clean":"2024-09-14T11:56:49.311836+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:56:49.311836+0000","last_undegraded":"2024-09-14T11:56:49.311836+0000","last_fullsized":"2024-09-14T11:56:49.311836+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:15.211850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'398","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.238830+0000","last_change":"2024-09-14T10:56:39.678521+0000","last_active":"2024-09-14T11:58:39.238830+0000","last_peered":"2024-09-14T11:58:39.238830+0000","last_clean":"2024-09-14T11:58:39.238830+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:39.238830+0000","last_undegraded":"2024-09-14T11:58:39.238830+0000","last_fullsized":"2024-09-14T11:58:39.238830+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:38.643392+0000","last_clean_scrub_stamp":"2024-09-14T10:56:38.643392+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:30.975047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":40288,"num_write":1313,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'389","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:04.142380+0000","last_change":"2024-09-14T10:56:41.693372+0000","last_active":"2024-09-14T11:56:04.142380+0000","last_peered":"2024-09-14T11:56:04.142380+0000","last_clean":"2024-09-14T11:56:04.142380+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:56:04.142380+0000","last_undegraded":"2024-09-14T11:56:04.142380+0000","last_fullsized":"2024-09-14T11:56:04.142380+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:08.940223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1898,"ondisk_log_size":1898,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1660817,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18638,"num_read_kb":39748,"num_write":15595,"num_write_kb":12041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2008,"ondisk_log_size":2008,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3597,"ondisk_log_size":3597,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":43145697,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44629,"num_read_kb":1932119,"num_write":73662,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59392000,"data_stored":59392000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3707,"ondisk_log_size":3707,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":187491,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":178270,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510195,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296580,"kb_used_data":12432,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075260,"statfs":{"total":96636764160,"available":96333066240,"internally_reserved":0,"allocated":12730368,"data_stored":10789257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510192,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147360,"kb_used_data":13412,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":94224480,"statfs":{"total":96636764160,"available":96485867520,"internally_reserved":0,"allocated":13733888,"data_stored":11812366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542894,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313716,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94058124,"statfs":{"total":96636764160,"available":96315518976,"internally_reserved":0,"allocated":11919360,"data_stored":9919858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542897,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176956,"kb_used_data":11132,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194884,"statfs":{"total":96636764160,"available":96455561216,"internally_reserved":0,"allocated":11399168,"data_stored":9381666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542895,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297248,"kb_used_data":9172,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94074592,"statfs":{"total":96636764160,"available":96332382208,"internally_reserved":0,"allocated":9392128,"data_stored":7423434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":294910407},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542898,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117452,"kb_used_data":5716,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94254388,"statfs":{"total":96636764160,"available":96516493312,"internally_reserved":0,"allocated":5853184,"data_stored":3932499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542896,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188852,"kb_used_data":13332,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94182988,"statfs":{"total":96636764160,"available":96443379712,"internally_reserved":0,"allocated":13651968,"data_stored":11690363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542895,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285532,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94086308,"statfs":{"total":96636764160,"available":96344379392,"internally_reserved":0,"allocated":15642624,"data_stored":13655531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5169152,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":9560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":7127040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8536064,"data_stored":8536064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7073792,"data_stored":7073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:58:46.204 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.204 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.204 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.204 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.204 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.205 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.206 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.207 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.208 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.209 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.210 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.211 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.212 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.213 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.214 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.215 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.216 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.217 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.218 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.219 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.220 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.221 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.222 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.223 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.224 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.225 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.226 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.226 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.228 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.229 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.230 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T10:56:22.575106+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.231 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.232 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.233 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.234 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.235 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.236 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:56:29.591030+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=29, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.237 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.238 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.239 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.240 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.241 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.242 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.243 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.244 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.245 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.246 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.247 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:56:38.643392+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.248 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:58:46.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:06.249 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:06.601 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:59:06.620 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:59:06.623 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2137,"stamp":"2024-09-14T11:59:05.904074+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45414219,"num_objects":743,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":312784,"num_read_kb":2565821,"num_write":166013,"num_write_kb":2614752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":39434,"num_omap_keys":141,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13193,"ondisk_log_size":13193,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1826896,"kb_used_data":92112,"kb_used_omap":12,"kb_used_meta":1734643,"kb_avail":753147824,"statfs":{"total":773094113280,"available":771223371776,"internally_reserved":0,"allocated":94322688,"data_stored":78604974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1776274992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31924,"num_omap_keys":111,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006088"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.574819+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:57:57.574819+0000","last_peered":"2024-09-14T11:57:57.574819+0000","last_clean":"2024-09-14T11:57:57.574819+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:57:57.574819+0000","last_undegraded":"2024-09-14T11:57:57.574819+0000","last_fullsized":"2024-09-14T11:57:57.574819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13318,"num_write":14,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.732014+0000","last_change":"2024-09-14T11:32:11.437735+0000","last_active":"2024-09-14T11:54:42.732014+0000","last_peered":"2024-09-14T11:54:42.732014+0000","last_clean":"2024-09-14T11:54:42.732014+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:54:42.732014+0000","last_undegraded":"2024-09-14T11:54:42.732014+0000","last_fullsized":"2024-09-14T11:54:42.732014+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:47.395141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.650977+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:58:36.650977+0000","last_peered":"2024-09-14T11:58:36.650977+0000","last_clean":"2024-09-14T11:58:36.650977+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:58:36.650977+0000","last_undegraded":"2024-09-14T11:58:36.650977+0000","last_fullsized":"2024-09-14T11:58:36.650977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.449688+0000","last_change":"2024-09-14T11:15:22.382182+0000","last_active":"2024-09-14T11:57:52.449688+0000","last_peered":"2024-09-14T11:57:52.449688+0000","last_clean":"2024-09-14T11:57:52.449688+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:57:52.449688+0000","last_undegraded":"2024-09-14T11:57:52.449688+0000","last_fullsized":"2024-09-14T11:57:52.449688+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:17.002880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":151,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:47.747116+0000","last_change":"2024-09-14T11:12:39.149946+0000","last_active":"2024-09-14T11:56:47.747116+0000","last_peered":"2024-09-14T11:56:47.747116+0000","last_clean":"2024-09-14T11:56:47.747116+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:56:47.747116+0000","last_undegraded":"2024-09-14T11:56:47.747116+0000","last_fullsized":"2024-09-14T11:56:47.747116+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681797+0000","last_change":"2024-09-14T11:32:11.434861+0000","last_active":"2024-09-14T11:56:23.681797+0000","last_peered":"2024-09-14T11:56:23.681797+0000","last_clean":"2024-09-14T11:56:23.681797+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:56:23.681797+0000","last_undegraded":"2024-09-14T11:56:23.681797+0000","last_fullsized":"2024-09-14T11:56:23.681797+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:02.655710+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:55:02.655710+0000","last_peered":"2024-09-14T11:55:02.655710+0000","last_clean":"2024-09-14T11:55:02.655710+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:55:02.655710+0000","last_undegraded":"2024-09-14T11:55:02.655710+0000","last_fullsized":"2024-09-14T11:55:02.655710+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:42.694530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738922+0000","last_change":"2024-09-14T11:15:22.378824+0000","last_active":"2024-09-14T11:55:27.738922+0000","last_peered":"2024-09-14T11:55:27.738922+0000","last_clean":"2024-09-14T11:55:27.738922+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:55:27.738922+0000","last_undegraded":"2024-09-14T11:55:27.738922+0000","last_fullsized":"2024-09-14T11:55:27.738922+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:29.342445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.441434+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:56:27.441434+0000","last_peered":"2024-09-14T11:56:27.441434+0000","last_clean":"2024-09-14T11:56:27.441434+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:56:27.441434+0000","last_undegraded":"2024-09-14T11:56:27.441434+0000","last_fullsized":"2024-09-14T11:56:27.441434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.987782+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:58:36.987782+0000","last_peered":"2024-09-14T11:58:36.987782+0000","last_clean":"2024-09-14T11:58:36.987782+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:58:36.987782+0000","last_undegraded":"2024-09-14T11:58:36.987782+0000","last_fullsized":"2024-09-14T11:58:36.987782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615750+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:58:37.615750+0000","last_peered":"2024-09-14T11:58:37.615750+0000","last_clean":"2024-09-14T11:58:37.615750+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:58:37.615750+0000","last_undegraded":"2024-09-14T11:58:37.615750+0000","last_fullsized":"2024-09-14T11:58:37.615750+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.521160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541604+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:54:17.541604+0000","last_peered":"2024-09-14T11:54:17.541604+0000","last_clean":"2024-09-14T11:54:17.541604+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:54:17.541604+0000","last_undegraded":"2024-09-14T11:54:17.541604+0000","last_fullsized":"2024-09-14T11:54:17.541604+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:05.758307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666064+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:56:27.666064+0000","last_peered":"2024-09-14T11:56:27.666064+0000","last_clean":"2024-09-14T11:56:27.666064+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:56:27.666064+0000","last_undegraded":"2024-09-14T11:56:27.666064+0000","last_fullsized":"2024-09-14T11:56:27.666064+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.535330+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:55:07.535330+0000","last_peered":"2024-09-14T11:55:07.535330+0000","last_clean":"2024-09-14T11:55:07.535330+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:55:07.535330+0000","last_undegraded":"2024-09-14T11:55:07.535330+0000","last_fullsized":"2024-09-14T11:55:07.535330+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:34.726917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.943979+0000","last_change":"2024-09-14T11:15:25.395023+0000","last_active":"2024-09-14T11:58:38.943979+0000","last_peered":"2024-09-14T11:58:38.943979+0000","last_clean":"2024-09-14T11:58:38.943979+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:58:38.943979+0000","last_undegraded":"2024-09-14T11:58:38.943979+0000","last_fullsized":"2024-09-14T11:58:38.943979+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10232,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:43.440709+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:56:43.440709+0000","last_peered":"2024-09-14T11:56:43.440709+0000","last_clean":"2024-09-14T11:56:43.440709+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:56:43.440709+0000","last_undegraded":"2024-09-14T11:56:43.440709+0000","last_fullsized":"2024-09-14T11:56:43.440709+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:25.328393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670510+0000","last_change":"2024-09-14T11:12:39.152199+0000","last_active":"2024-09-14T11:55:08.670510+0000","last_peered":"2024-09-14T11:55:08.670510+0000","last_clean":"2024-09-14T11:55:08.670510+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:55:08.670510+0000","last_undegraded":"2024-09-14T11:55:08.670510+0000","last_fullsized":"2024-09-14T11:55:08.670510+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:33.862160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":40,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:28.673548+0000","last_change":"2024-09-14T11:15:25.385836+0000","last_active":"2024-09-14T11:55:28.673548+0000","last_peered":"2024-09-14T11:55:28.673548+0000","last_clean":"2024-09-14T11:55:28.673548+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:55:28.673548+0000","last_undegraded":"2024-09-14T11:55:28.673548+0000","last_fullsized":"2024-09-14T11:55:28.673548+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:47.787237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.835728+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:58:36.835728+0000","last_peered":"2024-09-14T11:58:36.835728+0000","last_clean":"2024-09-14T11:58:36.835728+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:58:36.835728+0000","last_undegraded":"2024-09-14T11:58:36.835728+0000","last_fullsized":"2024-09-14T11:58:36.835728+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.664943+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:56:17.664943+0000","last_peered":"2024-09-14T11:56:17.664943+0000","last_clean":"2024-09-14T11:56:17.664943+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:56:17.664943+0000","last_undegraded":"2024-09-14T11:56:17.664943+0000","last_fullsized":"2024-09-14T11:56:17.664943+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.453375+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:57:57.453375+0000","last_peered":"2024-09-14T11:57:57.453375+0000","last_clean":"2024-09-14T11:57:57.453375+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:57:57.453375+0000","last_undegraded":"2024-09-14T11:57:57.453375+0000","last_fullsized":"2024-09-14T11:57:57.453375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.543032+0000","last_change":"2024-09-14T11:12:39.148861+0000","last_active":"2024-09-14T11:56:12.543032+0000","last_peered":"2024-09-14T11:56:12.543032+0000","last_clean":"2024-09-14T11:56:12.543032+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:56:12.543032+0000","last_undegraded":"2024-09-14T11:56:12.543032+0000","last_fullsized":"2024-09-14T11:56:12.543032+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:33:48.885213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.538794+0000","last_change":"2024-09-14T11:32:11.441324+0000","last_active":"2024-09-14T11:55:32.538794+0000","last_peered":"2024-09-14T11:55:32.538794+0000","last_clean":"2024-09-14T11:55:32.538794+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:55:32.538794+0000","last_undegraded":"2024-09-14T11:55:32.538794+0000","last_fullsized":"2024-09-14T11:55:32.538794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:40.912189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.700036+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:58:37.700036+0000","last_peered":"2024-09-14T11:58:37.700036+0000","last_clean":"2024-09-14T11:58:37.700036+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:58:37.700036+0000","last_undegraded":"2024-09-14T11:58:37.700036+0000","last_fullsized":"2024-09-14T11:58:37.700036+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.739392+0000","last_change":"2024-09-14T11:32:11.425898+0000","last_active":"2024-09-14T11:55:32.739392+0000","last_peered":"2024-09-14T11:55:32.739392+0000","last_clean":"2024-09-14T11:55:32.739392+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:55:32.739392+0000","last_undegraded":"2024-09-14T11:55:32.739392+0000","last_fullsized":"2024-09-14T11:55:32.739392+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:44.908579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.431262+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:56:27.431262+0000","last_peered":"2024-09-14T11:56:27.431262+0000","last_clean":"2024-09-14T11:56:27.431262+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:56:27.431262+0000","last_undegraded":"2024-09-14T11:56:27.431262+0000","last_fullsized":"2024-09-14T11:56:27.431262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.009353+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:58:39.009353+0000","last_peered":"2024-09-14T11:58:39.009353+0000","last_clean":"2024-09-14T11:58:39.009353+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:58:39.009353+0000","last_undegraded":"2024-09-14T11:58:39.009353+0000","last_fullsized":"2024-09-14T11:58:39.009353+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.616315+0000","last_change":"2024-09-14T11:15:22.364016+0000","last_active":"2024-09-14T11:58:37.616315+0000","last_peered":"2024-09-14T11:58:37.616315+0000","last_clean":"2024-09-14T11:58:37.616315+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:58:37.616315+0000","last_undegraded":"2024-09-14T11:58:37.616315+0000","last_fullsized":"2024-09-14T11:58:37.616315+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":122,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.743509+0000","last_change":"2024-09-14T11:12:39.148536+0000","last_active":"2024-09-14T11:56:12.743509+0000","last_peered":"2024-09-14T11:56:12.743509+0000","last_clean":"2024-09-14T11:56:12.743509+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:56:12.743509+0000","last_undegraded":"2024-09-14T11:56:12.743509+0000","last_fullsized":"2024-09-14T11:56:12.743509+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:22.270515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.451124+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:58:37.451124+0000","last_peered":"2024-09-14T11:58:37.451124+0000","last_clean":"2024-09-14T11:58:37.451124+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:58:37.451124+0000","last_undegraded":"2024-09-14T11:58:37.451124+0000","last_fullsized":"2024-09-14T11:58:37.451124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.021259+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:58:38.021259+0000","last_peered":"2024-09-14T11:58:38.021259+0000","last_clean":"2024-09-14T11:58:38.021259+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:58:38.021259+0000","last_undegraded":"2024-09-14T11:58:38.021259+0000","last_fullsized":"2024-09-14T11:58:38.021259+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440825+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:56:22.440825+0000","last_peered":"2024-09-14T11:56:22.440825+0000","last_clean":"2024-09-14T11:56:22.440825+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:56:22.440825+0000","last_undegraded":"2024-09-14T11:56:22.440825+0000","last_fullsized":"2024-09-14T11:56:22.440825+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.651118+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:58:36.651118+0000","last_peered":"2024-09-14T11:58:36.651118+0000","last_clean":"2024-09-14T11:58:36.651118+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:58:36.651118+0000","last_undegraded":"2024-09-14T11:58:36.651118+0000","last_fullsized":"2024-09-14T11:58:36.651118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447296+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:57:23.447296+0000","last_peered":"2024-09-14T11:57:23.447296+0000","last_clean":"2024-09-14T11:57:23.447296+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:57:23.447296+0000","last_undegraded":"2024-09-14T11:57:23.447296+0000","last_fullsized":"2024-09-14T11:57:23.447296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":156,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668344+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:54:42.668344+0000","last_peered":"2024-09-14T11:54:42.668344+0000","last_clean":"2024-09-14T11:54:42.668344+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:54:42.668344+0000","last_undegraded":"2024-09-14T11:54:42.668344+0000","last_fullsized":"2024-09-14T11:54:42.668344+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:35.282364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.665554+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:56:22.665554+0000","last_peered":"2024-09-14T11:56:22.665554+0000","last_clean":"2024-09-14T11:56:22.665554+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:56:22.665554+0000","last_undegraded":"2024-09-14T11:56:22.665554+0000","last_fullsized":"2024-09-14T11:56:22.665554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.446265+0000","last_change":"2024-09-14T11:15:25.391047+0000","last_active":"2024-09-14T11:57:27.446265+0000","last_peered":"2024-09-14T11:57:27.446265+0000","last_clean":"2024-09-14T11:57:27.446265+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:57:27.446265+0000","last_undegraded":"2024-09-14T11:57:27.446265+0000","last_fullsized":"2024-09-14T11:57:27.446265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:36.099082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652801+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:54:42.652801+0000","last_peered":"2024-09-14T11:54:42.652801+0000","last_clean":"2024-09-14T11:54:42.652801+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:54:42.652801+0000","last_undegraded":"2024-09-14T11:54:42.652801+0000","last_fullsized":"2024-09-14T11:54:42.652801+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:06:54.823817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669689+0000","last_change":"2024-09-14T11:15:22.380265+0000","last_active":"2024-09-14T11:55:03.669689+0000","last_peered":"2024-09-14T11:55:03.669689+0000","last_clean":"2024-09-14T11:55:03.669689+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:55:03.669689+0000","last_undegraded":"2024-09-14T11:55:03.669689+0000","last_fullsized":"2024-09-14T11:55:03.669689+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:47.184220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:38.546224+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:54:38.546224+0000","last_peered":"2024-09-14T11:54:38.546224+0000","last_clean":"2024-09-14T11:54:38.546224+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:54:38.546224+0000","last_undegraded":"2024-09-14T11:54:38.546224+0000","last_fullsized":"2024-09-14T11:54:38.546224+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:50.950647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440794+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:56:22.440794+0000","last_peered":"2024-09-14T11:56:22.440794+0000","last_clean":"2024-09-14T11:56:22.440794+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:56:22.440794+0000","last_undegraded":"2024-09-14T11:56:22.440794+0000","last_fullsized":"2024-09-14T11:56:22.440794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670462+0000","last_change":"2024-09-14T11:15:25.394352+0000","last_active":"2024-09-14T11:55:08.670462+0000","last_peered":"2024-09-14T11:55:08.670462+0000","last_clean":"2024-09-14T11:55:08.670462+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:55:08.670462+0000","last_undegraded":"2024-09-14T11:55:08.670462+0000","last_fullsized":"2024-09-14T11:55:08.670462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:35.832475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":194,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653140+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:54:42.653140+0000","last_peered":"2024-09-14T11:54:42.653140+0000","last_clean":"2024-09-14T11:54:42.653140+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:54:42.653140+0000","last_undegraded":"2024-09-14T11:54:42.653140+0000","last_fullsized":"2024-09-14T11:54:42.653140+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:29.954707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.742985+0000","last_change":"2024-09-14T11:32:11.425357+0000","last_active":"2024-09-14T11:56:07.742985+0000","last_peered":"2024-09-14T11:56:07.742985+0000","last_clean":"2024-09-14T11:56:07.742985+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:56:07.742985+0000","last_undegraded":"2024-09-14T11:56:07.742985+0000","last_fullsized":"2024-09-14T11:56:07.742985+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:04.671224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.447013+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:58:07.447013+0000","last_peered":"2024-09-14T11:58:07.447013+0000","last_clean":"2024-09-14T11:58:07.447013+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:58:07.447013+0000","last_undegraded":"2024-09-14T11:58:07.447013+0000","last_fullsized":"2024-09-14T11:58:07.447013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3079,"num_write":6,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668319+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:54:42.668319+0000","last_peered":"2024-09-14T11:54:42.668319+0000","last_clean":"2024-09-14T11:54:42.668319+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:54:42.668319+0000","last_undegraded":"2024-09-14T11:54:42.668319+0000","last_fullsized":"2024-09-14T11:54:42.668319+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:51.143671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:12.455130+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:58:12.455130+0000","last_peered":"2024-09-14T11:58:12.455130+0000","last_clean":"2024-09-14T11:58:12.455130+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:58:12.455130+0000","last_undegraded":"2024-09-14T11:58:12.455130+0000","last_fullsized":"2024-09-14T11:58:12.455130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:52.741529+0000","last_change":"2024-09-14T11:15:22.370925+0000","last_active":"2024-09-14T11:55:52.741529+0000","last_peered":"2024-09-14T11:55:52.741529+0000","last_clean":"2024-09-14T11:55:52.741529+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:55:52.741529+0000","last_undegraded":"2024-09-14T11:55:52.741529+0000","last_fullsized":"2024-09-14T11:55:52.741529+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:51.657676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:03.678742+0000","last_change":"2024-09-14T11:32:11.435885+0000","last_active":"2024-09-14T11:56:03.678742+0000","last_peered":"2024-09-14T11:56:03.678742+0000","last_clean":"2024-09-14T11:56:03.678742+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:56:03.678742+0000","last_undegraded":"2024-09-14T11:56:03.678742+0000","last_fullsized":"2024-09-14T11:56:03.678742+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:04.456222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:27.454554+0000","last_change":"2024-09-14T11:15:25.389833+0000","last_active":"2024-09-14T11:58:27.454554+0000","last_peered":"2024-09-14T11:58:27.454554+0000","last_clean":"2024-09-14T11:58:27.454554+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:58:27.454554+0000","last_undegraded":"2024-09-14T11:58:27.454554+0000","last_fullsized":"2024-09-14T11:58:27.454554+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:34.345624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:23.672755+0000","last_change":"2024-09-14T11:12:39.147355+0000","last_active":"2024-09-14T11:55:23.672755+0000","last_peered":"2024-09-14T11:55:23.672755+0000","last_clean":"2024-09-14T11:55:23.672755+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:55:23.672755+0000","last_undegraded":"2024-09-14T11:55:23.672755+0000","last_fullsized":"2024-09-14T11:55:23.672755+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:13.956283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.542021+0000","last_change":"2024-09-14T11:15:22.379118+0000","last_active":"2024-09-14T11:56:02.542021+0000","last_peered":"2024-09-14T11:56:02.542021+0000","last_clean":"2024-09-14T11:56:02.542021+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:56:02.542021+0000","last_undegraded":"2024-09-14T11:56:02.542021+0000","last_fullsized":"2024-09-14T11:56:02.542021+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.600963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":189,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.738869+0000","last_change":"2024-09-14T11:12:39.149430+0000","last_active":"2024-09-14T11:55:27.738869+0000","last_peered":"2024-09-14T11:55:27.738869+0000","last_clean":"2024-09-14T11:55:27.738869+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:55:27.738869+0000","last_undegraded":"2024-09-14T11:55:27.738869+0000","last_fullsized":"2024-09-14T11:55:27.738869+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:02.980390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.653286+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:54:42.653286+0000","last_peered":"2024-09-14T11:54:42.653286+0000","last_clean":"2024-09-14T11:54:42.653286+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:54:42.653286+0000","last_undegraded":"2024-09-14T11:54:42.653286+0000","last_fullsized":"2024-09-14T11:54:42.653286+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:15.841468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.068037+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:58:39.068037+0000","last_peered":"2024-09-14T11:58:39.068037+0000","last_clean":"2024-09-14T11:58:39.068037+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:58:39.068037+0000","last_undegraded":"2024-09-14T11:58:39.068037+0000","last_fullsized":"2024-09-14T11:58:39.068037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2106,"num_write":6,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.616499+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:58:37.616499+0000","last_peered":"2024-09-14T11:58:37.616499+0000","last_clean":"2024-09-14T11:58:37.616499+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:58:37.616499+0000","last_undegraded":"2024-09-14T11:58:37.616499+0000","last_fullsized":"2024-09-14T11:58:37.616499+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668478+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:54:42.668478+0000","last_peered":"2024-09-14T11:54:42.668478+0000","last_clean":"2024-09-14T11:54:42.668478+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:54:42.668478+0000","last_undegraded":"2024-09-14T11:54:42.668478+0000","last_fullsized":"2024-09-14T11:54:42.668478+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:33.627281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'12","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.943983+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:58:38.943983+0000","last_peered":"2024-09-14T11:58:38.943983+0000","last_clean":"2024-09-14T11:58:38.943983+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:58:38.943983+0000","last_undegraded":"2024-09-14T11:58:38.943983+0000","last_fullsized":"2024-09-14T11:58:38.943983+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9238,"num_write":22,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.020902+0000","last_change":"2024-09-14T11:15:22.377316+0000","last_active":"2024-09-14T11:58:38.020902+0000","last_peered":"2024-09-14T11:58:38.020902+0000","last_clean":"2024-09-14T11:58:38.020902+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:58:38.020902+0000","last_undegraded":"2024-09-14T11:58:38.020902+0000","last_fullsized":"2024-09-14T11:58:38.020902+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:25.594786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668371+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:54:42.668371+0000","last_peered":"2024-09-14T11:54:42.668371+0000","last_clean":"2024-09-14T11:54:42.668371+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:54:42.668371+0000","last_undegraded":"2024-09-14T11:54:42.668371+0000","last_fullsized":"2024-09-14T11:54:42.668371+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:37.210143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.517712+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:58:38.517712+0000","last_peered":"2024-09-14T11:58:38.517712+0000","last_clean":"2024-09-14T11:58:38.517712+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:58:38.517712+0000","last_undegraded":"2024-09-14T11:58:38.517712+0000","last_fullsized":"2024-09-14T11:58:38.517712+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.652877+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:54:42.652877+0000","last_peered":"2024-09-14T11:54:42.652877+0000","last_clean":"2024-09-14T11:54:42.652877+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:54:42.652877+0000","last_undegraded":"2024-09-14T11:54:42.652877+0000","last_fullsized":"2024-09-14T11:54:42.652877+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:12.740126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.009446+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:58:39.009446+0000","last_peered":"2024-09-14T11:58:39.009446+0000","last_clean":"2024-09-14T11:58:39.009446+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:58:39.009446+0000","last_undegraded":"2024-09-14T11:58:39.009446+0000","last_fullsized":"2024-09-14T11:58:39.009446+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9236,"num_write":14,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:08.454028+0000","last_change":"2024-09-14T11:15:22.380025+0000","last_active":"2024-09-14T11:58:08.454028+0000","last_peered":"2024-09-14T11:58:08.454028+0000","last_clean":"2024-09-14T11:58:08.454028+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:58:08.454028+0000","last_undegraded":"2024-09-14T11:58:08.454028+0000","last_fullsized":"2024-09-14T11:58:08.454028+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:46.350891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678034+0000","last_change":"2024-09-14T11:12:39.148220+0000","last_active":"2024-09-14T11:55:58.678034+0000","last_peered":"2024-09-14T11:55:58.678034+0000","last_clean":"2024-09-14T11:55:58.678034+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:55:58.678034+0000","last_undegraded":"2024-09-14T11:55:58.678034+0000","last_fullsized":"2024-09-14T11:55:58.678034+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:39.515999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672229+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:55:07.672229+0000","last_peered":"2024-09-14T11:55:07.672229+0000","last_clean":"2024-09-14T11:55:07.672229+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:55:07.672229+0000","last_undegraded":"2024-09-14T11:55:07.672229+0000","last_fullsized":"2024-09-14T11:55:07.672229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:49.122371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656337+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:55:07.656337+0000","last_peered":"2024-09-14T11:55:07.656337+0000","last_clean":"2024-09-14T11:55:07.656337+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:55:07.656337+0000","last_undegraded":"2024-09-14T11:55:07.656337+0000","last_fullsized":"2024-09-14T11:55:07.656337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:28.033760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436876+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:57:02.436876+0000","last_peered":"2024-09-14T11:57:02.436876+0000","last_clean":"2024-09-14T11:57:02.436876+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:57:02.436876+0000","last_undegraded":"2024-09-14T11:57:02.436876+0000","last_fullsized":"2024-09-14T11:57:02.436876+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:13.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":101,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663286+0000","last_change":"2024-09-14T11:12:39.156458+0000","last_active":"2024-09-14T11:56:02.663286+0000","last_peered":"2024-09-14T11:56:02.663286+0000","last_clean":"2024-09-14T11:56:02.663286+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:56:02.663286+0000","last_undegraded":"2024-09-14T11:56:02.663286+0000","last_fullsized":"2024-09-14T11:56:02.663286+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:31.776422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.549256+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:55:07.549256+0000","last_peered":"2024-09-14T11:55:07.549256+0000","last_clean":"2024-09-14T11:55:07.549256+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:55:07.549256+0000","last_undegraded":"2024-09-14T11:55:07.549256+0000","last_fullsized":"2024-09-14T11:55:07.549256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:29.849057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'2","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443164+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:57:07.443164+0000","last_peered":"2024-09-14T11:57:07.443164+0000","last_clean":"2024-09-14T11:57:07.443164+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:57:07.443164+0000","last_undegraded":"2024-09-14T11:57:07.443164+0000","last_fullsized":"2024-09-14T11:57:07.443164+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:29:50.686182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.749827+0000","last_change":"2024-09-14T11:15:22.372158+0000","last_active":"2024-09-14T11:57:07.749827+0000","last_peered":"2024-09-14T11:57:07.749827+0000","last_clean":"2024-09-14T11:57:07.749827+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:57:07.749827+0000","last_undegraded":"2024-09-14T11:57:07.749827+0000","last_fullsized":"2024-09-14T11:57:07.749827+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:31.110739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.678107+0000","last_change":"2024-09-14T11:12:39.150717+0000","last_active":"2024-09-14T11:55:58.678107+0000","last_peered":"2024-09-14T11:55:58.678107+0000","last_clean":"2024-09-14T11:55:58.678107+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:55:58.678107+0000","last_undegraded":"2024-09-14T11:55:58.678107+0000","last_fullsized":"2024-09-14T11:55:58.678107+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:28:45.689240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.433033+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:56:37.433033+0000","last_peered":"2024-09-14T11:56:37.433033+0000","last_clean":"2024-09-14T11:56:37.433033+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:56:37.433033+0000","last_undegraded":"2024-09-14T11:56:37.433033+0000","last_fullsized":"2024-09-14T11:56:37.433033+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562172+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:56:32.562172+0000","last_peered":"2024-09-14T11:56:32.562172+0000","last_clean":"2024-09-14T11:56:32.562172+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:56:32.562172+0000","last_undegraded":"2024-09-14T11:56:32.562172+0000","last_fullsized":"2024-09-14T11:56:32.562172+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.432976+0000","last_change":"2024-09-14T11:12:39.152381+0000","last_active":"2024-09-14T11:56:37.432976+0000","last_peered":"2024-09-14T11:56:37.432976+0000","last_clean":"2024-09-14T11:56:37.432976+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:56:37.432976+0000","last_undegraded":"2024-09-14T11:56:37.432976+0000","last_fullsized":"2024-09-14T11:56:37.432976+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:49.106166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550583+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:55:08.550583+0000","last_peered":"2024-09-14T11:55:08.550583+0000","last_clean":"2024-09-14T11:55:08.550583+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:55:08.550583+0000","last_undegraded":"2024-09-14T11:55:08.550583+0000","last_fullsized":"2024-09-14T11:55:08.550583+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:49:30.888765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.440009+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:56:38.440009+0000","last_peered":"2024-09-14T11:56:38.440009+0000","last_clean":"2024-09-14T11:56:38.440009+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:56:38.440009+0000","last_undegraded":"2024-09-14T11:56:38.440009+0000","last_fullsized":"2024-09-14T11:56:38.440009+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144134+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:58:37.144134+0000","last_peered":"2024-09-14T11:58:37.144134+0000","last_clean":"2024-09-14T11:58:37.144134+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:58:37.144134+0000","last_undegraded":"2024-09-14T11:58:37.144134+0000","last_fullsized":"2024-09-14T11:58:37.144134+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.438324+0000","last_change":"2024-09-14T11:12:39.147602+0000","last_active":"2024-09-14T11:56:27.438324+0000","last_peered":"2024-09-14T11:56:27.438324+0000","last_clean":"2024-09-14T11:56:27.438324+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:56:27.438324+0000","last_undegraded":"2024-09-14T11:56:27.438324+0000","last_fullsized":"2024-09-14T11:56:27.438324+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:46.383390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"262'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.742512+0000","last_change":"2024-09-14T11:32:11.429687+0000","last_active":"2024-09-14T11:56:02.742512+0000","last_peered":"2024-09-14T11:56:02.742512+0000","last_clean":"2024-09-14T11:56:02.742512+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:56:02.742512+0000","last_undegraded":"2024-09-14T11:56:02.742512+0000","last_fullsized":"2024-09-14T11:56:02.742512+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:04.011582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.990265+0000","last_change":"2024-09-14T11:15:25.393792+0000","last_active":"2024-09-14T11:58:36.990265+0000","last_peered":"2024-09-14T11:58:36.990265+0000","last_clean":"2024-09-14T11:58:36.990265+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:58:36.990265+0000","last_undegraded":"2024-09-14T11:58:36.990265+0000","last_fullsized":"2024-09-14T11:58:36.990265+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:55.257772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16376,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.836852+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:58:36.836852+0000","last_peered":"2024-09-14T11:58:36.836852+0000","last_clean":"2024-09-14T11:58:36.836852+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:58:36.836852+0000","last_undegraded":"2024-09-14T11:58:36.836852+0000","last_fullsized":"2024-09-14T11:58:36.836852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7164,"num_write":12,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'10","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.571869+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:57:37.571869+0000","last_peered":"2024-09-14T11:57:37.571869+0000","last_clean":"2024-09-14T11:57:37.571869+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:57:37.571869+0000","last_undegraded":"2024-09-14T11:57:37.571869+0000","last_fullsized":"2024-09-14T11:57:37.571869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12313,"num_write":20,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.670674+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:54:57.670674+0000","last_peered":"2024-09-14T11:54:57.670674+0000","last_clean":"2024-09-14T11:54:57.670674+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:54:57.670674+0000","last_undegraded":"2024-09-14T11:54:57.670674+0000","last_fullsized":"2024-09-14T11:54:57.670674+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:34.148504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.437717+0000","last_change":"2024-09-14T11:12:39.147615+0000","last_active":"2024-09-14T11:56:23.437717+0000","last_peered":"2024-09-14T11:56:23.437717+0000","last_clean":"2024-09-14T11:56:23.437717+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:56:23.437717+0000","last_undegraded":"2024-09-14T11:56:23.437717+0000","last_fullsized":"2024-09-14T11:56:23.437717+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:28:19.785409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656302+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:55:07.656302+0000","last_peered":"2024-09-14T11:55:07.656302+0000","last_clean":"2024-09-14T11:55:07.656302+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:55:07.656302+0000","last_undegraded":"2024-09-14T11:55:07.656302+0000","last_fullsized":"2024-09-14T11:55:07.656302+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:40.123052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.669707+0000","last_change":"2024-09-14T11:15:25.396627+0000","last_active":"2024-09-14T11:55:03.669707+0000","last_peered":"2024-09-14T11:55:03.669707+0000","last_clean":"2024-09-14T11:55:03.669707+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:55:03.669707+0000","last_undegraded":"2024-09-14T11:55:03.669707+0000","last_fullsized":"2024-09-14T11:55:03.669707+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:23.471334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:57.534143+0000","last_change":"2024-09-14T11:15:22.378471+0000","last_active":"2024-09-14T11:54:57.534143+0000","last_peered":"2024-09-14T11:54:57.534143+0000","last_clean":"2024-09-14T11:54:57.534143+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:54:57.534143+0000","last_undegraded":"2024-09-14T11:54:57.534143+0000","last_fullsized":"2024-09-14T11:54:57.534143+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:08:11.906269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":99,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:23.681832+0000","last_change":"2024-09-14T11:12:39.142992+0000","last_active":"2024-09-14T11:56:23.681832+0000","last_peered":"2024-09-14T11:56:23.681832+0000","last_clean":"2024-09-14T11:56:23.681832+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:56:23.681832+0000","last_undegraded":"2024-09-14T11:56:23.681832+0000","last_fullsized":"2024-09-14T11:56:23.681832+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:20.230213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672320+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:55:07.672320+0000","last_peered":"2024-09-14T11:55:07.672320+0000","last_clean":"2024-09-14T11:55:07.672320+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:55:07.672320+0000","last_undegraded":"2024-09-14T11:55:07.672320+0000","last_fullsized":"2024-09-14T11:55:07.672320+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:44.097739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549751+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:55:03.549751+0000","last_peered":"2024-09-14T11:55:03.549751+0000","last_clean":"2024-09-14T11:55:03.549751+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:55:03.549751+0000","last_undegraded":"2024-09-14T11:55:03.549751+0000","last_fullsized":"2024-09-14T11:55:03.549751+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:31.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669044+0000","last_change":"2024-09-14T11:15:22.376114+0000","last_active":"2024-09-14T11:54:58.669044+0000","last_peered":"2024-09-14T11:54:58.669044+0000","last_clean":"2024-09-14T11:54:58.669044+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:54:58.669044+0000","last_undegraded":"2024-09-14T11:54:58.669044+0000","last_fullsized":"2024-09-14T11:54:58.669044+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:22.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":166,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.435136+0000","last_change":"2024-09-14T11:12:39.149756+0000","last_active":"2024-09-14T11:56:52.435136+0000","last_peered":"2024-09-14T11:56:52.435136+0000","last_clean":"2024-09-14T11:56:52.435136+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:56:52.435136+0000","last_undegraded":"2024-09-14T11:56:52.435136+0000","last_fullsized":"2024-09-14T11:56:52.435136+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'362","reported_seq":1013,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.193740+0000","last_change":"2024-09-14T11:59:01.193740+0000","last_active":"2024-09-14T11:59:01.193740+0000","last_peered":"2024-09-14T11:59:01.193740+0000","last_clean":"2024-09-14T11:59:01.193740+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:59:01.193740+0000","last_undegraded":"2024-09-14T11:59:01.193740+0000","last_fullsized":"2024-09-14T11:59:01.193740+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.193613+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:48.418030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":9138,"num_write":1125,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'440","reported_seq":1951,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:58.264788+0000","last_change":"2024-09-14T10:56:41.690207+0000","last_active":"2024-09-14T11:55:58.264788+0000","last_peered":"2024-09-14T11:55:58.264788+0000","last_clean":"2024-09-14T11:55:58.264788+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:55:58.264788+0000","last_undegraded":"2024-09-14T11:55:58.264788+0000","last_fullsized":"2024-09-14T11:55:58.264788+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:16.173917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'360","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.148587+0000","last_change":"2024-09-14T11:58:48.148587+0000","last_active":"2024-09-14T11:58:48.148587+0000","last_peered":"2024-09-14T11:58:48.148587+0000","last_clean":"2024-09-14T11:58:48.148587+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:48.148587+0000","last_undegraded":"2024-09-14T11:58:48.148587+0000","last_fullsized":"2024-09-14T11:58:48.148587+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.148462+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:26.110691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7650412,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":625,"num_read_kb":47838,"num_write":1199,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'490","reported_seq":2200,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:10.460547+0000","last_change":"2024-09-14T10:56:41.699684+0000","last_active":"2024-09-14T11:56:10.460547+0000","last_peered":"2024-09-14T11:56:10.460547+0000","last_clean":"2024-09-14T11:56:10.460547+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:56:10.460547+0000","last_undegraded":"2024-09-14T11:56:10.460547+0000","last_fullsized":"2024-09-14T11:56:10.460547+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:07:11.904607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'408","reported_seq":1102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.093046+0000","last_change":"2024-09-14T11:58:49.093046+0000","last_active":"2024-09-14T11:58:49.093046+0000","last_peered":"2024-09-14T11:58:49.093046+0000","last_clean":"2024-09-14T11:58:49.093046+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:49.093046+0000","last_undegraded":"2024-09-14T11:58:49.093046+0000","last_fullsized":"2024-09-14T11:58:49.093046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.092922+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:17.953603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":833,"num_read_kb":44180,"num_write":1273,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'371","reported_seq":1871,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:18.337410+0000","last_change":"2024-09-14T10:56:41.694979+0000","last_active":"2024-09-14T11:56:18.337410+0000","last_peered":"2024-09-14T11:56:18.337410+0000","last_clean":"2024-09-14T11:56:18.337410+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:56:18.337410+0000","last_undegraded":"2024-09-14T11:56:18.337410+0000","last_fullsized":"2024-09-14T11:56:18.337410+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:14.514694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'478","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.664464+0000","last_change":"2024-09-14T11:58:58.664464+0000","last_active":"2024-09-14T11:58:58.664464+0000","last_peered":"2024-09-14T11:58:58.664464+0000","last_clean":"2024-09-14T11:58:58.664464+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:58.664464+0000","last_undegraded":"2024-09-14T11:58:58.664464+0000","last_fullsized":"2024-09-14T11:58:58.664464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.664259+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:35.300032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730156,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":988,"num_read_kb":27790,"num_write":1317,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1227","reported_seq":2918,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.997268+0000","last_change":"2024-09-14T11:58:57.997268+0000","last_active":"2024-09-14T11:58:57.997268+0000","last_peered":"2024-09-14T11:58:57.997268+0000","last_clean":"2024-09-14T11:58:57.997268+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:58:57.997268+0000","last_undegraded":"2024-09-14T11:58:57.997268+0000","last_fullsized":"2024-09-14T11:58:57.997268+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1227","last_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_deep_scrub":"263'1227","last_deep_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.997174+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.497164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'356","reported_seq":964,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.259740+0000","last_change":"2024-09-14T11:58:57.259740+0000","last_active":"2024-09-14T11:58:57.259740+0000","last_peered":"2024-09-14T11:58:57.259740+0000","last_clean":"2024-09-14T11:58:57.259740+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:57.259740+0000","last_undegraded":"2024-09-14T11:58:57.259740+0000","last_fullsized":"2024-09-14T11:58:57.259740+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.259603+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:49.299765+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":13771,"num_write":1092,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'580","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751244+0000","last_change":"2024-09-14T11:58:56.751244+0000","last_active":"2024-09-14T11:58:56.751244+0000","last_peered":"2024-09-14T11:58:56.751244+0000","last_clean":"2024-09-14T11:58:56.751244+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:58:56.751244+0000","last_undegraded":"2024-09-14T11:58:56.751244+0000","last_fullsized":"2024-09-14T11:58:56.751244+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'580","last_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_deep_scrub":"263'580","last_deep_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751162+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:07.015372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'342","reported_seq":942,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.696232+0000","last_change":"2024-09-14T11:58:56.696232+0000","last_active":"2024-09-14T11:58:56.696232+0000","last_peered":"2024-09-14T11:58:56.696232+0000","last_clean":"2024-09-14T11:58:56.696232+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:56.696232+0000","last_undegraded":"2024-09-14T11:58:56.696232+0000","last_fullsized":"2024-09-14T11:58:56.696232+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.696022+0000","objects_scrubbed":11,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.669606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":503,"num_read_kb":13548,"num_write":1089,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'833","reported_seq":2424,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.313416+0000","last_change":"2024-09-14T10:56:41.692162+0000","last_active":"2024-09-14T11:56:49.313416+0000","last_peered":"2024-09-14T11:56:49.313416+0000","last_clean":"2024-09-14T11:56:49.313416+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:56:49.313416+0000","last_undegraded":"2024-09-14T11:56:49.313416+0000","last_fullsized":"2024-09-14T11:56:49.313416+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":800,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'331","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.247534+0000","last_change":"2024-09-14T11:58:56.247534+0000","last_active":"2024-09-14T11:58:56.247534+0000","last_peered":"2024-09-14T11:58:56.247534+0000","last_clean":"2024-09-14T11:58:56.247534+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:56.247534+0000","last_undegraded":"2024-09-14T11:58:56.247534+0000","last_fullsized":"2024-09-14T11:58:56.247534+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.247425+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:59.925743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730161,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":635,"num_read_kb":14446,"num_write":1067,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2453,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:44.821254+0000","last_change":"2024-09-14T10:56:41.689448+0000","last_active":"2024-09-14T11:55:44.821254+0000","last_peered":"2024-09-14T11:55:44.821254+0000","last_clean":"2024-09-14T11:55:44.821254+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:55:44.821254+0000","last_undegraded":"2024-09-14T11:55:44.821254+0000","last_fullsized":"2024-09-14T11:55:44.821254+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:26.618232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'348","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.256977+0000","last_change":"2024-09-14T11:58:54.256977+0000","last_active":"2024-09-14T11:58:54.256977+0000","last_peered":"2024-09-14T11:58:54.256977+0000","last_clean":"2024-09-14T11:58:54.256977+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:54.256977+0000","last_undegraded":"2024-09-14T11:58:54.256977+0000","last_fullsized":"2024-09-14T11:58:54.256977+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.256878+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:40.203214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":23067,"num_write":1167,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'426","reported_seq":1881,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.111851+0000","last_change":"2024-09-14T11:58:50.111851+0000","last_active":"2024-09-14T11:58:50.111851+0000","last_peered":"2024-09-14T11:58:50.111851+0000","last_clean":"2024-09-14T11:58:50.111851+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:58:50.111851+0000","last_undegraded":"2024-09-14T11:58:50.111851+0000","last_fullsized":"2024-09-14T11:58:50.111851+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.111748+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:42.879545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'458","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.809485+0000","last_change":"2024-09-14T11:58:59.809485+0000","last_active":"2024-09-14T11:58:59.809485+0000","last_peered":"2024-09-14T11:58:59.809485+0000","last_clean":"2024-09-14T11:58:59.809485+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:58:59.809485+0000","last_undegraded":"2024-09-14T11:58:59.809485+0000","last_fullsized":"2024-09-14T11:58:59.809485+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.809380+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:00.989122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'433","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.215773+0000","last_change":"2024-09-14T11:58:58.215773+0000","last_active":"2024-09-14T11:58:58.215773+0000","last_peered":"2024-09-14T11:58:58.215773+0000","last_clean":"2024-09-14T11:58:58.215773+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:58.215773+0000","last_undegraded":"2024-09-14T11:58:58.215773+0000","last_fullsized":"2024-09-14T11:58:58.215773+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.215635+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:41.047428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":936,"num_read_kb":12852,"num_write":1596,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'534","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.145362+0000","last_change":"2024-09-14T11:59:02.145362+0000","last_active":"2024-09-14T11:59:02.145362+0000","last_peered":"2024-09-14T11:59:02.145362+0000","last_clean":"2024-09-14T11:59:02.145362+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:59:02.145362+0000","last_undegraded":"2024-09-14T11:59:02.145362+0000","last_fullsized":"2024-09-14T11:59:02.145362+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.145274+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:24.998860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'342","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700509+0000","last_change":"2024-09-14T11:58:52.700509+0000","last_active":"2024-09-14T11:58:52.700509+0000","last_peered":"2024-09-14T11:58:52.700509+0000","last_clean":"2024-09-14T11:58:52.700509+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:52.700509+0000","last_undegraded":"2024-09-14T11:58:52.700509+0000","last_fullsized":"2024-09-14T11:58:52.700509+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700378+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:26.328993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":13589,"num_write":1026,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'636","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910117+0000","last_change":"2024-09-14T10:56:41.684245+0000","last_active":"2024-09-14T11:56:51.910117+0000","last_peered":"2024-09-14T11:56:51.910117+0000","last_clean":"2024-09-14T11:56:51.910117+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:56:51.910117+0000","last_undegraded":"2024-09-14T11:56:51.910117+0000","last_fullsized":"2024-09-14T11:56:51.910117+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:41.521602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'390","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.716046+0000","last_change":"2024-09-14T11:58:51.716046+0000","last_active":"2024-09-14T11:58:51.716046+0000","last_peered":"2024-09-14T11:58:51.716046+0000","last_clean":"2024-09-14T11:58:51.716046+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:51.716046+0000","last_undegraded":"2024-09-14T11:58:51.716046+0000","last_fullsized":"2024-09-14T11:58:51.716046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'390","last_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_deep_scrub":"263'390","last_deep_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.715916+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:38.249633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":713,"num_read_kb":72218,"num_write":1254,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1148","reported_seq":2704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.092857+0000","last_change":"2024-09-14T11:58:54.092857+0000","last_active":"2024-09-14T11:58:54.092857+0000","last_peered":"2024-09-14T11:58:54.092857+0000","last_clean":"2024-09-14T11:58:54.092857+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:58:54.092857+0000","last_undegraded":"2024-09-14T11:58:54.092857+0000","last_fullsized":"2024-09-14T11:58:54.092857+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.092741+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:41.284736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'354","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.762926+0000","last_change":"2024-09-14T11:58:49.762926+0000","last_active":"2024-09-14T11:58:49.762926+0000","last_peered":"2024-09-14T11:58:49.762926+0000","last_clean":"2024-09-14T11:58:49.762926+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:49.762926+0000","last_undegraded":"2024-09-14T11:58:49.762926+0000","last_fullsized":"2024-09-14T11:58:49.762926+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.762804+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:03.472810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":653,"num_read_kb":16353,"num_write":1203,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'441","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.097650+0000","last_change":"2024-09-14T11:58:53.097650+0000","last_active":"2024-09-14T11:58:53.097650+0000","last_peered":"2024-09-14T11:58:53.097650+0000","last_clean":"2024-09-14T11:58:53.097650+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:58:53.097650+0000","last_undegraded":"2024-09-14T11:58:53.097650+0000","last_fullsized":"2024-09-14T11:58:53.097650+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.097548+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:21.145958+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1179,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'325","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.248618+0000","last_change":"2024-09-14T11:58:50.248618+0000","last_active":"2024-09-14T11:58:50.248618+0000","last_peered":"2024-09-14T11:58:50.248618+0000","last_clean":"2024-09-14T11:58:50.248618+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:50.248618+0000","last_undegraded":"2024-09-14T11:58:50.248618+0000","last_fullsized":"2024-09-14T11:58:50.248618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.248492+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:11.374577+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730152,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":6224,"num_write":1046,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'761","reported_seq":2348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.808871+0000","last_change":"2024-09-14T11:59:01.808871+0000","last_active":"2024-09-14T11:59:01.808871+0000","last_peered":"2024-09-14T11:59:01.808871+0000","last_clean":"2024-09-14T11:59:01.808871+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:59:01.808871+0000","last_undegraded":"2024-09-14T11:59:01.808871+0000","last_fullsized":"2024-09-14T11:59:01.808871+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.808745+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:36.042147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'370","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.123218+0000","last_change":"2024-09-14T11:58:47.123218+0000","last_active":"2024-09-14T11:58:47.123218+0000","last_peered":"2024-09-14T11:58:47.123218+0000","last_clean":"2024-09-14T11:58:47.123218+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:47.123218+0000","last_undegraded":"2024-09-14T11:58:47.123218+0000","last_fullsized":"2024-09-14T11:58:47.123218+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.123129+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:41.680446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170217,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":11097,"num_write":1169,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'102","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.924904+0000","last_change":"2024-09-14T10:56:49.738494+0000","last_active":"2024-09-14T11:56:52.924904+0000","last_peered":"2024-09-14T11:56:52.924904+0000","last_clean":"2024-09-14T11:56:52.924904+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:56:52.924904+0000","last_undegraded":"2024-09-14T11:56:52.924904+0000","last_fullsized":"2024-09-14T11:56:52.924904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:00.728999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'438","reported_seq":2163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.290385+0000","last_change":"2024-09-14T11:58:57.290385+0000","last_active":"2024-09-14T11:58:57.290385+0000","last_peered":"2024-09-14T11:58:57.290385+0000","last_clean":"2024-09-14T11:58:57.290385+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:57.290385+0000","last_undegraded":"2024-09-14T11:58:57.290385+0000","last_fullsized":"2024-09-14T11:58:57.290385+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.290287+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:14.201274+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'363","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.185211+0000","last_change":"2024-09-14T11:58:53.185211+0000","last_active":"2024-09-14T11:58:53.185211+0000","last_peered":"2024-09-14T11:58:53.185211+0000","last_clean":"2024-09-14T11:58:53.185211+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:53.185211+0000","last_undegraded":"2024-09-14T11:58:53.185211+0000","last_fullsized":"2024-09-14T11:58:53.185211+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.185066+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:33.650629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":709,"num_read_kb":79863,"num_write":1135,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546248+0000","last_change":"2024-09-14T10:56:43.703574+0000","last_active":"2024-09-14T11:54:47.546248+0000","last_peered":"2024-09-14T11:54:47.546248+0000","last_clean":"2024-09-14T11:54:47.546248+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:54:47.546248+0000","last_undegraded":"2024-09-14T11:54:47.546248+0000","last_fullsized":"2024-09-14T11:54:47.546248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:13.211833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'338","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.315902+0000","last_change":"2024-09-14T10:56:45.717205+0000","last_active":"2024-09-14T11:58:38.315902+0000","last_peered":"2024-09-14T11:58:38.315902+0000","last_clean":"2024-09-14T11:58:38.315902+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:58:38.315902+0000","last_undegraded":"2024-09-14T11:58:38.315902+0000","last_fullsized":"2024-09-14T11:58:38.315902+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:15.199061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1166,"num_write":430,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":472,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669188+0000","last_change":"2024-09-14T10:56:47.732016+0000","last_active":"2024-09-14T11:54:47.669188+0000","last_peered":"2024-09-14T11:54:47.669188+0000","last_clean":"2024-09-14T11:54:47.669188+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:54:47.669188+0000","last_undegraded":"2024-09-14T11:54:47.669188+0000","last_fullsized":"2024-09-14T11:54:47.669188+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:03.581653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2511","reported_seq":4330,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:32.571152+0000","last_change":"2024-09-14T10:56:49.748541+0000","last_active":"2024-09-14T11:57:32.571152+0000","last_peered":"2024-09-14T11:57:32.571152+0000","last_clean":"2024-09-14T11:57:32.571152+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:57:32.571152+0000","last_undegraded":"2024-09-14T11:57:32.571152+0000","last_fullsized":"2024-09-14T11:57:32.571152+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":2500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:02.702024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1509","reported_seq":3177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.671768+0000","last_change":"2024-09-14T11:58:59.671768+0000","last_active":"2024-09-14T11:58:59.671768+0000","last_peered":"2024-09-14T11:58:59.671768+0000","last_clean":"2024-09-14T11:58:59.671768+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:58:59.671768+0000","last_undegraded":"2024-09-14T11:58:59.671768+0000","last_fullsized":"2024-09-14T11:58:59.671768+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1509","last_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_deep_scrub":"263'1509","last_deep_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.671671+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":1400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:49.912175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'351","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.126234+0000","last_change":"2024-09-14T11:58:45.126234+0000","last_active":"2024-09-14T11:58:45.126234+0000","last_peered":"2024-09-14T11:58:45.126234+0000","last_clean":"2024-09-14T11:58:45.126234+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:45.126234+0000","last_undegraded":"2024-09-14T11:58:45.126234+0000","last_fullsized":"2024-09-14T11:58:45.126234+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.126037+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:48.415741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":7357,"num_write":1125,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.658029+0000","last_change":"2024-09-14T10:56:43.698968+0000","last_active":"2024-09-14T11:55:17.658029+0000","last_peered":"2024-09-14T11:55:17.658029+0000","last_clean":"2024-09-14T11:55:17.658029+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:55:17.658029+0000","last_undegraded":"2024-09-14T11:55:17.658029+0000","last_fullsized":"2024-09-14T11:55:17.658029+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:15.625563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'104","reported_seq":634,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.047693+0000","last_change":"2024-09-14T10:56:45.722700+0000","last_active":"2024-09-14T11:57:19.047693+0000","last_peered":"2024-09-14T11:57:19.047693+0000","last_clean":"2024-09-14T11:57:19.047693+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:57:19.047693+0000","last_undegraded":"2024-09-14T11:57:19.047693+0000","last_fullsized":"2024-09-14T11:57:19.047693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:14.282229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:48.547649+0000","last_change":"2024-09-14T10:56:47.736072+0000","last_active":"2024-09-14T11:54:48.547649+0000","last_peered":"2024-09-14T11:54:48.547649+0000","last_clean":"2024-09-14T11:54:48.547649+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:54:48.547649+0000","last_undegraded":"2024-09-14T11:54:48.547649+0000","last_fullsized":"2024-09-14T11:54:48.547649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:39.992880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'114","reported_seq":607,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723799+0000","last_change":"2024-09-14T10:56:49.750882+0000","last_active":"2024-09-14T11:58:09.723799+0000","last_peered":"2024-09-14T11:58:09.723799+0000","last_clean":"2024-09-14T11:58:09.723799+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:58:09.723799+0000","last_undegraded":"2024-09-14T11:58:09.723799+0000","last_fullsized":"2024-09-14T11:58:09.723799+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:22.830554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'633","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.033445+0000","last_change":"2024-09-14T11:58:53.033445+0000","last_active":"2024-09-14T11:58:53.033445+0000","last_peered":"2024-09-14T11:58:53.033445+0000","last_clean":"2024-09-14T11:58:53.033445+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:53.033445+0000","last_undegraded":"2024-09-14T11:58:53.033445+0000","last_fullsized":"2024-09-14T11:58:53.033445+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'633","last_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_deep_scrub":"263'633","last_deep_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.033339+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.139377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'372","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.195024+0000","last_change":"2024-09-14T11:58:52.195024+0000","last_active":"2024-09-14T11:58:52.195024+0000","last_peered":"2024-09-14T11:58:52.195024+0000","last_clean":"2024-09-14T11:58:52.195024+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:52.195024+0000","last_undegraded":"2024-09-14T11:58:52.195024+0000","last_fullsized":"2024-09-14T11:58:52.195024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.194890+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:09.932572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":77744,"num_write":1160,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653968+0000","last_change":"2024-09-14T10:56:43.701731+0000","last_active":"2024-09-14T11:54:47.653968+0000","last_peered":"2024-09-14T11:54:47.653968+0000","last_clean":"2024-09-14T11:54:47.653968+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:54:47.653968+0000","last_undegraded":"2024-09-14T11:54:47.653968+0000","last_fullsized":"2024-09-14T11:54:47.653968+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:01.110895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'145","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.120684+0000","last_change":"2024-09-14T11:59:00.120684+0000","last_active":"2024-09-14T11:59:00.120684+0000","last_peered":"2024-09-14T11:59:00.120684+0000","last_clean":"2024-09-14T11:59:00.120684+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:59:00.120684+0000","last_undegraded":"2024-09-14T11:59:00.120684+0000","last_fullsized":"2024-09-14T11:59:00.120684+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.120596+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:09.503078+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'776","reported_seq":4517,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.387193+0000","last_change":"2024-09-14T10:56:47.731166+0000","last_active":"2024-09-14T11:58:38.387193+0000","last_peered":"2024-09-14T11:58:38.387193+0000","last_clean":"2024-09-14T11:58:38.387193+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:58:38.387193+0000","last_undegraded":"2024-09-14T11:58:38.387193+0000","last_fullsized":"2024-09-14T11:58:38.387193+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:43.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'210","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.442305+0000","last_change":"2024-09-14T10:56:49.740657+0000","last_active":"2024-09-14T11:56:53.442305+0000","last_peered":"2024-09-14T11:56:53.442305+0000","last_clean":"2024-09-14T11:56:53.442305+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:56:53.442305+0000","last_undegraded":"2024-09-14T11:56:53.442305+0000","last_fullsized":"2024-09-14T11:56:53.442305+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:29.712729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'436","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.286059+0000","last_change":"2024-09-14T11:58:59.286059+0000","last_active":"2024-09-14T11:58:59.286059+0000","last_peered":"2024-09-14T11:58:59.286059+0000","last_clean":"2024-09-14T11:58:59.286059+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:58:59.286059+0000","last_undegraded":"2024-09-14T11:58:59.286059+0000","last_fullsized":"2024-09-14T11:58:59.286059+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.285928+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:01.883072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'327","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.702760+0000","last_change":"2024-09-14T11:58:47.702760+0000","last_active":"2024-09-14T11:58:47.702760+0000","last_peered":"2024-09-14T11:58:47.702760+0000","last_clean":"2024-09-14T11:58:47.702760+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:47.702760+0000","last_undegraded":"2024-09-14T11:58:47.702760+0000","last_fullsized":"2024-09-14T11:58:47.702760+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.702654+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:45.134369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":94667,"num_write":978,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.546276+0000","last_change":"2024-09-14T10:56:43.702583+0000","last_active":"2024-09-14T11:54:47.546276+0000","last_peered":"2024-09-14T11:54:47.546276+0000","last_clean":"2024-09-14T11:54:47.546276+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:54:47.546276+0000","last_undegraded":"2024-09-14T11:54:47.546276+0000","last_fullsized":"2024-09-14T11:54:47.546276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:27:02.306290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'273","reported_seq":832,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.928198+0000","last_change":"2024-09-14T10:56:45.717333+0000","last_active":"2024-09-14T11:58:37.928198+0000","last_peered":"2024-09-14T11:58:37.928198+0000","last_clean":"2024-09-14T11:58:37.928198+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:58:37.928198+0000","last_undegraded":"2024-09-14T11:58:37.928198+0000","last_fullsized":"2024-09-14T11:58:37.928198+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:45.182188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47840,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":445,"num_read_kb":1034,"num_write":358,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'811","reported_seq":2642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.358724+0000","last_change":"2024-09-14T10:56:47.734484+0000","last_active":"2024-09-14T11:58:38.358724+0000","last_peered":"2024-09-14T11:58:38.358724+0000","last_clean":"2024-09-14T11:58:38.358724+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:58:38.358724+0000","last_undegraded":"2024-09-14T11:58:38.358724+0000","last_fullsized":"2024-09-14T11:58:38.358724+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:38.201517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'660","reported_seq":2029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.688828+0000","last_change":"2024-09-14T11:58:57.688828+0000","last_active":"2024-09-14T11:58:57.688828+0000","last_peered":"2024-09-14T11:58:57.688828+0000","last_clean":"2024-09-14T11:58:57.688828+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:57.688828+0000","last_undegraded":"2024-09-14T11:58:57.688828+0000","last_fullsized":"2024-09-14T11:58:57.688828+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'660","last_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_deep_scrub":"263'660","last_deep_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.688740+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:09.797199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'344","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.245207+0000","last_change":"2024-09-14T11:58:51.245207+0000","last_active":"2024-09-14T11:58:51.245207+0000","last_peered":"2024-09-14T11:58:51.245207+0000","last_clean":"2024-09-14T11:58:51.245207+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:51.245207+0000","last_undegraded":"2024-09-14T11:58:51.245207+0000","last_fullsized":"2024-09-14T11:58:51.245207+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.245091+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:42.023295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730185,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17523,"num_write":1016,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.674155+0000","last_change":"2024-09-14T10:56:43.698774+0000","last_active":"2024-09-14T11:55:17.674155+0000","last_peered":"2024-09-14T11:55:17.674155+0000","last_clean":"2024-09-14T11:55:17.674155+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:55:17.674155+0000","last_undegraded":"2024-09-14T11:55:17.674155+0000","last_fullsized":"2024-09-14T11:55:17.674155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:15.883668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'412","reported_seq":1028,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.797251+0000","last_change":"2024-09-14T10:56:45.715379+0000","last_active":"2024-09-14T11:58:38.797251+0000","last_peered":"2024-09-14T11:58:38.797251+0000","last_clean":"2024-09-14T11:58:38.797251+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:58:38.797251+0000","last_undegraded":"2024-09-14T11:58:38.797251+0000","last_fullsized":"2024-09-14T11:58:38.797251+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:11.970010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46953,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":681,"num_read_kb":1474,"num_write":542,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.536831+0000","last_change":"2024-09-14T10:56:47.727987+0000","last_active":"2024-09-14T11:55:17.536831+0000","last_peered":"2024-09-14T11:55:17.536831+0000","last_clean":"2024-09-14T11:55:17.536831+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:55:17.536831+0000","last_undegraded":"2024-09-14T11:55:17.536831+0000","last_fullsized":"2024-09-14T11:55:17.536831+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:26:35.450777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'581","reported_seq":1393,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311916+0000","last_change":"2024-09-14T10:56:49.748529+0000","last_active":"2024-09-14T11:58:11.311916+0000","last_peered":"2024-09-14T11:58:11.311916+0000","last_clean":"2024-09-14T11:58:11.311916+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:58:11.311916+0000","last_undegraded":"2024-09-14T11:58:11.311916+0000","last_fullsized":"2024-09-14T11:58:11.311916+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:18.226410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'452","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.816837+0000","last_change":"2024-09-14T11:58:54.816837+0000","last_active":"2024-09-14T11:58:54.816837+0000","last_peered":"2024-09-14T11:58:54.816837+0000","last_clean":"2024-09-14T11:58:54.816837+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:58:54.816837+0000","last_undegraded":"2024-09-14T11:58:54.816837+0000","last_fullsized":"2024-09-14T11:58:54.816837+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.816749+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:50.855590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'367","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.236667+0000","last_change":"2024-09-14T11:58:50.236667+0000","last_active":"2024-09-14T11:58:50.236667+0000","last_peered":"2024-09-14T11:58:50.236667+0000","last_clean":"2024-09-14T11:58:50.236667+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:50.236667+0000","last_undegraded":"2024-09-14T11:58:50.236667+0000","last_fullsized":"2024-09-14T11:58:50.236667+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.236566+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:38.811873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":60976,"num_write":1200,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"263'6","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.085209+0000","last_change":"2024-09-14T11:58:57.085209+0000","last_active":"2024-09-14T11:58:57.085209+0000","last_peered":"2024-09-14T11:58:57.085209+0000","last_clean":"2024-09-14T11:58:57.085209+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:57.085209+0000","last_undegraded":"2024-09-14T11:58:57.085209+0000","last_fullsized":"2024-09-14T11:58:57.085209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.085117+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:15.512672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'279","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.138032+0000","last_change":"2024-09-14T10:56:45.717223+0000","last_active":"2024-09-14T11:58:37.138032+0000","last_peered":"2024-09-14T11:58:37.138032+0000","last_clean":"2024-09-14T11:58:37.138032+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:58:37.138032+0000","last_undegraded":"2024-09-14T11:58:37.138032+0000","last_fullsized":"2024-09-14T11:58:37.138032+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:53.982180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.659151+0000","last_change":"2024-09-14T10:56:47.728715+0000","last_active":"2024-09-14T11:55:27.659151+0000","last_peered":"2024-09-14T11:55:27.659151+0000","last_clean":"2024-09-14T11:55:27.659151+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:55:27.659151+0000","last_undegraded":"2024-09-14T11:55:27.659151+0000","last_fullsized":"2024-09-14T11:55:27.659151+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:34.862116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'110","reported_seq":591,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:28.691270+0000","last_change":"2024-09-14T10:56:49.740475+0000","last_active":"2024-09-14T11:57:28.691270+0000","last_peered":"2024-09-14T11:57:28.691270+0000","last_clean":"2024-09-14T11:57:28.691270+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:57:28.691270+0000","last_undegraded":"2024-09-14T11:57:28.691270+0000","last_fullsized":"2024-09-14T11:57:28.691270+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:13.870392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'438","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.759653+0000","last_change":"2024-09-14T11:58:58.759653+0000","last_active":"2024-09-14T11:58:58.759653+0000","last_peered":"2024-09-14T11:58:58.759653+0000","last_clean":"2024-09-14T11:58:58.759653+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:58.759653+0000","last_undegraded":"2024-09-14T11:58:58.759653+0000","last_fullsized":"2024-09-14T11:58:58.759653+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.759554+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:42.260528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'324","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.255581+0000","last_change":"2024-09-14T11:58:49.255581+0000","last_active":"2024-09-14T11:58:49.255581+0000","last_peered":"2024-09-14T11:58:49.255581+0000","last_clean":"2024-09-14T11:58:49.255581+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:49.255581+0000","last_undegraded":"2024-09-14T11:58:49.255581+0000","last_fullsized":"2024-09-14T11:58:49.255581+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.255417+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.505258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":11458,"num_write":967,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.050008+0000","last_change":"2024-09-14T11:58:58.050008+0000","last_active":"2024-09-14T11:58:58.050008+0000","last_peered":"2024-09-14T11:58:58.050008+0000","last_clean":"2024-09-14T11:58:58.050008+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:58:58.050008+0000","last_undegraded":"2024-09-14T11:58:58.050008+0000","last_fullsized":"2024-09-14T11:58:58.050008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.049910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:15.923228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'295","reported_seq":878,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.937603+0000","last_change":"2024-09-14T10:56:45.715385+0000","last_active":"2024-09-14T11:58:38.937603+0000","last_peered":"2024-09-14T11:58:38.937603+0000","last_clean":"2024-09-14T11:58:38.937603+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:58:38.937603+0000","last_undegraded":"2024-09-14T11:58:38.937603+0000","last_fullsized":"2024-09-14T11:58:38.937603+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:45.655994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50465,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":1040,"num_write":378,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.540322+0000","last_change":"2024-09-14T10:56:47.732668+0000","last_active":"2024-09-14T11:58:38.540322+0000","last_peered":"2024-09-14T11:58:38.540322+0000","last_clean":"2024-09-14T11:58:38.540322+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:58:38.540322+0000","last_undegraded":"2024-09-14T11:58:38.540322+0000","last_fullsized":"2024-09-14T11:58:38.540322+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:36.329167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'144","reported_seq":643,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.723376+0000","last_change":"2024-09-14T10:56:49.751141+0000","last_active":"2024-09-14T11:58:09.723376+0000","last_peered":"2024-09-14T11:58:09.723376+0000","last_clean":"2024-09-14T11:58:09.723376+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:58:09.723376+0000","last_undegraded":"2024-09-14T11:58:09.723376+0000","last_fullsized":"2024-09-14T11:58:09.723376+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:59.575096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'439","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.012062+0000","last_change":"2024-09-14T11:58:57.012062+0000","last_active":"2024-09-14T11:58:57.012062+0000","last_peered":"2024-09-14T11:58:57.012062+0000","last_clean":"2024-09-14T11:58:57.012062+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:58:57.012062+0000","last_undegraded":"2024-09-14T11:58:57.012062+0000","last_fullsized":"2024-09-14T11:58:57.012062+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.011931+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:47.884035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.124210+0000","last_change":"2024-09-14T11:58:45.124210+0000","last_active":"2024-09-14T11:58:45.124210+0000","last_peered":"2024-09-14T11:58:45.124210+0000","last_clean":"2024-09-14T11:58:45.124210+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:45.124210+0000","last_undegraded":"2024-09-14T11:58:45.124210+0000","last_fullsized":"2024-09-14T11:58:45.124210+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.124078+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:42.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730158,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":20707,"num_write":1086,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.106800+0000","last_change":"2024-09-14T11:58:55.106800+0000","last_active":"2024-09-14T11:58:55.106800+0000","last_peered":"2024-09-14T11:58:55.106800+0000","last_clean":"2024-09-14T11:58:55.106800+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:58:55.106800+0000","last_undegraded":"2024-09-14T11:58:55.106800+0000","last_fullsized":"2024-09-14T11:58:55.106800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.106702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:25.435659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'496","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.014926+0000","last_change":"2024-09-14T11:59:01.014926+0000","last_active":"2024-09-14T11:59:01.014926+0000","last_peered":"2024-09-14T11:59:01.014926+0000","last_clean":"2024-09-14T11:59:01.014926+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:59:01.014926+0000","last_undegraded":"2024-09-14T11:59:01.014926+0000","last_fullsized":"2024-09-14T11:59:01.014926+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.014817+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:05.088724+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104584,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":850,"num_read_kb":2088,"num_write":692,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.103600+0000","last_change":"2024-09-14T11:59:01.103600+0000","last_active":"2024-09-14T11:59:01.103600+0000","last_peered":"2024-09-14T11:59:01.103600+0000","last_clean":"2024-09-14T11:59:01.103600+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:59:01.103600+0000","last_undegraded":"2024-09-14T11:59:01.103600+0000","last_fullsized":"2024-09-14T11:59:01.103600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.103512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.351272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'153","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.913275+0000","last_change":"2024-09-14T10:56:49.745209+0000","last_active":"2024-09-14T11:56:52.913275+0000","last_peered":"2024-09-14T11:56:52.913275+0000","last_clean":"2024-09-14T11:56:52.913275+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:56:52.913275+0000","last_undegraded":"2024-09-14T11:56:52.913275+0000","last_fullsized":"2024-09-14T11:56:52.913275+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:00.954365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'486","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.754456+0000","last_change":"2024-09-14T11:58:50.754456+0000","last_active":"2024-09-14T11:58:50.754456+0000","last_peered":"2024-09-14T11:58:50.754456+0000","last_clean":"2024-09-14T11:58:50.754456+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:50.754456+0000","last_undegraded":"2024-09-14T11:58:50.754456+0000","last_fullsized":"2024-09-14T11:58:50.754456+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'486","last_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_deep_scrub":"263'486","last_deep_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.754357+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:01.136208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'383","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.397624+0000","last_change":"2024-09-14T11:58:45.397624+0000","last_active":"2024-09-14T11:58:45.397624+0000","last_peered":"2024-09-14T11:58:45.397624+0000","last_clean":"2024-09-14T11:58:45.397624+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:45.397624+0000","last_undegraded":"2024-09-14T11:58:45.397624+0000","last_fullsized":"2024-09-14T11:58:45.397624+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.397519+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:00.442423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460262,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":720,"num_read_kb":26829,"num_write":1334,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.076851+0000","last_change":"2024-09-14T11:58:56.076851+0000","last_active":"2024-09-14T11:58:56.076851+0000","last_peered":"2024-09-14T11:58:56.076851+0000","last_clean":"2024-09-14T11:58:56.076851+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:58:56.076851+0000","last_undegraded":"2024-09-14T11:58:56.076851+0000","last_fullsized":"2024-09-14T11:58:56.076851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.076745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:27.744336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'337","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.444929+0000","last_change":"2024-09-14T10:56:45.720877+0000","last_active":"2024-09-14T11:58:37.444929+0000","last_peered":"2024-09-14T11:58:37.444929+0000","last_clean":"2024-09-14T11:58:37.444929+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:58:37.444929+0000","last_undegraded":"2024-09-14T11:58:37.444929+0000","last_fullsized":"2024-09-14T11:58:37.444929+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:57.447381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658208+0000","last_change":"2024-09-14T10:56:47.732467+0000","last_active":"2024-09-14T11:55:22.658208+0000","last_peered":"2024-09-14T11:55:22.658208+0000","last_clean":"2024-09-14T11:55:22.658208+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:55:22.658208+0000","last_undegraded":"2024-09-14T11:55:22.658208+0000","last_fullsized":"2024-09-14T11:55:22.658208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:40.009813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446796+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:07.446796+0000","last_peered":"2024-09-14T11:57:07.446796+0000","last_clean":"2024-09-14T11:57:07.446796+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:07.446796+0000","last_undegraded":"2024-09-14T11:57:07.446796+0000","last_fullsized":"2024-09-14T11:57:07.446796+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:22.648516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'768","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.760938+0000","last_change":"2024-09-14T11:58:51.760938+0000","last_active":"2024-09-14T11:58:51.760938+0000","last_peered":"2024-09-14T11:58:51.760938+0000","last_clean":"2024-09-14T11:58:51.760938+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:51.760938+0000","last_undegraded":"2024-09-14T11:58:51.760938+0000","last_fullsized":"2024-09-14T11:58:51.760938+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.760830+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.067687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4017,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'396","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.685522+0000","last_change":"2024-09-14T11:58:46.685522+0000","last_active":"2024-09-14T11:58:46.685522+0000","last_peered":"2024-09-14T11:58:46.685522+0000","last_clean":"2024-09-14T11:58:46.685522+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:46.685522+0000","last_undegraded":"2024-09-14T11:58:46.685522+0000","last_fullsized":"2024-09-14T11:58:46.685522+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.685398+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:45.698748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":27548,"num_write":1230,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.121243+0000","last_change":"2024-09-14T11:58:59.121243+0000","last_active":"2024-09-14T11:58:59.121243+0000","last_peered":"2024-09-14T11:58:59.121243+0000","last_clean":"2024-09-14T11:58:59.121243+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:58:59.121243+0000","last_undegraded":"2024-09-14T11:58:59.121243+0000","last_fullsized":"2024-09-14T11:58:59.121243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.121156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'352","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.098104+0000","last_change":"2024-09-14T11:58:59.098104+0000","last_active":"2024-09-14T11:58:59.098104+0000","last_peered":"2024-09-14T11:58:59.098104+0000","last_clean":"2024-09-14T11:58:59.098104+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:59.098104+0000","last_undegraded":"2024-09-14T11:58:59.098104+0000","last_fullsized":"2024-09-14T11:58:59.098104+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.098007+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:42.018589+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'754","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.094373+0000","last_change":"2024-09-14T11:59:02.094373+0000","last_active":"2024-09-14T11:59:02.094373+0000","last_peered":"2024-09-14T11:59:02.094373+0000","last_clean":"2024-09-14T11:59:02.094373+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:59:02.094373+0000","last_undegraded":"2024-09-14T11:59:02.094373+0000","last_fullsized":"2024-09-14T11:59:02.094373+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.094282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:59.227105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'120","reported_seq":612,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.768184+0000","last_change":"2024-09-14T10:56:49.746163+0000","last_active":"2024-09-14T11:56:50.768184+0000","last_peered":"2024-09-14T11:56:50.768184+0000","last_clean":"2024-09-14T11:56:50.768184+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:56:50.768184+0000","last_undegraded":"2024-09-14T11:56:50.768184+0000","last_fullsized":"2024-09-14T11:56:50.768184+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:25.956197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'748","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.737338+0000","last_change":"2024-09-14T11:58:52.737338+0000","last_active":"2024-09-14T11:58:52.737338+0000","last_peered":"2024-09-14T11:58:52.737338+0000","last_clean":"2024-09-14T11:58:52.737338+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:58:52.737338+0000","last_undegraded":"2024-09-14T11:58:52.737338+0000","last_fullsized":"2024-09-14T11:58:52.737338+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.737257+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:36.814154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.699782+0000","last_change":"2024-09-14T11:58:45.699782+0000","last_active":"2024-09-14T11:58:45.699782+0000","last_peered":"2024-09-14T11:58:45.699782+0000","last_clean":"2024-09-14T11:58:45.699782+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:45.699782+0000","last_undegraded":"2024-09-14T11:58:45.699782+0000","last_fullsized":"2024-09-14T11:58:45.699782+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.699650+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:10.613326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":90386,"num_write":1114,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1447,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.167037+0000","last_change":"2024-09-14T10:56:43.701046+0000","last_active":"2024-09-14T11:58:36.167037+0000","last_peered":"2024-09-14T11:58:36.167037+0000","last_clean":"2024-09-14T11:58:36.167037+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:58:36.167037+0000","last_undegraded":"2024-09-14T11:58:36.167037+0000","last_fullsized":"2024-09-14T11:58:36.167037+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.743177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'92","reported_seq":616,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.017399+0000","last_change":"2024-09-14T10:56:45.713884+0000","last_active":"2024-09-14T11:57:19.017399+0000","last_peered":"2024-09-14T11:57:19.017399+0000","last_clean":"2024-09-14T11:57:19.017399+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:57:19.017399+0000","last_undegraded":"2024-09-14T11:57:19.017399+0000","last_fullsized":"2024-09-14T11:57:19.017399+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:23.564660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'776","reported_seq":2401,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.122049+0000","last_change":"2024-09-14T10:56:47.728790+0000","last_active":"2024-09-14T11:58:38.122049+0000","last_peered":"2024-09-14T11:58:38.122049+0000","last_clean":"2024-09-14T11:58:38.122049+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:58:38.122049+0000","last_undegraded":"2024-09-14T11:58:38.122049+0000","last_fullsized":"2024-09-14T11:58:38.122049+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:22.655451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":664,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.297030+0000","last_change":"2024-09-14T10:56:49.746716+0000","last_active":"2024-09-14T11:56:49.297030+0000","last_peered":"2024-09-14T11:56:49.297030+0000","last_clean":"2024-09-14T11:56:49.297030+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:56:49.297030+0000","last_undegraded":"2024-09-14T11:56:49.297030+0000","last_fullsized":"2024-09-14T11:56:49.297030+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.164615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'790","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.214441+0000","last_change":"2024-09-14T11:58:54.214441+0000","last_active":"2024-09-14T11:58:54.214441+0000","last_peered":"2024-09-14T11:58:54.214441+0000","last_clean":"2024-09-14T11:58:54.214441+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:58:54.214441+0000","last_undegraded":"2024-09-14T11:58:54.214441+0000","last_fullsized":"2024-09-14T11:58:54.214441+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.214346+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:33.379939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.320469+0000","last_change":"2024-09-14T11:58:48.320469+0000","last_active":"2024-09-14T11:58:48.320469+0000","last_peered":"2024-09-14T11:58:48.320469+0000","last_clean":"2024-09-14T11:58:48.320469+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:48.320469+0000","last_undegraded":"2024-09-14T11:58:48.320469+0000","last_fullsized":"2024-09-14T11:58:48.320469+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.320357+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.438966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029101,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1389,"num_write":1004,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:13.551662+0000","last_change":"2024-09-14T10:56:43.698906+0000","last_active":"2024-09-14T11:55:13.551662+0000","last_peered":"2024-09-14T11:55:13.551662+0000","last_clean":"2024-09-14T11:55:13.551662+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:55:13.551662+0000","last_undegraded":"2024-09-14T11:55:13.551662+0000","last_fullsized":"2024-09-14T11:55:13.551662+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:39.807629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'395","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.375762+0000","last_change":"2024-09-14T10:56:45.719001+0000","last_active":"2024-09-14T11:58:38.375762+0000","last_peered":"2024-09-14T11:58:38.375762+0000","last_clean":"2024-09-14T11:58:38.375762+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:58:38.375762+0000","last_undegraded":"2024-09-14T11:58:38.375762+0000","last_fullsized":"2024-09-14T11:58:38.375762+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:08.270910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45959,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1239,"num_read_kb":1795,"num_write":1786,"num_write_kb":1623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.747632+0000","last_change":"2024-09-14T11:59:02.747632+0000","last_active":"2024-09-14T11:59:02.747632+0000","last_peered":"2024-09-14T11:59:02.747632+0000","last_clean":"2024-09-14T11:59:02.747632+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:59:02.747632+0000","last_undegraded":"2024-09-14T11:59:02.747632+0000","last_fullsized":"2024-09-14T11:59:02.747632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.747498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'192","reported_seq":686,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:50.186925+0000","last_change":"2024-09-14T10:56:49.743347+0000","last_active":"2024-09-14T11:56:50.186925+0000","last_peered":"2024-09-14T11:56:50.186925+0000","last_clean":"2024-09-14T11:56:50.186925+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:56:50.186925+0000","last_undegraded":"2024-09-14T11:56:50.186925+0000","last_fullsized":"2024-09-14T11:56:50.186925+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.016494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'648","reported_seq":2132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.745432+0000","last_change":"2024-09-14T11:58:53.745432+0000","last_active":"2024-09-14T11:58:53.745432+0000","last_peered":"2024-09-14T11:58:53.745432+0000","last_clean":"2024-09-14T11:58:53.745432+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:58:53.745432+0000","last_undegraded":"2024-09-14T11:58:53.745432+0000","last_fullsized":"2024-09-14T11:58:53.745432+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'648","last_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_deep_scrub":"263'648","last_deep_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.745349+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":600,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:32.204852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.168663+0000","last_change":"2024-09-14T11:58:46.168663+0000","last_active":"2024-09-14T11:58:46.168663+0000","last_peered":"2024-09-14T11:58:46.168663+0000","last_clean":"2024-09-14T11:58:46.168663+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:58:46.168663+0000","last_undegraded":"2024-09-14T11:58:46.168663+0000","last_fullsized":"2024-09-14T11:58:46.168663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.168543+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:01.548000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.569275+0000","last_change":"2024-09-14T11:58:46.569219+0000","last_active":"2024-09-14T11:58:46.569275+0000","last_peered":"2024-09-14T11:58:46.569275+0000","last_clean":"2024-09-14T11:58:46.569275+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:58:46.569275+0000","last_undegraded":"2024-09-14T11:58:46.569275+0000","last_fullsized":"2024-09-14T11:58:46.569275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.569138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:18.058116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'352","reported_seq":1016,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.444382+0000","last_change":"2024-09-14T11:58:44.444382+0000","last_active":"2024-09-14T11:58:44.444382+0000","last_peered":"2024-09-14T11:58:44.444382+0000","last_clean":"2024-09-14T11:58:44.444382+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:44.444382+0000","last_undegraded":"2024-09-14T11:58:44.444382+0000","last_fullsized":"2024-09-14T11:58:44.444382+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.444289+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:32.649496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":656,"num_read_kb":39235,"num_write":1025,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672300+0000","last_change":"2024-09-14T10:56:43.702002+0000","last_active":"2024-09-14T11:55:07.672300+0000","last_peered":"2024-09-14T11:55:07.672300+0000","last_clean":"2024-09-14T11:55:07.672300+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:55:07.672300+0000","last_undegraded":"2024-09-14T11:55:07.672300+0000","last_fullsized":"2024-09-14T11:55:07.672300+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:33.474891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'794","reported_seq":1492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.510335+0000","last_change":"2024-09-14T10:56:45.716034+0000","last_active":"2024-09-14T11:58:38.510335+0000","last_peered":"2024-09-14T11:58:38.510335+0000","last_clean":"2024-09-14T11:58:38.510335+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:58:38.510335+0000","last_undegraded":"2024-09-14T11:58:38.510335+0000","last_fullsized":"2024-09-14T11:58:38.510335+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:25.384704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159942,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1557,"num_read_kb":3699,"num_write":1498,"num_write_kb":1345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.657591+0000","last_change":"2024-09-14T10:56:47.736084+0000","last_active":"2024-09-14T11:55:17.657591+0000","last_peered":"2024-09-14T11:55:17.657591+0000","last_clean":"2024-09-14T11:55:17.657591+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:55:17.657591+0000","last_undegraded":"2024-09-14T11:55:17.657591+0000","last_fullsized":"2024-09-14T11:55:17.657591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:25:49.305417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'189","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.811415+0000","last_change":"2024-09-14T10:56:49.743581+0000","last_active":"2024-09-14T11:56:52.811415+0000","last_peered":"2024-09-14T11:56:52.811415+0000","last_clean":"2024-09-14T11:56:52.811415+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:56:52.811415+0000","last_undegraded":"2024-09-14T11:56:52.811415+0000","last_fullsized":"2024-09-14T11:56:52.811415+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:57.012986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.091140+0000","last_change":"2024-09-14T11:58:51.091140+0000","last_active":"2024-09-14T11:58:51.091140+0000","last_peered":"2024-09-14T11:58:51.091140+0000","last_clean":"2024-09-14T11:58:51.091140+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:58:51.091140+0000","last_undegraded":"2024-09-14T11:58:51.091140+0000","last_fullsized":"2024-09-14T11:58:51.091140+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.091045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:45.745869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.185772+0000","last_change":"2024-09-14T11:58:47.185772+0000","last_active":"2024-09-14T11:58:47.185772+0000","last_peered":"2024-09-14T11:58:47.185772+0000","last_clean":"2024-09-14T11:58:47.185772+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:58:47.185772+0000","last_undegraded":"2024-09-14T11:58:47.185772+0000","last_fullsized":"2024-09-14T11:58:47.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:42.752443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'294","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.189335+0000","last_change":"2024-09-14T11:58:43.189335+0000","last_active":"2024-09-14T11:58:43.189335+0000","last_peered":"2024-09-14T11:58:43.189335+0000","last_clean":"2024-09-14T11:58:43.189335+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:43.189335+0000","last_undegraded":"2024-09-14T11:58:43.189335+0000","last_fullsized":"2024-09-14T11:58:43.189335+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.189192+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.174639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":19285,"num_write":870,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:17.551105+0000","last_change":"2024-09-14T10:56:43.701669+0000","last_active":"2024-09-14T11:55:17.551105+0000","last_peered":"2024-09-14T11:55:17.551105+0000","last_clean":"2024-09-14T11:55:17.551105+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:55:17.551105+0000","last_undegraded":"2024-09-14T11:55:17.551105+0000","last_fullsized":"2024-09-14T11:55:17.551105+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:32.330161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1329","reported_seq":3014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.441017+0000","last_change":"2024-09-14T10:56:45.719919+0000","last_active":"2024-09-14T11:58:38.441017+0000","last_peered":"2024-09-14T11:58:38.441017+0000","last_clean":"2024-09-14T11:58:38.441017+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:58:38.441017+0000","last_undegraded":"2024-09-14T11:58:38.441017+0000","last_fullsized":"2024-09-14T11:58:38.441017+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":1300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:00:28.154269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147529,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":4061,"num_write":1198,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.673250+0000","last_change":"2024-09-14T10:56:47.734554+0000","last_active":"2024-09-14T11:55:12.673250+0000","last_peered":"2024-09-14T11:55:12.673250+0000","last_clean":"2024-09-14T11:55:12.673250+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:55:12.673250+0000","last_undegraded":"2024-09-14T11:55:12.673250+0000","last_fullsized":"2024-09-14T11:55:12.673250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:41:20.113002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'94","reported_seq":590,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:16.504531+0000","last_change":"2024-09-14T10:56:49.741143+0000","last_active":"2024-09-14T11:56:16.504531+0000","last_peered":"2024-09-14T11:56:16.504531+0000","last_clean":"2024-09-14T11:56:16.504531+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:56:16.504531+0000","last_undegraded":"2024-09-14T11:56:16.504531+0000","last_fullsized":"2024-09-14T11:56:16.504531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.919275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'940","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.240513+0000","last_change":"2024-09-14T11:58:52.240513+0000","last_active":"2024-09-14T11:58:52.240513+0000","last_peered":"2024-09-14T11:58:52.240513+0000","last_clean":"2024-09-14T11:58:52.240513+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:58:52.240513+0000","last_undegraded":"2024-09-14T11:58:52.240513+0000","last_fullsized":"2024-09-14T11:58:52.240513+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'940","last_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_deep_scrub":"263'940","last_deep_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.240421+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:19.620785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.087405+0000","last_change":"2024-09-14T11:58:44.087353+0000","last_active":"2024-09-14T11:58:44.087405+0000","last_peered":"2024-09-14T11:58:44.087405+0000","last_clean":"2024-09-14T11:58:44.087405+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:58:44.087405+0000","last_undegraded":"2024-09-14T11:58:44.087405+0000","last_fullsized":"2024-09-14T11:58:44.087405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.087274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.959220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.207333+0000","last_change":"2024-09-14T11:58:44.207283+0000","last_active":"2024-09-14T11:58:44.207333+0000","last_peered":"2024-09-14T11:58:44.207333+0000","last_clean":"2024-09-14T11:58:44.207333+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:44.207333+0000","last_undegraded":"2024-09-14T11:58:44.207333+0000","last_fullsized":"2024-09-14T11:58:44.207333+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.207202+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.074753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":14745,"num_write":993,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.123366+0000","last_change":"2024-09-14T11:58:52.123366+0000","last_active":"2024-09-14T11:58:52.123366+0000","last_peered":"2024-09-14T11:58:52.123366+0000","last_clean":"2024-09-14T11:58:52.123366+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:58:52.123366+0000","last_undegraded":"2024-09-14T11:58:52.123366+0000","last_fullsized":"2024-09-14T11:58:52.123366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.123283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:43.905032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'291","reported_seq":1564,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:06.772091+0000","last_change":"2024-09-14T10:56:45.720189+0000","last_active":"2024-09-14T11:58:06.772091+0000","last_peered":"2024-09-14T11:58:06.772091+0000","last_clean":"2024-09-14T11:58:06.772091+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:58:06.772091+0000","last_undegraded":"2024-09-14T11:58:06.772091+0000","last_fullsized":"2024-09-14T11:58:06.772091+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:21.350299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656311+0000","last_change":"2024-09-14T10:56:47.737357+0000","last_active":"2024-09-14T11:55:07.656311+0000","last_peered":"2024-09-14T11:55:07.656311+0000","last_clean":"2024-09-14T11:55:07.656311+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:55:07.656311+0000","last_undegraded":"2024-09-14T11:55:07.656311+0000","last_fullsized":"2024-09-14T11:55:07.656311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:59.652704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'262","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.061479+0000","last_change":"2024-09-14T10:56:49.741618+0000","last_active":"2024-09-14T11:56:53.061479+0000","last_peered":"2024-09-14T11:56:53.061479+0000","last_clean":"2024-09-14T11:56:53.061479+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:56:53.061479+0000","last_undegraded":"2024-09-14T11:56:53.061479+0000","last_fullsized":"2024-09-14T11:56:53.061479+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:46:04.982419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'532","reported_seq":2145,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.215616+0000","last_change":"2024-09-14T11:58:55.215616+0000","last_active":"2024-09-14T11:58:55.215616+0000","last_peered":"2024-09-14T11:58:55.215616+0000","last_clean":"2024-09-14T11:58:55.215616+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:58:55.215616+0000","last_undegraded":"2024-09-14T11:58:55.215616+0000","last_fullsized":"2024-09-14T11:58:55.215616+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.215524+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:07.598615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.528258+0000","last_change":"2024-09-14T11:58:45.528200+0000","last_active":"2024-09-14T11:58:45.528258+0000","last_peered":"2024-09-14T11:58:45.528258+0000","last_clean":"2024-09-14T11:58:45.528258+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:58:45.528258+0000","last_undegraded":"2024-09-14T11:58:45.528258+0000","last_fullsized":"2024-09-14T11:58:45.528258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.528111+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:55.865518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'318","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.744001+0000","last_change":"2024-09-14T11:58:44.744001+0000","last_active":"2024-09-14T11:58:44.744001+0000","last_peered":"2024-09-14T11:58:44.744001+0000","last_clean":"2024-09-14T11:58:44.744001+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:44.744001+0000","last_undegraded":"2024-09-14T11:58:44.744001+0000","last_fullsized":"2024-09-14T11:58:44.744001+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.743862+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.790267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":28769,"num_write":1006,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656928+0000","last_change":"2024-09-14T10:56:43.703850+0000","last_active":"2024-09-14T11:55:12.656928+0000","last_peered":"2024-09-14T11:55:12.656928+0000","last_clean":"2024-09-14T11:55:12.656928+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:55:12.656928+0000","last_undegraded":"2024-09-14T11:55:12.656928+0000","last_fullsized":"2024-09-14T11:55:12.656928+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:20.154206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'142","reported_seq":690,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:27.449373+0000","last_change":"2024-09-14T10:56:45.723094+0000","last_active":"2024-09-14T11:57:27.449373+0000","last_peered":"2024-09-14T11:57:27.449373+0000","last_clean":"2024-09-14T11:57:27.449373+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:57:27.449373+0000","last_undegraded":"2024-09-14T11:57:27.449373+0000","last_fullsized":"2024-09-14T11:57:27.449373+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:07.418105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.741491+0000","last_change":"2024-09-14T11:59:01.741491+0000","last_active":"2024-09-14T11:59:01.741491+0000","last_peered":"2024-09-14T11:59:01.741491+0000","last_clean":"2024-09-14T11:59:01.741491+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:59:01.741491+0000","last_undegraded":"2024-09-14T11:59:01.741491+0000","last_fullsized":"2024-09-14T11:59:01.741491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.741352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:48.805285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":719,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.766817+0000","last_change":"2024-09-14T10:56:49.746061+0000","last_active":"2024-09-14T11:56:52.766817+0000","last_peered":"2024-09-14T11:56:52.766817+0000","last_clean":"2024-09-14T11:56:52.766817+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:56:52.766817+0000","last_undegraded":"2024-09-14T11:56:52.766817+0000","last_fullsized":"2024-09-14T11:56:52.766817+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:28.330851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'389","reported_seq":1849,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.196546+0000","last_change":"2024-09-14T11:58:51.196546+0000","last_active":"2024-09-14T11:58:51.196546+0000","last_peered":"2024-09-14T11:58:51.196546+0000","last_clean":"2024-09-14T11:58:51.196546+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:58:51.196546+0000","last_undegraded":"2024-09-14T11:58:51.196546+0000","last_fullsized":"2024-09-14T11:58:51.196546+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.196437+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:05.805557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'431","reported_seq":1089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.607993+0000","last_change":"2024-09-14T11:58:48.607993+0000","last_active":"2024-09-14T11:58:48.607993+0000","last_peered":"2024-09-14T11:58:48.607993+0000","last_clean":"2024-09-14T11:58:48.607993+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:48.607993+0000","last_undegraded":"2024-09-14T11:58:48.607993+0000","last_fullsized":"2024-09-14T11:58:48.607993+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.607870+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:44.650142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":3743,"num_write":1340,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.231477+0000","last_change":"2024-09-14T11:58:43.231436+0000","last_active":"2024-09-14T11:58:43.231477+0000","last_peered":"2024-09-14T11:58:43.231477+0000","last_clean":"2024-09-14T11:58:43.231477+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:58:43.231477+0000","last_undegraded":"2024-09-14T11:58:43.231477+0000","last_fullsized":"2024-09-14T11:58:43.231477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.231372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:04.024193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.032210+0000","last_change":"2024-09-14T11:59:02.032210+0000","last_active":"2024-09-14T11:59:02.032210+0000","last_peered":"2024-09-14T11:59:02.032210+0000","last_clean":"2024-09-14T11:59:02.032210+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:59:02.032210+0000","last_undegraded":"2024-09-14T11:59:02.032210+0000","last_fullsized":"2024-09-14T11:59:02.032210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.032101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.130324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'621","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.011394+0000","last_change":"2024-09-14T11:59:00.011394+0000","last_active":"2024-09-14T11:59:00.011394+0000","last_peered":"2024-09-14T11:59:00.011394+0000","last_clean":"2024-09-14T11:59:00.011394+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:59:00.011394+0000","last_undegraded":"2024-09-14T11:59:00.011394+0000","last_fullsized":"2024-09-14T11:59:00.011394+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'621","last_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_deep_scrub":"263'621","last_deep_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.011288+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:50.798461+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":2305,"num_write":884,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.550619+0000","last_change":"2024-09-14T10:56:47.732150+0000","last_active":"2024-09-14T11:55:08.550619+0000","last_peered":"2024-09-14T11:55:08.550619+0000","last_clean":"2024-09-14T11:55:08.550619+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:55:08.550619+0000","last_undegraded":"2024-09-14T11:55:08.550619+0000","last_fullsized":"2024-09-14T11:55:08.550619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:42.244231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'168","reported_seq":680,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.826154+0000","last_change":"2024-09-14T10:56:49.748121+0000","last_active":"2024-09-14T11:56:49.826154+0000","last_peered":"2024-09-14T11:56:49.826154+0000","last_clean":"2024-09-14T11:56:49.826154+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:56:49.826154+0000","last_undegraded":"2024-09-14T11:56:49.826154+0000","last_fullsized":"2024-09-14T11:56:49.826154+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:52.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.066775+0000","last_change":"2024-09-14T11:58:55.066775+0000","last_active":"2024-09-14T11:58:55.066775+0000","last_peered":"2024-09-14T11:58:55.066775+0000","last_clean":"2024-09-14T11:58:55.066775+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:58:55.066775+0000","last_undegraded":"2024-09-14T11:58:55.066775+0000","last_fullsized":"2024-09-14T11:58:55.066775+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.066670+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.411005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.152595+0000","last_change":"2024-09-14T11:58:50.152595+0000","last_active":"2024-09-14T11:58:50.152595+0000","last_peered":"2024-09-14T11:58:50.152595+0000","last_clean":"2024-09-14T11:58:50.152595+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:50.152595+0000","last_undegraded":"2024-09-14T11:58:50.152595+0000","last_fullsized":"2024-09-14T11:58:50.152595+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.152451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:15.470870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":39755,"num_write":947,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.221461+0000","last_change":"2024-09-14T11:58:48.221461+0000","last_active":"2024-09-14T11:58:48.221461+0000","last_peered":"2024-09-14T11:58:48.221461+0000","last_clean":"2024-09-14T11:58:48.221461+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:58:48.221461+0000","last_undegraded":"2024-09-14T11:58:48.221461+0000","last_fullsized":"2024-09-14T11:58:48.221461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.221349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:16.934950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.788524+0000","last_change":"2024-09-14T11:58:57.788524+0000","last_active":"2024-09-14T11:58:57.788524+0000","last_peered":"2024-09-14T11:58:57.788524+0000","last_clean":"2024-09-14T11:58:57.788524+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:58:57.788524+0000","last_undegraded":"2024-09-14T11:58:57.788524+0000","last_fullsized":"2024-09-14T11:58:57.788524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.788438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.196517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'191","reported_seq":765,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.127349+0000","last_change":"2024-09-14T10:56:45.711166+0000","last_active":"2024-09-14T11:57:19.127349+0000","last_peered":"2024-09-14T11:57:19.127349+0000","last_clean":"2024-09-14T11:57:19.127349+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:57:19.127349+0000","last_undegraded":"2024-09-14T11:57:19.127349+0000","last_fullsized":"2024-09-14T11:57:19.127349+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:47.059448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'799","reported_seq":2597,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.286225+0000","last_change":"2024-09-14T10:56:47.728767+0000","last_active":"2024-09-14T11:58:39.286225+0000","last_peered":"2024-09-14T11:58:39.286225+0000","last_clean":"2024-09-14T11:58:39.286225+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:58:39.286225+0000","last_undegraded":"2024-09-14T11:58:39.286225+0000","last_fullsized":"2024-09-14T11:58:39.286225+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'134","reported_seq":627,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452881+0000","last_change":"2024-09-14T10:56:49.737155+0000","last_active":"2024-09-14T11:57:52.452881+0000","last_peered":"2024-09-14T11:57:52.452881+0000","last_clean":"2024-09-14T11:57:52.452881+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:57:52.452881+0000","last_undegraded":"2024-09-14T11:57:52.452881+0000","last_fullsized":"2024-09-14T11:57:52.452881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:24.625591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.283321+0000","last_change":"2024-09-14T11:58:55.283205+0000","last_active":"2024-09-14T11:58:55.283321+0000","last_peered":"2024-09-14T11:58:55.283321+0000","last_clean":"2024-09-14T11:58:55.283321+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:58:55.283321+0000","last_undegraded":"2024-09-14T11:58:55.283321+0000","last_fullsized":"2024-09-14T11:58:55.283321+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.283109+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:51.916150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'358","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.209859+0000","last_change":"2024-09-14T11:58:51.209859+0000","last_active":"2024-09-14T11:58:51.209859+0000","last_peered":"2024-09-14T11:58:51.209859+0000","last_clean":"2024-09-14T11:58:51.209859+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:51.209859+0000","last_undegraded":"2024-09-14T11:58:51.209859+0000","last_fullsized":"2024-09-14T11:58:51.209859+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.209715+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:49.586185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":699,"num_read_kb":30583,"num_write":1068,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.215756+0000","last_change":"2024-09-14T11:58:45.215756+0000","last_active":"2024-09-14T11:58:45.215756+0000","last_peered":"2024-09-14T11:58:45.215756+0000","last_clean":"2024-09-14T11:58:45.215756+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:58:45.215756+0000","last_undegraded":"2024-09-14T11:58:45.215756+0000","last_fullsized":"2024-09-14T11:58:45.215756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.215695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:26.730819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:03.549708+0000","last_change":"2024-09-14T10:56:43.703110+0000","last_active":"2024-09-14T11:55:03.549708+0000","last_peered":"2024-09-14T11:55:03.549708+0000","last_clean":"2024-09-14T11:55:03.549708+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:55:03.549708+0000","last_undegraded":"2024-09-14T11:55:03.549708+0000","last_fullsized":"2024-09-14T11:55:03.549708+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:45:12.622307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'119","reported_seq":667,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.096817+0000","last_change":"2024-09-14T10:56:45.722824+0000","last_active":"2024-09-14T11:57:19.096817+0000","last_peered":"2024-09-14T11:57:19.096817+0000","last_clean":"2024-09-14T11:57:19.096817+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:57:19.096817+0000","last_undegraded":"2024-09-14T11:57:19.096817+0000","last_fullsized":"2024-09-14T11:57:19.096817+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:19.875207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'813","reported_seq":2998,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.359107+0000","last_change":"2024-09-14T10:56:47.731609+0000","last_active":"2024-09-14T11:58:38.359107+0000","last_peered":"2024-09-14T11:58:38.359107+0000","last_clean":"2024-09-14T11:58:38.359107+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:58:38.359107+0000","last_undegraded":"2024-09-14T11:58:38.359107+0000","last_fullsized":"2024-09-14T11:58:38.359107+0000","mapping_epoch":33,"log_start":"263'801","ondisk_log_start":"263'801","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":801,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:36.877641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'289","reported_seq":800,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.773375+0000","last_change":"2024-09-14T10:56:49.747406+0000","last_active":"2024-09-14T11:56:52.773375+0000","last_peered":"2024-09-14T11:56:52.773375+0000","last_clean":"2024-09-14T11:56:52.773375+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:56:52.773375+0000","last_undegraded":"2024-09-14T11:56:52.773375+0000","last_fullsized":"2024-09-14T11:56:52.773375+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:48.880523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.756014+0000","last_change":"2024-09-14T11:58:48.756014+0000","last_active":"2024-09-14T11:58:48.756014+0000","last_peered":"2024-09-14T11:58:48.756014+0000","last_clean":"2024-09-14T11:58:48.756014+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:58:48.756014+0000","last_undegraded":"2024-09-14T11:58:48.756014+0000","last_fullsized":"2024-09-14T11:58:48.756014+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.755922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:53.686958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'458","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.129855+0000","last_change":"2024-09-14T11:58:46.129855+0000","last_active":"2024-09-14T11:58:46.129855+0000","last_peered":"2024-09-14T11:58:46.129855+0000","last_clean":"2024-09-14T11:58:46.129855+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:46.129855+0000","last_undegraded":"2024-09-14T11:58:46.129855+0000","last_fullsized":"2024-09-14T11:58:46.129855+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.129767+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:43.560691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1014,"num_read_kb":14136,"num_write":1501,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.707137+0000","last_change":"2024-09-14T11:58:45.707137+0000","last_active":"2024-09-14T11:58:45.707137+0000","last_peered":"2024-09-14T11:58:45.707137+0000","last_clean":"2024-09-14T11:58:45.707137+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:58:45.707137+0000","last_undegraded":"2024-09-14T11:58:45.707137+0000","last_fullsized":"2024-09-14T11:58:45.707137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.707053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.841690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.273723+0000","last_change":"2024-09-14T11:59:01.273664+0000","last_active":"2024-09-14T11:59:01.273723+0000","last_peered":"2024-09-14T11:59:01.273723+0000","last_clean":"2024-09-14T11:59:01.273723+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:59:01.273723+0000","last_undegraded":"2024-09-14T11:59:01.273723+0000","last_fullsized":"2024-09-14T11:59:01.273723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.273570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:42.443452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'775","reported_seq":1492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.251600+0000","last_change":"2024-09-14T10:56:45.720876+0000","last_active":"2024-09-14T11:58:38.251600+0000","last_peered":"2024-09-14T11:58:38.251600+0000","last_clean":"2024-09-14T11:58:38.251600+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:58:38.251600+0000","last_undegraded":"2024-09-14T11:58:38.251600+0000","last_fullsized":"2024-09-14T11:58:38.251600+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":700,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:30:07.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1390,"num_read_kb":3483,"num_write":1134,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656600+0000","last_change":"2024-09-14T10:56:47.731417+0000","last_active":"2024-09-14T11:55:07.656600+0000","last_peered":"2024-09-14T11:55:07.656600+0000","last_clean":"2024-09-14T11:55:07.656600+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:55:07.656600+0000","last_undegraded":"2024-09-14T11:55:07.656600+0000","last_fullsized":"2024-09-14T11:55:07.656600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:34.160341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'154","reported_seq":691,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:39.473141+0000","last_change":"2024-09-14T10:56:49.746978+0000","last_active":"2024-09-14T11:55:39.473141+0000","last_peered":"2024-09-14T11:55:39.473141+0000","last_clean":"2024-09-14T11:55:39.473141+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:55:39.473141+0000","last_undegraded":"2024-09-14T11:55:39.473141+0000","last_fullsized":"2024-09-14T11:55:39.473141+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:12.779368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'168","reported_seq":714,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:53.003254+0000","last_change":"2024-09-14T10:56:49.747311+0000","last_active":"2024-09-14T11:56:53.003254+0000","last_peered":"2024-09-14T11:56:53.003254+0000","last_clean":"2024-09-14T11:56:53.003254+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:56:53.003254+0000","last_undegraded":"2024-09-14T11:56:53.003254+0000","last_fullsized":"2024-09-14T11:56:53.003254+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:29:47.257897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1125","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.774053+0000","last_change":"2024-09-14T11:58:53.774053+0000","last_active":"2024-09-14T11:58:53.774053+0000","last_peered":"2024-09-14T11:58:53.774053+0000","last_clean":"2024-09-14T11:58:53.774053+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:58:53.774053+0000","last_undegraded":"2024-09-14T11:58:53.774053+0000","last_fullsized":"2024-09-14T11:58:53.774053+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1125","last_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_deep_scrub":"263'1125","last_deep_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.773964+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:13.075424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'419","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.745556+0000","last_change":"2024-09-14T11:58:47.745556+0000","last_active":"2024-09-14T11:58:47.745556+0000","last_peered":"2024-09-14T11:58:47.745556+0000","last_clean":"2024-09-14T11:58:47.745556+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:47.745556+0000","last_undegraded":"2024-09-14T11:58:47.745556+0000","last_fullsized":"2024-09-14T11:58:47.745556+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.745449+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:44.093108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":639,"num_read_kb":10191,"num_write":1201,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.112762+0000","last_change":"2024-09-14T11:59:00.112762+0000","last_active":"2024-09-14T11:59:00.112762+0000","last_peered":"2024-09-14T11:59:00.112762+0000","last_clean":"2024-09-14T11:59:00.112762+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:59:00.112762+0000","last_undegraded":"2024-09-14T11:59:00.112762+0000","last_fullsized":"2024-09-14T11:59:00.112762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.112668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:16.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'333","reported_seq":911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.878388+0000","last_change":"2024-09-14T10:56:45.717554+0000","last_active":"2024-09-14T11:58:38.878388+0000","last_peered":"2024-09-14T11:58:38.878388+0000","last_clean":"2024-09-14T11:58:38.878388+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:58:38.878388+0000","last_undegraded":"2024-09-14T11:58:38.878388+0000","last_fullsized":"2024-09-14T11:58:38.878388+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:35.209988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":1418,"num_write":456,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656516+0000","last_change":"2024-09-14T10:56:47.725547+0000","last_active":"2024-09-14T11:55:07.656516+0000","last_peered":"2024-09-14T11:55:07.656516+0000","last_clean":"2024-09-14T11:55:07.656516+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:55:07.656516+0000","last_undegraded":"2024-09-14T11:55:07.656516+0000","last_fullsized":"2024-09-14T11:55:07.656516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:50.084006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":637,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:30.627089+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:55:30.627089+0000","last_peered":"2024-09-14T11:55:30.627089+0000","last_clean":"2024-09-14T11:55:30.627089+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:55:30.627089+0000","last_undegraded":"2024-09-14T11:55:30.627089+0000","last_fullsized":"2024-09-14T11:55:30.627089+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:17.809740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1059","reported_seq":2876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.245818+0000","last_change":"2024-09-14T11:58:53.245818+0000","last_active":"2024-09-14T11:58:53.245818+0000","last_peered":"2024-09-14T11:58:53.245818+0000","last_clean":"2024-09-14T11:58:53.245818+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:58:53.245818+0000","last_undegraded":"2024-09-14T11:58:53.245818+0000","last_fullsized":"2024-09-14T11:58:53.245818+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1059","last_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_deep_scrub":"263'1059","last_deep_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.245711+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:12.381249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'438","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.173546+0000","last_change":"2024-09-14T11:58:54.173546+0000","last_active":"2024-09-14T11:58:54.173546+0000","last_peered":"2024-09-14T11:58:54.173546+0000","last_clean":"2024-09-14T11:58:54.173546+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:54.173546+0000","last_undegraded":"2024-09-14T11:58:54.173546+0000","last_fullsized":"2024-09-14T11:58:54.173546+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.173383+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.863811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":832,"num_read_kb":46830,"num_write":1292,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656693+0000","last_change":"2024-09-14T10:56:43.695342+0000","last_active":"2024-09-14T11:55:07.656693+0000","last_peered":"2024-09-14T11:55:07.656693+0000","last_clean":"2024-09-14T11:55:07.656693+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:55:07.656693+0000","last_undegraded":"2024-09-14T11:55:07.656693+0000","last_fullsized":"2024-09-14T11:55:07.656693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:45.552140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'46","reported_seq":544,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:18.731707+0000","last_change":"2024-09-14T10:56:45.719223+0000","last_active":"2024-09-14T11:57:18.731707+0000","last_peered":"2024-09-14T11:57:18.731707+0000","last_clean":"2024-09-14T11:57:18.731707+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:57:18.731707+0000","last_undegraded":"2024-09-14T11:57:18.731707+0000","last_fullsized":"2024-09-14T11:57:18.731707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:12.736414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":473,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672205+0000","last_change":"2024-09-14T10:56:47.735092+0000","last_active":"2024-09-14T11:55:07.672205+0000","last_peered":"2024-09-14T11:55:07.672205+0000","last_clean":"2024-09-14T11:55:07.672205+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:55:07.672205+0000","last_undegraded":"2024-09-14T11:55:07.672205+0000","last_fullsized":"2024-09-14T11:55:07.672205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:26.157686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'191","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.919060+0000","last_change":"2024-09-14T10:56:49.748097+0000","last_active":"2024-09-14T11:56:51.919060+0000","last_peered":"2024-09-14T11:56:51.919060+0000","last_clean":"2024-09-14T11:56:51.919060+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:56:51.919060+0000","last_undegraded":"2024-09-14T11:56:51.919060+0000","last_fullsized":"2024-09-14T11:56:51.919060+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:32.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'556","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.329578+0000","last_change":"2024-09-14T11:58:56.329578+0000","last_active":"2024-09-14T11:58:56.329578+0000","last_peered":"2024-09-14T11:58:56.329578+0000","last_clean":"2024-09-14T11:58:56.329578+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:56.329578+0000","last_undegraded":"2024-09-14T11:58:56.329578+0000","last_fullsized":"2024-09-14T11:58:56.329578+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.329487+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:16.173830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'400","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.572237+0000","last_change":"2024-09-14T11:58:47.572237+0000","last_active":"2024-09-14T11:58:47.572237+0000","last_peered":"2024-09-14T11:58:47.572237+0000","last_clean":"2024-09-14T11:58:47.572237+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:47.572237+0000","last_undegraded":"2024-09-14T11:58:47.572237+0000","last_fullsized":"2024-09-14T11:58:47.572237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.572136+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.322151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":842,"num_read_kb":27462,"num_write":1412,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.672163+0000","last_change":"2024-09-14T10:56:43.699062+0000","last_active":"2024-09-14T11:55:07.672163+0000","last_peered":"2024-09-14T11:55:07.672163+0000","last_clean":"2024-09-14T11:55:07.672163+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:55:07.672163+0000","last_undegraded":"2024-09-14T11:55:07.672163+0000","last_fullsized":"2024-09-14T11:55:07.672163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:26.963005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'327","reported_seq":922,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.855084+0000","last_change":"2024-09-14T10:56:45.715959+0000","last_active":"2024-09-14T11:58:37.855084+0000","last_peered":"2024-09-14T11:58:37.855084+0000","last_clean":"2024-09-14T11:58:37.855084+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:58:37.855084+0000","last_undegraded":"2024-09-14T11:58:37.855084+0000","last_fullsized":"2024-09-14T11:58:37.855084+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:21:05.499950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1216,"num_write":428,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":476,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:08.670532+0000","last_change":"2024-09-14T10:56:47.732777+0000","last_active":"2024-09-14T11:55:08.670532+0000","last_peered":"2024-09-14T11:55:08.670532+0000","last_clean":"2024-09-14T11:55:08.670532+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:55:08.670532+0000","last_undegraded":"2024-09-14T11:55:08.670532+0000","last_fullsized":"2024-09-14T11:55:08.670532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:56.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'132","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:50.364550+0000","last_change":"2024-09-14T10:56:49.744968+0000","last_active":"2024-09-14T11:55:50.364550+0000","last_peered":"2024-09-14T11:55:50.364550+0000","last_clean":"2024-09-14T11:55:50.364550+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:55:50.364550+0000","last_undegraded":"2024-09-14T11:55:50.364550+0000","last_fullsized":"2024-09-14T11:55:50.364550+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.920523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'546","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.288352+0000","last_change":"2024-09-14T11:58:58.288352+0000","last_active":"2024-09-14T11:58:58.288352+0000","last_peered":"2024-09-14T11:58:58.288352+0000","last_clean":"2024-09-14T11:58:58.288352+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:58:58.288352+0000","last_undegraded":"2024-09-14T11:58:58.288352+0000","last_fullsized":"2024-09-14T11:58:58.288352+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'546","last_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_deep_scrub":"263'546","last_deep_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.288260+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:34.628427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'377","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.149039+0000","last_change":"2024-09-14T11:58:44.149039+0000","last_active":"2024-09-14T11:58:44.149039+0000","last_peered":"2024-09-14T11:58:44.149039+0000","last_clean":"2024-09-14T11:58:44.149039+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:44.149039+0000","last_undegraded":"2024-09-14T11:58:44.149039+0000","last_fullsized":"2024-09-14T11:58:44.149039+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.148961+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:02.627312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":41704,"num_write":1258,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.766783+0000","last_change":"2024-09-14T11:58:59.766783+0000","last_active":"2024-09-14T11:58:59.766783+0000","last_peered":"2024-09-14T11:58:59.766783+0000","last_clean":"2024-09-14T11:58:59.766783+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:58:59.766783+0000","last_undegraded":"2024-09-14T11:58:59.766783+0000","last_fullsized":"2024-09-14T11:58:59.766783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.766639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:45.001749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'282","reported_seq":842,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.608467+0000","last_change":"2024-09-14T10:56:45.716753+0000","last_active":"2024-09-14T11:58:37.608467+0000","last_peered":"2024-09-14T11:58:37.608467+0000","last_clean":"2024-09-14T11:58:37.608467+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:58:37.608467+0000","last_undegraded":"2024-09-14T11:58:37.608467+0000","last_fullsized":"2024-09-14T11:58:37.608467+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:06.690939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1119,"num_write":378,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656266+0000","last_change":"2024-09-14T10:56:47.736112+0000","last_active":"2024-09-14T11:55:07.656266+0000","last_peered":"2024-09-14T11:55:07.656266+0000","last_clean":"2024-09-14T11:55:07.656266+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:55:07.656266+0000","last_undegraded":"2024-09-14T11:55:07.656266+0000","last_fullsized":"2024-09-14T11:55:07.656266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:10.784169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'483","reported_seq":2286,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.786085+0000","last_change":"2024-09-14T11:58:55.786085+0000","last_active":"2024-09-14T11:58:55.786085+0000","last_peered":"2024-09-14T11:58:55.786085+0000","last_clean":"2024-09-14T11:58:55.786085+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:58:55.786085+0000","last_undegraded":"2024-09-14T11:58:55.786085+0000","last_fullsized":"2024-09-14T11:58:55.786085+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.786005+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:32.817114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2487,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'309","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.219033+0000","last_change":"2024-09-14T11:58:52.219033+0000","last_active":"2024-09-14T11:58:52.219033+0000","last_peered":"2024-09-14T11:58:52.219033+0000","last_clean":"2024-09-14T11:58:52.219033+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:52.219033+0000","last_undegraded":"2024-09-14T11:58:52.219033+0000","last_fullsized":"2024-09-14T11:58:52.219033+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.218942+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.549674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":570,"num_read_kb":63784,"num_write":891,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.961984+0000","last_change":"2024-09-14T11:58:58.961984+0000","last_active":"2024-09-14T11:58:58.961984+0000","last_peered":"2024-09-14T11:58:58.961984+0000","last_clean":"2024-09-14T11:58:58.961984+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:58.961984+0000","last_undegraded":"2024-09-14T11:58:58.961984+0000","last_fullsized":"2024-09-14T11:58:58.961984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.961880+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:20.687210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'498","reported_seq":1131,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.281601+0000","last_change":"2024-09-14T10:56:45.720443+0000","last_active":"2024-09-14T11:58:39.281601+0000","last_peered":"2024-09-14T11:58:39.281601+0000","last_clean":"2024-09-14T11:58:39.281601+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:58:39.281601+0000","last_undegraded":"2024-09-14T11:58:39.281601+0000","last_fullsized":"2024-09-14T11:58:39.281601+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:21.146179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":902,"num_read_kb":2267,"num_write":774,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":474,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541697+0000","last_change":"2024-09-14T10:56:47.731799+0000","last_active":"2024-09-14T11:54:17.541697+0000","last_peered":"2024-09-14T11:54:17.541697+0000","last_clean":"2024-09-14T11:54:17.541697+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:54:17.541697+0000","last_undegraded":"2024-09-14T11:54:17.541697+0000","last_fullsized":"2024-09-14T11:54:17.541697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:58.343090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'457","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.051229+0000","last_change":"2024-09-14T11:58:56.051229+0000","last_active":"2024-09-14T11:58:56.051229+0000","last_peered":"2024-09-14T11:58:56.051229+0000","last_clean":"2024-09-14T11:58:56.051229+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:58:56.051229+0000","last_undegraded":"2024-09-14T11:58:56.051229+0000","last_fullsized":"2024-09-14T11:58:56.051229+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.051133+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:38.593201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.201425+0000","last_change":"2024-09-14T11:58:46.201425+0000","last_active":"2024-09-14T11:58:46.201425+0000","last_peered":"2024-09-14T11:58:46.201425+0000","last_clean":"2024-09-14T11:58:46.201425+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:46.201425+0000","last_undegraded":"2024-09-14T11:58:46.201425+0000","last_fullsized":"2024-09-14T11:58:46.201425+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.201295+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:11.588159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":604,"num_read_kb":50717,"num_write":1053,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.776994+0000","last_change":"2024-09-14T11:59:00.776994+0000","last_active":"2024-09-14T11:59:00.776994+0000","last_peered":"2024-09-14T11:59:00.776994+0000","last_clean":"2024-09-14T11:59:00.776994+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:59:00.776994+0000","last_undegraded":"2024-09-14T11:59:00.776994+0000","last_fullsized":"2024-09-14T11:59:00.776994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.776887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:37.705302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'314","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.693526+0000","last_change":"2024-09-14T10:56:45.719927+0000","last_active":"2024-09-14T11:58:37.693526+0000","last_peered":"2024-09-14T11:58:37.693526+0000","last_clean":"2024-09-14T11:58:37.693526+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:58:37.693526+0000","last_undegraded":"2024-09-14T11:58:37.693526+0000","last_fullsized":"2024-09-14T11:58:37.693526+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:48.490893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51994,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":540,"num_read_kb":1196,"num_write":444,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.529645+0000","last_change":"2024-09-14T10:56:47.726517+0000","last_active":"2024-09-14T11:54:17.529645+0000","last_peered":"2024-09-14T11:54:17.529645+0000","last_clean":"2024-09-14T11:54:17.529645+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:54:17.529645+0000","last_undegraded":"2024-09-14T11:54:17.529645+0000","last_fullsized":"2024-09-14T11:54:17.529645+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:13.280821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'150","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:43.548609+0000","last_change":"2024-09-14T10:56:49.743152+0000","last_active":"2024-09-14T11:55:43.548609+0000","last_peered":"2024-09-14T11:55:43.548609+0000","last_clean":"2024-09-14T11:55:43.548609+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:55:43.548609+0000","last_undegraded":"2024-09-14T11:55:43.548609+0000","last_fullsized":"2024-09-14T11:55:43.548609+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:00.272121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'552","reported_seq":2159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.443381+0000","last_change":"2024-09-14T10:56:41.685799+0000","last_active":"2024-09-14T11:56:42.443381+0000","last_peered":"2024-09-14T11:56:42.443381+0000","last_clean":"2024-09-14T11:56:42.443381+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:56:42.443381+0000","last_undegraded":"2024-09-14T11:56:42.443381+0000","last_fullsized":"2024-09-14T11:56:42.443381+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:45.483192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'339","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.715160+0000","last_change":"2024-09-14T11:58:46.715160+0000","last_active":"2024-09-14T11:58:46.715160+0000","last_peered":"2024-09-14T11:58:46.715160+0000","last_clean":"2024-09-14T11:58:46.715160+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:46.715160+0000","last_undegraded":"2024-09-14T11:58:46.715160+0000","last_fullsized":"2024-09-14T11:58:46.715160+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.715001+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.562859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":82907,"num_write":1088,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:13.542445+0000","last_change":"2024-09-14T10:56:43.704594+0000","last_active":"2024-09-14T11:54:13.542445+0000","last_peered":"2024-09-14T11:54:13.542445+0000","last_clean":"2024-09-14T11:54:13.542445+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:54:13.542445+0000","last_undegraded":"2024-09-14T11:54:13.542445+0000","last_fullsized":"2024-09-14T11:54:13.542445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:25.531963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'306","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.135590+0000","last_change":"2024-09-14T10:56:45.713501+0000","last_active":"2024-09-14T11:58:39.135590+0000","last_peered":"2024-09-14T11:58:39.135590+0000","last_clean":"2024-09-14T11:58:39.135590+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:58:39.135590+0000","last_undegraded":"2024-09-14T11:58:39.135590+0000","last_fullsized":"2024-09-14T11:58:39.135590+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:35.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1144,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.442648+0000","last_change":"2024-09-14T10:56:47.733388+0000","last_active":"2024-09-14T11:57:02.442648+0000","last_peered":"2024-09-14T11:57:02.442648+0000","last_clean":"2024-09-14T11:57:02.442648+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:57:02.442648+0000","last_undegraded":"2024-09-14T11:57:02.442648+0000","last_fullsized":"2024-09-14T11:57:02.442648+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'166","reported_seq":659,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:11.311096+0000","last_change":"2024-09-14T10:56:49.745862+0000","last_active":"2024-09-14T11:58:11.311096+0000","last_peered":"2024-09-14T11:58:11.311096+0000","last_clean":"2024-09-14T11:58:11.311096+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:58:11.311096+0000","last_undegraded":"2024-09-14T11:58:11.311096+0000","last_fullsized":"2024-09-14T11:58:11.311096+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.824927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'530","reported_seq":2218,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.149263+0000","last_change":"2024-09-14T11:58:51.149263+0000","last_active":"2024-09-14T11:58:51.149263+0000","last_peered":"2024-09-14T11:58:51.149263+0000","last_clean":"2024-09-14T11:58:51.149263+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:51.149263+0000","last_undegraded":"2024-09-14T11:58:51.149263+0000","last_fullsized":"2024-09-14T11:58:51.149263+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'530","last_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_deep_scrub":"263'530","last_deep_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.149169+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:45.648421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'377","reported_seq":1038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.124725+0000","last_change":"2024-09-14T11:58:48.124725+0000","last_active":"2024-09-14T11:58:48.124725+0000","last_peered":"2024-09-14T11:58:48.124725+0000","last_clean":"2024-09-14T11:58:48.124725+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:48.124725+0000","last_undegraded":"2024-09-14T11:58:48.124725+0000","last_fullsized":"2024-09-14T11:58:48.124725+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.124576+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:36.223458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":42073,"num_write":1144,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.117157+0000","last_change":"2024-09-14T11:59:02.117157+0000","last_active":"2024-09-14T11:59:02.117157+0000","last_peered":"2024-09-14T11:59:02.117157+0000","last_clean":"2024-09-14T11:59:02.117157+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:59:02.117157+0000","last_undegraded":"2024-09-14T11:59:02.117157+0000","last_fullsized":"2024-09-14T11:59:02.117157+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.117068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:46.630742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'102","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:19.120594+0000","last_change":"2024-09-14T10:56:45.723330+0000","last_active":"2024-09-14T11:57:19.120594+0000","last_peered":"2024-09-14T11:57:19.120594+0000","last_clean":"2024-09-14T11:57:19.120594+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:57:19.120594+0000","last_undegraded":"2024-09-14T11:57:19.120594+0000","last_fullsized":"2024-09-14T11:57:19.120594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:52.375494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'777","reported_seq":4309,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.123160+0000","last_change":"2024-09-14T10:56:47.725052+0000","last_active":"2024-09-14T11:58:38.123160+0000","last_peered":"2024-09-14T11:58:38.123160+0000","last_clean":"2024-09-14T11:58:38.123160+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:58:38.123160+0000","last_undegraded":"2024-09-14T11:58:38.123160+0000","last_fullsized":"2024-09-14T11:58:38.123160+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:47.209530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":611,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:52.919170+0000","last_change":"2024-09-14T10:56:49.751037+0000","last_active":"2024-09-14T11:56:52.919170+0000","last_peered":"2024-09-14T11:56:52.919170+0000","last_clean":"2024-09-14T11:56:52.919170+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:56:52.919170+0000","last_undegraded":"2024-09-14T11:56:52.919170+0000","last_fullsized":"2024-09-14T11:56:52.919170+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:10.690807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'414","reported_seq":2037,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.771503+0000","last_change":"2024-09-14T11:58:56.771503+0000","last_active":"2024-09-14T11:58:56.771503+0000","last_peered":"2024-09-14T11:58:56.771503+0000","last_clean":"2024-09-14T11:58:56.771503+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:58:56.771503+0000","last_undegraded":"2024-09-14T11:58:56.771503+0000","last_fullsized":"2024-09-14T11:58:56.771503+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.771427+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:50.649246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'292","reported_seq":886,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.632043+0000","last_change":"2024-09-14T11:58:50.632043+0000","last_active":"2024-09-14T11:58:50.632043+0000","last_peered":"2024-09-14T11:58:50.632043+0000","last_clean":"2024-09-14T11:58:50.632043+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:50.632043+0000","last_undegraded":"2024-09-14T11:58:50.632043+0000","last_fullsized":"2024-09-14T11:58:50.632043+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.631922+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:24.620243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":9665,"num_write":976,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.664084+0000","last_change":"2024-09-14T10:56:43.698568+0000","last_active":"2024-09-14T11:54:17.664084+0000","last_peered":"2024-09-14T11:54:17.664084+0000","last_clean":"2024-09-14T11:54:17.664084+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:54:17.664084+0000","last_undegraded":"2024-09-14T11:54:17.664084+0000","last_fullsized":"2024-09-14T11:54:17.664084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:50.047236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'320","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.981914+0000","last_change":"2024-09-14T10:56:45.718845+0000","last_active":"2024-09-14T11:58:36.981914+0000","last_peered":"2024-09-14T11:58:36.981914+0000","last_clean":"2024-09-14T11:58:36.981914+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:58:36.981914+0000","last_undegraded":"2024-09-14T11:58:36.981914+0000","last_fullsized":"2024-09-14T11:58:36.981914+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:13.209858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.653460+0000","last_change":"2024-09-14T10:56:47.733362+0000","last_active":"2024-09-14T11:54:47.653460+0000","last_peered":"2024-09-14T11:54:47.653460+0000","last_clean":"2024-09-14T11:54:47.653460+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:54:47.653460+0000","last_undegraded":"2024-09-14T11:54:47.653460+0000","last_fullsized":"2024-09-14T11:54:47.653460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:33.594204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'123","reported_seq":613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.829287+0000","last_change":"2024-09-14T10:56:49.749682+0000","last_active":"2024-09-14T11:56:49.829287+0000","last_peered":"2024-09-14T11:56:49.829287+0000","last_clean":"2024-09-14T11:56:49.829287+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:56:49.829287+0000","last_undegraded":"2024-09-14T11:56:49.829287+0000","last_fullsized":"2024-09-14T11:56:49.829287+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:32.089427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'399","reported_seq":1844,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.798697+0000","last_change":"2024-09-14T11:58:57.798697+0000","last_active":"2024-09-14T11:58:57.798697+0000","last_peered":"2024-09-14T11:58:57.798697+0000","last_clean":"2024-09-14T11:58:57.798697+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:58:57.798697+0000","last_undegraded":"2024-09-14T11:58:57.798697+0000","last_fullsized":"2024-09-14T11:58:57.798697+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.798592+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:10.547579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'329","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.595701+0000","last_change":"2024-09-14T11:58:49.595701+0000","last_active":"2024-09-14T11:58:49.595701+0000","last_peered":"2024-09-14T11:58:49.595701+0000","last_clean":"2024-09-14T11:58:49.595701+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:49.595701+0000","last_undegraded":"2024-09-14T11:58:49.595701+0000","last_fullsized":"2024-09-14T11:58:49.595701+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.595597+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:05.088352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":577,"num_read_kb":29813,"num_write":1080,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.541668+0000","last_change":"2024-09-14T10:56:43.698362+0000","last_active":"2024-09-14T11:54:17.541668+0000","last_peered":"2024-09-14T11:54:17.541668+0000","last_clean":"2024-09-14T11:54:17.541668+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:54:17.541668+0000","last_undegraded":"2024-09-14T11:54:17.541668+0000","last_fullsized":"2024-09-14T11:54:17.541668+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.790448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'285","reported_seq":851,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.069236+0000","last_change":"2024-09-14T10:56:45.714250+0000","last_active":"2024-09-14T11:58:37.069236+0000","last_peered":"2024-09-14T11:58:37.069236+0000","last_clean":"2024-09-14T11:58:37.069236+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:58:37.069236+0000","last_undegraded":"2024-09-14T11:58:37.069236+0000","last_fullsized":"2024-09-14T11:58:37.069236+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:33.117467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":475,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:58.669009+0000","last_change":"2024-09-14T10:56:47.735191+0000","last_active":"2024-09-14T11:54:58.669009+0000","last_peered":"2024-09-14T11:54:58.669009+0000","last_clean":"2024-09-14T11:54:58.669009+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:54:58.669009+0000","last_undegraded":"2024-09-14T11:54:58.669009+0000","last_fullsized":"2024-09-14T11:54:58.669009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:14.084195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'105","reported_seq":615,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:00.049900+0000","last_change":"2024-09-14T10:56:49.737999+0000","last_active":"2024-09-14T11:56:00.049900+0000","last_peered":"2024-09-14T11:56:00.049900+0000","last_clean":"2024-09-14T11:56:00.049900+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:56:00.049900+0000","last_undegraded":"2024-09-14T11:56:00.049900+0000","last_fullsized":"2024-09-14T11:56:00.049900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:58:25.183467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'353","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.647791+0000","last_change":"2024-09-14T11:59:01.647791+0000","last_active":"2024-09-14T11:59:01.647791+0000","last_peered":"2024-09-14T11:59:01.647791+0000","last_clean":"2024-09-14T11:59:01.647791+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:59:01.647791+0000","last_undegraded":"2024-09-14T11:59:01.647791+0000","last_fullsized":"2024-09-14T11:59:01.647791+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.647703+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:52.541769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'405","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.374616+0000","last_change":"2024-09-14T11:58:46.374551+0000","last_active":"2024-09-14T11:58:46.374616+0000","last_peered":"2024-09-14T11:58:46.374616+0000","last_clean":"2024-09-14T11:58:46.374616+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:46.374616+0000","last_undegraded":"2024-09-14T11:58:46.374616+0000","last_fullsized":"2024-09-14T11:58:46.374616+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.374434+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:59.892127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":727,"num_read_kb":11025,"num_write":1267,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:43.546906+0000","last_change":"2024-09-14T10:56:43.701839+0000","last_active":"2024-09-14T11:54:43.546906+0000","last_peered":"2024-09-14T11:54:43.546906+0000","last_clean":"2024-09-14T11:54:43.546906+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:54:43.546906+0000","last_undegraded":"2024-09-14T11:54:43.546906+0000","last_fullsized":"2024-09-14T11:54:43.546906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:42.680388+0000","last_clean_scrub_stamp":"2024-09-14T10:56:42.680388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:17.293205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'237","reported_seq":792,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.003074+0000","last_change":"2024-09-14T10:56:45.717972+0000","last_active":"2024-09-14T11:58:39.003074+0000","last_peered":"2024-09-14T11:58:39.003074+0000","last_clean":"2024-09-14T11:58:39.003074+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:58:39.003074+0000","last_undegraded":"2024-09-14T11:58:39.003074+0000","last_fullsized":"2024-09-14T11:58:39.003074+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:35.627096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":992,"num_write":326,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:18.543346+0000","last_change":"2024-09-14T10:56:47.727607+0000","last_active":"2024-09-14T11:54:18.543346+0000","last_peered":"2024-09-14T11:54:18.543346+0000","last_clean":"2024-09-14T11:54:18.543346+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:54:18.543346+0000","last_undegraded":"2024-09-14T11:54:18.543346+0000","last_fullsized":"2024-09-14T11:54:18.543346+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:25.985367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'158","reported_seq":1613,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.803159+0000","last_change":"2024-09-14T10:56:49.749341+0000","last_active":"2024-09-14T11:56:49.803159+0000","last_peered":"2024-09-14T11:56:49.803159+0000","last_clean":"2024-09-14T11:56:49.803159+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:56:49.803159+0000","last_undegraded":"2024-09-14T11:56:49.803159+0000","last_fullsized":"2024-09-14T11:56:49.803159+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:09.689856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'472","reported_seq":2235,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.777077+0000","last_change":"2024-09-14T11:58:55.777077+0000","last_active":"2024-09-14T11:58:55.777077+0000","last_peered":"2024-09-14T11:58:55.777077+0000","last_clean":"2024-09-14T11:58:55.777077+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:58:55.777077+0000","last_undegraded":"2024-09-14T11:58:55.777077+0000","last_fullsized":"2024-09-14T11:58:55.777077+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'472","last_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_deep_scrub":"263'472","last_deep_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.776981+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:44.267879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2936,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'401","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.196149+0000","last_change":"2024-09-14T11:58:47.196149+0000","last_active":"2024-09-14T11:58:47.196149+0000","last_peered":"2024-09-14T11:58:47.196149+0000","last_clean":"2024-09-14T11:58:47.196149+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:47.196149+0000","last_undegraded":"2024-09-14T11:58:47.196149+0000","last_fullsized":"2024-09-14T11:58:47.196149+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.196028+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:09.718768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":747,"num_read_kb":46945,"num_write":1297,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.080514+0000","last_change":"2024-09-14T11:59:01.080514+0000","last_active":"2024-09-14T11:59:01.080514+0000","last_peered":"2024-09-14T11:59:01.080514+0000","last_clean":"2024-09-14T11:59:01.080514+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:59:01.080514+0000","last_undegraded":"2024-09-14T11:59:01.080514+0000","last_fullsized":"2024-09-14T11:59:01.080514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.080425+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:41.322185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'301","reported_seq":892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.200076+0000","last_change":"2024-09-14T10:56:45.721400+0000","last_active":"2024-09-14T11:58:39.200076+0000","last_peered":"2024-09-14T11:58:39.200076+0000","last_clean":"2024-09-14T11:58:39.200076+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:58:39.200076+0000","last_undegraded":"2024-09-14T11:58:39.200076+0000","last_fullsized":"2024-09-14T11:58:39.200076+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:44.693502+0000","last_clean_scrub_stamp":"2024-09-14T10:56:44.693502+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:52.182048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1073,"num_write":380,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:17.649773+0000","last_change":"2024-09-14T10:56:47.736437+0000","last_active":"2024-09-14T11:54:17.649773+0000","last_peered":"2024-09-14T11:54:17.649773+0000","last_clean":"2024-09-14T11:54:17.649773+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:54:17.649773+0000","last_undegraded":"2024-09-14T11:54:17.649773+0000","last_fullsized":"2024-09-14T11:54:17.649773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:46.706847+0000","last_clean_scrub_stamp":"2024-09-14T10:56:46.706847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:00.826459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'135","reported_seq":652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:09.871440+0000","last_change":"2024-09-14T10:56:49.747246+0000","last_active":"2024-09-14T11:58:09.871440+0000","last_peered":"2024-09-14T11:58:09.871440+0000","last_clean":"2024-09-14T11:58:09.871440+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:58:09.871440+0000","last_undegraded":"2024-09-14T11:58:09.871440+0000","last_fullsized":"2024-09-14T11:58:09.871440+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:08.836336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'586","reported_seq":2265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.175638+0000","last_change":"2024-09-14T11:58:56.175638+0000","last_active":"2024-09-14T11:58:56.175638+0000","last_peered":"2024-09-14T11:58:56.175638+0000","last_clean":"2024-09-14T11:58:56.175638+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:58:56.175638+0000","last_undegraded":"2024-09-14T11:58:56.175638+0000","last_fullsized":"2024-09-14T11:58:56.175638+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'586","last_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_deep_scrub":"263'586","last_deep_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.175551+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:06.302948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'351","reported_seq":1032,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.760006+0000","last_change":"2024-09-14T11:58:49.760006+0000","last_active":"2024-09-14T11:58:49.760006+0000","last_peered":"2024-09-14T11:58:49.760006+0000","last_clean":"2024-09-14T11:58:49.760006+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:49.760006+0000","last_undegraded":"2024-09-14T11:58:49.760006+0000","last_fullsized":"2024-09-14T11:58:49.760006+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.759805+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:27.741535+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":646,"num_read_kb":60949,"num_write":1082,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1054","reported_seq":2943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.153320+0000","last_change":"2024-09-14T11:58:58.153320+0000","last_active":"2024-09-14T11:58:58.153320+0000","last_peered":"2024-09-14T11:58:58.153320+0000","last_clean":"2024-09-14T11:58:58.153320+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:58:58.153320+0000","last_undegraded":"2024-09-14T11:58:58.153320+0000","last_fullsized":"2024-09-14T11:58:58.153320+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1054","last_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_deep_scrub":"263'1054","last_deep_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.153235+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":1000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:25.111446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3040,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'359","reported_seq":1024,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.165361+0000","last_change":"2024-09-14T11:58:46.165361+0000","last_active":"2024-09-14T11:58:46.165361+0000","last_peered":"2024-09-14T11:58:46.165361+0000","last_clean":"2024-09-14T11:58:46.165361+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:46.165361+0000","last_undegraded":"2024-09-14T11:58:46.165361+0000","last_fullsized":"2024-09-14T11:58:46.165361+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.165246+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.126478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":22760,"num_write":1134,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1000","reported_seq":2622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.625634+0000","last_change":"2024-09-14T11:59:00.625634+0000","last_active":"2024-09-14T11:59:00.625634+0000","last_peered":"2024-09-14T11:59:00.625634+0000","last_clean":"2024-09-14T11:59:00.625634+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:59:00.625634+0000","last_undegraded":"2024-09-14T11:59:00.625634+0000","last_fullsized":"2024-09-14T11:59:00.625634+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1000","last_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_deep_scrub":"263'1000","last_deep_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.625532+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.706881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'338","reported_seq":1078,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.659978+0000","last_change":"2024-09-14T11:58:51.659978+0000","last_active":"2024-09-14T11:58:51.659978+0000","last_peered":"2024-09-14T11:58:51.659978+0000","last_clean":"2024-09-14T11:58:51.659978+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:51.659978+0000","last_undegraded":"2024-09-14T11:58:51.659978+0000","last_fullsized":"2024-09-14T11:58:51.659978+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.659787+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:18.224027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":988,"num_read_kb":42151,"num_write":1083,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'861","reported_seq":2451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.135043+0000","last_change":"2024-09-14T11:58:57.135043+0000","last_active":"2024-09-14T11:58:57.135043+0000","last_peered":"2024-09-14T11:58:57.135043+0000","last_clean":"2024-09-14T11:58:57.135043+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:58:57.135043+0000","last_undegraded":"2024-09-14T11:58:57.135043+0000","last_fullsized":"2024-09-14T11:58:57.135043+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'861","last_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_deep_scrub":"263'861","last_deep_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.134958+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.253599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1081,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.137399+0000","last_change":"2024-09-14T11:58:50.137399+0000","last_active":"2024-09-14T11:58:50.137399+0000","last_peered":"2024-09-14T11:58:50.137399+0000","last_clean":"2024-09-14T11:58:50.137399+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:50.137399+0000","last_undegraded":"2024-09-14T11:58:50.137399+0000","last_fullsized":"2024-09-14T11:58:50.137399+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.137192+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:56.624534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":875,"num_read_kb":14120,"num_write":1246,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1638","reported_seq":3366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.242786+0000","last_change":"2024-09-14T11:59:02.242786+0000","last_active":"2024-09-14T11:59:02.242786+0000","last_peered":"2024-09-14T11:59:02.242786+0000","last_clean":"2024-09-14T11:59:02.242786+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:59:02.242786+0000","last_undegraded":"2024-09-14T11:59:02.242786+0000","last_fullsized":"2024-09-14T11:59:02.242786+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1638","last_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_deep_scrub":"263'1638","last_deep_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.242676+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":1600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:30.360125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'410","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.363150+0000","last_change":"2024-09-14T11:58:47.363150+0000","last_active":"2024-09-14T11:58:47.363150+0000","last_peered":"2024-09-14T11:58:47.363150+0000","last_clean":"2024-09-14T11:58:47.363150+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:47.363150+0000","last_undegraded":"2024-09-14T11:58:47.363150+0000","last_fullsized":"2024-09-14T11:58:47.363150+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.363039+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:01.895164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":770,"num_read_kb":3391,"num_write":1187,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'527","reported_seq":2248,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.787143+0000","last_change":"2024-09-14T11:59:02.787143+0000","last_active":"2024-09-14T11:59:02.787143+0000","last_peered":"2024-09-14T11:59:02.787143+0000","last_clean":"2024-09-14T11:59:02.787143+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:59:02.787143+0000","last_undegraded":"2024-09-14T11:59:02.787143+0000","last_fullsized":"2024-09-14T11:59:02.787143+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.787058+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:30.375500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'413","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.188393+0000","last_change":"2024-09-14T11:58:47.188393+0000","last_active":"2024-09-14T11:58:47.188393+0000","last_peered":"2024-09-14T11:58:47.188393+0000","last_clean":"2024-09-14T11:58:47.188393+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:47.188393+0000","last_undegraded":"2024-09-14T11:58:47.188393+0000","last_fullsized":"2024-09-14T11:58:47.188393+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.188302+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:16.690313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1077,"num_read_kb":5071,"num_write":1242,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'776","reported_seq":2312,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.236838+0000","last_change":"2024-09-14T11:59:00.236838+0000","last_active":"2024-09-14T11:59:00.236838+0000","last_peered":"2024-09-14T11:59:00.236838+0000","last_clean":"2024-09-14T11:59:00.236838+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:59:00.236838+0000","last_undegraded":"2024-09-14T11:59:00.236838+0000","last_fullsized":"2024-09-14T11:59:00.236838+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.236741+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:54.394852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'362","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.715807+0000","last_change":"2024-09-14T11:58:48.715807+0000","last_active":"2024-09-14T11:58:48.715807+0000","last_peered":"2024-09-14T11:58:48.715807+0000","last_clean":"2024-09-14T11:58:48.715807+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:48.715807+0000","last_undegraded":"2024-09-14T11:58:48.715807+0000","last_fullsized":"2024-09-14T11:58:48.715807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.715659+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:22.302518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":6911,"num_write":1146,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'416","reported_seq":1955,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.754848+0000","last_change":"2024-09-14T11:58:54.754848+0000","last_active":"2024-09-14T11:58:54.754848+0000","last_peered":"2024-09-14T11:58:54.754848+0000","last_clean":"2024-09-14T11:58:54.754848+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:54.754848+0000","last_undegraded":"2024-09-14T11:58:54.754848+0000","last_fullsized":"2024-09-14T11:58:54.754848+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.754764+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:57.847444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'437","reported_seq":1305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.244256+0000","last_change":"2024-09-14T11:58:53.244256+0000","last_active":"2024-09-14T11:58:53.244256+0000","last_peered":"2024-09-14T11:58:53.244256+0000","last_clean":"2024-09-14T11:58:53.244256+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:53.244256+0000","last_undegraded":"2024-09-14T11:58:53.244256+0000","last_fullsized":"2024-09-14T11:58:53.244256+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.244161+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.178653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1316,"num_read_kb":48095,"num_write":1372,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'717","reported_seq":2047,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:22.445682+0000","last_change":"2024-09-14T10:56:41.697391+0000","last_active":"2024-09-14T11:57:22.445682+0000","last_peered":"2024-09-14T11:57:22.445682+0000","last_clean":"2024-09-14T11:57:22.445682+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:57:22.445682+0000","last_undegraded":"2024-09-14T11:57:22.445682+0000","last_fullsized":"2024-09-14T11:57:22.445682+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:33:49.941382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'420","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700278+0000","last_change":"2024-09-14T11:58:52.700278+0000","last_active":"2024-09-14T11:58:52.700278+0000","last_peered":"2024-09-14T11:58:52.700278+0000","last_clean":"2024-09-14T11:58:52.700278+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:52.700278+0000","last_undegraded":"2024-09-14T11:58:52.700278+0000","last_fullsized":"2024-09-14T11:58:52.700278+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'420","last_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_deep_scrub":"263'420","last_deep_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700176+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:03.862543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":12822,"num_write":1366,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'499","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.764942+0000","last_change":"2024-09-14T11:59:00.764942+0000","last_active":"2024-09-14T11:59:00.764942+0000","last_peered":"2024-09-14T11:59:00.764942+0000","last_clean":"2024-09-14T11:59:00.764942+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:59:00.764942+0000","last_undegraded":"2024-09-14T11:59:00.764942+0000","last_fullsized":"2024-09-14T11:59:00.764942+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.764847+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:24.807051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'451","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.271709+0000","last_change":"2024-09-14T11:58:49.271709+0000","last_active":"2024-09-14T11:58:49.271709+0000","last_peered":"2024-09-14T11:58:49.271709+0000","last_clean":"2024-09-14T11:58:49.271709+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:49.271709+0000","last_undegraded":"2024-09-14T11:58:49.271709+0000","last_fullsized":"2024-09-14T11:58:49.271709+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.271605+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:36.880499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1544,"num_read_kb":34981,"num_write":1381,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1165","reported_seq":2733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.151543+0000","last_change":"2024-09-14T11:58:49.151543+0000","last_active":"2024-09-14T11:58:49.151543+0000","last_peered":"2024-09-14T11:58:49.151543+0000","last_clean":"2024-09-14T11:58:49.151543+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:58:49.151543+0000","last_undegraded":"2024-09-14T11:58:49.151543+0000","last_fullsized":"2024-09-14T11:58:49.151543+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1165","last_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_deep_scrub":"263'1165","last_deep_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.151466+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:18.332268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'313","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.736359+0000","last_change":"2024-09-14T11:58:53.736359+0000","last_active":"2024-09-14T11:58:53.736359+0000","last_peered":"2024-09-14T11:58:53.736359+0000","last_clean":"2024-09-14T11:58:53.736359+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:53.736359+0000","last_undegraded":"2024-09-14T11:58:53.736359+0000","last_fullsized":"2024-09-14T11:58:53.736359+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.736196+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:44.006375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":3420,"num_write":993,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'622","reported_seq":2444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.810902+0000","last_change":"2024-09-14T11:58:58.810902+0000","last_active":"2024-09-14T11:58:58.810902+0000","last_peered":"2024-09-14T11:58:58.810902+0000","last_clean":"2024-09-14T11:58:58.810902+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:58:58.810902+0000","last_undegraded":"2024-09-14T11:58:58.810902+0000","last_fullsized":"2024-09-14T11:58:58.810902+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.810813+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:28.032812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2730,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.055033+0000","last_change":"2024-09-14T11:58:52.055033+0000","last_active":"2024-09-14T11:58:52.055033+0000","last_peered":"2024-09-14T11:58:52.055033+0000","last_clean":"2024-09-14T11:58:52.055033+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:52.055033+0000","last_undegraded":"2024-09-14T11:58:52.055033+0000","last_fullsized":"2024-09-14T11:58:52.055033+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.054914+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:01.336250+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":7722,"num_write":1033,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1677","reported_seq":3385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.173696+0000","last_change":"2024-09-14T11:59:00.173696+0000","last_active":"2024-09-14T11:59:00.173696+0000","last_peered":"2024-09-14T11:59:00.173696+0000","last_clean":"2024-09-14T11:59:00.173696+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:59:00.173696+0000","last_undegraded":"2024-09-14T11:59:00.173696+0000","last_fullsized":"2024-09-14T11:59:00.173696+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1677","last_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_deep_scrub":"263'1677","last_deep_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.173612+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":1600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:07.415310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'359","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.766923+0000","last_change":"2024-09-14T11:58:50.766923+0000","last_active":"2024-09-14T11:58:50.766923+0000","last_peered":"2024-09-14T11:58:50.766923+0000","last_clean":"2024-09-14T11:58:50.766923+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:50.766923+0000","last_undegraded":"2024-09-14T11:58:50.766923+0000","last_fullsized":"2024-09-14T11:58:50.766923+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.766799+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:21.140749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":21069,"num_write":1116,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'704","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.036175+0000","last_change":"2024-09-14T11:58:54.036175+0000","last_active":"2024-09-14T11:58:54.036175+0000","last_peered":"2024-09-14T11:58:54.036175+0000","last_clean":"2024-09-14T11:58:54.036175+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:58:54.036175+0000","last_undegraded":"2024-09-14T11:58:54.036175+0000","last_fullsized":"2024-09-14T11:58:54.036175+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'704","last_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_deep_scrub":"263'704","last_deep_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.036089+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.473534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'327","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.208361+0000","last_change":"2024-09-14T11:58:55.208361+0000","last_active":"2024-09-14T11:58:55.208361+0000","last_peered":"2024-09-14T11:58:55.208361+0000","last_clean":"2024-09-14T11:58:55.208361+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:55.208361+0000","last_undegraded":"2024-09-14T11:58:55.208361+0000","last_fullsized":"2024-09-14T11:58:55.208361+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.208243+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:46.410805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":36238,"num_write":1055,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'409","reported_seq":1902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.910480+0000","last_change":"2024-09-14T10:56:41.690216+0000","last_active":"2024-09-14T11:56:51.910480+0000","last_peered":"2024-09-14T11:56:51.910480+0000","last_clean":"2024-09-14T11:56:51.910480+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:56:51.910480+0000","last_undegraded":"2024-09-14T11:56:51.910480+0000","last_fullsized":"2024-09-14T11:56:51.910480+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:05:40.669308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'371","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.189295+0000","last_change":"2024-09-14T11:58:48.189295+0000","last_active":"2024-09-14T11:58:48.189295+0000","last_peered":"2024-09-14T11:58:48.189295+0000","last_clean":"2024-09-14T11:58:48.189295+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:48.189295+0000","last_undegraded":"2024-09-14T11:58:48.189295+0000","last_fullsized":"2024-09-14T11:58:48.189295+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.189198+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:51.338474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":882,"num_read_kb":32736,"num_write":1182,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'728","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.188459+0000","last_change":"2024-09-14T11:58:59.188459+0000","last_active":"2024-09-14T11:58:59.188459+0000","last_peered":"2024-09-14T11:58:59.188459+0000","last_clean":"2024-09-14T11:58:59.188459+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:58:59.188459+0000","last_undegraded":"2024-09-14T11:58:59.188459+0000","last_fullsized":"2024-09-14T11:58:59.188459+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.188347+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:48.449081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'355","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.698436+0000","last_change":"2024-09-14T11:58:54.698436+0000","last_active":"2024-09-14T11:58:54.698436+0000","last_peered":"2024-09-14T11:58:54.698436+0000","last_clean":"2024-09-14T11:58:54.698436+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:54.698436+0000","last_undegraded":"2024-09-14T11:58:54.698436+0000","last_fullsized":"2024-09-14T11:58:54.698436+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.698288+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:08.401763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":35326,"num_write":1083,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'299","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.679499+0000","last_change":"2024-09-14T11:58:55.679499+0000","last_active":"2024-09-14T11:58:55.679499+0000","last_peered":"2024-09-14T11:58:55.679499+0000","last_clean":"2024-09-14T11:58:55.679499+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:55.679499+0000","last_undegraded":"2024-09-14T11:58:55.679499+0000","last_fullsized":"2024-09-14T11:58:55.679499+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.679380+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:45.132704+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":8144,"num_write":967,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'848","reported_seq":2539,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:49.311836+0000","last_change":"2024-09-14T10:56:41.697673+0000","last_active":"2024-09-14T11:56:49.311836+0000","last_peered":"2024-09-14T11:56:49.311836+0000","last_clean":"2024-09-14T11:56:49.311836+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:56:49.311836+0000","last_undegraded":"2024-09-14T11:56:49.311836+0000","last_fullsized":"2024-09-14T11:56:49.311836+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:15.211850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'398","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.117031+0000","last_change":"2024-09-14T11:58:49.117031+0000","last_active":"2024-09-14T11:58:49.117031+0000","last_peered":"2024-09-14T11:58:49.117031+0000","last_clean":"2024-09-14T11:58:49.117031+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:49.117031+0000","last_undegraded":"2024-09-14T11:58:49.117031+0000","last_fullsized":"2024-09-14T11:58:49.117031+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.116906+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:11.076523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":40288,"num_write":1313,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'389","reported_seq":1996,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:04.142380+0000","last_change":"2024-09-14T10:56:41.693372+0000","last_active":"2024-09-14T11:56:04.142380+0000","last_peered":"2024-09-14T11:56:04.142380+0000","last_clean":"2024-09-14T11:56:04.142380+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:56:04.142380+0000","last_undegraded":"2024-09-14T11:56:04.142380+0000","last_fullsized":"2024-09-14T11:56:04.142380+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:40.664652+0000","last_clean_scrub_stamp":"2024-09-14T10:56:40.664652+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:08.940223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1898,"ondisk_log_size":1898,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":501,"ondisk_log_size":501,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1660817,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18638,"num_read_kb":39748,"num_write":15595,"num_write_kb":12041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2031,"ondisk_log_size":2031,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29442,"num_omap_keys":119,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3724,"ondisk_log_size":3724,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":43145697,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44629,"num_read_kb":1932119,"num_write":73662,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59392000,"data_stored":59392000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3707,"ondisk_log_size":3707,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":187491,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":178270,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510199,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296288,"kb_used_data":12432,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075552,"statfs":{"total":96636764160,"available":96333365248,"internally_reserved":0,"allocated":12730368,"data_stored":10789257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510196,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147316,"kb_used_data":13412,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":94224524,"statfs":{"total":96636764160,"available":96485912576,"internally_reserved":0,"allocated":13733888,"data_stored":11812366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542898,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313544,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94058296,"statfs":{"total":96636764160,"available":96315695104,"internally_reserved":0,"allocated":11919360,"data_stored":9919858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542901,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176908,"kb_used_data":11132,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194932,"statfs":{"total":96636764160,"available":96455610368,"internally_reserved":0,"allocated":11399168,"data_stored":9381666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542899,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301348,"kb_used_data":9172,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94070492,"statfs":{"total":96636764160,"available":96328183808,"internally_reserved":0,"allocated":9392128,"data_stored":7423434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542902,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":117412,"kb_used_data":5716,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94254428,"statfs":{"total":96636764160,"available":96516534272,"internally_reserved":0,"allocated":5853184,"data_stored":3932499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542900,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188836,"kb_used_data":13332,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94183004,"statfs":{"total":96636764160,"available":96443396096,"internally_reserved":0,"allocated":13651968,"data_stored":11690363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542899,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285244,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94086596,"statfs":{"total":96636764160,"available":96344674304,"internally_reserved":0,"allocated":15642624,"data_stored":13655531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5169152,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":9560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":7127040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8536064,"data_stored":8536064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7073792,"data_stored":7073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:06.643 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.643 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.643 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.643 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.643 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.644 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.645 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.646 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.647 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.648 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.649 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.650 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.651 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.652 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.653 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.654 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.655 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.656 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.657 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.658 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.659 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.660 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.661 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.662 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.663 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.664 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.665 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.666 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.667 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.668 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.669 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.670 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.671 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.672 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.673 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:56:42.680388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.674 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:56:44.693502+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=44, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:56:46.706847+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=46, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.675 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.676 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.676 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:56:40.664652+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:06.676 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:26.677 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:27.029 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:59:27.039 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:59:27.042 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2147,"stamp":"2024-09-14T11:59:25.913180+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45414219,"num_objects":743,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":312784,"num_read_kb":2565821,"num_write":166013,"num_write_kb":2614752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741392,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13271,"ondisk_log_size":13271,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1814416,"kb_used_data":92112,"kb_used_omap":12,"kb_used_meta":1722163,"kb_avail":753160304,"statfs":{"total":773094113280,"available":771236151296,"internally_reserved":0,"allocated":94322688,"data_stored":78604974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1763495472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536355,"num_omap_keys":1246,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005988"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.545571+0000","last_change":"2024-09-14T11:32:11.438700+0000","last_active":"2024-09-14T11:54:42.545571+0000","last_peered":"2024-09-14T11:54:42.545571+0000","last_clean":"2024-09-14T11:54:42.545571+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:54:42.545571+0000","last_undegraded":"2024-09-14T11:54:42.545571+0000","last_fullsized":"2024-09-14T11:54:42.545571+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:25.537099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'9","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.574819+0000","last_change":"2024-09-14T11:15:25.395056+0000","last_active":"2024-09-14T11:57:57.574819+0000","last_peered":"2024-09-14T11:57:57.574819+0000","last_clean":"2024-09-14T11:57:57.574819+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:57:57.574819+0000","last_undegraded":"2024-09-14T11:57:57.574819+0000","last_fullsized":"2024-09-14T11:57:57.574819+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:58.486587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13318,"num_write":14,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:52.452810+0000","last_change":"2024-09-14T11:15:22.372445+0000","last_active":"2024-09-14T11:57:52.452810+0000","last_peered":"2024-09-14T11:57:52.452810+0000","last_clean":"2024-09-14T11:57:52.452810+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:57:52.452810+0000","last_undegraded":"2024-09-14T11:57:52.452810+0000","last_fullsized":"2024-09-14T11:57:52.452810+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:40.705272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666175+0000","last_change":"2024-09-14T11:12:39.155517+0000","last_active":"2024-09-14T11:56:27.666175+0000","last_peered":"2024-09-14T11:56:27.666175+0000","last_clean":"2024-09-14T11:56:27.666175+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:56:27.666175+0000","last_undegraded":"2024-09-14T11:56:27.666175+0000","last_fullsized":"2024-09-14T11:56:27.666175+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:53.251432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.133003+0000","last_change":"2024-09-14T11:59:13.133003+0000","last_active":"2024-09-14T11:59:13.133003+0000","last_peered":"2024-09-14T11:59:13.133003+0000","last_clean":"2024-09-14T11:59:13.133003+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:59:13.133003+0000","last_undegraded":"2024-09-14T11:59:13.133003+0000","last_fullsized":"2024-09-14T11:59:13.133003+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.132915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:41.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.650977+0000","last_change":"2024-09-14T11:15:25.392361+0000","last_active":"2024-09-14T11:58:36.650977+0000","last_peered":"2024-09-14T11:58:36.650977+0000","last_clean":"2024-09-14T11:58:36.650977+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:58:36.650977+0000","last_undegraded":"2024-09-14T11:58:36.650977+0000","last_fullsized":"2024-09-14T11:58:36.650977+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:19.988494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.984429+0000","last_change":"2024-09-14T11:59:17.984429+0000","last_active":"2024-09-14T11:59:17.984429+0000","last_peered":"2024-09-14T11:59:17.984429+0000","last_clean":"2024-09-14T11:59:17.984429+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:59:17.984429+0000","last_undegraded":"2024-09-14T11:59:17.984429+0000","last_fullsized":"2024-09-14T11:59:17.984429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.984338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:16.588236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.059073+0000","last_change":"2024-09-14T11:59:03.059073+0000","last_active":"2024-09-14T11:59:03.059073+0000","last_peered":"2024-09-14T11:59:03.059073+0000","last_clean":"2024-09-14T11:59:03.059073+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:59:03.059073+0000","last_undegraded":"2024-09-14T11:59:03.059073+0000","last_fullsized":"2024-09-14T11:59:03.059073+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.058984+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:45.926589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.734191+0000","last_change":"2024-09-14T11:59:22.734191+0000","last_active":"2024-09-14T11:59:22.734191+0000","last_peered":"2024-09-14T11:59:22.734191+0000","last_clean":"2024-09-14T11:59:22.734191+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:59:22.734191+0000","last_undegraded":"2024-09-14T11:59:22.734191+0000","last_fullsized":"2024-09-14T11:59:22.734191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.734105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.515792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":44,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.443257+0000","last_change":"2024-09-14T11:15:25.381703+0000","last_active":"2024-09-14T11:57:07.443257+0000","last_peered":"2024-09-14T11:57:07.443257+0000","last_clean":"2024-09-14T11:57:07.443257+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:57:07.443257+0000","last_undegraded":"2024-09-14T11:57:07.443257+0000","last_fullsized":"2024-09-14T11:57:07.443257+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.163519+0000","last_change":"2024-09-14T11:59:09.163519+0000","last_active":"2024-09-14T11:59:09.163519+0000","last_peered":"2024-09-14T11:59:09.163519+0000","last_clean":"2024-09-14T11:59:09.163519+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:59:09.163519+0000","last_undegraded":"2024-09-14T11:59:09.163519+0000","last_fullsized":"2024-09-14T11:59:09.163519+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.163385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:01.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":125,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.656914+0000","last_change":"2024-09-14T11:12:39.151824+0000","last_active":"2024-09-14T11:55:12.656914+0000","last_peered":"2024-09-14T11:55:12.656914+0000","last_clean":"2024-09-14T11:55:12.656914+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:55:12.656914+0000","last_undegraded":"2024-09-14T11:55:12.656914+0000","last_fullsized":"2024-09-14T11:55:12.656914+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:53.656624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.441434+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:56:27.441434+0000","last_peered":"2024-09-14T11:56:27.441434+0000","last_clean":"2024-09-14T11:56:27.441434+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:56:27.441434+0000","last_undegraded":"2024-09-14T11:56:27.441434+0000","last_fullsized":"2024-09-14T11:56:27.441434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.987782+0000","last_change":"2024-09-14T11:15:25.399230+0000","last_active":"2024-09-14T11:58:36.987782+0000","last_peered":"2024-09-14T11:58:36.987782+0000","last_clean":"2024-09-14T11:58:36.987782+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:58:36.987782+0000","last_undegraded":"2024-09-14T11:58:36.987782+0000","last_fullsized":"2024-09-14T11:58:36.987782+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.813623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.516764+0000","last_change":"2024-09-14T11:15:22.376340+0000","last_active":"2024-09-14T11:58:38.516764+0000","last_peered":"2024-09-14T11:58:38.516764+0000","last_clean":"2024-09-14T11:58:38.516764+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:58:38.516764+0000","last_undegraded":"2024-09-14T11:58:38.516764+0000","last_fullsized":"2024-09-14T11:58:38.516764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657407+0000","last_change":"2024-09-14T11:12:39.148897+0000","last_active":"2024-09-14T11:55:12.657407+0000","last_peered":"2024-09-14T11:55:12.657407+0000","last_clean":"2024-09-14T11:55:12.657407+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:55:12.657407+0000","last_undegraded":"2024-09-14T11:55:12.657407+0000","last_fullsized":"2024-09-14T11:55:12.657407+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:34.601983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:42.563449+0000","last_change":"2024-09-14T11:15:25.394919+0000","last_active":"2024-09-14T11:56:42.563449+0000","last_peered":"2024-09-14T11:56:42.563449+0000","last_clean":"2024-09-14T11:56:42.563449+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:56:42.563449+0000","last_undegraded":"2024-09-14T11:56:42.563449+0000","last_fullsized":"2024-09-14T11:56:42.563449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.666064+0000","last_change":"2024-09-14T11:15:22.370822+0000","last_active":"2024-09-14T11:56:27.666064+0000","last_peered":"2024-09-14T11:56:27.666064+0000","last_clean":"2024-09-14T11:56:27.666064+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:56:27.666064+0000","last_undegraded":"2024-09-14T11:56:27.666064+0000","last_fullsized":"2024-09-14T11:56:27.666064+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657357+0000","last_change":"2024-09-14T11:12:39.150081+0000","last_active":"2024-09-14T11:55:12.657357+0000","last_peered":"2024-09-14T11:55:12.657357+0000","last_clean":"2024-09-14T11:55:12.657357+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:55:12.657357+0000","last_undegraded":"2024-09-14T11:55:12.657357+0000","last_fullsized":"2024-09-14T11:55:12.657357+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:24.233922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.444072+0000","last_change":"2024-09-14T11:32:11.440653+0000","last_active":"2024-09-14T11:57:12.444072+0000","last_peered":"2024-09-14T11:57:12.444072+0000","last_clean":"2024-09-14T11:57:12.444072+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:57:12.444072+0000","last_undegraded":"2024-09-14T11:57:12.444072+0000","last_fullsized":"2024-09-14T11:57:12.444072+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.791580+0000","last_change":"2024-09-14T11:59:19.791580+0000","last_active":"2024-09-14T11:59:19.791580+0000","last_peered":"2024-09-14T11:59:19.791580+0000","last_clean":"2024-09-14T11:59:19.791580+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:59:19.791580+0000","last_undegraded":"2024-09-14T11:59:19.791580+0000","last_fullsized":"2024-09-14T11:59:19.791580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.791500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:50.852626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10232,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.615659+0000","last_change":"2024-09-14T11:15:22.371121+0000","last_active":"2024-09-14T11:58:37.615659+0000","last_peered":"2024-09-14T11:58:37.615659+0000","last_clean":"2024-09-14T11:58:37.615659+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:58:37.615659+0000","last_undegraded":"2024-09-14T11:58:37.615659+0000","last_fullsized":"2024-09-14T11:58:37.615659+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.735183+0000","last_change":"2024-09-14T11:59:14.735183+0000","last_active":"2024-09-14T11:59:14.735183+0000","last_peered":"2024-09-14T11:59:14.735183+0000","last_clean":"2024-09-14T11:59:14.735183+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:59:14.735183+0000","last_undegraded":"2024-09-14T11:59:14.735183+0000","last_fullsized":"2024-09-14T11:59:14.735183+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.735096+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:36.716450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'1","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668390+0000","last_change":"2024-09-14T11:32:11.436799+0000","last_active":"2024-09-14T11:54:42.668390+0000","last_peered":"2024-09-14T11:54:42.668390+0000","last_clean":"2024-09-14T11:54:42.668390+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:54:42.668390+0000","last_undegraded":"2024-09-14T11:54:42.668390+0000","last_fullsized":"2024-09-14T11:54:42.668390+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:53.984429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.749192+0000","last_change":"2024-09-14T11:59:20.749192+0000","last_active":"2024-09-14T11:59:20.749192+0000","last_peered":"2024-09-14T11:59:20.749192+0000","last_clean":"2024-09-14T11:59:20.749192+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:59:20.749192+0000","last_undegraded":"2024-09-14T11:59:20.749192+0000","last_fullsized":"2024-09-14T11:59:20.749192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.749100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:38.196873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.835728+0000","last_change":"2024-09-14T11:15:22.380798+0000","last_active":"2024-09-14T11:58:36.835728+0000","last_peered":"2024-09-14T11:58:36.835728+0000","last_clean":"2024-09-14T11:58:36.835728+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:58:36.835728+0000","last_undegraded":"2024-09-14T11:58:36.835728+0000","last_fullsized":"2024-09-14T11:58:36.835728+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:28.888151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.664943+0000","last_change":"2024-09-14T11:12:39.151716+0000","last_active":"2024-09-14T11:56:17.664943+0000","last_peered":"2024-09-14T11:56:17.664943+0000","last_clean":"2024-09-14T11:56:17.664943+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:56:17.664943+0000","last_undegraded":"2024-09-14T11:56:17.664943+0000","last_fullsized":"2024-09-14T11:56:17.664943+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:42.668455+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:54:42.668455+0000","last_peered":"2024-09-14T11:54:42.668455+0000","last_clean":"2024-09-14T11:54:42.668455+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:54:42.668455+0000","last_undegraded":"2024-09-14T11:54:42.668455+0000","last_fullsized":"2024-09-14T11:54:42.668455+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:12.298328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:57.453375+0000","last_change":"2024-09-14T11:15:25.397268+0000","last_active":"2024-09-14T11:57:57.453375+0000","last_peered":"2024-09-14T11:57:57.453375+0000","last_clean":"2024-09-14T11:57:57.453375+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:57:57.453375+0000","last_undegraded":"2024-09-14T11:57:57.453375+0000","last_fullsized":"2024-09-14T11:57:57.453375+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:56.469878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":46,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:22.658104+0000","last_change":"2024-09-14T11:15:22.371970+0000","last_active":"2024-09-14T11:55:22.658104+0000","last_peered":"2024-09-14T11:55:22.658104+0000","last_clean":"2024-09-14T11:55:22.658104+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:55:22.658104+0000","last_undegraded":"2024-09-14T11:55:22.658104+0000","last_fullsized":"2024-09-14T11:55:22.658104+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:35:13.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.046761+0000","last_change":"2024-09-14T11:59:15.046761+0000","last_active":"2024-09-14T11:59:15.046761+0000","last_peered":"2024-09-14T11:59:15.046761+0000","last_clean":"2024-09-14T11:59:15.046761+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:59:15.046761+0000","last_undegraded":"2024-09-14T11:59:15.046761+0000","last_fullsized":"2024-09-14T11:59:15.046761+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.046667+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:31.667121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.966622+0000","last_change":"2024-09-14T11:59:21.966622+0000","last_active":"2024-09-14T11:59:21.966622+0000","last_peered":"2024-09-14T11:59:21.966622+0000","last_clean":"2024-09-14T11:59:21.966622+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:59:21.966622+0000","last_undegraded":"2024-09-14T11:59:21.966622+0000","last_fullsized":"2024-09-14T11:59:21.966622+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.966514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:37.272047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":39,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.700036+0000","last_change":"2024-09-14T11:16:16.965444+0000","last_active":"2024-09-14T11:58:37.700036+0000","last_peered":"2024-09-14T11:58:37.700036+0000","last_clean":"2024-09-14T11:58:37.700036+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:58:37.700036+0000","last_undegraded":"2024-09-14T11:58:37.700036+0000","last_fullsized":"2024-09-14T11:58:37.700036+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:53.499672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.550255+0000","last_change":"2024-09-14T11:15:22.374686+0000","last_active":"2024-09-14T11:55:12.550255+0000","last_peered":"2024-09-14T11:55:12.550255+0000","last_clean":"2024-09-14T11:55:12.550255+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:55:12.550255+0000","last_undegraded":"2024-09-14T11:55:12.550255+0000","last_fullsized":"2024-09-14T11:55:12.550255+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:53.561771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":214,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664445+0000","last_change":"2024-09-14T11:12:39.153477+0000","last_active":"2024-09-14T11:56:12.664445+0000","last_peered":"2024-09-14T11:56:12.664445+0000","last_clean":"2024-09-14T11:56:12.664445+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:56:12.664445+0000","last_undegraded":"2024-09-14T11:56:12.664445+0000","last_fullsized":"2024-09-14T11:56:12.664445+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:04.498242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.100053+0000","last_change":"2024-09-14T11:59:12.100053+0000","last_active":"2024-09-14T11:59:12.100053+0000","last_peered":"2024-09-14T11:59:12.100053+0000","last_clean":"2024-09-14T11:59:12.100053+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:59:12.100053+0000","last_undegraded":"2024-09-14T11:59:12.100053+0000","last_fullsized":"2024-09-14T11:59:12.100053+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.099973+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:00.241604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:12.657396+0000","last_change":"2024-09-14T11:15:25.399054+0000","last_active":"2024-09-14T11:55:12.657396+0000","last_peered":"2024-09-14T11:55:12.657396+0000","last_clean":"2024-09-14T11:55:12.657396+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:55:12.657396+0000","last_undegraded":"2024-09-14T11:55:12.657396+0000","last_fullsized":"2024-09-14T11:55:12.657396+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:55.158959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.431262+0000","last_change":"2024-09-14T11:15:22.377250+0000","last_active":"2024-09-14T11:56:27.431262+0000","last_peered":"2024-09-14T11:56:27.431262+0000","last_clean":"2024-09-14T11:56:27.431262+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:56:27.431262+0000","last_undegraded":"2024-09-14T11:56:27.431262+0000","last_fullsized":"2024-09-14T11:56:27.431262+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664452+0000","last_change":"2024-09-14T11:12:39.155161+0000","last_active":"2024-09-14T11:56:12.664452+0000","last_peered":"2024-09-14T11:56:12.664452+0000","last_clean":"2024-09-14T11:56:12.664452+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:56:12.664452+0000","last_undegraded":"2024-09-14T11:56:12.664452+0000","last_fullsized":"2024-09-14T11:56:12.664452+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:38.293853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.676245+0000","last_change":"2024-09-14T11:32:11.434767+0000","last_active":"2024-09-14T11:55:32.676245+0000","last_peered":"2024-09-14T11:55:32.676245+0000","last_clean":"2024-09-14T11:55:32.676245+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:55:32.676245+0000","last_undegraded":"2024-09-14T11:55:32.676245+0000","last_fullsized":"2024-09-14T11:55:32.676245+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.009353+0000","last_change":"2024-09-14T11:15:25.400010+0000","last_active":"2024-09-14T11:58:39.009353+0000","last_peered":"2024-09-14T11:58:39.009353+0000","last_clean":"2024-09-14T11:58:39.009353+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:58:39.009353+0000","last_undegraded":"2024-09-14T11:58:39.009353+0000","last_fullsized":"2024-09-14T11:58:39.009353+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.075554+0000","last_change":"2024-09-14T11:59:07.075554+0000","last_active":"2024-09-14T11:59:07.075554+0000","last_peered":"2024-09-14T11:59:07.075554+0000","last_clean":"2024-09-14T11:59:07.075554+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:59:07.075554+0000","last_undegraded":"2024-09-14T11:59:07.075554+0000","last_fullsized":"2024-09-14T11:59:07.075554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.075458+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:32.773384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.059348+0000","last_change":"2024-09-14T11:59:05.059348+0000","last_active":"2024-09-14T11:59:05.059348+0000","last_peered":"2024-09-14T11:59:05.059348+0000","last_clean":"2024-09-14T11:59:05.059348+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:59:05.059348+0000","last_undegraded":"2024-09-14T11:59:05.059348+0000","last_fullsized":"2024-09-14T11:59:05.059348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.059255+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:17.564726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.553130+0000","last_change":"2024-09-14T11:32:11.436840+0000","last_active":"2024-09-14T11:55:32.553130+0000","last_peered":"2024-09-14T11:55:32.553130+0000","last_clean":"2024-09-14T11:55:32.553130+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:55:32.553130+0000","last_undegraded":"2024-09-14T11:55:32.553130+0000","last_fullsized":"2024-09-14T11:55:32.553130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:44.264386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.451124+0000","last_change":"2024-09-14T11:15:25.389711+0000","last_active":"2024-09-14T11:58:37.451124+0000","last_peered":"2024-09-14T11:58:37.451124+0000","last_clean":"2024-09-14T11:58:37.451124+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:58:37.451124+0000","last_undegraded":"2024-09-14T11:58:37.451124+0000","last_fullsized":"2024-09-14T11:58:37.451124+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.021259+0000","last_change":"2024-09-14T11:15:22.372016+0000","last_active":"2024-09-14T11:58:38.021259+0000","last_peered":"2024-09-14T11:58:38.021259+0000","last_clean":"2024-09-14T11:58:38.021259+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:58:38.021259+0000","last_undegraded":"2024-09-14T11:58:38.021259+0000","last_fullsized":"2024-09-14T11:58:38.021259+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":84,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:54:47.669063+0000","last_change":"2024-09-14T11:12:39.147166+0000","last_active":"2024-09-14T11:54:47.669063+0000","last_peered":"2024-09-14T11:54:47.669063+0000","last_clean":"2024-09-14T11:54:47.669063+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:54:47.669063+0000","last_undegraded":"2024-09-14T11:54:47.669063+0000","last_fullsized":"2024-09-14T11:54:47.669063+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:14.839189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440825+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:56:22.440825+0000","last_peered":"2024-09-14T11:56:22.440825+0000","last_clean":"2024-09-14T11:56:22.440825+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:56:22.440825+0000","last_undegraded":"2024-09-14T11:56:22.440825+0000","last_fullsized":"2024-09-14T11:56:22.440825+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'9","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.651118+0000","last_change":"2024-09-14T11:15:25.392664+0000","last_active":"2024-09-14T11:58:36.651118+0000","last_peered":"2024-09-14T11:58:36.651118+0000","last_clean":"2024-09-14T11:58:36.651118+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:58:36.651118+0000","last_undegraded":"2024-09-14T11:58:36.651118+0000","last_fullsized":"2024-09-14T11:58:36.651118+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.459393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:23.447296+0000","last_change":"2024-09-14T11:15:22.377440+0000","last_active":"2024-09-14T11:57:23.447296+0000","last_peered":"2024-09-14T11:57:23.447296+0000","last_clean":"2024-09-14T11:57:23.447296+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:57:23.447296+0000","last_undegraded":"2024-09-14T11:57:23.447296+0000","last_fullsized":"2024-09-14T11:57:23.447296+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:48.574474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":157,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436853+0000","last_change":"2024-09-14T11:12:39.148230+0000","last_active":"2024-09-14T11:57:02.436853+0000","last_peered":"2024-09-14T11:57:02.436853+0000","last_clean":"2024-09-14T11:57:02.436853+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:57:02.436853+0000","last_undegraded":"2024-09-14T11:57:02.436853+0000","last_fullsized":"2024-09-14T11:57:02.436853+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.665554+0000","last_change":"2024-09-14T11:32:11.434939+0000","last_active":"2024-09-14T11:56:22.665554+0000","last_peered":"2024-09-14T11:56:22.665554+0000","last_clean":"2024-09-14T11:56:22.665554+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:56:22.665554+0000","last_undegraded":"2024-09-14T11:56:22.665554+0000","last_fullsized":"2024-09-14T11:56:22.665554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.940907+0000","last_change":"2024-09-14T11:59:20.940907+0000","last_active":"2024-09-14T11:59:20.940907+0000","last_peered":"2024-09-14T11:59:20.940907+0000","last_clean":"2024-09-14T11:59:20.940907+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:59:20.940907+0000","last_undegraded":"2024-09-14T11:59:20.940907+0000","last_fullsized":"2024-09-14T11:59:20.940907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.940817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:58.585992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144879+0000","last_change":"2024-09-14T11:15:22.367726+0000","last_active":"2024-09-14T11:58:37.144879+0000","last_peered":"2024-09-14T11:58:37.144879+0000","last_clean":"2024-09-14T11:58:37.144879+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:58:37.144879+0000","last_undegraded":"2024-09-14T11:58:37.144879+0000","last_fullsized":"2024-09-14T11:58:37.144879+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:47.112534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.442355+0000","last_change":"2024-09-14T11:12:39.155146+0000","last_active":"2024-09-14T11:57:02.442355+0000","last_peered":"2024-09-14T11:57:02.442355+0000","last_clean":"2024-09-14T11:57:02.442355+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:57:02.442355+0000","last_undegraded":"2024-09-14T11:57:02.442355+0000","last_fullsized":"2024-09-14T11:57:02.442355+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"262'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659452+0000","last_change":"2024-09-14T11:32:11.431597+0000","last_active":"2024-09-14T11:55:32.659452+0000","last_peered":"2024-09-14T11:55:32.659452+0000","last_clean":"2024-09-14T11:55:32.659452+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:55:32.659452+0000","last_undegraded":"2024-09-14T11:55:32.659452+0000","last_fullsized":"2024-09-14T11:55:32.659452+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:57.001346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":41,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:07.656679+0000","last_change":"2024-09-14T11:15:25.396727+0000","last_active":"2024-09-14T11:55:07.656679+0000","last_peered":"2024-09-14T11:55:07.656679+0000","last_clean":"2024-09-14T11:55:07.656679+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:55:07.656679+0000","last_undegraded":"2024-09-14T11:55:07.656679+0000","last_fullsized":"2024-09-14T11:55:07.656679+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:13.961762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781098+0000","last_change":"2024-09-14T11:59:16.781098+0000","last_active":"2024-09-14T11:59:16.781098+0000","last_peered":"2024-09-14T11:59:16.781098+0000","last_clean":"2024-09-14T11:59:16.781098+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:59:16.781098+0000","last_undegraded":"2024-09-14T11:59:16.781098+0000","last_fullsized":"2024-09-14T11:59:16.781098+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.781001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:55.027672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:58.443059+0000","last_change":"2024-09-14T11:12:39.149535+0000","last_active":"2024-09-14T11:56:58.443059+0000","last_peered":"2024-09-14T11:56:58.443059+0000","last_clean":"2024-09-14T11:56:58.443059+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:56:58.443059+0000","last_undegraded":"2024-09-14T11:56:58.443059+0000","last_fullsized":"2024-09-14T11:56:58.443059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440794+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:56:22.440794+0000","last_peered":"2024-09-14T11:56:22.440794+0000","last_clean":"2024-09-14T11:56:22.440794+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:56:22.440794+0000","last_undegraded":"2024-09-14T11:56:22.440794+0000","last_fullsized":"2024-09-14T11:56:22.440794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.801416+0000","last_change":"2024-09-14T11:59:18.801416+0000","last_active":"2024-09-14T11:59:18.801416+0000","last_peered":"2024-09-14T11:59:18.801416+0000","last_clean":"2024-09-14T11:59:18.801416+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:59:18.801416+0000","last_undegraded":"2024-09-14T11:59:18.801416+0000","last_fullsized":"2024-09-14T11:59:18.801416+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.801330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:29.523992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":73,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.450990+0000","last_change":"2024-09-14T11:15:22.377097+0000","last_active":"2024-09-14T11:58:37.450990+0000","last_peered":"2024-09-14T11:58:37.450990+0000","last_clean":"2024-09-14T11:58:37.450990+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:58:37.450990+0000","last_undegraded":"2024-09-14T11:58:37.450990+0000","last_fullsized":"2024-09-14T11:58:37.450990+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:48.755901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":195,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.446089+0000","last_change":"2024-09-14T11:12:39.152633+0000","last_active":"2024-09-14T11:57:02.446089+0000","last_peered":"2024-09-14T11:57:02.446089+0000","last_clean":"2024-09-14T11:57:02.446089+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:57:02.446089+0000","last_undegraded":"2024-09-14T11:57:02.446089+0000","last_fullsized":"2024-09-14T11:57:02.446089+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.101682+0000","last_change":"2024-09-14T11:59:11.101682+0000","last_active":"2024-09-14T11:59:11.101682+0000","last_peered":"2024-09-14T11:59:11.101682+0000","last_clean":"2024-09-14T11:59:11.101682+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:59:11.101682+0000","last_undegraded":"2024-09-14T11:59:11.101682+0000","last_fullsized":"2024-09-14T11:59:11.101682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.101584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.108804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662692+0000","last_change":"2024-09-14T11:15:25.387980+0000","last_active":"2024-09-14T11:55:57.662692+0000","last_peered":"2024-09-14T11:55:57.662692+0000","last_clean":"2024-09-14T11:55:57.662692+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:55:57.662692+0000","last_undegraded":"2024-09-14T11:55:57.662692+0000","last_fullsized":"2024-09-14T11:55:57.662692+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:59.843326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.447013+0000","last_change":"2024-09-14T11:15:22.376911+0000","last_active":"2024-09-14T11:58:07.447013+0000","last_peered":"2024-09-14T11:58:07.447013+0000","last_clean":"2024-09-14T11:58:07.447013+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:58:07.447013+0000","last_undegraded":"2024-09-14T11:58:07.447013+0000","last_fullsized":"2024-09-14T11:58:07.447013+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:16.752226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3079,"num_write":6,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":204,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:32.659820+0000","last_change":"2024-09-14T11:12:39.153118+0000","last_active":"2024-09-14T11:55:32.659820+0000","last_peered":"2024-09-14T11:55:32.659820+0000","last_clean":"2024-09-14T11:55:32.659820+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:55:32.659820+0000","last_undegraded":"2024-09-14T11:55:32.659820+0000","last_fullsized":"2024-09-14T11:55:32.659820+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:55.026695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.436168+0000","last_change":"2024-09-14T11:32:11.441904+0000","last_active":"2024-09-14T11:56:57.436168+0000","last_peered":"2024-09-14T11:56:57.436168+0000","last_clean":"2024-09-14T11:56:57.436168+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:56:57.436168+0000","last_undegraded":"2024-09-14T11:56:57.436168+0000","last_fullsized":"2024-09-14T11:56:57.436168+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":45,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:12.455130+0000","last_change":"2024-09-14T11:15:25.398285+0000","last_active":"2024-09-14T11:58:12.455130+0000","last_peered":"2024-09-14T11:58:12.455130+0000","last_clean":"2024-09-14T11:58:12.455130+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:58:12.455130+0000","last_undegraded":"2024-09-14T11:58:12.455130+0000","last_fullsized":"2024-09-14T11:58:12.455130+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.716838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.113881+0000","last_change":"2024-09-14T11:59:08.113881+0000","last_active":"2024-09-14T11:59:08.113881+0000","last_peered":"2024-09-14T11:59:08.113881+0000","last_clean":"2024-09-14T11:59:08.113881+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:59:08.113881+0000","last_undegraded":"2024-09-14T11:59:08.113881+0000","last_fullsized":"2024-09-14T11:59:08.113881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.113784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:24.490857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.552608+0000","last_change":"2024-09-14T11:12:39.148645+0000","last_active":"2024-09-14T11:55:27.552608+0000","last_peered":"2024-09-14T11:55:27.552608+0000","last_clean":"2024-09-14T11:55:27.552608+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:55:27.552608+0000","last_undegraded":"2024-09-14T11:55:27.552608+0000","last_fullsized":"2024-09-14T11:55:27.552608+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:31:26.109804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.783252+0000","last_change":"2024-09-14T11:59:21.783252+0000","last_active":"2024-09-14T11:59:21.783252+0000","last_peered":"2024-09-14T11:59:21.783252+0000","last_clean":"2024-09-14T11:59:21.783252+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:59:21.783252+0000","last_undegraded":"2024-09-14T11:59:21.783252+0000","last_fullsized":"2024-09-14T11:59:21.783252+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.783139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:06.762141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.963077+0000","last_change":"2024-09-14T11:59:19.963077+0000","last_active":"2024-09-14T11:59:19.963077+0000","last_peered":"2024-09-14T11:59:19.963077+0000","last_clean":"2024-09-14T11:59:19.963077+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:59:19.963077+0000","last_undegraded":"2024-09-14T11:59:19.963077+0000","last_fullsized":"2024-09-14T11:59:19.963077+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.962996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:15.918979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:07.451774+0000","last_change":"2024-09-14T11:15:22.378388+0000","last_active":"2024-09-14T11:58:07.451774+0000","last_peered":"2024-09-14T11:58:07.451774+0000","last_clean":"2024-09-14T11:58:07.451774+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:58:07.451774+0000","last_undegraded":"2024-09-14T11:58:07.451774+0000","last_fullsized":"2024-09-14T11:58:07.451774+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:37.326711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.746668+0000","last_change":"2024-09-14T11:59:13.746668+0000","last_active":"2024-09-14T11:59:13.746668+0000","last_peered":"2024-09-14T11:59:13.746668+0000","last_clean":"2024-09-14T11:59:13.746668+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:59:13.746668+0000","last_undegraded":"2024-09-14T11:59:13.746668+0000","last_fullsized":"2024-09-14T11:59:13.746668+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.746567+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:14.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.681256+0000","last_change":"2024-09-14T11:32:11.438627+0000","last_active":"2024-09-14T11:56:02.681256+0000","last_peered":"2024-09-14T11:56:02.681256+0000","last_clean":"2024-09-14T11:56:02.681256+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:56:02.681256+0000","last_undegraded":"2024-09-14T11:56:02.681256+0000","last_fullsized":"2024-09-14T11:56:02.681256+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:47.078418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.662711+0000","last_change":"2024-09-14T11:15:25.394827+0000","last_active":"2024-09-14T11:55:57.662711+0000","last_peered":"2024-09-14T11:55:57.662711+0000","last_clean":"2024-09-14T11:55:57.662711+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:55:57.662711+0000","last_undegraded":"2024-09-14T11:55:57.662711+0000","last_fullsized":"2024-09-14T11:55:57.662711+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:03.553818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.021805+0000","last_change":"2024-09-14T11:59:17.021805+0000","last_active":"2024-09-14T11:59:17.021805+0000","last_peered":"2024-09-14T11:59:17.021805+0000","last_clean":"2024-09-14T11:59:17.021805+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:59:17.021805+0000","last_undegraded":"2024-09-14T11:59:17.021805+0000","last_fullsized":"2024-09-14T11:59:17.021805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.021712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:50.412612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.047142+0000","last_change":"2024-09-14T11:59:04.047142+0000","last_active":"2024-09-14T11:59:04.047142+0000","last_peered":"2024-09-14T11:59:04.047142+0000","last_clean":"2024-09-14T11:59:04.047142+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:59:04.047142+0000","last_undegraded":"2024-09-14T11:59:04.047142+0000","last_fullsized":"2024-09-14T11:59:04.047142+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.047040+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:05.840200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.445502+0000","last_change":"2024-09-14T11:32:11.442081+0000","last_active":"2024-09-14T11:56:57.445502+0000","last_peered":"2024-09-14T11:56:57.445502+0000","last_clean":"2024-09-14T11:56:57.445502+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:56:57.445502+0000","last_undegraded":"2024-09-14T11:56:57.445502+0000","last_fullsized":"2024-09-14T11:56:57.445502+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.068037+0000","last_change":"2024-09-14T11:15:25.397220+0000","last_active":"2024-09-14T11:58:39.068037+0000","last_peered":"2024-09-14T11:58:39.068037+0000","last_clean":"2024-09-14T11:58:39.068037+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:58:39.068037+0000","last_undegraded":"2024-09-14T11:58:39.068037+0000","last_fullsized":"2024-09-14T11:58:39.068037+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2106,"num_write":6,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.616499+0000","last_change":"2024-09-14T11:15:22.373390+0000","last_active":"2024-09-14T11:58:37.616499+0000","last_peered":"2024-09-14T11:58:37.616499+0000","last_clean":"2024-09-14T11:58:37.616499+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:58:37.616499+0000","last_undegraded":"2024-09-14T11:58:37.616499+0000","last_fullsized":"2024-09-14T11:58:37.616499+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:27.658768+0000","last_change":"2024-09-14T11:12:39.153320+0000","last_active":"2024-09-14T11:55:27.658768+0000","last_peered":"2024-09-14T11:55:27.658768+0000","last_clean":"2024-09-14T11:55:27.658768+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:55:27.658768+0000","last_undegraded":"2024-09-14T11:55:27.658768+0000","last_fullsized":"2024-09-14T11:55:27.658768+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:21.620859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436920+0000","last_change":"2024-09-14T11:32:11.439386+0000","last_active":"2024-09-14T11:57:02.436920+0000","last_peered":"2024-09-14T11:57:02.436920+0000","last_clean":"2024-09-14T11:57:02.436920+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:57:02.436920+0000","last_undegraded":"2024-09-14T11:57:02.436920+0000","last_fullsized":"2024-09-14T11:57:02.436920+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'12","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.943983+0000","last_change":"2024-09-14T11:15:25.387037+0000","last_active":"2024-09-14T11:58:38.943983+0000","last_peered":"2024-09-14T11:58:38.943983+0000","last_clean":"2024-09-14T11:58:38.943983+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:58:38.943983+0000","last_undegraded":"2024-09-14T11:58:38.943983+0000","last_fullsized":"2024-09-14T11:58:38.943983+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9238,"num_write":22,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.084075+0000","last_change":"2024-09-14T11:59:14.084075+0000","last_active":"2024-09-14T11:59:14.084075+0000","last_peered":"2024-09-14T11:59:14.084075+0000","last_clean":"2024-09-14T11:59:14.084075+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:59:14.084075+0000","last_undegraded":"2024-09-14T11:59:14.084075+0000","last_fullsized":"2024-09-14T11:59:14.084075+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.083986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.169123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:07.681937+0000","last_change":"2024-09-14T11:12:39.150807+0000","last_active":"2024-09-14T11:56:07.681937+0000","last_peered":"2024-09-14T11:56:07.681937+0000","last_clean":"2024-09-14T11:56:07.681937+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:56:07.681937+0000","last_undegraded":"2024-09-14T11:56:07.681937+0000","last_fullsized":"2024-09-14T11:56:07.681937+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:16.403726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'1","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.436197+0000","last_change":"2024-09-14T11:32:11.435668+0000","last_active":"2024-09-14T11:56:57.436197+0000","last_peered":"2024-09-14T11:56:57.436197+0000","last_clean":"2024-09-14T11:56:57.436197+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:56:57.436197+0000","last_undegraded":"2024-09-14T11:56:57.436197+0000","last_fullsized":"2024-09-14T11:56:57.436197+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:55:57.541462+0000","last_change":"2024-09-14T11:15:25.394087+0000","last_active":"2024-09-14T11:55:57.541462+0000","last_peered":"2024-09-14T11:55:57.541462+0000","last_clean":"2024-09-14T11:55:57.541462+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:55:57.541462+0000","last_undegraded":"2024-09-14T11:55:57.541462+0000","last_fullsized":"2024-09-14T11:55:57.541462+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:55:28.530596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:38.517712+0000","last_change":"2024-09-14T11:15:22.372019+0000","last_active":"2024-09-14T11:58:38.517712+0000","last_peered":"2024-09-14T11:58:38.517712+0000","last_clean":"2024-09-14T11:58:38.517712+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:58:38.517712+0000","last_undegraded":"2024-09-14T11:58:38.517712+0000","last_fullsized":"2024-09-14T11:58:38.517712+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":95,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663202+0000","last_change":"2024-09-14T11:12:39.151666+0000","last_active":"2024-09-14T11:56:02.663202+0000","last_peered":"2024-09-14T11:56:02.663202+0000","last_clean":"2024-09-14T11:56:02.663202+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:56:02.663202+0000","last_undegraded":"2024-09-14T11:56:02.663202+0000","last_fullsized":"2024-09-14T11:56:02.663202+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.342287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.441694+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:56:57.441694+0000","last_peered":"2024-09-14T11:56:57.441694+0000","last_clean":"2024-09-14T11:56:57.441694+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:56:57.441694+0000","last_undegraded":"2024-09-14T11:56:57.441694+0000","last_fullsized":"2024-09-14T11:56:57.441694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'9","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:39.009446+0000","last_change":"2024-09-14T11:15:25.392043+0000","last_active":"2024-09-14T11:58:39.009446+0000","last_peered":"2024-09-14T11:58:39.009446+0000","last_clean":"2024-09-14T11:58:39.009446+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:58:39.009446+0000","last_undegraded":"2024-09-14T11:58:39.009446+0000","last_fullsized":"2024-09-14T11:58:39.009446+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9236,"num_write":14,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.742815+0000","last_change":"2024-09-14T11:59:22.742815+0000","last_active":"2024-09-14T11:59:22.742815+0000","last_peered":"2024-09-14T11:59:22.742815+0000","last_clean":"2024-09-14T11:59:22.742815+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:59:22.742815+0000","last_undegraded":"2024-09-14T11:59:22.742815+0000","last_fullsized":"2024-09-14T11:59:22.742815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.742721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.744647+0000","last_change":"2024-09-14T11:59:12.744647+0000","last_active":"2024-09-14T11:59:12.744647+0000","last_peered":"2024-09-14T11:59:12.744647+0000","last_clean":"2024-09-14T11:59:12.744647+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:59:12.744647+0000","last_undegraded":"2024-09-14T11:59:12.744647+0000","last_fullsized":"2024-09-14T11:59:12.744647+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.744566+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:09.980455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.438417+0000","last_change":"2024-09-14T11:32:11.440358+0000","last_active":"2024-09-14T11:57:12.438417+0000","last_peered":"2024-09-14T11:57:12.438417+0000","last_clean":"2024-09-14T11:57:12.438417+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:57:12.438417+0000","last_undegraded":"2024-09-14T11:57:12.438417+0000","last_fullsized":"2024-09-14T11:57:12.438417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.444813+0000","last_change":"2024-09-14T11:15:25.394952+0000","last_active":"2024-09-14T11:57:17.444813+0000","last_peered":"2024-09-14T11:57:17.444813+0000","last_clean":"2024-09-14T11:57:17.444813+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:57:17.444813+0000","last_undegraded":"2024-09-14T11:57:17.444813+0000","last_fullsized":"2024-09-14T11:57:17.444813+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.075070+0000","last_change":"2024-09-14T11:15:22.376071+0000","last_active":"2024-09-14T11:58:37.075070+0000","last_peered":"2024-09-14T11:58:37.075070+0000","last_clean":"2024-09-14T11:58:37.075070+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:58:37.075070+0000","last_undegraded":"2024-09-14T11:58:37.075070+0000","last_fullsized":"2024-09-14T11:58:37.075070+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.158018+0000","last_change":"2024-09-14T11:59:22.158018+0000","last_active":"2024-09-14T11:59:22.158018+0000","last_peered":"2024-09-14T11:59:22.158018+0000","last_clean":"2024-09-14T11:59:22.158018+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:59:22.158018+0000","last_undegraded":"2024-09-14T11:59:22.158018+0000","last_fullsized":"2024-09-14T11:59:22.158018+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.157923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:01.473904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.568108+0000","last_change":"2024-09-14T11:32:11.440943+0000","last_active":"2024-09-14T11:57:12.568108+0000","last_peered":"2024-09-14T11:57:12.568108+0000","last_clean":"2024-09-14T11:57:12.568108+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:57:12.568108+0000","last_undegraded":"2024-09-14T11:57:12.568108+0000","last_fullsized":"2024-09-14T11:57:12.568108+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.700993+0000","last_change":"2024-09-14T11:15:25.381403+0000","last_active":"2024-09-14T11:58:37.700993+0000","last_peered":"2024-09-14T11:58:37.700993+0000","last_clean":"2024-09-14T11:58:37.700993+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:58:37.700993+0000","last_undegraded":"2024-09-14T11:58:37.700993+0000","last_fullsized":"2024-09-14T11:58:37.700993+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.062681+0000","last_change":"2024-09-14T11:59:06.062559+0000","last_active":"2024-09-14T11:59:06.062681+0000","last_peered":"2024-09-14T11:59:06.062681+0000","last_clean":"2024-09-14T11:59:06.062681+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:59:06.062681+0000","last_undegraded":"2024-09-14T11:59:06.062681+0000","last_fullsized":"2024-09-14T11:59:06.062681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.062448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.178762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.739744+0000","last_change":"2024-09-14T11:59:11.739744+0000","last_active":"2024-09-14T11:59:11.739744+0000","last_peered":"2024-09-14T11:59:11.739744+0000","last_clean":"2024-09-14T11:59:11.739744+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:59:11.739744+0000","last_undegraded":"2024-09-14T11:59:11.739744+0000","last_fullsized":"2024-09-14T11:59:11.739744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.739660+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:24.442901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:17.543570+0000","last_change":"2024-09-14T11:32:11.441708+0000","last_active":"2024-09-14T11:56:17.543570+0000","last_peered":"2024-09-14T11:56:17.543570+0000","last_clean":"2024-09-14T11:56:17.543570+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:56:17.543570+0000","last_undegraded":"2024-09-14T11:56:17.543570+0000","last_fullsized":"2024-09-14T11:56:17.543570+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:00:30.665427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":43,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:37.433033+0000","last_change":"2024-09-14T11:15:25.391546+0000","last_active":"2024-09-14T11:56:37.433033+0000","last_peered":"2024-09-14T11:56:37.433033+0000","last_clean":"2024-09-14T11:56:37.433033+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:56:37.433033+0000","last_undegraded":"2024-09-14T11:56:37.433033+0000","last_fullsized":"2024-09-14T11:56:37.433033+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":63,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:32.562172+0000","last_change":"2024-09-14T11:15:22.372490+0000","last_active":"2024-09-14T11:56:32.562172+0000","last_peered":"2024-09-14T11:56:32.562172+0000","last_clean":"2024-09-14T11:56:32.562172+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:56:32.562172+0000","last_undegraded":"2024-09-14T11:56:32.562172+0000","last_fullsized":"2024-09-14T11:56:32.562172+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:24.922428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.182624+0000","last_change":"2024-09-14T11:59:22.182624+0000","last_active":"2024-09-14T11:59:22.182624+0000","last_peered":"2024-09-14T11:59:22.182624+0000","last_clean":"2024-09-14T11:59:22.182624+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:59:22.182624+0000","last_undegraded":"2024-09-14T11:59:22.182624+0000","last_fullsized":"2024-09-14T11:59:22.182624+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.182530+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:03.582278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:13.445664+0000","last_change":"2024-09-14T11:32:11.441912+0000","last_active":"2024-09-14T11:57:13.445664+0000","last_peered":"2024-09-14T11:57:13.445664+0000","last_clean":"2024-09-14T11:57:13.445664+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:57:13.445664+0000","last_undegraded":"2024-09-14T11:57:13.445664+0000","last_fullsized":"2024-09-14T11:57:13.445664+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:38.440009+0000","last_change":"2024-09-14T11:15:25.393446+0000","last_active":"2024-09-14T11:56:38.440009+0000","last_peered":"2024-09-14T11:56:38.440009+0000","last_clean":"2024-09-14T11:56:38.440009+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:56:38.440009+0000","last_undegraded":"2024-09-14T11:56:38.440009+0000","last_fullsized":"2024-09-14T11:56:38.440009+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:37.144134+0000","last_change":"2024-09-14T11:15:22.375594+0000","last_active":"2024-09-14T11:58:37.144134+0000","last_peered":"2024-09-14T11:58:37.144134+0000","last_clean":"2024-09-14T11:58:37.144134+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:58:37.144134+0000","last_undegraded":"2024-09-14T11:58:37.144134+0000","last_fullsized":"2024-09-14T11:58:37.144134+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:42.113510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.098178+0000","last_change":"2024-09-14T11:59:13.098178+0000","last_active":"2024-09-14T11:59:13.098178+0000","last_peered":"2024-09-14T11:59:13.098178+0000","last_clean":"2024-09-14T11:59:13.098178+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:59:13.098178+0000","last_undegraded":"2024-09-14T11:59:13.098178+0000","last_fullsized":"2024-09-14T11:59:13.098178+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.098094+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:19.834460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.143092+0000","last_change":"2024-09-14T11:59:10.143092+0000","last_active":"2024-09-14T11:59:10.143092+0000","last_peered":"2024-09-14T11:59:10.143092+0000","last_clean":"2024-09-14T11:59:10.143092+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:59:10.143092+0000","last_undegraded":"2024-09-14T11:59:10.143092+0000","last_fullsized":"2024-09-14T11:59:10.143092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.142995+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:46.424281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.936680+0000","last_change":"2024-09-14T11:59:18.936680+0000","last_active":"2024-09-14T11:59:18.936680+0000","last_peered":"2024-09-14T11:59:18.936680+0000","last_clean":"2024-09-14T11:59:18.936680+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:59:18.936680+0000","last_undegraded":"2024-09-14T11:59:18.936680+0000","last_fullsized":"2024-09-14T11:59:18.936680+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.936581+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:35.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16376,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'7","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:36.836852+0000","last_change":"2024-09-14T11:15:22.373814+0000","last_active":"2024-09-14T11:58:36.836852+0000","last_peered":"2024-09-14T11:58:36.836852+0000","last_clean":"2024-09-14T11:58:36.836852+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:58:36.836852+0000","last_undegraded":"2024-09-14T11:58:36.836852+0000","last_fullsized":"2024-09-14T11:58:36.836852+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:27.493761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7164,"num_write":12,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":142,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.561319+0000","last_change":"2024-09-14T11:12:39.151900+0000","last_active":"2024-09-14T11:56:27.561319+0000","last_peered":"2024-09-14T11:56:27.561319+0000","last_clean":"2024-09-14T11:56:27.561319+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:56:27.561319+0000","last_undegraded":"2024-09-14T11:56:27.561319+0000","last_fullsized":"2024-09-14T11:56:27.561319+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:12:38.127450+0000","last_clean_scrub_stamp":"2024-09-14T11:12:38.127450+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:14.393705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:02.663263+0000","last_change":"2024-09-14T11:32:11.431539+0000","last_active":"2024-09-14T11:56:02.663263+0000","last_peered":"2024-09-14T11:56:02.663263+0000","last_clean":"2024-09-14T11:56:02.663263+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:56:02.663263+0000","last_undegraded":"2024-09-14T11:56:02.663263+0000","last_fullsized":"2024-09-14T11:56:02.663263+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:22.427461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'10","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:37.571869+0000","last_change":"2024-09-14T11:15:25.386480+0000","last_active":"2024-09-14T11:57:37.571869+0000","last_peered":"2024-09-14T11:57:37.571869+0000","last_clean":"2024-09-14T11:57:37.571869+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:57:37.571869+0000","last_undegraded":"2024-09-14T11:57:37.571869+0000","last_fullsized":"2024-09-14T11:57:37.571869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:22.418593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12313,"num_write":20,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:02.436808+0000","last_change":"2024-09-14T11:15:22.375172+0000","last_active":"2024-09-14T11:57:02.436808+0000","last_peered":"2024-09-14T11:57:02.436808+0000","last_clean":"2024-09-14T11:57:02.436808+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:57:02.436808+0000","last_undegraded":"2024-09-14T11:57:02.436808+0000","last_fullsized":"2024-09-14T11:57:02.436808+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:21.342236+0000","last_clean_scrub_stamp":"2024-09-14T11:15:21.342236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.709355+0000","last_change":"2024-09-14T11:59:21.709355+0000","last_active":"2024-09-14T11:59:21.709355+0000","last_peered":"2024-09-14T11:59:21.709355+0000","last_clean":"2024-09-14T11:59:21.709355+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:59:21.709355+0000","last_undegraded":"2024-09-14T11:59:21.709355+0000","last_fullsized":"2024-09-14T11:59:21.709355+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.709270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.443980+0000","last_change":"2024-09-14T11:32:11.436220+0000","last_active":"2024-09-14T11:57:12.443980+0000","last_peered":"2024-09-14T11:57:12.443980+0000","last_clean":"2024-09-14T11:57:12.443980+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:57:12.443980+0000","last_undegraded":"2024-09-14T11:57:12.443980+0000","last_fullsized":"2024-09-14T11:57:12.443980+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.783156+0000","last_change":"2024-09-14T11:59:17.783156+0000","last_active":"2024-09-14T11:59:17.783156+0000","last_peered":"2024-09-14T11:59:17.783156+0000","last_clean":"2024-09-14T11:59:17.783156+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:59:17.783156+0000","last_undegraded":"2024-09-14T11:59:17.783156+0000","last_fullsized":"2024-09-14T11:59:17.783156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.783071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:40.106669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.998678+0000","last_change":"2024-09-14T11:59:15.998678+0000","last_active":"2024-09-14T11:59:15.998678+0000","last_peered":"2024-09-14T11:59:15.998678+0000","last_clean":"2024-09-14T11:59:15.998678+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:59:15.998678+0000","last_undegraded":"2024-09-14T11:59:15.998678+0000","last_fullsized":"2024-09-14T11:59:15.998678+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.998590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:10.917760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.764138+0000","last_change":"2024-09-14T11:59:10.764138+0000","last_active":"2024-09-14T11:59:10.764138+0000","last_peered":"2024-09-14T11:59:10.764138+0000","last_clean":"2024-09-14T11:59:10.764138+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:59:10.764138+0000","last_undegraded":"2024-09-14T11:59:10.764138+0000","last_fullsized":"2024-09-14T11:59:10.764138+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.764059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:35.059111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:17.439240+0000","last_change":"2024-09-14T11:32:11.438185+0000","last_active":"2024-09-14T11:57:17.439240+0000","last_peered":"2024-09-14T11:57:17.439240+0000","last_clean":"2024-09-14T11:57:17.439240+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:57:17.439240+0000","last_undegraded":"2024-09-14T11:57:17.439240+0000","last_fullsized":"2024-09-14T11:57:17.439240+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:08.444833+0000","last_change":"2024-09-14T11:15:25.385107+0000","last_active":"2024-09-14T11:57:08.444833+0000","last_peered":"2024-09-14T11:57:08.444833+0000","last_clean":"2024-09-14T11:57:08.444833+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:57:08.444833+0000","last_undegraded":"2024-09-14T11:57:08.444833+0000","last_fullsized":"2024-09-14T11:57:08.444833+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:15:24.360995+0000","last_clean_scrub_stamp":"2024-09-14T11:15:24.360995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.759764+0000","last_change":"2024-09-14T11:59:15.759764+0000","last_active":"2024-09-14T11:59:15.759764+0000","last_peered":"2024-09-14T11:59:15.759764+0000","last_clean":"2024-09-14T11:59:15.759764+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:59:15.759764+0000","last_undegraded":"2024-09-14T11:59:15.759764+0000","last_fullsized":"2024-09-14T11:59:15.759764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.759654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:43.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.091154+0000","last_change":"2024-09-14T11:59:20.091154+0000","last_active":"2024-09-14T11:59:20.091154+0000","last_peered":"2024-09-14T11:59:20.091154+0000","last_clean":"2024-09-14T11:59:20.091154+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:59:20.091154+0000","last_undegraded":"2024-09-14T11:59:20.091154+0000","last_fullsized":"2024-09-14T11:59:20.091154+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.091080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:22.171147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'362","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.193832+0000","last_change":"2024-09-14T11:59:01.193740+0000","last_active":"2024-09-14T11:59:01.193832+0000","last_peered":"2024-09-14T11:59:01.193832+0000","last_clean":"2024-09-14T11:59:01.193832+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:59:01.193832+0000","last_undegraded":"2024-09-14T11:59:01.193832+0000","last_fullsized":"2024-09-14T11:59:01.193832+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.193613+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:48.418030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":9138,"num_write":1125,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'442","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.642141+0000","last_change":"2024-09-14T11:59:04.642052+0000","last_active":"2024-09-14T11:59:04.642141+0000","last_peered":"2024-09-14T11:59:04.642141+0000","last_clean":"2024-09-14T11:59:04.642141+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:59:04.642141+0000","last_undegraded":"2024-09-14T11:59:04.642141+0000","last_fullsized":"2024-09-14T11:59:04.642141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.641934+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:19.634497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'360","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.148658+0000","last_change":"2024-09-14T11:58:48.148587+0000","last_active":"2024-09-14T11:58:48.148658+0000","last_peered":"2024-09-14T11:58:48.148658+0000","last_clean":"2024-09-14T11:58:48.148658+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:48.148658+0000","last_undegraded":"2024-09-14T11:58:48.148658+0000","last_fullsized":"2024-09-14T11:58:48.148658+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.148462+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:26.110691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7650412,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":625,"num_read_kb":47838,"num_write":1199,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'491","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.159534+0000","last_change":"2024-09-14T11:59:03.159475+0000","last_active":"2024-09-14T11:59:03.159534+0000","last_peered":"2024-09-14T11:59:03.159534+0000","last_clean":"2024-09-14T11:59:03.159534+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:59:03.159534+0000","last_undegraded":"2024-09-14T11:59:03.159534+0000","last_fullsized":"2024-09-14T11:59:03.159534+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.159398+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:15.424664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'408","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.093127+0000","last_change":"2024-09-14T11:58:49.093046+0000","last_active":"2024-09-14T11:58:49.093127+0000","last_peered":"2024-09-14T11:58:49.093127+0000","last_clean":"2024-09-14T11:58:49.093127+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:49.093127+0000","last_undegraded":"2024-09-14T11:58:49.093127+0000","last_fullsized":"2024-09-14T11:58:49.093127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.092922+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:17.953603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":833,"num_read_kb":44180,"num_write":1273,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'376","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.808251+0000","last_change":"2024-09-14T11:59:04.808153+0000","last_active":"2024-09-14T11:59:04.808251+0000","last_peered":"2024-09-14T11:59:04.808251+0000","last_clean":"2024-09-14T11:59:04.808251+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:59:04.808251+0000","last_undegraded":"2024-09-14T11:59:04.808251+0000","last_fullsized":"2024-09-14T11:59:04.808251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.808029+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:56.690295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3028,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'478","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.664464+0000","last_change":"2024-09-14T11:58:58.664464+0000","last_active":"2024-09-14T11:58:58.664464+0000","last_peered":"2024-09-14T11:58:58.664464+0000","last_clean":"2024-09-14T11:58:58.664464+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:58.664464+0000","last_undegraded":"2024-09-14T11:58:58.664464+0000","last_fullsized":"2024-09-14T11:58:58.664464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.664259+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:35.300032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730156,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":988,"num_read_kb":27790,"num_write":1317,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1227","reported_seq":2919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.997326+0000","last_change":"2024-09-14T11:58:57.997268+0000","last_active":"2024-09-14T11:58:57.997326+0000","last_peered":"2024-09-14T11:58:57.997326+0000","last_clean":"2024-09-14T11:58:57.997326+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:58:57.997326+0000","last_undegraded":"2024-09-14T11:58:57.997326+0000","last_fullsized":"2024-09-14T11:58:57.997326+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1227","last_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_deep_scrub":"263'1227","last_deep_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.997174+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.497164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'356","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.259835+0000","last_change":"2024-09-14T11:58:57.259740+0000","last_active":"2024-09-14T11:58:57.259835+0000","last_peered":"2024-09-14T11:58:57.259835+0000","last_clean":"2024-09-14T11:58:57.259835+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:57.259835+0000","last_undegraded":"2024-09-14T11:58:57.259835+0000","last_fullsized":"2024-09-14T11:58:57.259835+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.259603+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:49.299765+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":13771,"num_write":1092,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'580","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751244+0000","last_change":"2024-09-14T11:58:56.751244+0000","last_active":"2024-09-14T11:58:56.751244+0000","last_peered":"2024-09-14T11:58:56.751244+0000","last_clean":"2024-09-14T11:58:56.751244+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:58:56.751244+0000","last_undegraded":"2024-09-14T11:58:56.751244+0000","last_fullsized":"2024-09-14T11:58:56.751244+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'580","last_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_deep_scrub":"263'580","last_deep_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751162+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:07.015372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'342","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.696332+0000","last_change":"2024-09-14T11:58:56.696232+0000","last_active":"2024-09-14T11:58:56.696332+0000","last_peered":"2024-09-14T11:58:56.696332+0000","last_clean":"2024-09-14T11:58:56.696332+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:56.696332+0000","last_undegraded":"2024-09-14T11:58:56.696332+0000","last_fullsized":"2024-09-14T11:58:56.696332+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.696022+0000","objects_scrubbed":11,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.669606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":503,"num_read_kb":13548,"num_write":1089,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'835","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.773405+0000","last_change":"2024-09-14T11:59:03.773348+0000","last_active":"2024-09-14T11:59:03.773405+0000","last_peered":"2024-09-14T11:59:03.773405+0000","last_clean":"2024-09-14T11:59:03.773405+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:59:03.773405+0000","last_undegraded":"2024-09-14T11:59:03.773405+0000","last_fullsized":"2024-09-14T11:59:03.773405+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'835","last_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_deep_scrub":"263'835","last_deep_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.773269+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:28.622910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'331","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.247600+0000","last_change":"2024-09-14T11:58:56.247534+0000","last_active":"2024-09-14T11:58:56.247600+0000","last_peered":"2024-09-14T11:58:56.247600+0000","last_clean":"2024-09-14T11:58:56.247600+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:56.247600+0000","last_undegraded":"2024-09-14T11:58:56.247600+0000","last_fullsized":"2024-09-14T11:58:56.247600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.247425+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:59.925743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730161,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":635,"num_read_kb":14446,"num_write":1067,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.619014+0000","last_change":"2024-09-14T11:59:05.618880+0000","last_active":"2024-09-14T11:59:05.619014+0000","last_peered":"2024-09-14T11:59:05.619014+0000","last_clean":"2024-09-14T11:59:05.619014+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:59:05.619014+0000","last_undegraded":"2024-09-14T11:59:05.619014+0000","last_fullsized":"2024-09-14T11:59:05.619014+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'902","last_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_deep_scrub":"263'902","last_deep_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.618786+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:06.981410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'348","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.257046+0000","last_change":"2024-09-14T11:58:54.256977+0000","last_active":"2024-09-14T11:58:54.257046+0000","last_peered":"2024-09-14T11:58:54.257046+0000","last_clean":"2024-09-14T11:58:54.257046+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:54.257046+0000","last_undegraded":"2024-09-14T11:58:54.257046+0000","last_fullsized":"2024-09-14T11:58:54.257046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.256878+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:40.203214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":23067,"num_write":1167,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'426","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.111927+0000","last_change":"2024-09-14T11:58:50.111851+0000","last_active":"2024-09-14T11:58:50.111927+0000","last_peered":"2024-09-14T11:58:50.111927+0000","last_clean":"2024-09-14T11:58:50.111927+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:58:50.111927+0000","last_undegraded":"2024-09-14T11:58:50.111927+0000","last_fullsized":"2024-09-14T11:58:50.111927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.111748+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:42.879545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'458","reported_seq":1891,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.809485+0000","last_change":"2024-09-14T11:58:59.809485+0000","last_active":"2024-09-14T11:58:59.809485+0000","last_peered":"2024-09-14T11:58:59.809485+0000","last_clean":"2024-09-14T11:58:59.809485+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:58:59.809485+0000","last_undegraded":"2024-09-14T11:58:59.809485+0000","last_fullsized":"2024-09-14T11:58:59.809485+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.809380+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:00.989122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'433","reported_seq":1164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.215773+0000","last_change":"2024-09-14T11:58:58.215773+0000","last_active":"2024-09-14T11:58:58.215773+0000","last_peered":"2024-09-14T11:58:58.215773+0000","last_clean":"2024-09-14T11:58:58.215773+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:58.215773+0000","last_undegraded":"2024-09-14T11:58:58.215773+0000","last_fullsized":"2024-09-14T11:58:58.215773+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.215635+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:41.047428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":936,"num_read_kb":12852,"num_write":1596,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'534","reported_seq":2296,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.145362+0000","last_change":"2024-09-14T11:59:02.145362+0000","last_active":"2024-09-14T11:59:02.145362+0000","last_peered":"2024-09-14T11:59:02.145362+0000","last_clean":"2024-09-14T11:59:02.145362+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:59:02.145362+0000","last_undegraded":"2024-09-14T11:59:02.145362+0000","last_fullsized":"2024-09-14T11:59:02.145362+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.145274+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:24.998860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'342","reported_seq":952,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700509+0000","last_change":"2024-09-14T11:58:52.700509+0000","last_active":"2024-09-14T11:58:52.700509+0000","last_peered":"2024-09-14T11:58:52.700509+0000","last_clean":"2024-09-14T11:58:52.700509+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:52.700509+0000","last_undegraded":"2024-09-14T11:58:52.700509+0000","last_fullsized":"2024-09-14T11:58:52.700509+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700378+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:26.328993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":13589,"num_write":1026,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'640","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.631183+0000","last_change":"2024-09-14T11:59:02.631183+0000","last_active":"2024-09-14T11:59:02.631183+0000","last_peered":"2024-09-14T11:59:02.631183+0000","last_clean":"2024-09-14T11:59:02.631183+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:59:02.631183+0000","last_undegraded":"2024-09-14T11:59:02.631183+0000","last_fullsized":"2024-09-14T11:59:02.631183+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'640","last_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_deep_scrub":"263'640","last_deep_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.631096+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:52.105995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'390","reported_seq":1066,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.716046+0000","last_change":"2024-09-14T11:58:51.716046+0000","last_active":"2024-09-14T11:58:51.716046+0000","last_peered":"2024-09-14T11:58:51.716046+0000","last_clean":"2024-09-14T11:58:51.716046+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:51.716046+0000","last_undegraded":"2024-09-14T11:58:51.716046+0000","last_fullsized":"2024-09-14T11:58:51.716046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'390","last_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_deep_scrub":"263'390","last_deep_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.715916+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:38.249633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":713,"num_read_kb":72218,"num_write":1254,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1148","reported_seq":2704,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.092857+0000","last_change":"2024-09-14T11:58:54.092857+0000","last_active":"2024-09-14T11:58:54.092857+0000","last_peered":"2024-09-14T11:58:54.092857+0000","last_clean":"2024-09-14T11:58:54.092857+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:58:54.092857+0000","last_undegraded":"2024-09-14T11:58:54.092857+0000","last_fullsized":"2024-09-14T11:58:54.092857+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.092741+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:41.284736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'354","reported_seq":1003,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.762926+0000","last_change":"2024-09-14T11:58:49.762926+0000","last_active":"2024-09-14T11:58:49.762926+0000","last_peered":"2024-09-14T11:58:49.762926+0000","last_clean":"2024-09-14T11:58:49.762926+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:49.762926+0000","last_undegraded":"2024-09-14T11:58:49.762926+0000","last_fullsized":"2024-09-14T11:58:49.762926+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.762804+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:03.472810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":653,"num_read_kb":16353,"num_write":1203,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'441","reported_seq":2067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.097650+0000","last_change":"2024-09-14T11:58:53.097650+0000","last_active":"2024-09-14T11:58:53.097650+0000","last_peered":"2024-09-14T11:58:53.097650+0000","last_clean":"2024-09-14T11:58:53.097650+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:58:53.097650+0000","last_undegraded":"2024-09-14T11:58:53.097650+0000","last_fullsized":"2024-09-14T11:58:53.097650+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.097548+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:21.145958+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1179,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'325","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.248618+0000","last_change":"2024-09-14T11:58:50.248618+0000","last_active":"2024-09-14T11:58:50.248618+0000","last_peered":"2024-09-14T11:58:50.248618+0000","last_clean":"2024-09-14T11:58:50.248618+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:50.248618+0000","last_undegraded":"2024-09-14T11:58:50.248618+0000","last_fullsized":"2024-09-14T11:58:50.248618+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.248492+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:11.374577+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730152,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":6224,"num_write":1046,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'761","reported_seq":2348,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.808871+0000","last_change":"2024-09-14T11:59:01.808871+0000","last_active":"2024-09-14T11:59:01.808871+0000","last_peered":"2024-09-14T11:59:01.808871+0000","last_clean":"2024-09-14T11:59:01.808871+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:59:01.808871+0000","last_undegraded":"2024-09-14T11:59:01.808871+0000","last_fullsized":"2024-09-14T11:59:01.808871+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.808745+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:36.042147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'370","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.123218+0000","last_change":"2024-09-14T11:58:47.123218+0000","last_active":"2024-09-14T11:58:47.123218+0000","last_peered":"2024-09-14T11:58:47.123218+0000","last_clean":"2024-09-14T11:58:47.123218+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:47.123218+0000","last_undegraded":"2024-09-14T11:58:47.123218+0000","last_fullsized":"2024-09-14T11:58:47.123218+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.123129+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:41.680446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170217,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":11097,"num_write":1169,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":632,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.739808+0000","last_change":"2024-09-14T11:59:18.739808+0000","last_active":"2024-09-14T11:59:18.739808+0000","last_peered":"2024-09-14T11:59:18.739808+0000","last_clean":"2024-09-14T11:59:18.739808+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:59:18.739808+0000","last_undegraded":"2024-09-14T11:59:18.739808+0000","last_fullsized":"2024-09-14T11:59:18.739808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.739718+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:04.826400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'438","reported_seq":2163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.290385+0000","last_change":"2024-09-14T11:58:57.290385+0000","last_active":"2024-09-14T11:58:57.290385+0000","last_peered":"2024-09-14T11:58:57.290385+0000","last_clean":"2024-09-14T11:58:57.290385+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:57.290385+0000","last_undegraded":"2024-09-14T11:58:57.290385+0000","last_fullsized":"2024-09-14T11:58:57.290385+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.290287+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:14.201274+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'363","reported_seq":1042,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.185211+0000","last_change":"2024-09-14T11:58:53.185211+0000","last_active":"2024-09-14T11:58:53.185211+0000","last_peered":"2024-09-14T11:58:53.185211+0000","last_clean":"2024-09-14T11:58:53.185211+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:53.185211+0000","last_undegraded":"2024-09-14T11:58:53.185211+0000","last_fullsized":"2024-09-14T11:58:53.185211+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.185066+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:33.650629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":709,"num_read_kb":79863,"num_write":1135,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.555143+0000","last_change":"2024-09-14T11:59:08.555143+0000","last_active":"2024-09-14T11:59:08.555143+0000","last_peered":"2024-09-14T11:59:08.555143+0000","last_clean":"2024-09-14T11:59:08.555143+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:59:08.555143+0000","last_undegraded":"2024-09-14T11:59:08.555143+0000","last_fullsized":"2024-09-14T11:59:08.555143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.555050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.084087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":949,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.035219+0000","last_change":"2024-09-14T11:59:08.035219+0000","last_active":"2024-09-14T11:59:08.035219+0000","last_peered":"2024-09-14T11:59:08.035219+0000","last_clean":"2024-09-14T11:59:08.035219+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:59:08.035219+0000","last_undegraded":"2024-09-14T11:59:08.035219+0000","last_fullsized":"2024-09-14T11:59:08.035219+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.035130+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:34.188253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1166,"num_write":430,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":480,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.132653+0000","last_change":"2024-09-14T11:59:17.132653+0000","last_active":"2024-09-14T11:59:17.132653+0000","last_peered":"2024-09-14T11:59:17.132653+0000","last_clean":"2024-09-14T11:59:17.132653+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:59:17.132653+0000","last_undegraded":"2024-09-14T11:59:17.132653+0000","last_fullsized":"2024-09-14T11:59:17.132653+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.132565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2513","reported_seq":4340,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.259163+0000","last_change":"2024-09-14T11:59:21.259163+0000","last_active":"2024-09-14T11:59:21.259163+0000","last_peered":"2024-09-14T11:59:21.259163+0000","last_clean":"2024-09-14T11:59:21.259163+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:59:21.259163+0000","last_undegraded":"2024-09-14T11:59:21.259163+0000","last_fullsized":"2024-09-14T11:59:21.259163+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2513","last_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_deep_scrub":"263'2513","last_deep_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.259077+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":2500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:46.514561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1509","reported_seq":3177,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.671768+0000","last_change":"2024-09-14T11:58:59.671768+0000","last_active":"2024-09-14T11:58:59.671768+0000","last_peered":"2024-09-14T11:58:59.671768+0000","last_clean":"2024-09-14T11:58:59.671768+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:58:59.671768+0000","last_undegraded":"2024-09-14T11:58:59.671768+0000","last_fullsized":"2024-09-14T11:58:59.671768+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1509","last_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_deep_scrub":"263'1509","last_deep_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.671671+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":1400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:49.912175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'351","reported_seq":978,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.126234+0000","last_change":"2024-09-14T11:58:45.126234+0000","last_active":"2024-09-14T11:58:45.126234+0000","last_peered":"2024-09-14T11:58:45.126234+0000","last_clean":"2024-09-14T11:58:45.126234+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:45.126234+0000","last_undegraded":"2024-09-14T11:58:45.126234+0000","last_fullsized":"2024-09-14T11:58:45.126234+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.126037+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:48.415741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":7357,"num_write":1125,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.195824+0000","last_change":"2024-09-14T11:59:04.195824+0000","last_active":"2024-09-14T11:59:04.195824+0000","last_peered":"2024-09-14T11:59:04.195824+0000","last_clean":"2024-09-14T11:59:04.195824+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:59:04.195824+0000","last_undegraded":"2024-09-14T11:59:04.195824+0000","last_fullsized":"2024-09-14T11:59:04.195824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.195724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:15.148217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'108","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.828534+0000","last_change":"2024-09-14T11:59:11.828534+0000","last_active":"2024-09-14T11:59:11.828534+0000","last_peered":"2024-09-14T11:59:11.828534+0000","last_clean":"2024-09-14T11:59:11.828534+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:59:11.828534+0000","last_undegraded":"2024-09-14T11:59:11.828534+0000","last_fullsized":"2024-09-14T11:59:11.828534+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.828433+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:51.968761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.692789+0000","last_change":"2024-09-14T11:59:14.692789+0000","last_active":"2024-09-14T11:59:14.692789+0000","last_peered":"2024-09-14T11:59:14.692789+0000","last_clean":"2024-09-14T11:59:14.692789+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:59:14.692789+0000","last_undegraded":"2024-09-14T11:59:14.692789+0000","last_fullsized":"2024-09-14T11:59:14.692789+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.692686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:53.432442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.085836+0000","last_change":"2024-09-14T11:59:18.085710+0000","last_active":"2024-09-14T11:59:18.085836+0000","last_peered":"2024-09-14T11:59:18.085836+0000","last_clean":"2024-09-14T11:59:18.085836+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:59:18.085836+0000","last_undegraded":"2024-09-14T11:59:18.085836+0000","last_fullsized":"2024-09-14T11:59:18.085836+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.085608+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:28.679206+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'633","reported_seq":2385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.033445+0000","last_change":"2024-09-14T11:58:53.033445+0000","last_active":"2024-09-14T11:58:53.033445+0000","last_peered":"2024-09-14T11:58:53.033445+0000","last_clean":"2024-09-14T11:58:53.033445+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:53.033445+0000","last_undegraded":"2024-09-14T11:58:53.033445+0000","last_fullsized":"2024-09-14T11:58:53.033445+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'633","last_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_deep_scrub":"263'633","last_deep_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.033339+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.139377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'372","reported_seq":1040,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.195024+0000","last_change":"2024-09-14T11:58:52.195024+0000","last_active":"2024-09-14T11:58:52.195024+0000","last_peered":"2024-09-14T11:58:52.195024+0000","last_clean":"2024-09-14T11:58:52.195024+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:52.195024+0000","last_undegraded":"2024-09-14T11:58:52.195024+0000","last_fullsized":"2024-09-14T11:58:52.195024+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.194890+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:09.932572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":77744,"num_write":1160,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.177747+0000","last_change":"2024-09-14T11:59:07.177747+0000","last_active":"2024-09-14T11:59:07.177747+0000","last_peered":"2024-09-14T11:59:07.177747+0000","last_clean":"2024-09-14T11:59:07.177747+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:59:07.177747+0000","last_undegraded":"2024-09-14T11:59:07.177747+0000","last_fullsized":"2024-09-14T11:59:07.177747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.177676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:55.805641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'145","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.120684+0000","last_change":"2024-09-14T11:59:00.120684+0000","last_active":"2024-09-14T11:59:00.120684+0000","last_peered":"2024-09-14T11:59:00.120684+0000","last_clean":"2024-09-14T11:59:00.120684+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:59:00.120684+0000","last_undegraded":"2024-09-14T11:59:00.120684+0000","last_fullsized":"2024-09-14T11:59:00.120684+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.120596+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:09.503078+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'777","reported_seq":4526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.164519+0000","last_change":"2024-09-14T11:59:16.164519+0000","last_active":"2024-09-14T11:59:16.164519+0000","last_peered":"2024-09-14T11:59:16.164519+0000","last_clean":"2024-09-14T11:59:16.164519+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:59:16.164519+0000","last_undegraded":"2024-09-14T11:59:16.164519+0000","last_fullsized":"2024-09-14T11:59:16.164519+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.164426+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:13.531172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.666630+0000","last_change":"2024-09-14T11:59:20.666555+0000","last_active":"2024-09-14T11:59:20.666630+0000","last_peered":"2024-09-14T11:59:20.666630+0000","last_clean":"2024-09-14T11:59:20.666630+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:59:20.666630+0000","last_undegraded":"2024-09-14T11:59:20.666630+0000","last_fullsized":"2024-09-14T11:59:20.666630+0000","mapping_epoch":35,"log_start":"263'201","ondisk_log_start":"263'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.666459+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:01.439570+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'436","reported_seq":2064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.286059+0000","last_change":"2024-09-14T11:58:59.286059+0000","last_active":"2024-09-14T11:58:59.286059+0000","last_peered":"2024-09-14T11:58:59.286059+0000","last_clean":"2024-09-14T11:58:59.286059+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:58:59.286059+0000","last_undegraded":"2024-09-14T11:58:59.286059+0000","last_fullsized":"2024-09-14T11:58:59.286059+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.285928+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:01.883072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'327","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.702760+0000","last_change":"2024-09-14T11:58:47.702760+0000","last_active":"2024-09-14T11:58:47.702760+0000","last_peered":"2024-09-14T11:58:47.702760+0000","last_clean":"2024-09-14T11:58:47.702760+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:47.702760+0000","last_undegraded":"2024-09-14T11:58:47.702760+0000","last_fullsized":"2024-09-14T11:58:47.702760+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.702654+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:45.134369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":94667,"num_write":978,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.520832+0000","last_change":"2024-09-14T11:59:10.520832+0000","last_active":"2024-09-14T11:59:10.520832+0000","last_peered":"2024-09-14T11:59:10.520832+0000","last_clean":"2024-09-14T11:59:10.520832+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:59:10.520832+0000","last_undegraded":"2024-09-14T11:59:10.520832+0000","last_fullsized":"2024-09-14T11:59:10.520832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.520751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:23.745612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'278","reported_seq":845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.175916+0000","last_change":"2024-09-14T11:59:11.175916+0000","last_active":"2024-09-14T11:59:11.175916+0000","last_peered":"2024-09-14T11:59:11.175916+0000","last_clean":"2024-09-14T11:59:11.175916+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:59:11.175916+0000","last_undegraded":"2024-09-14T11:59:11.175916+0000","last_fullsized":"2024-09-14T11:59:11.175916+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.175829+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.855512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47840,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":445,"num_read_kb":1034,"num_write":358,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'812","reported_seq":2651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.248791+0000","last_change":"2024-09-14T11:59:17.248791+0000","last_active":"2024-09-14T11:59:17.248791+0000","last_peered":"2024-09-14T11:59:17.248791+0000","last_clean":"2024-09-14T11:59:17.248791+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:59:17.248791+0000","last_undegraded":"2024-09-14T11:59:17.248791+0000","last_fullsized":"2024-09-14T11:59:17.248791+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'812","last_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_deep_scrub":"263'812","last_deep_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.248692+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:23.181243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'660","reported_seq":2029,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.688828+0000","last_change":"2024-09-14T11:58:57.688828+0000","last_active":"2024-09-14T11:58:57.688828+0000","last_peered":"2024-09-14T11:58:57.688828+0000","last_clean":"2024-09-14T11:58:57.688828+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:57.688828+0000","last_undegraded":"2024-09-14T11:58:57.688828+0000","last_fullsized":"2024-09-14T11:58:57.688828+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'660","last_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_deep_scrub":"263'660","last_deep_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.688740+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:09.797199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'344","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.245207+0000","last_change":"2024-09-14T11:58:51.245207+0000","last_active":"2024-09-14T11:58:51.245207+0000","last_peered":"2024-09-14T11:58:51.245207+0000","last_clean":"2024-09-14T11:58:51.245207+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:51.245207+0000","last_undegraded":"2024-09-14T11:58:51.245207+0000","last_fullsized":"2024-09-14T11:58:51.245207+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.245091+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:42.023295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730185,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17523,"num_write":1016,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.097644+0000","last_change":"2024-09-14T11:59:05.097644+0000","last_active":"2024-09-14T11:59:05.097644+0000","last_peered":"2024-09-14T11:59:05.097644+0000","last_clean":"2024-09-14T11:59:05.097644+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:59:05.097644+0000","last_undegraded":"2024-09-14T11:59:05.097644+0000","last_fullsized":"2024-09-14T11:59:05.097644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.097558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:04.561569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'421","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.512036+0000","last_change":"2024-09-14T11:59:12.512036+0000","last_active":"2024-09-14T11:59:12.512036+0000","last_peered":"2024-09-14T11:59:12.512036+0000","last_clean":"2024-09-14T11:59:12.512036+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:59:12.512036+0000","last_undegraded":"2024-09-14T11:59:12.512036+0000","last_fullsized":"2024-09-14T11:59:12.512036+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.511928+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.113276+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46953,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":681,"num_read_kb":1474,"num_write":542,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.031924+0000","last_change":"2024-09-14T11:59:05.031924+0000","last_active":"2024-09-14T11:59:05.031924+0000","last_peered":"2024-09-14T11:59:05.031924+0000","last_clean":"2024-09-14T11:59:05.031924+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:59:05.031924+0000","last_undegraded":"2024-09-14T11:59:05.031924+0000","last_fullsized":"2024-09-14T11:59:05.031924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.031837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:42.237118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'587","reported_seq":1408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.356816+0000","last_change":"2024-09-14T11:59:17.356754+0000","last_active":"2024-09-14T11:59:17.356816+0000","last_peered":"2024-09-14T11:59:17.356816+0000","last_clean":"2024-09-14T11:59:17.356816+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:59:17.356816+0000","last_undegraded":"2024-09-14T11:59:17.356816+0000","last_fullsized":"2024-09-14T11:59:17.356816+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'587","last_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_deep_scrub":"263'587","last_deep_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.356652+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.326137+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'452","reported_seq":2129,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.816837+0000","last_change":"2024-09-14T11:58:54.816837+0000","last_active":"2024-09-14T11:58:54.816837+0000","last_peered":"2024-09-14T11:58:54.816837+0000","last_clean":"2024-09-14T11:58:54.816837+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:58:54.816837+0000","last_undegraded":"2024-09-14T11:58:54.816837+0000","last_fullsized":"2024-09-14T11:58:54.816837+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.816749+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:50.855590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'367","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.236667+0000","last_change":"2024-09-14T11:58:50.236667+0000","last_active":"2024-09-14T11:58:50.236667+0000","last_peered":"2024-09-14T11:58:50.236667+0000","last_clean":"2024-09-14T11:58:50.236667+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:50.236667+0000","last_undegraded":"2024-09-14T11:58:50.236667+0000","last_fullsized":"2024-09-14T11:58:50.236667+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.236566+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:38.811873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":60976,"num_write":1200,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"263'6","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.085209+0000","last_change":"2024-09-14T11:58:57.085209+0000","last_active":"2024-09-14T11:58:57.085209+0000","last_peered":"2024-09-14T11:58:57.085209+0000","last_clean":"2024-09-14T11:58:57.085209+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:57.085209+0000","last_undegraded":"2024-09-14T11:58:57.085209+0000","last_fullsized":"2024-09-14T11:58:57.085209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.085117+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:15.512672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'284","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.201561+0000","last_change":"2024-09-14T11:59:10.201561+0000","last_active":"2024-09-14T11:59:10.201561+0000","last_peered":"2024-09-14T11:59:10.201561+0000","last_clean":"2024-09-14T11:59:10.201561+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:59:10.201561+0000","last_undegraded":"2024-09-14T11:59:10.201561+0000","last_fullsized":"2024-09-14T11:59:10.201561+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.201469+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:48.613270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.268879+0000","last_change":"2024-09-14T11:59:16.268879+0000","last_active":"2024-09-14T11:59:16.268879+0000","last_peered":"2024-09-14T11:59:16.268879+0000","last_clean":"2024-09-14T11:59:16.268879+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:59:16.268879+0000","last_undegraded":"2024-09-14T11:59:16.268879+0000","last_fullsized":"2024-09-14T11:59:16.268879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.268790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:38.351368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'111","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.756656+0000","last_change":"2024-09-14T11:59:06.756656+0000","last_active":"2024-09-14T11:59:06.756656+0000","last_peered":"2024-09-14T11:59:06.756656+0000","last_clean":"2024-09-14T11:59:06.756656+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:59:06.756656+0000","last_undegraded":"2024-09-14T11:59:06.756656+0000","last_fullsized":"2024-09-14T11:59:06.756656+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.756562+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:37.023051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'438","reported_seq":1876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.759653+0000","last_change":"2024-09-14T11:58:58.759653+0000","last_active":"2024-09-14T11:58:58.759653+0000","last_peered":"2024-09-14T11:58:58.759653+0000","last_clean":"2024-09-14T11:58:58.759653+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:58.759653+0000","last_undegraded":"2024-09-14T11:58:58.759653+0000","last_fullsized":"2024-09-14T11:58:58.759653+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.759554+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:42.260528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'324","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.255581+0000","last_change":"2024-09-14T11:58:49.255581+0000","last_active":"2024-09-14T11:58:49.255581+0000","last_peered":"2024-09-14T11:58:49.255581+0000","last_clean":"2024-09-14T11:58:49.255581+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:49.255581+0000","last_undegraded":"2024-09-14T11:58:49.255581+0000","last_fullsized":"2024-09-14T11:58:49.255581+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.255417+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.505258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":11458,"num_write":967,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.050008+0000","last_change":"2024-09-14T11:58:58.050008+0000","last_active":"2024-09-14T11:58:58.050008+0000","last_peered":"2024-09-14T11:58:58.050008+0000","last_clean":"2024-09-14T11:58:58.050008+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:58:58.050008+0000","last_undegraded":"2024-09-14T11:58:58.050008+0000","last_fullsized":"2024-09-14T11:58:58.050008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.049910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:15.923228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'302","reported_seq":893,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.215574+0000","last_change":"2024-09-14T11:59:10.215574+0000","last_active":"2024-09-14T11:59:10.215574+0000","last_peered":"2024-09-14T11:59:10.215574+0000","last_clean":"2024-09-14T11:59:10.215574+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:59:10.215574+0000","last_undegraded":"2024-09-14T11:59:10.215574+0000","last_fullsized":"2024-09-14T11:59:10.215574+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.215461+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.687739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50465,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":1040,"num_write":378,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2933,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.998865+0000","last_change":"2024-09-14T11:59:03.998865+0000","last_active":"2024-09-14T11:59:03.998865+0000","last_peered":"2024-09-14T11:59:03.998865+0000","last_clean":"2024-09-14T11:59:03.998865+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:59:03.998865+0000","last_undegraded":"2024-09-14T11:59:03.998865+0000","last_fullsized":"2024-09-14T11:59:03.998865+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.998777+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.585506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'146","reported_seq":653,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.045957+0000","last_change":"2024-09-14T11:59:16.045957+0000","last_active":"2024-09-14T11:59:16.045957+0000","last_peered":"2024-09-14T11:59:16.045957+0000","last_clean":"2024-09-14T11:59:16.045957+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:59:16.045957+0000","last_undegraded":"2024-09-14T11:59:16.045957+0000","last_fullsized":"2024-09-14T11:59:16.045957+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.045861+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:48.038828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'439","reported_seq":2006,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.012062+0000","last_change":"2024-09-14T11:58:57.012062+0000","last_active":"2024-09-14T11:58:57.012062+0000","last_peered":"2024-09-14T11:58:57.012062+0000","last_clean":"2024-09-14T11:58:57.012062+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:58:57.012062+0000","last_undegraded":"2024-09-14T11:58:57.012062+0000","last_fullsized":"2024-09-14T11:58:57.012062+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.011931+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:47.884035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.124210+0000","last_change":"2024-09-14T11:58:45.124210+0000","last_active":"2024-09-14T11:58:45.124210+0000","last_peered":"2024-09-14T11:58:45.124210+0000","last_clean":"2024-09-14T11:58:45.124210+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:45.124210+0000","last_undegraded":"2024-09-14T11:58:45.124210+0000","last_fullsized":"2024-09-14T11:58:45.124210+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.124078+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:42.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730158,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":20707,"num_write":1086,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.106800+0000","last_change":"2024-09-14T11:58:55.106800+0000","last_active":"2024-09-14T11:58:55.106800+0000","last_peered":"2024-09-14T11:58:55.106800+0000","last_clean":"2024-09-14T11:58:55.106800+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:58:55.106800+0000","last_undegraded":"2024-09-14T11:58:55.106800+0000","last_fullsized":"2024-09-14T11:58:55.106800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.106702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:25.435659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'496","reported_seq":1135,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.014926+0000","last_change":"2024-09-14T11:59:01.014926+0000","last_active":"2024-09-14T11:59:01.014926+0000","last_peered":"2024-09-14T11:59:01.014926+0000","last_clean":"2024-09-14T11:59:01.014926+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:59:01.014926+0000","last_undegraded":"2024-09-14T11:59:01.014926+0000","last_fullsized":"2024-09-14T11:59:01.014926+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.014817+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:05.088724+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104584,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":850,"num_read_kb":2088,"num_write":692,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.103600+0000","last_change":"2024-09-14T11:59:01.103600+0000","last_active":"2024-09-14T11:59:01.103600+0000","last_peered":"2024-09-14T11:59:01.103600+0000","last_clean":"2024-09-14T11:59:01.103600+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:59:01.103600+0000","last_undegraded":"2024-09-14T11:59:01.103600+0000","last_fullsized":"2024-09-14T11:59:01.103600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.103512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.351272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'154","reported_seq":665,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.165330+0000","last_change":"2024-09-14T11:59:11.165330+0000","last_active":"2024-09-14T11:59:11.165330+0000","last_peered":"2024-09-14T11:59:11.165330+0000","last_clean":"2024-09-14T11:59:11.165330+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:59:11.165330+0000","last_undegraded":"2024-09-14T11:59:11.165330+0000","last_fullsized":"2024-09-14T11:59:11.165330+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.165237+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:39.619620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'486","reported_seq":2271,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.754456+0000","last_change":"2024-09-14T11:58:50.754456+0000","last_active":"2024-09-14T11:58:50.754456+0000","last_peered":"2024-09-14T11:58:50.754456+0000","last_clean":"2024-09-14T11:58:50.754456+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:50.754456+0000","last_undegraded":"2024-09-14T11:58:50.754456+0000","last_fullsized":"2024-09-14T11:58:50.754456+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'486","last_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_deep_scrub":"263'486","last_deep_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.754357+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:01.136208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'383","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.397624+0000","last_change":"2024-09-14T11:58:45.397624+0000","last_active":"2024-09-14T11:58:45.397624+0000","last_peered":"2024-09-14T11:58:45.397624+0000","last_clean":"2024-09-14T11:58:45.397624+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:45.397624+0000","last_undegraded":"2024-09-14T11:58:45.397624+0000","last_fullsized":"2024-09-14T11:58:45.397624+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.397519+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:00.442423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460262,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":720,"num_read_kb":26829,"num_write":1334,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.076851+0000","last_change":"2024-09-14T11:58:56.076851+0000","last_active":"2024-09-14T11:58:56.076851+0000","last_peered":"2024-09-14T11:58:56.076851+0000","last_clean":"2024-09-14T11:58:56.076851+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:58:56.076851+0000","last_undegraded":"2024-09-14T11:58:56.076851+0000","last_fullsized":"2024-09-14T11:58:56.076851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.076745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:27.744336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'343","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.832169+0000","last_change":"2024-09-14T11:59:10.832169+0000","last_active":"2024-09-14T11:59:10.832169+0000","last_peered":"2024-09-14T11:59:10.832169+0000","last_clean":"2024-09-14T11:59:10.832169+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:59:10.832169+0000","last_undegraded":"2024-09-14T11:59:10.832169+0000","last_fullsized":"2024-09-14T11:59:10.832169+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.832082+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:56.975816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.079968+0000","last_change":"2024-09-14T11:59:15.079968+0000","last_active":"2024-09-14T11:59:15.079968+0000","last_peered":"2024-09-14T11:59:15.079968+0000","last_clean":"2024-09-14T11:59:15.079968+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:59:15.079968+0000","last_undegraded":"2024-09-14T11:59:15.079968+0000","last_fullsized":"2024-09-14T11:59:15.079968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.079878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.130970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'130","reported_seq":631,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:59.557846+0000","last_change":"2024-09-14T10:56:49.746135+0000","last_active":"2024-09-14T11:57:59.557846+0000","last_peered":"2024-09-14T11:57:59.557846+0000","last_clean":"2024-09-14T11:57:59.557846+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:57:59.557846+0000","last_undegraded":"2024-09-14T11:57:59.557846+0000","last_fullsized":"2024-09-14T11:57:59.557846+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'768","reported_seq":2688,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.760938+0000","last_change":"2024-09-14T11:58:51.760938+0000","last_active":"2024-09-14T11:58:51.760938+0000","last_peered":"2024-09-14T11:58:51.760938+0000","last_clean":"2024-09-14T11:58:51.760938+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:51.760938+0000","last_undegraded":"2024-09-14T11:58:51.760938+0000","last_fullsized":"2024-09-14T11:58:51.760938+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.760830+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.067687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4017,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'396","reported_seq":1062,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.685522+0000","last_change":"2024-09-14T11:58:46.685522+0000","last_active":"2024-09-14T11:58:46.685522+0000","last_peered":"2024-09-14T11:58:46.685522+0000","last_clean":"2024-09-14T11:58:46.685522+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:46.685522+0000","last_undegraded":"2024-09-14T11:58:46.685522+0000","last_fullsized":"2024-09-14T11:58:46.685522+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.685398+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:45.698748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":27548,"num_write":1230,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.121243+0000","last_change":"2024-09-14T11:58:59.121243+0000","last_active":"2024-09-14T11:58:59.121243+0000","last_peered":"2024-09-14T11:58:59.121243+0000","last_clean":"2024-09-14T11:58:59.121243+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:58:59.121243+0000","last_undegraded":"2024-09-14T11:58:59.121243+0000","last_fullsized":"2024-09-14T11:58:59.121243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.121156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'352","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.098104+0000","last_change":"2024-09-14T11:58:59.098104+0000","last_active":"2024-09-14T11:58:59.098104+0000","last_peered":"2024-09-14T11:58:59.098104+0000","last_clean":"2024-09-14T11:58:59.098104+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:59.098104+0000","last_undegraded":"2024-09-14T11:58:59.098104+0000","last_fullsized":"2024-09-14T11:58:59.098104+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.098007+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:42.018589+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'754","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.094373+0000","last_change":"2024-09-14T11:59:02.094373+0000","last_active":"2024-09-14T11:59:02.094373+0000","last_peered":"2024-09-14T11:59:02.094373+0000","last_clean":"2024-09-14T11:59:02.094373+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:59:02.094373+0000","last_undegraded":"2024-09-14T11:59:02.094373+0000","last_fullsized":"2024-09-14T11:59:02.094373+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.094282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:59.227105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'123","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.151465+0000","last_change":"2024-09-14T11:59:08.151371+0000","last_active":"2024-09-14T11:59:08.151465+0000","last_peered":"2024-09-14T11:59:08.151465+0000","last_clean":"2024-09-14T11:59:08.151465+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:59:08.151465+0000","last_undegraded":"2024-09-14T11:59:08.151465+0000","last_fullsized":"2024-09-14T11:59:08.151465+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.151256+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.059464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'748","reported_seq":2269,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.737338+0000","last_change":"2024-09-14T11:58:52.737338+0000","last_active":"2024-09-14T11:58:52.737338+0000","last_peered":"2024-09-14T11:58:52.737338+0000","last_clean":"2024-09-14T11:58:52.737338+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:58:52.737338+0000","last_undegraded":"2024-09-14T11:58:52.737338+0000","last_fullsized":"2024-09-14T11:58:52.737338+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.737257+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:36.814154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.699782+0000","last_change":"2024-09-14T11:58:45.699782+0000","last_active":"2024-09-14T11:58:45.699782+0000","last_peered":"2024-09-14T11:58:45.699782+0000","last_clean":"2024-09-14T11:58:45.699782+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:45.699782+0000","last_undegraded":"2024-09-14T11:58:45.699782+0000","last_fullsized":"2024-09-14T11:58:45.699782+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.699650+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:10.613326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":90386,"num_write":1114,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.598642+0000","last_change":"2024-09-14T11:59:07.598642+0000","last_active":"2024-09-14T11:59:07.598642+0000","last_peered":"2024-09-14T11:59:07.598642+0000","last_clean":"2024-09-14T11:59:07.598642+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:59:07.598642+0000","last_undegraded":"2024-09-14T11:59:07.598642+0000","last_fullsized":"2024-09-14T11:59:07.598642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.598558+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:48.979302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'97","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.229635+0000","last_change":"2024-09-14T11:59:08.229635+0000","last_active":"2024-09-14T11:59:08.229635+0000","last_peered":"2024-09-14T11:59:08.229635+0000","last_clean":"2024-09-14T11:59:08.229635+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:59:08.229635+0000","last_undegraded":"2024-09-14T11:59:08.229635+0000","last_fullsized":"2024-09-14T11:59:08.229635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.229543+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:06.240077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'776","reported_seq":2409,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.752708+0000","last_change":"2024-09-14T11:59:03.752708+0000","last_active":"2024-09-14T11:59:03.752708+0000","last_peered":"2024-09-14T11:59:03.752708+0000","last_clean":"2024-09-14T11:59:03.752708+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:59:03.752708+0000","last_undegraded":"2024-09-14T11:59:03.752708+0000","last_fullsized":"2024-09-14T11:59:03.752708+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.752612+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:52.775220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.704072+0000","last_change":"2024-09-14T11:59:19.704011+0000","last_active":"2024-09-14T11:59:19.704072+0000","last_peered":"2024-09-14T11:59:19.704072+0000","last_clean":"2024-09-14T11:59:19.704072+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:59:19.704072+0000","last_undegraded":"2024-09-14T11:59:19.704072+0000","last_fullsized":"2024-09-14T11:59:19.704072+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.703915+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:03.125097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'790","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.214441+0000","last_change":"2024-09-14T11:58:54.214441+0000","last_active":"2024-09-14T11:58:54.214441+0000","last_peered":"2024-09-14T11:58:54.214441+0000","last_clean":"2024-09-14T11:58:54.214441+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:58:54.214441+0000","last_undegraded":"2024-09-14T11:58:54.214441+0000","last_fullsized":"2024-09-14T11:58:54.214441+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.214346+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:33.379939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'328","reported_seq":934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.320469+0000","last_change":"2024-09-14T11:58:48.320469+0000","last_active":"2024-09-14T11:58:48.320469+0000","last_peered":"2024-09-14T11:58:48.320469+0000","last_clean":"2024-09-14T11:58:48.320469+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:48.320469+0000","last_undegraded":"2024-09-14T11:58:48.320469+0000","last_fullsized":"2024-09-14T11:58:48.320469+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.320357+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.438966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029101,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1389,"num_write":1004,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.890106+0000","last_change":"2024-09-14T11:59:06.890106+0000","last_active":"2024-09-14T11:59:06.890106+0000","last_peered":"2024-09-14T11:59:06.890106+0000","last_clean":"2024-09-14T11:59:06.890106+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:59:06.890106+0000","last_undegraded":"2024-09-14T11:59:06.890106+0000","last_fullsized":"2024-09-14T11:59:06.890106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.890026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:38.506072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'404","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.470070+0000","last_change":"2024-09-14T11:59:13.470070+0000","last_active":"2024-09-14T11:59:13.470070+0000","last_peered":"2024-09-14T11:59:13.470070+0000","last_clean":"2024-09-14T11:59:13.470070+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:59:13.470070+0000","last_undegraded":"2024-09-14T11:59:13.470070+0000","last_fullsized":"2024-09-14T11:59:13.470070+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.469964+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.308998+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45959,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1239,"num_read_kb":1795,"num_write":1786,"num_write_kb":1623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.747632+0000","last_change":"2024-09-14T11:59:02.747632+0000","last_active":"2024-09-14T11:59:02.747632+0000","last_peered":"2024-09-14T11:59:02.747632+0000","last_clean":"2024-09-14T11:59:02.747632+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:59:02.747632+0000","last_undegraded":"2024-09-14T11:59:02.747632+0000","last_fullsized":"2024-09-14T11:59:02.747632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.747498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'197","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.165634+0000","last_change":"2024-09-14T11:59:09.165579+0000","last_active":"2024-09-14T11:59:09.165634+0000","last_peered":"2024-09-14T11:59:09.165634+0000","last_clean":"2024-09-14T11:59:09.165634+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:59:09.165634+0000","last_undegraded":"2024-09-14T11:59:09.165634+0000","last_fullsized":"2024-09-14T11:59:09.165634+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.165485+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:37.416199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'648","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.745492+0000","last_change":"2024-09-14T11:58:53.745432+0000","last_active":"2024-09-14T11:58:53.745492+0000","last_peered":"2024-09-14T11:58:53.745492+0000","last_clean":"2024-09-14T11:58:53.745492+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:58:53.745492+0000","last_undegraded":"2024-09-14T11:58:53.745492+0000","last_fullsized":"2024-09-14T11:58:53.745492+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'648","last_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_deep_scrub":"263'648","last_deep_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.745349+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":600,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:32.204852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.168663+0000","last_change":"2024-09-14T11:58:46.168663+0000","last_active":"2024-09-14T11:58:46.168663+0000","last_peered":"2024-09-14T11:58:46.168663+0000","last_clean":"2024-09-14T11:58:46.168663+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:58:46.168663+0000","last_undegraded":"2024-09-14T11:58:46.168663+0000","last_fullsized":"2024-09-14T11:58:46.168663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.168543+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:01.548000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.569275+0000","last_change":"2024-09-14T11:58:46.569219+0000","last_active":"2024-09-14T11:58:46.569275+0000","last_peered":"2024-09-14T11:58:46.569275+0000","last_clean":"2024-09-14T11:58:46.569275+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:58:46.569275+0000","last_undegraded":"2024-09-14T11:58:46.569275+0000","last_fullsized":"2024-09-14T11:58:46.569275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.569138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:18.058116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'352","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.444433+0000","last_change":"2024-09-14T11:58:44.444382+0000","last_active":"2024-09-14T11:58:44.444433+0000","last_peered":"2024-09-14T11:58:44.444433+0000","last_clean":"2024-09-14T11:58:44.444433+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:44.444433+0000","last_undegraded":"2024-09-14T11:58:44.444433+0000","last_fullsized":"2024-09-14T11:58:44.444433+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.444289+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:32.649496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":656,"num_read_kb":39235,"num_write":1025,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.108459+0000","last_change":"2024-09-14T11:59:04.108374+0000","last_active":"2024-09-14T11:59:04.108459+0000","last_peered":"2024-09-14T11:59:04.108459+0000","last_clean":"2024-09-14T11:59:04.108459+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:59:04.108459+0000","last_undegraded":"2024-09-14T11:59:04.108459+0000","last_fullsized":"2024-09-14T11:59:04.108459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.108274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:04.664406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'800","reported_seq":1506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.503710+0000","last_change":"2024-09-14T11:59:11.503710+0000","last_active":"2024-09-14T11:59:11.503710+0000","last_peered":"2024-09-14T11:59:11.503710+0000","last_clean":"2024-09-14T11:59:11.503710+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:59:11.503710+0000","last_undegraded":"2024-09-14T11:59:11.503710+0000","last_fullsized":"2024-09-14T11:59:11.503710+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.503605+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:34.646109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159942,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1557,"num_read_kb":3699,"num_write":1498,"num_write_kb":1345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106782,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.022564+0000","last_change":"2024-09-14T11:59:06.022564+0000","last_active":"2024-09-14T11:59:06.022564+0000","last_peered":"2024-09-14T11:59:06.022564+0000","last_clean":"2024-09-14T11:59:06.022564+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:59:06.022564+0000","last_undegraded":"2024-09-14T11:59:06.022564+0000","last_fullsized":"2024-09-14T11:59:06.022564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.022472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:49.065861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'192","reported_seq":898,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.787410+0000","last_change":"2024-09-14T11:59:08.787410+0000","last_active":"2024-09-14T11:59:08.787410+0000","last_peered":"2024-09-14T11:59:08.787410+0000","last_clean":"2024-09-14T11:59:08.787410+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:59:08.787410+0000","last_undegraded":"2024-09-14T11:59:08.787410+0000","last_fullsized":"2024-09-14T11:59:08.787410+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.787313+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.951609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.091140+0000","last_change":"2024-09-14T11:58:51.091140+0000","last_active":"2024-09-14T11:58:51.091140+0000","last_peered":"2024-09-14T11:58:51.091140+0000","last_clean":"2024-09-14T11:58:51.091140+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:58:51.091140+0000","last_undegraded":"2024-09-14T11:58:51.091140+0000","last_fullsized":"2024-09-14T11:58:51.091140+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.091045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:45.745869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.185772+0000","last_change":"2024-09-14T11:58:47.185772+0000","last_active":"2024-09-14T11:58:47.185772+0000","last_peered":"2024-09-14T11:58:47.185772+0000","last_clean":"2024-09-14T11:58:47.185772+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:58:47.185772+0000","last_undegraded":"2024-09-14T11:58:47.185772+0000","last_fullsized":"2024-09-14T11:58:47.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:42.752443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'294","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.189454+0000","last_change":"2024-09-14T11:58:43.189335+0000","last_active":"2024-09-14T11:58:43.189454+0000","last_peered":"2024-09-14T11:58:43.189454+0000","last_clean":"2024-09-14T11:58:43.189454+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:43.189454+0000","last_undegraded":"2024-09-14T11:58:43.189454+0000","last_fullsized":"2024-09-14T11:58:43.189454+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.189192+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.174639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":19285,"num_write":870,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.631675+0000","last_change":"2024-09-14T11:59:06.631675+0000","last_active":"2024-09-14T11:59:06.631675+0000","last_peered":"2024-09-14T11:59:06.631675+0000","last_clean":"2024-09-14T11:59:06.631675+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:59:06.631675+0000","last_undegraded":"2024-09-14T11:59:06.631675+0000","last_fullsized":"2024-09-14T11:59:06.631675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.631578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:27.585412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1337","reported_seq":3031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.084394+0000","last_change":"2024-09-14T11:59:04.084328+0000","last_active":"2024-09-14T11:59:04.084394+0000","last_peered":"2024-09-14T11:59:04.084394+0000","last_clean":"2024-09-14T11:59:04.084394+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:59:04.084394+0000","last_undegraded":"2024-09-14T11:59:04.084394+0000","last_fullsized":"2024-09-14T11:59:04.084394+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1337","last_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_deep_scrub":"263'1337","last_deep_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.084232+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":1300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.280837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147529,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":4061,"num_write":1198,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.204694+0000","last_change":"2024-09-14T11:59:14.204694+0000","last_active":"2024-09-14T11:59:14.204694+0000","last_peered":"2024-09-14T11:59:14.204694+0000","last_clean":"2024-09-14T11:59:14.204694+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:59:14.204694+0000","last_undegraded":"2024-09-14T11:59:14.204694+0000","last_fullsized":"2024-09-14T11:59:14.204694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.204609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:29.615881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.143196+0000","last_change":"2024-09-14T11:59:12.143196+0000","last_active":"2024-09-14T11:59:12.143196+0000","last_peered":"2024-09-14T11:59:12.143196+0000","last_clean":"2024-09-14T11:59:12.143196+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:59:12.143196+0000","last_undegraded":"2024-09-14T11:59:12.143196+0000","last_fullsized":"2024-09-14T11:59:12.143196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.143119+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:39.907735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'940","reported_seq":2815,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.240513+0000","last_change":"2024-09-14T11:58:52.240513+0000","last_active":"2024-09-14T11:58:52.240513+0000","last_peered":"2024-09-14T11:58:52.240513+0000","last_clean":"2024-09-14T11:58:52.240513+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:58:52.240513+0000","last_undegraded":"2024-09-14T11:58:52.240513+0000","last_fullsized":"2024-09-14T11:58:52.240513+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'940","last_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_deep_scrub":"263'940","last_deep_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.240421+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:19.620785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.087405+0000","last_change":"2024-09-14T11:58:44.087353+0000","last_active":"2024-09-14T11:58:44.087405+0000","last_peered":"2024-09-14T11:58:44.087405+0000","last_clean":"2024-09-14T11:58:44.087405+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:58:44.087405+0000","last_undegraded":"2024-09-14T11:58:44.087405+0000","last_fullsized":"2024-09-14T11:58:44.087405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.087274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.959220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.207333+0000","last_change":"2024-09-14T11:58:44.207283+0000","last_active":"2024-09-14T11:58:44.207333+0000","last_peered":"2024-09-14T11:58:44.207333+0000","last_clean":"2024-09-14T11:58:44.207333+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:44.207333+0000","last_undegraded":"2024-09-14T11:58:44.207333+0000","last_fullsized":"2024-09-14T11:58:44.207333+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.207202+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.074753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":14745,"num_write":993,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.123366+0000","last_change":"2024-09-14T11:58:52.123366+0000","last_active":"2024-09-14T11:58:52.123366+0000","last_peered":"2024-09-14T11:58:52.123366+0000","last_clean":"2024-09-14T11:58:52.123366+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:58:52.123366+0000","last_undegraded":"2024-09-14T11:58:52.123366+0000","last_fullsized":"2024-09-14T11:58:52.123366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.123283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:43.905032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'300","reported_seq":1581,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.173844+0000","last_change":"2024-09-14T11:59:09.173844+0000","last_active":"2024-09-14T11:59:09.173844+0000","last_peered":"2024-09-14T11:59:09.173844+0000","last_clean":"2024-09-14T11:59:09.173844+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:59:09.173844+0000","last_undegraded":"2024-09-14T11:59:09.173844+0000","last_fullsized":"2024-09-14T11:59:09.173844+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.173746+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:19.388852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.984467+0000","last_change":"2024-09-14T11:59:04.984412+0000","last_active":"2024-09-14T11:59:04.984467+0000","last_peered":"2024-09-14T11:59:04.984467+0000","last_clean":"2024-09-14T11:59:04.984467+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:59:04.984467+0000","last_undegraded":"2024-09-14T11:59:04.984467+0000","last_fullsized":"2024-09-14T11:59:04.984467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.984302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:51.608454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'266","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.282776+0000","last_change":"2024-09-14T11:59:20.282776+0000","last_active":"2024-09-14T11:59:20.282776+0000","last_peered":"2024-09-14T11:59:20.282776+0000","last_clean":"2024-09-14T11:59:20.282776+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:59:20.282776+0000","last_undegraded":"2024-09-14T11:59:20.282776+0000","last_fullsized":"2024-09-14T11:59:20.282776+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'266","last_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_deep_scrub":"263'266","last_deep_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.282670+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:28.650824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'532","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.215680+0000","last_change":"2024-09-14T11:58:55.215616+0000","last_active":"2024-09-14T11:58:55.215680+0000","last_peered":"2024-09-14T11:58:55.215680+0000","last_clean":"2024-09-14T11:58:55.215680+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:58:55.215680+0000","last_undegraded":"2024-09-14T11:58:55.215680+0000","last_fullsized":"2024-09-14T11:58:55.215680+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.215524+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:07.598615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.528258+0000","last_change":"2024-09-14T11:58:45.528200+0000","last_active":"2024-09-14T11:58:45.528258+0000","last_peered":"2024-09-14T11:58:45.528258+0000","last_clean":"2024-09-14T11:58:45.528258+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:58:45.528258+0000","last_undegraded":"2024-09-14T11:58:45.528258+0000","last_fullsized":"2024-09-14T11:58:45.528258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.528111+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:55.865518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'318","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.744061+0000","last_change":"2024-09-14T11:58:44.744001+0000","last_active":"2024-09-14T11:58:44.744061+0000","last_peered":"2024-09-14T11:58:44.744061+0000","last_clean":"2024-09-14T11:58:44.744061+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:44.744061+0000","last_undegraded":"2024-09-14T11:58:44.744061+0000","last_fullsized":"2024-09-14T11:58:44.744061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.743862+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.790267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":28769,"num_write":1006,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.075932+0000","last_change":"2024-09-14T11:59:11.075932+0000","last_active":"2024-09-14T11:59:11.075932+0000","last_peered":"2024-09-14T11:59:11.075932+0000","last_clean":"2024-09-14T11:59:11.075932+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:59:11.075932+0000","last_undegraded":"2024-09-14T11:59:11.075932+0000","last_fullsized":"2024-09-14T11:59:11.075932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.075841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:14.957973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'149","reported_seq":705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.277307+0000","last_change":"2024-09-14T11:59:13.277307+0000","last_active":"2024-09-14T11:59:13.277307+0000","last_peered":"2024-09-14T11:59:13.277307+0000","last_clean":"2024-09-14T11:59:13.277307+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:59:13.277307+0000","last_undegraded":"2024-09-14T11:59:13.277307+0000","last_fullsized":"2024-09-14T11:59:13.277307+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.277197+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:07.842082+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.741491+0000","last_change":"2024-09-14T11:59:01.741491+0000","last_active":"2024-09-14T11:59:01.741491+0000","last_peered":"2024-09-14T11:59:01.741491+0000","last_clean":"2024-09-14T11:59:01.741491+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:59:01.741491+0000","last_undegraded":"2024-09-14T11:59:01.741491+0000","last_fullsized":"2024-09-14T11:59:01.741491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.741352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:48.805285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":727,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.291665+0000","last_change":"2024-09-14T11:59:19.291665+0000","last_active":"2024-09-14T11:59:19.291665+0000","last_peered":"2024-09-14T11:59:19.291665+0000","last_clean":"2024-09-14T11:59:19.291665+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:59:19.291665+0000","last_undegraded":"2024-09-14T11:59:19.291665+0000","last_fullsized":"2024-09-14T11:59:19.291665+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.291569+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:45.556534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'389","reported_seq":1850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.196607+0000","last_change":"2024-09-14T11:58:51.196546+0000","last_active":"2024-09-14T11:58:51.196607+0000","last_peered":"2024-09-14T11:58:51.196607+0000","last_clean":"2024-09-14T11:58:51.196607+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:58:51.196607+0000","last_undegraded":"2024-09-14T11:58:51.196607+0000","last_fullsized":"2024-09-14T11:58:51.196607+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.196437+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:05.805557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'431","reported_seq":1089,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.607993+0000","last_change":"2024-09-14T11:58:48.607993+0000","last_active":"2024-09-14T11:58:48.607993+0000","last_peered":"2024-09-14T11:58:48.607993+0000","last_clean":"2024-09-14T11:58:48.607993+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:48.607993+0000","last_undegraded":"2024-09-14T11:58:48.607993+0000","last_fullsized":"2024-09-14T11:58:48.607993+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.607870+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:44.650142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":3743,"num_write":1340,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.231477+0000","last_change":"2024-09-14T11:58:43.231436+0000","last_active":"2024-09-14T11:58:43.231477+0000","last_peered":"2024-09-14T11:58:43.231477+0000","last_clean":"2024-09-14T11:58:43.231477+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:58:43.231477+0000","last_undegraded":"2024-09-14T11:58:43.231477+0000","last_fullsized":"2024-09-14T11:58:43.231477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.231372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:04.024193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.032264+0000","last_change":"2024-09-14T11:59:02.032210+0000","last_active":"2024-09-14T11:59:02.032264+0000","last_peered":"2024-09-14T11:59:02.032264+0000","last_clean":"2024-09-14T11:59:02.032264+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:59:02.032264+0000","last_undegraded":"2024-09-14T11:59:02.032264+0000","last_fullsized":"2024-09-14T11:59:02.032264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.032101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.130324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'621","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.011394+0000","last_change":"2024-09-14T11:59:00.011394+0000","last_active":"2024-09-14T11:59:00.011394+0000","last_peered":"2024-09-14T11:59:00.011394+0000","last_clean":"2024-09-14T11:59:00.011394+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:59:00.011394+0000","last_undegraded":"2024-09-14T11:59:00.011394+0000","last_fullsized":"2024-09-14T11:59:00.011394+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'621","last_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_deep_scrub":"263'621","last_deep_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.011288+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:50.798461+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":2305,"num_write":884,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.705324+0000","last_change":"2024-09-14T11:59:15.705258+0000","last_active":"2024-09-14T11:59:15.705324+0000","last_peered":"2024-09-14T11:59:15.705324+0000","last_clean":"2024-09-14T11:59:15.705324+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:59:15.705324+0000","last_undegraded":"2024-09-14T11:59:15.705324+0000","last_fullsized":"2024-09-14T11:59:15.705324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.705170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:32.898069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.119668+0000","last_change":"2024-09-14T11:59:19.119668+0000","last_active":"2024-09-14T11:59:19.119668+0000","last_peered":"2024-09-14T11:59:19.119668+0000","last_clean":"2024-09-14T11:59:19.119668+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:59:19.119668+0000","last_undegraded":"2024-09-14T11:59:19.119668+0000","last_fullsized":"2024-09-14T11:59:19.119668+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.119565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:16.877063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.066843+0000","last_change":"2024-09-14T11:58:55.066775+0000","last_active":"2024-09-14T11:58:55.066843+0000","last_peered":"2024-09-14T11:58:55.066843+0000","last_clean":"2024-09-14T11:58:55.066843+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:58:55.066843+0000","last_undegraded":"2024-09-14T11:58:55.066843+0000","last_fullsized":"2024-09-14T11:58:55.066843+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.066670+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.411005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.152742+0000","last_change":"2024-09-14T11:58:50.152595+0000","last_active":"2024-09-14T11:58:50.152742+0000","last_peered":"2024-09-14T11:58:50.152742+0000","last_clean":"2024-09-14T11:58:50.152742+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:50.152742+0000","last_undegraded":"2024-09-14T11:58:50.152742+0000","last_fullsized":"2024-09-14T11:58:50.152742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.152451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:15.470870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":39755,"num_write":947,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.221566+0000","last_change":"2024-09-14T11:58:48.221461+0000","last_active":"2024-09-14T11:58:48.221566+0000","last_peered":"2024-09-14T11:58:48.221566+0000","last_clean":"2024-09-14T11:58:48.221566+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:58:48.221566+0000","last_undegraded":"2024-09-14T11:58:48.221566+0000","last_fullsized":"2024-09-14T11:58:48.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.221349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:16.934950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.788591+0000","last_change":"2024-09-14T11:58:57.788524+0000","last_active":"2024-09-14T11:58:57.788591+0000","last_peered":"2024-09-14T11:58:57.788591+0000","last_clean":"2024-09-14T11:58:57.788591+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:58:57.788591+0000","last_undegraded":"2024-09-14T11:58:57.788591+0000","last_fullsized":"2024-09-14T11:58:57.788591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.788438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.196517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'198","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.091120+0000","last_change":"2024-09-14T11:59:03.091060+0000","last_active":"2024-09-14T11:59:03.091120+0000","last_peered":"2024-09-14T11:59:03.091120+0000","last_clean":"2024-09-14T11:59:03.091120+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:59:03.091120+0000","last_undegraded":"2024-09-14T11:59:03.091120+0000","last_fullsized":"2024-09-14T11:59:03.091120+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.090961+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:07.204455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'800","reported_seq":2606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.406681+0000","last_change":"2024-09-14T11:59:15.406681+0000","last_active":"2024-09-14T11:59:15.406681+0000","last_peered":"2024-09-14T11:59:15.406681+0000","last_clean":"2024-09-14T11:59:15.406681+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:59:15.406681+0000","last_undegraded":"2024-09-14T11:59:15.406681+0000","last_fullsized":"2024-09-14T11:59:15.406681+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.406593+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:33.921083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'137","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.322847+0000","last_change":"2024-09-14T11:59:19.322847+0000","last_active":"2024-09-14T11:59:19.322847+0000","last_peered":"2024-09-14T11:59:19.322847+0000","last_clean":"2024-09-14T11:59:19.322847+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:59:19.322847+0000","last_undegraded":"2024-09-14T11:59:19.322847+0000","last_fullsized":"2024-09-14T11:59:19.322847+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.322696+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:24.890324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.283321+0000","last_change":"2024-09-14T11:58:55.283205+0000","last_active":"2024-09-14T11:58:55.283321+0000","last_peered":"2024-09-14T11:58:55.283321+0000","last_clean":"2024-09-14T11:58:55.283321+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:58:55.283321+0000","last_undegraded":"2024-09-14T11:58:55.283321+0000","last_fullsized":"2024-09-14T11:58:55.283321+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.283109+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:51.916150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'358","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.209859+0000","last_change":"2024-09-14T11:58:51.209859+0000","last_active":"2024-09-14T11:58:51.209859+0000","last_peered":"2024-09-14T11:58:51.209859+0000","last_clean":"2024-09-14T11:58:51.209859+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:51.209859+0000","last_undegraded":"2024-09-14T11:58:51.209859+0000","last_fullsized":"2024-09-14T11:58:51.209859+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.209715+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:49.586185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":699,"num_read_kb":30583,"num_write":1068,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.215800+0000","last_change":"2024-09-14T11:58:45.215756+0000","last_active":"2024-09-14T11:58:45.215800+0000","last_peered":"2024-09-14T11:58:45.215800+0000","last_clean":"2024-09-14T11:58:45.215800+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:58:45.215800+0000","last_undegraded":"2024-09-14T11:58:45.215800+0000","last_fullsized":"2024-09-14T11:58:45.215800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.215695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:26.730819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.845801+0000","last_change":"2024-09-14T11:59:05.845748+0000","last_active":"2024-09-14T11:59:05.845801+0000","last_peered":"2024-09-14T11:59:05.845801+0000","last_clean":"2024-09-14T11:59:05.845801+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:59:05.845801+0000","last_undegraded":"2024-09-14T11:59:05.845801+0000","last_fullsized":"2024-09-14T11:59:05.845801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.845663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:31.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'124","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.816674+0000","last_change":"2024-09-14T11:59:09.816611+0000","last_active":"2024-09-14T11:59:09.816674+0000","last_peered":"2024-09-14T11:59:09.816674+0000","last_clean":"2024-09-14T11:59:09.816674+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:59:09.816674+0000","last_undegraded":"2024-09-14T11:59:09.816674+0000","last_fullsized":"2024-09-14T11:59:09.816674+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.816525+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:12.664495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'814","reported_seq":3008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.285037+0000","last_change":"2024-09-14T11:59:18.285037+0000","last_active":"2024-09-14T11:59:18.285037+0000","last_peered":"2024-09-14T11:59:18.285037+0000","last_clean":"2024-09-14T11:59:18.285037+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:59:18.285037+0000","last_undegraded":"2024-09-14T11:59:18.285037+0000","last_fullsized":"2024-09-14T11:59:18.285037+0000","mapping_epoch":33,"log_start":"263'801","ondisk_log_start":"263'801","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.284950+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:39.729906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'293","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.079637+0000","last_change":"2024-09-14T11:59:17.079637+0000","last_active":"2024-09-14T11:59:17.079637+0000","last_peered":"2024-09-14T11:59:17.079637+0000","last_clean":"2024-09-14T11:59:17.079637+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:59:17.079637+0000","last_undegraded":"2024-09-14T11:59:17.079637+0000","last_fullsized":"2024-09-14T11:59:17.079637+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.079557+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.126100+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.756071+0000","last_change":"2024-09-14T11:58:48.756014+0000","last_active":"2024-09-14T11:58:48.756071+0000","last_peered":"2024-09-14T11:58:48.756071+0000","last_clean":"2024-09-14T11:58:48.756071+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:58:48.756071+0000","last_undegraded":"2024-09-14T11:58:48.756071+0000","last_fullsized":"2024-09-14T11:58:48.756071+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.755922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:53.686958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'458","reported_seq":1183,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.129855+0000","last_change":"2024-09-14T11:58:46.129855+0000","last_active":"2024-09-14T11:58:46.129855+0000","last_peered":"2024-09-14T11:58:46.129855+0000","last_clean":"2024-09-14T11:58:46.129855+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:46.129855+0000","last_undegraded":"2024-09-14T11:58:46.129855+0000","last_fullsized":"2024-09-14T11:58:46.129855+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.129767+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:43.560691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1014,"num_read_kb":14136,"num_write":1501,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.707186+0000","last_change":"2024-09-14T11:58:45.707137+0000","last_active":"2024-09-14T11:58:45.707186+0000","last_peered":"2024-09-14T11:58:45.707186+0000","last_clean":"2024-09-14T11:58:45.707186+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:58:45.707186+0000","last_undegraded":"2024-09-14T11:58:45.707186+0000","last_fullsized":"2024-09-14T11:58:45.707186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.707053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.841690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.273723+0000","last_change":"2024-09-14T11:59:01.273664+0000","last_active":"2024-09-14T11:59:01.273723+0000","last_peered":"2024-09-14T11:59:01.273723+0000","last_clean":"2024-09-14T11:59:01.273723+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:59:01.273723+0000","last_undegraded":"2024-09-14T11:59:01.273723+0000","last_fullsized":"2024-09-14T11:59:01.273723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.273570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:42.443452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'782","reported_seq":1508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.198534+0000","last_change":"2024-09-14T11:59:08.198466+0000","last_active":"2024-09-14T11:59:08.198534+0000","last_peered":"2024-09-14T11:59:08.198534+0000","last_clean":"2024-09-14T11:59:08.198534+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:59:08.198534+0000","last_undegraded":"2024-09-14T11:59:08.198534+0000","last_fullsized":"2024-09-14T11:59:08.198534+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.198359+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.340430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1390,"num_read_kb":3483,"num_write":1134,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.233728+0000","last_change":"2024-09-14T11:59:12.233637+0000","last_active":"2024-09-14T11:59:12.233728+0000","last_peered":"2024-09-14T11:59:12.233728+0000","last_clean":"2024-09-14T11:59:12.233728+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:59:12.233728+0000","last_undegraded":"2024-09-14T11:59:12.233728+0000","last_fullsized":"2024-09-14T11:59:12.233728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.233510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:37.460007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'157","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.335827+0000","last_change":"2024-09-14T11:59:18.335827+0000","last_active":"2024-09-14T11:59:18.335827+0000","last_peered":"2024-09-14T11:59:18.335827+0000","last_clean":"2024-09-14T11:59:18.335827+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:59:18.335827+0000","last_undegraded":"2024-09-14T11:59:18.335827+0000","last_fullsized":"2024-09-14T11:59:18.335827+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.335731+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:55.839157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'169","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.122842+0000","last_change":"2024-09-14T11:59:21.122780+0000","last_active":"2024-09-14T11:59:21.122842+0000","last_peered":"2024-09-14T11:59:21.122842+0000","last_clean":"2024-09-14T11:59:21.122842+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:59:21.122842+0000","last_undegraded":"2024-09-14T11:59:21.122842+0000","last_fullsized":"2024-09-14T11:59:21.122842+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'169","last_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_deep_scrub":"263'169","last_deep_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.122685+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:05.175454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1125","reported_seq":2692,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.774053+0000","last_change":"2024-09-14T11:58:53.774053+0000","last_active":"2024-09-14T11:58:53.774053+0000","last_peered":"2024-09-14T11:58:53.774053+0000","last_clean":"2024-09-14T11:58:53.774053+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:58:53.774053+0000","last_undegraded":"2024-09-14T11:58:53.774053+0000","last_fullsized":"2024-09-14T11:58:53.774053+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1125","last_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_deep_scrub":"263'1125","last_deep_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.773964+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:13.075424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'419","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.745556+0000","last_change":"2024-09-14T11:58:47.745556+0000","last_active":"2024-09-14T11:58:47.745556+0000","last_peered":"2024-09-14T11:58:47.745556+0000","last_clean":"2024-09-14T11:58:47.745556+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:47.745556+0000","last_undegraded":"2024-09-14T11:58:47.745556+0000","last_fullsized":"2024-09-14T11:58:47.745556+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.745449+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:44.093108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":639,"num_read_kb":10191,"num_write":1201,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.112762+0000","last_change":"2024-09-14T11:59:00.112762+0000","last_active":"2024-09-14T11:59:00.112762+0000","last_peered":"2024-09-14T11:59:00.112762+0000","last_clean":"2024-09-14T11:59:00.112762+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:59:00.112762+0000","last_undegraded":"2024-09-14T11:59:00.112762+0000","last_fullsized":"2024-09-14T11:59:00.112762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.112668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:16.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'338","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.231431+0000","last_change":"2024-09-14T11:59:09.231431+0000","last_active":"2024-09-14T11:59:09.231431+0000","last_peered":"2024-09-14T11:59:09.231431+0000","last_clean":"2024-09-14T11:59:09.231431+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:59:09.231431+0000","last_undegraded":"2024-09-14T11:59:09.231431+0000","last_fullsized":"2024-09-14T11:59:09.231431+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.231332+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:55.280074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":1418,"num_write":456,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.238818+0000","last_change":"2024-09-14T11:59:21.238818+0000","last_active":"2024-09-14T11:59:21.238818+0000","last_peered":"2024-09-14T11:59:21.238818+0000","last_clean":"2024-09-14T11:59:21.238818+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:59:21.238818+0000","last_undegraded":"2024-09-14T11:59:21.238818+0000","last_fullsized":"2024-09-14T11:59:21.238818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.238721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:05.674834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:07.446920+0000","last_change":"2024-09-14T10:56:49.743510+0000","last_active":"2024-09-14T11:57:07.446920+0000","last_peered":"2024-09-14T11:57:07.446920+0000","last_clean":"2024-09-14T11:57:07.446920+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:57:07.446920+0000","last_undegraded":"2024-09-14T11:57:07.446920+0000","last_fullsized":"2024-09-14T11:57:07.446920+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1059","reported_seq":2876,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.245818+0000","last_change":"2024-09-14T11:58:53.245818+0000","last_active":"2024-09-14T11:58:53.245818+0000","last_peered":"2024-09-14T11:58:53.245818+0000","last_clean":"2024-09-14T11:58:53.245818+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:58:53.245818+0000","last_undegraded":"2024-09-14T11:58:53.245818+0000","last_fullsized":"2024-09-14T11:58:53.245818+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1059","last_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_deep_scrub":"263'1059","last_deep_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.245711+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:12.381249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'438","reported_seq":1123,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.173546+0000","last_change":"2024-09-14T11:58:54.173546+0000","last_active":"2024-09-14T11:58:54.173546+0000","last_peered":"2024-09-14T11:58:54.173546+0000","last_clean":"2024-09-14T11:58:54.173546+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:54.173546+0000","last_undegraded":"2024-09-14T11:58:54.173546+0000","last_fullsized":"2024-09-14T11:58:54.173546+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.173383+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.863811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":832,"num_read_kb":46830,"num_write":1292,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.197160+0000","last_change":"2024-09-14T11:59:06.197160+0000","last_active":"2024-09-14T11:59:06.197160+0000","last_peered":"2024-09-14T11:59:06.197160+0000","last_clean":"2024-09-14T11:59:06.197160+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:59:06.197160+0000","last_undegraded":"2024-09-14T11:59:06.197160+0000","last_fullsized":"2024-09-14T11:59:06.197160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.197073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.229151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":555,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.039824+0000","last_change":"2024-09-14T11:59:03.039824+0000","last_active":"2024-09-14T11:59:03.039824+0000","last_peered":"2024-09-14T11:59:03.039824+0000","last_clean":"2024-09-14T11:59:03.039824+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:59:03.039824+0000","last_undegraded":"2024-09-14T11:59:03.039824+0000","last_fullsized":"2024-09-14T11:59:03.039824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.039699+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:26.320715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.195567+0000","last_change":"2024-09-14T11:59:15.195567+0000","last_active":"2024-09-14T11:59:15.195567+0000","last_peered":"2024-09-14T11:59:15.195567+0000","last_clean":"2024-09-14T11:59:15.195567+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:59:15.195567+0000","last_undegraded":"2024-09-14T11:59:15.195567+0000","last_fullsized":"2024-09-14T11:59:15.195567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.195475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:39.566828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.092260+0000","last_change":"2024-09-14T11:59:20.092198+0000","last_active":"2024-09-14T11:59:20.092260+0000","last_peered":"2024-09-14T11:59:20.092260+0000","last_clean":"2024-09-14T11:59:20.092260+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:59:20.092260+0000","last_undegraded":"2024-09-14T11:59:20.092260+0000","last_fullsized":"2024-09-14T11:59:20.092260+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.092085+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:45.013902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'556","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.329578+0000","last_change":"2024-09-14T11:58:56.329578+0000","last_active":"2024-09-14T11:58:56.329578+0000","last_peered":"2024-09-14T11:58:56.329578+0000","last_clean":"2024-09-14T11:58:56.329578+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:56.329578+0000","last_undegraded":"2024-09-14T11:58:56.329578+0000","last_fullsized":"2024-09-14T11:58:56.329578+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.329487+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:16.173830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'400","reported_seq":1083,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.572237+0000","last_change":"2024-09-14T11:58:47.572237+0000","last_active":"2024-09-14T11:58:47.572237+0000","last_peered":"2024-09-14T11:58:47.572237+0000","last_clean":"2024-09-14T11:58:47.572237+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:47.572237+0000","last_undegraded":"2024-09-14T11:58:47.572237+0000","last_fullsized":"2024-09-14T11:58:47.572237+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.572136+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.322151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":842,"num_read_kb":27462,"num_write":1412,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.154840+0000","last_change":"2024-09-14T11:59:07.154840+0000","last_active":"2024-09-14T11:59:07.154840+0000","last_peered":"2024-09-14T11:59:07.154840+0000","last_clean":"2024-09-14T11:59:07.154840+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:59:07.154840+0000","last_undegraded":"2024-09-14T11:59:07.154840+0000","last_fullsized":"2024-09-14T11:59:07.154840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.154746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:10.308624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'332","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.282815+0000","last_change":"2024-09-14T11:59:14.282815+0000","last_active":"2024-09-14T11:59:14.282815+0000","last_peered":"2024-09-14T11:59:14.282815+0000","last_clean":"2024-09-14T11:59:14.282815+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:59:14.282815+0000","last_undegraded":"2024-09-14T11:59:14.282815+0000","last_fullsized":"2024-09-14T11:59:14.282815+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.282700+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:59.118738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1216,"num_write":428,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.733126+0000","last_change":"2024-09-14T11:59:04.733126+0000","last_active":"2024-09-14T11:59:04.733126+0000","last_peered":"2024-09-14T11:59:04.733126+0000","last_clean":"2024-09-14T11:59:04.733126+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:59:04.733126+0000","last_undegraded":"2024-09-14T11:59:04.733126+0000","last_fullsized":"2024-09-14T11:59:04.733126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.733044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:38.911493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'133","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.229832+0000","last_change":"2024-09-14T11:59:22.229765+0000","last_active":"2024-09-14T11:59:22.229832+0000","last_peered":"2024-09-14T11:59:22.229832+0000","last_clean":"2024-09-14T11:59:22.229832+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:59:22.229832+0000","last_undegraded":"2024-09-14T11:59:22.229832+0000","last_fullsized":"2024-09-14T11:59:22.229832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.229680+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:51.141588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'546","reported_seq":2241,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.288352+0000","last_change":"2024-09-14T11:58:58.288352+0000","last_active":"2024-09-14T11:58:58.288352+0000","last_peered":"2024-09-14T11:58:58.288352+0000","last_clean":"2024-09-14T11:58:58.288352+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:58:58.288352+0000","last_undegraded":"2024-09-14T11:58:58.288352+0000","last_fullsized":"2024-09-14T11:58:58.288352+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'546","last_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_deep_scrub":"263'546","last_deep_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.288260+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:34.628427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'377","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.149039+0000","last_change":"2024-09-14T11:58:44.149039+0000","last_active":"2024-09-14T11:58:44.149039+0000","last_peered":"2024-09-14T11:58:44.149039+0000","last_clean":"2024-09-14T11:58:44.149039+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:44.149039+0000","last_undegraded":"2024-09-14T11:58:44.149039+0000","last_fullsized":"2024-09-14T11:58:44.149039+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.148961+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:02.627312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":41704,"num_write":1258,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.766783+0000","last_change":"2024-09-14T11:58:59.766783+0000","last_active":"2024-09-14T11:58:59.766783+0000","last_peered":"2024-09-14T11:58:59.766783+0000","last_clean":"2024-09-14T11:58:59.766783+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:58:59.766783+0000","last_undegraded":"2024-09-14T11:58:59.766783+0000","last_fullsized":"2024-09-14T11:58:59.766783+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.766639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:45.001749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.186708+0000","last_change":"2024-09-14T11:59:12.186708+0000","last_active":"2024-09-14T11:59:12.186708+0000","last_peered":"2024-09-14T11:59:12.186708+0000","last_clean":"2024-09-14T11:59:12.186708+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:59:12.186708+0000","last_undegraded":"2024-09-14T11:59:12.186708+0000","last_fullsized":"2024-09-14T11:59:12.186708+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'286","last_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_deep_scrub":"263'286","last_deep_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.186612+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:43.838896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1119,"num_write":378,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.021108+0000","last_change":"2024-09-14T11:59:07.021108+0000","last_active":"2024-09-14T11:59:07.021108+0000","last_peered":"2024-09-14T11:59:07.021108+0000","last_clean":"2024-09-14T11:59:07.021108+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:59:07.021108+0000","last_undegraded":"2024-09-14T11:59:07.021108+0000","last_fullsized":"2024-09-14T11:59:07.021108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.021000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:10.337668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'483","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.786147+0000","last_change":"2024-09-14T11:58:55.786085+0000","last_active":"2024-09-14T11:58:55.786147+0000","last_peered":"2024-09-14T11:58:55.786147+0000","last_clean":"2024-09-14T11:58:55.786147+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:58:55.786147+0000","last_undegraded":"2024-09-14T11:58:55.786147+0000","last_fullsized":"2024-09-14T11:58:55.786147+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.786005+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:32.817114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2487,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'309","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.219033+0000","last_change":"2024-09-14T11:58:52.219033+0000","last_active":"2024-09-14T11:58:52.219033+0000","last_peered":"2024-09-14T11:58:52.219033+0000","last_clean":"2024-09-14T11:58:52.219033+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:52.219033+0000","last_undegraded":"2024-09-14T11:58:52.219033+0000","last_fullsized":"2024-09-14T11:58:52.219033+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.218942+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.549674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":570,"num_read_kb":63784,"num_write":891,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.961984+0000","last_change":"2024-09-14T11:58:58.961984+0000","last_active":"2024-09-14T11:58:58.961984+0000","last_peered":"2024-09-14T11:58:58.961984+0000","last_clean":"2024-09-14T11:58:58.961984+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:58.961984+0000","last_undegraded":"2024-09-14T11:58:58.961984+0000","last_fullsized":"2024-09-14T11:58:58.961984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.961880+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:20.687210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'502","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.080424+0000","last_change":"2024-09-14T11:59:06.080362+0000","last_active":"2024-09-14T11:59:06.080424+0000","last_peered":"2024-09-14T11:59:06.080424+0000","last_clean":"2024-09-14T11:59:06.080424+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:59:06.080424+0000","last_undegraded":"2024-09-14T11:59:06.080424+0000","last_fullsized":"2024-09-14T11:59:06.080424+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.080267+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:23.259445+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":902,"num_read_kb":2267,"num_write":774,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.393681+0000","last_change":"2024-09-14T11:59:16.393625+0000","last_active":"2024-09-14T11:59:16.393681+0000","last_peered":"2024-09-14T11:59:16.393681+0000","last_clean":"2024-09-14T11:59:16.393681+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:59:16.393681+0000","last_undegraded":"2024-09-14T11:59:16.393681+0000","last_fullsized":"2024-09-14T11:59:16.393681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.393539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:39.648638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'140","reported_seq":635,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:51.901215+0000","last_change":"2024-09-14T10:56:49.738452+0000","last_active":"2024-09-14T11:56:51.901215+0000","last_peered":"2024-09-14T11:56:51.901215+0000","last_clean":"2024-09-14T11:56:51.901215+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:56:51.901215+0000","last_undegraded":"2024-09-14T11:56:51.901215+0000","last_fullsized":"2024-09-14T11:56:51.901215+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:48.721028+0000","last_clean_scrub_stamp":"2024-09-14T10:56:48.721028+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:08.619720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'457","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.051229+0000","last_change":"2024-09-14T11:58:56.051229+0000","last_active":"2024-09-14T11:58:56.051229+0000","last_peered":"2024-09-14T11:58:56.051229+0000","last_clean":"2024-09-14T11:58:56.051229+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:58:56.051229+0000","last_undegraded":"2024-09-14T11:58:56.051229+0000","last_fullsized":"2024-09-14T11:58:56.051229+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.051133+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:38.593201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.201425+0000","last_change":"2024-09-14T11:58:46.201425+0000","last_active":"2024-09-14T11:58:46.201425+0000","last_peered":"2024-09-14T11:58:46.201425+0000","last_clean":"2024-09-14T11:58:46.201425+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:46.201425+0000","last_undegraded":"2024-09-14T11:58:46.201425+0000","last_fullsized":"2024-09-14T11:58:46.201425+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.201295+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:11.588159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":604,"num_read_kb":50717,"num_write":1053,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.777074+0000","last_change":"2024-09-14T11:59:00.776994+0000","last_active":"2024-09-14T11:59:00.777074+0000","last_peered":"2024-09-14T11:59:00.777074+0000","last_clean":"2024-09-14T11:59:00.777074+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:59:00.777074+0000","last_undegraded":"2024-09-14T11:59:00.777074+0000","last_fullsized":"2024-09-14T11:59:00.777074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.776887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:37.705302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'322","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.209305+0000","last_change":"2024-09-14T11:59:13.209243+0000","last_active":"2024-09-14T11:59:13.209305+0000","last_peered":"2024-09-14T11:59:13.209305+0000","last_clean":"2024-09-14T11:59:13.209305+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:59:13.209305+0000","last_undegraded":"2024-09-14T11:59:13.209305+0000","last_fullsized":"2024-09-14T11:59:13.209305+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.209134+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:29.981909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51994,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":540,"num_read_kb":1196,"num_write":444,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.132697+0000","last_change":"2024-09-14T11:59:10.132626+0000","last_active":"2024-09-14T11:59:10.132697+0000","last_peered":"2024-09-14T11:59:10.132697+0000","last_clean":"2024-09-14T11:59:10.132697+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:59:10.132697+0000","last_undegraded":"2024-09-14T11:59:10.132697+0000","last_fullsized":"2024-09-14T11:59:10.132697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.132530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.624497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'155","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.777821+0000","last_change":"2024-09-14T11:59:09.777821+0000","last_active":"2024-09-14T11:59:09.777821+0000","last_peered":"2024-09-14T11:59:09.777821+0000","last_clean":"2024-09-14T11:59:09.777821+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:59:09.777821+0000","last_undegraded":"2024-09-14T11:59:09.777821+0000","last_fullsized":"2024-09-14T11:59:09.777821+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.777731+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:44.407066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'557","reported_seq":2173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.195787+0000","last_change":"2024-09-14T11:59:03.195720+0000","last_active":"2024-09-14T11:59:03.195787+0000","last_peered":"2024-09-14T11:59:03.195787+0000","last_clean":"2024-09-14T11:59:03.195787+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:59:03.195787+0000","last_undegraded":"2024-09-14T11:59:03.195787+0000","last_fullsized":"2024-09-14T11:59:03.195787+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.195624+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:14.590310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'339","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.715221+0000","last_change":"2024-09-14T11:58:46.715160+0000","last_active":"2024-09-14T11:58:46.715221+0000","last_peered":"2024-09-14T11:58:46.715221+0000","last_clean":"2024-09-14T11:58:46.715221+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:46.715221+0000","last_undegraded":"2024-09-14T11:58:46.715221+0000","last_fullsized":"2024-09-14T11:58:46.715221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.715001+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.562859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":82907,"num_write":1088,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.817803+0000","last_change":"2024-09-14T11:59:08.817719+0000","last_active":"2024-09-14T11:59:08.817803+0000","last_peered":"2024-09-14T11:59:08.817803+0000","last_clean":"2024-09-14T11:59:08.817803+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:59:08.817803+0000","last_undegraded":"2024-09-14T11:59:08.817803+0000","last_fullsized":"2024-09-14T11:59:08.817803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.817631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:04.693866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'311","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.220153+0000","last_change":"2024-09-14T11:59:11.220081+0000","last_active":"2024-09-14T11:59:11.220153+0000","last_peered":"2024-09-14T11:59:11.220153+0000","last_clean":"2024-09-14T11:59:11.220153+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:59:11.220153+0000","last_undegraded":"2024-09-14T11:59:11.220153+0000","last_fullsized":"2024-09-14T11:59:11.220153+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.219995+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:55.442982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1144,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.100004+0000","last_change":"2024-09-14T11:59:07.100004+0000","last_active":"2024-09-14T11:59:07.100004+0000","last_peered":"2024-09-14T11:59:07.100004+0000","last_clean":"2024-09-14T11:59:07.100004+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:59:07.100004+0000","last_undegraded":"2024-09-14T11:59:07.100004+0000","last_fullsized":"2024-09-14T11:59:07.100004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.099923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:57.135245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'171","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.261233+0000","last_change":"2024-09-14T11:59:20.261233+0000","last_active":"2024-09-14T11:59:20.261233+0000","last_peered":"2024-09-14T11:59:20.261233+0000","last_clean":"2024-09-14T11:59:20.261233+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:59:20.261233+0000","last_undegraded":"2024-09-14T11:59:20.261233+0000","last_fullsized":"2024-09-14T11:59:20.261233+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.261131+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:48.354170+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'530","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.149325+0000","last_change":"2024-09-14T11:58:51.149263+0000","last_active":"2024-09-14T11:58:51.149325+0000","last_peered":"2024-09-14T11:58:51.149325+0000","last_clean":"2024-09-14T11:58:51.149325+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:51.149325+0000","last_undegraded":"2024-09-14T11:58:51.149325+0000","last_fullsized":"2024-09-14T11:58:51.149325+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'530","last_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_deep_scrub":"263'530","last_deep_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.149169+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:45.648421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.124810+0000","last_change":"2024-09-14T11:58:48.124725+0000","last_active":"2024-09-14T11:58:48.124810+0000","last_peered":"2024-09-14T11:58:48.124810+0000","last_clean":"2024-09-14T11:58:48.124810+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:48.124810+0000","last_undegraded":"2024-09-14T11:58:48.124810+0000","last_fullsized":"2024-09-14T11:58:48.124810+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.124576+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:36.223458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":42073,"num_write":1144,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.117211+0000","last_change":"2024-09-14T11:59:02.117157+0000","last_active":"2024-09-14T11:59:02.117211+0000","last_peered":"2024-09-14T11:59:02.117211+0000","last_clean":"2024-09-14T11:59:02.117211+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:59:02.117211+0000","last_undegraded":"2024-09-14T11:59:02.117211+0000","last_fullsized":"2024-09-14T11:59:02.117211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.117068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:46.630742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'108","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.745968+0000","last_change":"2024-09-14T11:59:13.745968+0000","last_active":"2024-09-14T11:59:13.745968+0000","last_peered":"2024-09-14T11:59:13.745968+0000","last_clean":"2024-09-14T11:59:13.745968+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:59:13.745968+0000","last_undegraded":"2024-09-14T11:59:13.745968+0000","last_fullsized":"2024-09-14T11:59:13.745968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.745840+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:38.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2688,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'777","reported_seq":4318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.779729+0000","last_change":"2024-09-14T11:59:07.779669+0000","last_active":"2024-09-14T11:59:07.779729+0000","last_peered":"2024-09-14T11:59:07.779729+0000","last_clean":"2024-09-14T11:59:07.779729+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:59:07.779729+0000","last_undegraded":"2024-09-14T11:59:07.779729+0000","last_fullsized":"2024-09-14T11:59:07.779729+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.779585+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:41.418684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.104511+0000","last_change":"2024-09-14T11:59:18.104511+0000","last_active":"2024-09-14T11:59:18.104511+0000","last_peered":"2024-09-14T11:59:18.104511+0000","last_clean":"2024-09-14T11:59:18.104511+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:59:18.104511+0000","last_undegraded":"2024-09-14T11:59:18.104511+0000","last_fullsized":"2024-09-14T11:59:18.104511+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.104432+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:04.905650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'414","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.771567+0000","last_change":"2024-09-14T11:58:56.771503+0000","last_active":"2024-09-14T11:58:56.771567+0000","last_peered":"2024-09-14T11:58:56.771567+0000","last_clean":"2024-09-14T11:58:56.771567+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:58:56.771567+0000","last_undegraded":"2024-09-14T11:58:56.771567+0000","last_fullsized":"2024-09-14T11:58:56.771567+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.771427+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:50.649246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'292","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.632108+0000","last_change":"2024-09-14T11:58:50.632043+0000","last_active":"2024-09-14T11:58:50.632108+0000","last_peered":"2024-09-14T11:58:50.632108+0000","last_clean":"2024-09-14T11:58:50.632108+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:50.632108+0000","last_undegraded":"2024-09-14T11:58:50.632108+0000","last_fullsized":"2024-09-14T11:58:50.632108+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.631922+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:24.620243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":9665,"num_write":976,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.128127+0000","last_change":"2024-09-14T11:59:06.128064+0000","last_active":"2024-09-14T11:59:06.128127+0000","last_peered":"2024-09-14T11:59:06.128127+0000","last_clean":"2024-09-14T11:59:06.128127+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:59:06.128127+0000","last_undegraded":"2024-09-14T11:59:06.128127+0000","last_fullsized":"2024-09-14T11:59:06.128127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.127974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:38.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'328","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.421820+0000","last_change":"2024-09-14T11:59:14.421820+0000","last_active":"2024-09-14T11:59:14.421820+0000","last_peered":"2024-09-14T11:59:14.421820+0000","last_clean":"2024-09-14T11:59:14.421820+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:59:14.421820+0000","last_undegraded":"2024-09-14T11:59:14.421820+0000","last_fullsized":"2024-09-14T11:59:14.421820+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.421721+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.045444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.066601+0000","last_change":"2024-09-14T11:59:10.066601+0000","last_active":"2024-09-14T11:59:10.066601+0000","last_peered":"2024-09-14T11:59:10.066601+0000","last_clean":"2024-09-14T11:59:10.066601+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:59:10.066601+0000","last_undegraded":"2024-09-14T11:59:10.066601+0000","last_fullsized":"2024-09-14T11:59:10.066601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.066508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'127","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.116026+0000","last_change":"2024-09-14T11:59:19.116026+0000","last_active":"2024-09-14T11:59:19.116026+0000","last_peered":"2024-09-14T11:59:19.116026+0000","last_clean":"2024-09-14T11:59:19.116026+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:59:19.116026+0000","last_undegraded":"2024-09-14T11:59:19.116026+0000","last_fullsized":"2024-09-14T11:59:19.116026+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.115921+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.392234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'399","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.798794+0000","last_change":"2024-09-14T11:58:57.798697+0000","last_active":"2024-09-14T11:58:57.798794+0000","last_peered":"2024-09-14T11:58:57.798794+0000","last_clean":"2024-09-14T11:58:57.798794+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:58:57.798794+0000","last_undegraded":"2024-09-14T11:58:57.798794+0000","last_fullsized":"2024-09-14T11:58:57.798794+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.798592+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:10.547579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'329","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.595764+0000","last_change":"2024-09-14T11:58:49.595701+0000","last_active":"2024-09-14T11:58:49.595764+0000","last_peered":"2024-09-14T11:58:49.595764+0000","last_clean":"2024-09-14T11:58:49.595764+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:49.595764+0000","last_undegraded":"2024-09-14T11:58:49.595764+0000","last_fullsized":"2024-09-14T11:58:49.595764+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.595597+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:05.088352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":577,"num_read_kb":29813,"num_write":1080,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.564191+0000","last_change":"2024-09-14T11:59:09.564131+0000","last_active":"2024-09-14T11:59:09.564191+0000","last_peered":"2024-09-14T11:59:09.564191+0000","last_clean":"2024-09-14T11:59:09.564191+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:59:09.564191+0000","last_undegraded":"2024-09-14T11:59:09.564191+0000","last_fullsized":"2024-09-14T11:59:09.564191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.564019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:59.535304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":863,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.080079+0000","last_change":"2024-09-14T11:59:09.080079+0000","last_active":"2024-09-14T11:59:09.080079+0000","last_peered":"2024-09-14T11:59:09.080079+0000","last_clean":"2024-09-14T11:59:09.080079+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:59:09.080079+0000","last_undegraded":"2024-09-14T11:59:09.080079+0000","last_fullsized":"2024-09-14T11:59:09.080079+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.079948+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:36.756322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.775934+0000","last_change":"2024-09-14T11:59:05.775934+0000","last_active":"2024-09-14T11:59:05.775934+0000","last_peered":"2024-09-14T11:59:05.775934+0000","last_clean":"2024-09-14T11:59:05.775934+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:59:05.775934+0000","last_undegraded":"2024-09-14T11:59:05.775934+0000","last_fullsized":"2024-09-14T11:59:05.775934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.775845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:06.480989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'106","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.239465+0000","last_change":"2024-09-14T11:59:22.239465+0000","last_active":"2024-09-14T11:59:22.239465+0000","last_peered":"2024-09-14T11:59:22.239465+0000","last_clean":"2024-09-14T11:59:22.239465+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:59:22.239465+0000","last_undegraded":"2024-09-14T11:59:22.239465+0000","last_fullsized":"2024-09-14T11:59:22.239465+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.239338+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:32.855003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'353","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.647791+0000","last_change":"2024-09-14T11:59:01.647791+0000","last_active":"2024-09-14T11:59:01.647791+0000","last_peered":"2024-09-14T11:59:01.647791+0000","last_clean":"2024-09-14T11:59:01.647791+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:59:01.647791+0000","last_undegraded":"2024-09-14T11:59:01.647791+0000","last_fullsized":"2024-09-14T11:59:01.647791+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.647703+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:52.541769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'405","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.374616+0000","last_change":"2024-09-14T11:58:46.374551+0000","last_active":"2024-09-14T11:58:46.374616+0000","last_peered":"2024-09-14T11:58:46.374616+0000","last_clean":"2024-09-14T11:58:46.374616+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:46.374616+0000","last_undegraded":"2024-09-14T11:58:46.374616+0000","last_fullsized":"2024-09-14T11:58:46.374616+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.374434+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:59.892127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":727,"num_read_kb":11025,"num_write":1267,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.860193+0000","last_change":"2024-09-14T11:59:07.860193+0000","last_active":"2024-09-14T11:59:07.860193+0000","last_peered":"2024-09-14T11:59:07.860193+0000","last_clean":"2024-09-14T11:59:07.860193+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:59:07.860193+0000","last_undegraded":"2024-09-14T11:59:07.860193+0000","last_fullsized":"2024-09-14T11:59:07.860193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.860100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:58.269568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'240","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.311259+0000","last_change":"2024-09-14T11:59:15.311185+0000","last_active":"2024-09-14T11:59:15.311259+0000","last_peered":"2024-09-14T11:59:15.311259+0000","last_clean":"2024-09-14T11:59:15.311259+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:59:15.311259+0000","last_undegraded":"2024-09-14T11:59:15.311259+0000","last_fullsized":"2024-09-14T11:59:15.311259+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.311087+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:06.682204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":992,"num_write":326,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.725892+0000","last_change":"2024-09-14T11:59:17.725830+0000","last_active":"2024-09-14T11:59:17.725892+0000","last_peered":"2024-09-14T11:59:17.725892+0000","last_clean":"2024-09-14T11:59:17.725892+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:59:17.725892+0000","last_undegraded":"2024-09-14T11:59:17.725892+0000","last_fullsized":"2024-09-14T11:59:17.725892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.725743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:34.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'165","reported_seq":1628,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.140772+0000","last_change":"2024-09-14T11:59:21.140772+0000","last_active":"2024-09-14T11:59:21.140772+0000","last_peered":"2024-09-14T11:59:21.140772+0000","last_clean":"2024-09-14T11:59:21.140772+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:59:21.140772+0000","last_undegraded":"2024-09-14T11:59:21.140772+0000","last_fullsized":"2024-09-14T11:59:21.140772+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.140669+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:41.420270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'472","reported_seq":2235,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.777077+0000","last_change":"2024-09-14T11:58:55.777077+0000","last_active":"2024-09-14T11:58:55.777077+0000","last_peered":"2024-09-14T11:58:55.777077+0000","last_clean":"2024-09-14T11:58:55.777077+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:58:55.777077+0000","last_undegraded":"2024-09-14T11:58:55.777077+0000","last_fullsized":"2024-09-14T11:58:55.777077+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'472","last_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_deep_scrub":"263'472","last_deep_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.776981+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:44.267879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2936,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'401","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.196149+0000","last_change":"2024-09-14T11:58:47.196149+0000","last_active":"2024-09-14T11:58:47.196149+0000","last_peered":"2024-09-14T11:58:47.196149+0000","last_clean":"2024-09-14T11:58:47.196149+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:47.196149+0000","last_undegraded":"2024-09-14T11:58:47.196149+0000","last_fullsized":"2024-09-14T11:58:47.196149+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.196028+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:09.718768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":747,"num_read_kb":46945,"num_write":1297,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.080514+0000","last_change":"2024-09-14T11:59:01.080514+0000","last_active":"2024-09-14T11:59:01.080514+0000","last_peered":"2024-09-14T11:59:01.080514+0000","last_clean":"2024-09-14T11:59:01.080514+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:59:01.080514+0000","last_undegraded":"2024-09-14T11:59:01.080514+0000","last_fullsized":"2024-09-14T11:59:01.080514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.080425+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:41.322185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'305","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.789404+0000","last_change":"2024-09-14T11:59:12.789300+0000","last_active":"2024-09-14T11:59:12.789404+0000","last_peered":"2024-09-14T11:59:12.789404+0000","last_clean":"2024-09-14T11:59:12.789404+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:59:12.789404+0000","last_undegraded":"2024-09-14T11:59:12.789404+0000","last_fullsized":"2024-09-14T11:59:12.789404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.789182+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:43.211846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1073,"num_write":380,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.117611+0000","last_change":"2024-09-14T11:59:14.117549+0000","last_active":"2024-09-14T11:59:14.117611+0000","last_peered":"2024-09-14T11:59:14.117611+0000","last_clean":"2024-09-14T11:59:14.117611+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:59:14.117611+0000","last_undegraded":"2024-09-14T11:59:14.117611+0000","last_fullsized":"2024-09-14T11:59:14.117611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.117458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:26.797657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'137","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.714249+0000","last_change":"2024-09-14T11:59:16.714249+0000","last_active":"2024-09-14T11:59:16.714249+0000","last_peered":"2024-09-14T11:59:16.714249+0000","last_clean":"2024-09-14T11:59:16.714249+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:59:16.714249+0000","last_undegraded":"2024-09-14T11:59:16.714249+0000","last_fullsized":"2024-09-14T11:59:16.714249+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.714152+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:50.948493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'586","reported_seq":2265,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.175638+0000","last_change":"2024-09-14T11:58:56.175638+0000","last_active":"2024-09-14T11:58:56.175638+0000","last_peered":"2024-09-14T11:58:56.175638+0000","last_clean":"2024-09-14T11:58:56.175638+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:58:56.175638+0000","last_undegraded":"2024-09-14T11:58:56.175638+0000","last_fullsized":"2024-09-14T11:58:56.175638+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'586","last_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_deep_scrub":"263'586","last_deep_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.175551+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:06.302948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'351","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.760102+0000","last_change":"2024-09-14T11:58:49.760006+0000","last_active":"2024-09-14T11:58:49.760102+0000","last_peered":"2024-09-14T11:58:49.760102+0000","last_clean":"2024-09-14T11:58:49.760102+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:49.760102+0000","last_undegraded":"2024-09-14T11:58:49.760102+0000","last_fullsized":"2024-09-14T11:58:49.760102+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.759805+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:27.741535+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":646,"num_read_kb":60949,"num_write":1082,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1054","reported_seq":2943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.153320+0000","last_change":"2024-09-14T11:58:58.153320+0000","last_active":"2024-09-14T11:58:58.153320+0000","last_peered":"2024-09-14T11:58:58.153320+0000","last_clean":"2024-09-14T11:58:58.153320+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:58:58.153320+0000","last_undegraded":"2024-09-14T11:58:58.153320+0000","last_fullsized":"2024-09-14T11:58:58.153320+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1054","last_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_deep_scrub":"263'1054","last_deep_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.153235+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":1000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:25.111446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3040,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'359","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.165462+0000","last_change":"2024-09-14T11:58:46.165361+0000","last_active":"2024-09-14T11:58:46.165462+0000","last_peered":"2024-09-14T11:58:46.165462+0000","last_clean":"2024-09-14T11:58:46.165462+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:46.165462+0000","last_undegraded":"2024-09-14T11:58:46.165462+0000","last_fullsized":"2024-09-14T11:58:46.165462+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.165246+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.126478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":22760,"num_write":1134,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1000","reported_seq":2622,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.625634+0000","last_change":"2024-09-14T11:59:00.625634+0000","last_active":"2024-09-14T11:59:00.625634+0000","last_peered":"2024-09-14T11:59:00.625634+0000","last_clean":"2024-09-14T11:59:00.625634+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:59:00.625634+0000","last_undegraded":"2024-09-14T11:59:00.625634+0000","last_fullsized":"2024-09-14T11:59:00.625634+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1000","last_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_deep_scrub":"263'1000","last_deep_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.625532+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.706881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'338","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.660072+0000","last_change":"2024-09-14T11:58:51.659978+0000","last_active":"2024-09-14T11:58:51.660072+0000","last_peered":"2024-09-14T11:58:51.660072+0000","last_clean":"2024-09-14T11:58:51.660072+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:51.660072+0000","last_undegraded":"2024-09-14T11:58:51.660072+0000","last_fullsized":"2024-09-14T11:58:51.660072+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.659787+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:18.224027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":988,"num_read_kb":42151,"num_write":1083,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'861","reported_seq":2451,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.135043+0000","last_change":"2024-09-14T11:58:57.135043+0000","last_active":"2024-09-14T11:58:57.135043+0000","last_peered":"2024-09-14T11:58:57.135043+0000","last_clean":"2024-09-14T11:58:57.135043+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:58:57.135043+0000","last_undegraded":"2024-09-14T11:58:57.135043+0000","last_fullsized":"2024-09-14T11:58:57.135043+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'861","last_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_deep_scrub":"263'861","last_deep_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.134958+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.253599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.137502+0000","last_change":"2024-09-14T11:58:50.137399+0000","last_active":"2024-09-14T11:58:50.137502+0000","last_peered":"2024-09-14T11:58:50.137502+0000","last_clean":"2024-09-14T11:58:50.137502+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:50.137502+0000","last_undegraded":"2024-09-14T11:58:50.137502+0000","last_fullsized":"2024-09-14T11:58:50.137502+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.137192+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:56.624534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":875,"num_read_kb":14120,"num_write":1246,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1638","reported_seq":3366,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.242786+0000","last_change":"2024-09-14T11:59:02.242786+0000","last_active":"2024-09-14T11:59:02.242786+0000","last_peered":"2024-09-14T11:59:02.242786+0000","last_clean":"2024-09-14T11:59:02.242786+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:59:02.242786+0000","last_undegraded":"2024-09-14T11:59:02.242786+0000","last_fullsized":"2024-09-14T11:59:02.242786+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1638","last_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_deep_scrub":"263'1638","last_deep_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.242676+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":1600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:30.360125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'410","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.363150+0000","last_change":"2024-09-14T11:58:47.363150+0000","last_active":"2024-09-14T11:58:47.363150+0000","last_peered":"2024-09-14T11:58:47.363150+0000","last_clean":"2024-09-14T11:58:47.363150+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:47.363150+0000","last_undegraded":"2024-09-14T11:58:47.363150+0000","last_fullsized":"2024-09-14T11:58:47.363150+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.363039+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:01.895164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":770,"num_read_kb":3391,"num_write":1187,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'527","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.787198+0000","last_change":"2024-09-14T11:59:02.787143+0000","last_active":"2024-09-14T11:59:02.787198+0000","last_peered":"2024-09-14T11:59:02.787198+0000","last_clean":"2024-09-14T11:59:02.787198+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:59:02.787198+0000","last_undegraded":"2024-09-14T11:59:02.787198+0000","last_fullsized":"2024-09-14T11:59:02.787198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.787058+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:30.375500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'413","reported_seq":1160,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.188393+0000","last_change":"2024-09-14T11:58:47.188393+0000","last_active":"2024-09-14T11:58:47.188393+0000","last_peered":"2024-09-14T11:58:47.188393+0000","last_clean":"2024-09-14T11:58:47.188393+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:47.188393+0000","last_undegraded":"2024-09-14T11:58:47.188393+0000","last_fullsized":"2024-09-14T11:58:47.188393+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.188302+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:16.690313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1077,"num_read_kb":5071,"num_write":1242,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'776","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.236909+0000","last_change":"2024-09-14T11:59:00.236838+0000","last_active":"2024-09-14T11:59:00.236909+0000","last_peered":"2024-09-14T11:59:00.236909+0000","last_clean":"2024-09-14T11:59:00.236909+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:59:00.236909+0000","last_undegraded":"2024-09-14T11:59:00.236909+0000","last_fullsized":"2024-09-14T11:59:00.236909+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.236741+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:54.394852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'362","reported_seq":1001,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.715807+0000","last_change":"2024-09-14T11:58:48.715807+0000","last_active":"2024-09-14T11:58:48.715807+0000","last_peered":"2024-09-14T11:58:48.715807+0000","last_clean":"2024-09-14T11:58:48.715807+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:48.715807+0000","last_undegraded":"2024-09-14T11:58:48.715807+0000","last_fullsized":"2024-09-14T11:58:48.715807+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.715659+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:22.302518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":6911,"num_write":1146,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'416","reported_seq":1956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.754902+0000","last_change":"2024-09-14T11:58:54.754848+0000","last_active":"2024-09-14T11:58:54.754902+0000","last_peered":"2024-09-14T11:58:54.754902+0000","last_clean":"2024-09-14T11:58:54.754902+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:54.754902+0000","last_undegraded":"2024-09-14T11:58:54.754902+0000","last_fullsized":"2024-09-14T11:58:54.754902+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.754764+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:57.847444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'437","reported_seq":1305,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.244256+0000","last_change":"2024-09-14T11:58:53.244256+0000","last_active":"2024-09-14T11:58:53.244256+0000","last_peered":"2024-09-14T11:58:53.244256+0000","last_clean":"2024-09-14T11:58:53.244256+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:53.244256+0000","last_undegraded":"2024-09-14T11:58:53.244256+0000","last_fullsized":"2024-09-14T11:58:53.244256+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.244161+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.178653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1316,"num_read_kb":48095,"num_write":1372,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'719","reported_seq":2057,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.085584+0000","last_change":"2024-09-14T11:59:13.085584+0000","last_active":"2024-09-14T11:59:13.085584+0000","last_peered":"2024-09-14T11:59:13.085584+0000","last_clean":"2024-09-14T11:59:13.085584+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:59:13.085584+0000","last_undegraded":"2024-09-14T11:59:13.085584+0000","last_fullsized":"2024-09-14T11:59:13.085584+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'719","last_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_deep_scrub":"263'719","last_deep_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.085497+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:04.036153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'420","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700278+0000","last_change":"2024-09-14T11:58:52.700278+0000","last_active":"2024-09-14T11:58:52.700278+0000","last_peered":"2024-09-14T11:58:52.700278+0000","last_clean":"2024-09-14T11:58:52.700278+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:52.700278+0000","last_undegraded":"2024-09-14T11:58:52.700278+0000","last_fullsized":"2024-09-14T11:58:52.700278+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'420","last_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_deep_scrub":"263'420","last_deep_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700176+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:03.862543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":12822,"num_write":1366,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'499","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.764942+0000","last_change":"2024-09-14T11:59:00.764942+0000","last_active":"2024-09-14T11:59:00.764942+0000","last_peered":"2024-09-14T11:59:00.764942+0000","last_clean":"2024-09-14T11:59:00.764942+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:59:00.764942+0000","last_undegraded":"2024-09-14T11:59:00.764942+0000","last_fullsized":"2024-09-14T11:59:00.764942+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.764847+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:24.807051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'451","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.271709+0000","last_change":"2024-09-14T11:58:49.271709+0000","last_active":"2024-09-14T11:58:49.271709+0000","last_peered":"2024-09-14T11:58:49.271709+0000","last_clean":"2024-09-14T11:58:49.271709+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:49.271709+0000","last_undegraded":"2024-09-14T11:58:49.271709+0000","last_fullsized":"2024-09-14T11:58:49.271709+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.271605+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:36.880499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1544,"num_read_kb":34981,"num_write":1381,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1165","reported_seq":2733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.151543+0000","last_change":"2024-09-14T11:58:49.151543+0000","last_active":"2024-09-14T11:58:49.151543+0000","last_peered":"2024-09-14T11:58:49.151543+0000","last_clean":"2024-09-14T11:58:49.151543+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:58:49.151543+0000","last_undegraded":"2024-09-14T11:58:49.151543+0000","last_fullsized":"2024-09-14T11:58:49.151543+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1165","last_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_deep_scrub":"263'1165","last_deep_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.151466+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:18.332268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'313","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.736359+0000","last_change":"2024-09-14T11:58:53.736359+0000","last_active":"2024-09-14T11:58:53.736359+0000","last_peered":"2024-09-14T11:58:53.736359+0000","last_clean":"2024-09-14T11:58:53.736359+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:53.736359+0000","last_undegraded":"2024-09-14T11:58:53.736359+0000","last_fullsized":"2024-09-14T11:58:53.736359+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.736196+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:44.006375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":3420,"num_write":993,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'622","reported_seq":2444,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.810902+0000","last_change":"2024-09-14T11:58:58.810902+0000","last_active":"2024-09-14T11:58:58.810902+0000","last_peered":"2024-09-14T11:58:58.810902+0000","last_clean":"2024-09-14T11:58:58.810902+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:58:58.810902+0000","last_undegraded":"2024-09-14T11:58:58.810902+0000","last_fullsized":"2024-09-14T11:58:58.810902+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.810813+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:28.032812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2730,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'341","reported_seq":993,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.055033+0000","last_change":"2024-09-14T11:58:52.055033+0000","last_active":"2024-09-14T11:58:52.055033+0000","last_peered":"2024-09-14T11:58:52.055033+0000","last_clean":"2024-09-14T11:58:52.055033+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:52.055033+0000","last_undegraded":"2024-09-14T11:58:52.055033+0000","last_fullsized":"2024-09-14T11:58:52.055033+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.054914+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:01.336250+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":7722,"num_write":1033,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1677","reported_seq":3385,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.173696+0000","last_change":"2024-09-14T11:59:00.173696+0000","last_active":"2024-09-14T11:59:00.173696+0000","last_peered":"2024-09-14T11:59:00.173696+0000","last_clean":"2024-09-14T11:59:00.173696+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:59:00.173696+0000","last_undegraded":"2024-09-14T11:59:00.173696+0000","last_fullsized":"2024-09-14T11:59:00.173696+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1677","last_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_deep_scrub":"263'1677","last_deep_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.173612+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":1600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:07.415310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'359","reported_seq":1104,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.766923+0000","last_change":"2024-09-14T11:58:50.766923+0000","last_active":"2024-09-14T11:58:50.766923+0000","last_peered":"2024-09-14T11:58:50.766923+0000","last_clean":"2024-09-14T11:58:50.766923+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:50.766923+0000","last_undegraded":"2024-09-14T11:58:50.766923+0000","last_fullsized":"2024-09-14T11:58:50.766923+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.766799+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:21.140749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":21069,"num_write":1116,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'704","reported_seq":2120,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.036175+0000","last_change":"2024-09-14T11:58:54.036175+0000","last_active":"2024-09-14T11:58:54.036175+0000","last_peered":"2024-09-14T11:58:54.036175+0000","last_clean":"2024-09-14T11:58:54.036175+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:58:54.036175+0000","last_undegraded":"2024-09-14T11:58:54.036175+0000","last_fullsized":"2024-09-14T11:58:54.036175+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'704","last_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_deep_scrub":"263'704","last_deep_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.036089+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.473534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'327","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.208361+0000","last_change":"2024-09-14T11:58:55.208361+0000","last_active":"2024-09-14T11:58:55.208361+0000","last_peered":"2024-09-14T11:58:55.208361+0000","last_clean":"2024-09-14T11:58:55.208361+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:55.208361+0000","last_undegraded":"2024-09-14T11:58:55.208361+0000","last_fullsized":"2024-09-14T11:58:55.208361+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.208243+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:46.410805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":36238,"num_write":1055,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'410","reported_seq":1911,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.214583+0000","last_change":"2024-09-14T11:59:05.214583+0000","last_active":"2024-09-14T11:59:05.214583+0000","last_peered":"2024-09-14T11:59:05.214583+0000","last_clean":"2024-09-14T11:59:05.214583+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:59:05.214583+0000","last_undegraded":"2024-09-14T11:59:05.214583+0000","last_fullsized":"2024-09-14T11:59:05.214583+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.214496+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:43.529192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'371","reported_seq":1109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.189295+0000","last_change":"2024-09-14T11:58:48.189295+0000","last_active":"2024-09-14T11:58:48.189295+0000","last_peered":"2024-09-14T11:58:48.189295+0000","last_clean":"2024-09-14T11:58:48.189295+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:48.189295+0000","last_undegraded":"2024-09-14T11:58:48.189295+0000","last_fullsized":"2024-09-14T11:58:48.189295+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.189198+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:51.338474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":882,"num_read_kb":32736,"num_write":1182,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'728","reported_seq":2263,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.188459+0000","last_change":"2024-09-14T11:58:59.188459+0000","last_active":"2024-09-14T11:58:59.188459+0000","last_peered":"2024-09-14T11:58:59.188459+0000","last_clean":"2024-09-14T11:58:59.188459+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:58:59.188459+0000","last_undegraded":"2024-09-14T11:58:59.188459+0000","last_fullsized":"2024-09-14T11:58:59.188459+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.188347+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:48.449081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'355","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.698436+0000","last_change":"2024-09-14T11:58:54.698436+0000","last_active":"2024-09-14T11:58:54.698436+0000","last_peered":"2024-09-14T11:58:54.698436+0000","last_clean":"2024-09-14T11:58:54.698436+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:54.698436+0000","last_undegraded":"2024-09-14T11:58:54.698436+0000","last_fullsized":"2024-09-14T11:58:54.698436+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.698288+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:08.401763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":35326,"num_write":1083,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'299","reported_seq":902,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.679499+0000","last_change":"2024-09-14T11:58:55.679499+0000","last_active":"2024-09-14T11:58:55.679499+0000","last_peered":"2024-09-14T11:58:55.679499+0000","last_clean":"2024-09-14T11:58:55.679499+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:55.679499+0000","last_undegraded":"2024-09-14T11:58:55.679499+0000","last_fullsized":"2024-09-14T11:58:55.679499+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.679380+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:45.132704+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":8144,"num_write":967,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'850","reported_seq":2549,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.088830+0000","last_change":"2024-09-14T11:59:12.088830+0000","last_active":"2024-09-14T11:59:12.088830+0000","last_peered":"2024-09-14T11:59:12.088830+0000","last_clean":"2024-09-14T11:59:12.088830+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:59:12.088830+0000","last_undegraded":"2024-09-14T11:59:12.088830+0000","last_fullsized":"2024-09-14T11:59:12.088830+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'850","last_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_deep_scrub":"263'850","last_deep_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.088731+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:07.995815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'398","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.117031+0000","last_change":"2024-09-14T11:58:49.117031+0000","last_active":"2024-09-14T11:58:49.117031+0000","last_peered":"2024-09-14T11:58:49.117031+0000","last_clean":"2024-09-14T11:58:49.117031+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:49.117031+0000","last_undegraded":"2024-09-14T11:58:49.117031+0000","last_fullsized":"2024-09-14T11:58:49.117031+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.116906+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:11.076523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":40288,"num_write":1313,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'392","reported_seq":2007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.625263+0000","last_change":"2024-09-14T11:59:03.625263+0000","last_active":"2024-09-14T11:59:03.625263+0000","last_peered":"2024-09-14T11:59:03.625263+0000","last_clean":"2024-09-14T11:59:03.625263+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:59:03.625263+0000","last_undegraded":"2024-09-14T11:59:03.625263+0000","last_fullsized":"2024-09-14T11:59:03.625263+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.625149+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:36.235567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1880,"ondisk_log_size":1880,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":505,"ondisk_log_size":505,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1660817,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18638,"num_read_kb":39748,"num_write":15595,"num_write_kb":12041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702580,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35737,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3751,"ondisk_log_size":3751,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":43145697,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44629,"num_read_kb":1932119,"num_write":73662,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59392000,"data_stored":59392000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3707,"ondisk_log_size":3707,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":187491,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":178270,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510203,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296288,"kb_used_data":12432,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075552,"statfs":{"total":96636764160,"available":96333365248,"internally_reserved":0,"allocated":12730368,"data_stored":10789257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510200,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130676,"kb_used_data":13412,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94241164,"statfs":{"total":96636764160,"available":96502951936,"internally_reserved":0,"allocated":13733888,"data_stored":11812366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542902,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313544,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94058296,"statfs":{"total":96636764160,"available":96315695104,"internally_reserved":0,"allocated":11919360,"data_stored":9919858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542905,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176908,"kb_used_data":11132,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194932,"statfs":{"total":96636764160,"available":96455610368,"internally_reserved":0,"allocated":11399168,"data_stored":9381666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542903,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301348,"kb_used_data":9172,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94070492,"statfs":{"total":96636764160,"available":96328183808,"internally_reserved":0,"allocated":9392128,"data_stored":7423434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542907,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121572,"kb_used_data":5716,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94250268,"statfs":{"total":96636764160,"available":96512274432,"internally_reserved":0,"allocated":5853184,"data_stored":3932499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542904,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188836,"kb_used_data":13332,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94183004,"statfs":{"total":96636764160,"available":96443396096,"internally_reserved":0,"allocated":13651968,"data_stored":11690363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542903,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285244,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94086596,"statfs":{"total":96636764160,"available":96344674304,"internally_reserved":0,"allocated":15642624,"data_stored":13655531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5169152,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":9560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":7127040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8536064,"data_stored":8536064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7073792,"data_stored":7073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:27.056 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.057 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.058 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.059 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.060 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.061 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.062 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.063 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.064 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:12:38.127450+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=12, tm_sec=38, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:15:21.342236+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=21, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.065 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.066 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:15:24.360995+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=15, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.066 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.067 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.068 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:56:48.721028+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:27.069 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:59:47.069 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:59:47.423 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T11:59:47.438 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T11:59:47.440 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2157,"stamp":"2024-09-14T11:59:45.922604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45414219,"num_objects":743,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":312784,"num_read_kb":2565821,"num_write":166013,"num_write_kb":2614752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":741956,"num_omap_keys":1793,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13279,"ondisk_log_size":13279,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1814416,"kb_used_data":92112,"kb_used_omap":12,"kb_used_meta":1722163,"kb_avail":753160304,"statfs":{"total":773094113280,"available":771236151296,"internally_reserved":0,"allocated":94322688,"data_stored":78604974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1763495472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":564,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006338"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.185656+0000","last_change":"2024-09-14T11:59:33.185591+0000","last_active":"2024-09-14T11:59:33.185656+0000","last_peered":"2024-09-14T11:59:33.185656+0000","last_clean":"2024-09-14T11:59:33.185656+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:59:33.185656+0000","last_undegraded":"2024-09-14T11:59:33.185656+0000","last_fullsized":"2024-09-14T11:59:33.185656+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.185507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.185507+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.185507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:53.897191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.134775+0000","last_change":"2024-09-14T11:59:30.134775+0000","last_active":"2024-09-14T11:59:30.134775+0000","last_peered":"2024-09-14T11:59:30.134775+0000","last_clean":"2024-09-14T11:59:30.134775+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:59:30.134775+0000","last_undegraded":"2024-09-14T11:59:30.134775+0000","last_fullsized":"2024-09-14T11:59:30.134775+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:30.134653+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:30.134653+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.134653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:35.686820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13318,"num_write":14,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.326926+0000","last_change":"2024-09-14T11:59:32.326926+0000","last_active":"2024-09-14T11:59:32.326926+0000","last_peered":"2024-09-14T11:59:32.326926+0000","last_clean":"2024-09-14T11:59:32.326926+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:59:32.326926+0000","last_undegraded":"2024-09-14T11:59:32.326926+0000","last_fullsized":"2024-09-14T11:59:32.326926+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:32.326836+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:32.326836+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.326836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:45.835770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.008316+0000","last_change":"2024-09-14T11:59:28.008316+0000","last_active":"2024-09-14T11:59:28.008316+0000","last_peered":"2024-09-14T11:59:28.008316+0000","last_clean":"2024-09-14T11:59:28.008316+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:59:28.008316+0000","last_undegraded":"2024-09-14T11:59:28.008316+0000","last_fullsized":"2024-09-14T11:59:28.008316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T11:59:28.008222+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T11:59:28.008222+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.008222+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:23.688179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.133068+0000","last_change":"2024-09-14T11:59:13.133003+0000","last_active":"2024-09-14T11:59:13.133068+0000","last_peered":"2024-09-14T11:59:13.133068+0000","last_clean":"2024-09-14T11:59:13.133068+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:59:13.133068+0000","last_undegraded":"2024-09-14T11:59:13.133068+0000","last_fullsized":"2024-09-14T11:59:13.133068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.132915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:41.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.753213+0000","last_change":"2024-09-14T11:59:33.753213+0000","last_active":"2024-09-14T11:59:33.753213+0000","last_peered":"2024-09-14T11:59:33.753213+0000","last_clean":"2024-09-14T11:59:33.753213+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:59:33.753213+0000","last_undegraded":"2024-09-14T11:59:33.753213+0000","last_fullsized":"2024-09-14T11:59:33.753213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:59:33.753081+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:59:33.753081+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.753081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.972004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.984429+0000","last_change":"2024-09-14T11:59:17.984429+0000","last_active":"2024-09-14T11:59:17.984429+0000","last_peered":"2024-09-14T11:59:17.984429+0000","last_clean":"2024-09-14T11:59:17.984429+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:59:17.984429+0000","last_undegraded":"2024-09-14T11:59:17.984429+0000","last_fullsized":"2024-09-14T11:59:17.984429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.984338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:16.588236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.059073+0000","last_change":"2024-09-14T11:59:03.059073+0000","last_active":"2024-09-14T11:59:03.059073+0000","last_peered":"2024-09-14T11:59:03.059073+0000","last_clean":"2024-09-14T11:59:03.059073+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:59:03.059073+0000","last_undegraded":"2024-09-14T11:59:03.059073+0000","last_fullsized":"2024-09-14T11:59:03.059073+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.058984+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:45.926589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.734191+0000","last_change":"2024-09-14T11:59:22.734191+0000","last_active":"2024-09-14T11:59:22.734191+0000","last_peered":"2024-09-14T11:59:22.734191+0000","last_clean":"2024-09-14T11:59:22.734191+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:59:22.734191+0000","last_undegraded":"2024-09-14T11:59:22.734191+0000","last_fullsized":"2024-09-14T11:59:22.734191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.734105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.515792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.075059+0000","last_change":"2024-09-14T11:59:35.075059+0000","last_active":"2024-09-14T11:59:35.075059+0000","last_peered":"2024-09-14T11:59:35.075059+0000","last_clean":"2024-09-14T11:59:35.075059+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:59:35.075059+0000","last_undegraded":"2024-09-14T11:59:35.075059+0000","last_fullsized":"2024-09-14T11:59:35.075059+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.074968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.074968+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.074968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:09.049293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.163641+0000","last_change":"2024-09-14T11:59:09.163519+0000","last_active":"2024-09-14T11:59:09.163641+0000","last_peered":"2024-09-14T11:59:09.163641+0000","last_clean":"2024-09-14T11:59:09.163641+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:59:09.163641+0000","last_undegraded":"2024-09-14T11:59:09.163641+0000","last_fullsized":"2024-09-14T11:59:09.163641+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.163385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:01.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.021878+0000","last_change":"2024-09-14T11:59:27.021878+0000","last_active":"2024-09-14T11:59:27.021878+0000","last_peered":"2024-09-14T11:59:27.021878+0000","last_clean":"2024-09-14T11:59:27.021878+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:59:27.021878+0000","last_undegraded":"2024-09-14T11:59:27.021878+0000","last_fullsized":"2024-09-14T11:59:27.021878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:59:27.021785+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:59:27.021785+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.021785+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:09.411815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:27.441434+0000","last_change":"2024-09-14T11:32:11.438991+0000","last_active":"2024-09-14T11:56:27.441434+0000","last_peered":"2024-09-14T11:56:27.441434+0000","last_clean":"2024-09-14T11:56:27.441434+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:56:27.441434+0000","last_undegraded":"2024-09-14T11:56:27.441434+0000","last_fullsized":"2024-09-14T11:56:27.441434+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.314440+0000","last_change":"2024-09-14T11:59:41.314440+0000","last_active":"2024-09-14T11:59:41.314440+0000","last_peered":"2024-09-14T11:59:41.314440+0000","last_clean":"2024-09-14T11:59:41.314440+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:59:41.314440+0000","last_undegraded":"2024-09-14T11:59:41.314440+0000","last_fullsized":"2024-09-14T11:59:41.314440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:59:41.314330+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:59:41.314330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.314330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:00.859570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.778984+0000","last_change":"2024-09-14T11:59:27.778984+0000","last_active":"2024-09-14T11:59:27.778984+0000","last_peered":"2024-09-14T11:59:27.778984+0000","last_clean":"2024-09-14T11:59:27.778984+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:59:27.778984+0000","last_undegraded":"2024-09-14T11:59:27.778984+0000","last_fullsized":"2024-09-14T11:59:27.778984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:27.778889+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:27.778889+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.778889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:19.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.339700+0000","last_change":"2024-09-14T11:59:31.339700+0000","last_active":"2024-09-14T11:59:31.339700+0000","last_peered":"2024-09-14T11:59:31.339700+0000","last_clean":"2024-09-14T11:59:31.339700+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:59:31.339700+0000","last_undegraded":"2024-09-14T11:59:31.339700+0000","last_fullsized":"2024-09-14T11:59:31.339700+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:59:31.339612+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:59:31.339612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.339612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:44.420355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":26,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:12.664415+0000","last_change":"2024-09-14T11:32:11.442161+0000","last_active":"2024-09-14T11:56:12.664415+0000","last_peered":"2024-09-14T11:56:12.664415+0000","last_clean":"2024-09-14T11:56:12.664415+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:56:12.664415+0000","last_undegraded":"2024-09-14T11:56:12.664415+0000","last_fullsized":"2024-09-14T11:56:12.664415+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:25.888924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.167041+0000","last_change":"2024-09-14T11:59:29.167041+0000","last_active":"2024-09-14T11:59:29.167041+0000","last_peered":"2024-09-14T11:59:29.167041+0000","last_clean":"2024-09-14T11:59:29.167041+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:59:29.167041+0000","last_undegraded":"2024-09-14T11:59:29.167041+0000","last_fullsized":"2024-09-14T11:59:29.167041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:29.166921+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.166921+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.166921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:58.981878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.067598+0000","last_change":"2024-09-14T11:59:34.067598+0000","last_active":"2024-09-14T11:59:34.067598+0000","last_peered":"2024-09-14T11:59:34.067598+0000","last_clean":"2024-09-14T11:59:34.067598+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:59:34.067598+0000","last_undegraded":"2024-09-14T11:59:34.067598+0000","last_fullsized":"2024-09-14T11:59:34.067598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:59:34.067493+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:59:34.067493+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.067493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:37.418505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.367059+0000","last_change":"2024-09-14T11:59:30.367059+0000","last_active":"2024-09-14T11:59:30.367059+0000","last_peered":"2024-09-14T11:59:30.367059+0000","last_clean":"2024-09-14T11:59:30.367059+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:59:30.367059+0000","last_undegraded":"2024-09-14T11:59:30.367059+0000","last_fullsized":"2024-09-14T11:59:30.367059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'10","last_scrub_stamp":"2024-09-14T11:59:30.366965+0000","last_deep_scrub":"258'10","last_deep_scrub_stamp":"2024-09-14T11:59:30.366965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.366965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.323487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.923408+0000","last_change":"2024-09-14T11:59:22.923408+0000","last_active":"2024-09-14T11:59:22.923408+0000","last_peered":"2024-09-14T11:59:22.923408+0000","last_clean":"2024-09-14T11:59:22.923408+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:59:22.923408+0000","last_undegraded":"2024-09-14T11:59:22.923408+0000","last_fullsized":"2024-09-14T11:59:22.923408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.923308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.923308+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.923308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:16.187316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.791580+0000","last_change":"2024-09-14T11:59:19.791580+0000","last_active":"2024-09-14T11:59:19.791580+0000","last_peered":"2024-09-14T11:59:19.791580+0000","last_clean":"2024-09-14T11:59:19.791580+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:59:19.791580+0000","last_undegraded":"2024-09-14T11:59:19.791580+0000","last_fullsized":"2024-09-14T11:59:19.791580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.791500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:50.852626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10232,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.794389+0000","last_change":"2024-09-14T11:59:25.794389+0000","last_active":"2024-09-14T11:59:25.794389+0000","last_peered":"2024-09-14T11:59:25.794389+0000","last_clean":"2024-09-14T11:59:25.794389+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:59:25.794389+0000","last_undegraded":"2024-09-14T11:59:25.794389+0000","last_fullsized":"2024-09-14T11:59:25.794389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:25.794299+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:25.794299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.794299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.495288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.735183+0000","last_change":"2024-09-14T11:59:14.735183+0000","last_active":"2024-09-14T11:59:14.735183+0000","last_peered":"2024-09-14T11:59:14.735183+0000","last_clean":"2024-09-14T11:59:14.735183+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:59:14.735183+0000","last_undegraded":"2024-09-14T11:59:14.735183+0000","last_fullsized":"2024-09-14T11:59:14.735183+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.735096+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:36.716450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.078128+0000","last_change":"2024-09-14T11:59:41.078066+0000","last_active":"2024-09-14T11:59:41.078128+0000","last_peered":"2024-09-14T11:59:41.078128+0000","last_clean":"2024-09-14T11:59:41.078128+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:59:41.078128+0000","last_undegraded":"2024-09-14T11:59:41.078128+0000","last_fullsized":"2024-09-14T11:59:41.078128+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:41.077982+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:41.077982+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.077982+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:47.488819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.749192+0000","last_change":"2024-09-14T11:59:20.749192+0000","last_active":"2024-09-14T11:59:20.749192+0000","last_peered":"2024-09-14T11:59:20.749192+0000","last_clean":"2024-09-14T11:59:20.749192+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:59:20.749192+0000","last_undegraded":"2024-09-14T11:59:20.749192+0000","last_fullsized":"2024-09-14T11:59:20.749192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.749100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:38.196873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.808730+0000","last_change":"2024-09-14T11:59:26.808730+0000","last_active":"2024-09-14T11:59:26.808730+0000","last_peered":"2024-09-14T11:59:26.808730+0000","last_clean":"2024-09-14T11:59:26.808730+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:59:26.808730+0000","last_undegraded":"2024-09-14T11:59:26.808730+0000","last_fullsized":"2024-09-14T11:59:26.808730+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:59:26.808644+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:59:26.808644+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.808644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:43.305290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.100913+0000","last_change":"2024-09-14T11:59:25.100913+0000","last_active":"2024-09-14T11:59:25.100913+0000","last_peered":"2024-09-14T11:59:25.100913+0000","last_clean":"2024-09-14T11:59:25.100913+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:59:25.100913+0000","last_undegraded":"2024-09-14T11:59:25.100913+0000","last_fullsized":"2024-09-14T11:59:25.100913+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T11:59:25.100823+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T11:59:25.100823+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.100823+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:04.338869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:57:12.438555+0000","last_change":"2024-09-14T11:32:11.443889+0000","last_active":"2024-09-14T11:57:12.438555+0000","last_peered":"2024-09-14T11:57:12.438555+0000","last_clean":"2024-09-14T11:57:12.438555+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:57:12.438555+0000","last_undegraded":"2024-09-14T11:57:12.438555+0000","last_fullsized":"2024-09-14T11:57:12.438555+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.303540+0000","last_change":"2024-09-14T11:59:40.303540+0000","last_active":"2024-09-14T11:59:40.303540+0000","last_peered":"2024-09-14T11:59:40.303540+0000","last_clean":"2024-09-14T11:59:40.303540+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:59:40.303540+0000","last_undegraded":"2024-09-14T11:59:40.303540+0000","last_fullsized":"2024-09-14T11:59:40.303540+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:40.303449+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:40.303449+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.303449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:09.476961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.015449+0000","last_change":"2024-09-14T11:59:31.015449+0000","last_active":"2024-09-14T11:59:31.015449+0000","last_peered":"2024-09-14T11:59:31.015449+0000","last_clean":"2024-09-14T11:59:31.015449+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:59:31.015449+0000","last_undegraded":"2024-09-14T11:59:31.015449+0000","last_fullsized":"2024-09-14T11:59:31.015449+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.015349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.015349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.015349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.863122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.046761+0000","last_change":"2024-09-14T11:59:15.046761+0000","last_active":"2024-09-14T11:59:15.046761+0000","last_peered":"2024-09-14T11:59:15.046761+0000","last_clean":"2024-09-14T11:59:15.046761+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:59:15.046761+0000","last_undegraded":"2024-09-14T11:59:15.046761+0000","last_fullsized":"2024-09-14T11:59:15.046761+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.046667+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:31.667121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.966622+0000","last_change":"2024-09-14T11:59:21.966622+0000","last_active":"2024-09-14T11:59:21.966622+0000","last_peered":"2024-09-14T11:59:21.966622+0000","last_clean":"2024-09-14T11:59:21.966622+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:59:21.966622+0000","last_undegraded":"2024-09-14T11:59:21.966622+0000","last_fullsized":"2024-09-14T11:59:21.966622+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.966514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:37.272047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":47,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.019637+0000","last_change":"2024-09-14T11:59:39.019637+0000","last_active":"2024-09-14T11:59:39.019637+0000","last_peered":"2024-09-14T11:59:39.019637+0000","last_clean":"2024-09-14T11:59:39.019637+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:59:39.019637+0000","last_undegraded":"2024-09-14T11:59:39.019637+0000","last_fullsized":"2024-09-14T11:59:39.019637+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:39.019493+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:39.019493+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.019493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:26.293176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.209533+0000","last_change":"2024-09-14T11:59:26.209533+0000","last_active":"2024-09-14T11:59:26.209533+0000","last_peered":"2024-09-14T11:59:26.209533+0000","last_clean":"2024-09-14T11:59:26.209533+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:59:26.209533+0000","last_undegraded":"2024-09-14T11:59:26.209533+0000","last_fullsized":"2024-09-14T11:59:26.209533+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:26.209431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:26.209431+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.209431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:19.695508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.051785+0000","last_change":"2024-09-14T11:59:26.051785+0000","last_active":"2024-09-14T11:59:26.051785+0000","last_peered":"2024-09-14T11:59:26.051785+0000","last_clean":"2024-09-14T11:59:26.051785+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:59:26.051785+0000","last_undegraded":"2024-09-14T11:59:26.051785+0000","last_fullsized":"2024-09-14T11:59:26.051785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-14T11:59:26.051689+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-14T11:59:26.051689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.051689+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:55.172209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.100053+0000","last_change":"2024-09-14T11:59:12.100053+0000","last_active":"2024-09-14T11:59:12.100053+0000","last_peered":"2024-09-14T11:59:12.100053+0000","last_clean":"2024-09-14T11:59:12.100053+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:59:12.100053+0000","last_undegraded":"2024-09-14T11:59:12.100053+0000","last_fullsized":"2024-09-14T11:59:12.100053+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.099973+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:00.241604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.243188+0000","last_change":"2024-09-14T11:59:37.243188+0000","last_active":"2024-09-14T11:59:37.243188+0000","last_peered":"2024-09-14T11:59:37.243188+0000","last_clean":"2024-09-14T11:59:37.243188+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:59:37.243188+0000","last_undegraded":"2024-09-14T11:59:37.243188+0000","last_fullsized":"2024-09-14T11:59:37.243188+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.243090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.243090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.243090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:13.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.066777+0000","last_change":"2024-09-14T11:59:30.066777+0000","last_active":"2024-09-14T11:59:30.066777+0000","last_peered":"2024-09-14T11:59:30.066777+0000","last_clean":"2024-09-14T11:59:30.066777+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:59:30.066777+0000","last_undegraded":"2024-09-14T11:59:30.066777+0000","last_fullsized":"2024-09-14T11:59:30.066777+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:30.066675+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:30.066675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.066675+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:41.913874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.359884+0000","last_change":"2024-09-14T11:59:29.359884+0000","last_active":"2024-09-14T11:59:29.359884+0000","last_peered":"2024-09-14T11:59:29.359884+0000","last_clean":"2024-09-14T11:59:29.359884+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:59:29.359884+0000","last_undegraded":"2024-09-14T11:59:29.359884+0000","last_fullsized":"2024-09-14T11:59:29.359884+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:59:29.359794+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:59:29.359794+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.359794+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:06.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.028411+0000","last_change":"2024-09-14T11:59:40.028411+0000","last_active":"2024-09-14T11:59:40.028411+0000","last_peered":"2024-09-14T11:59:40.028411+0000","last_clean":"2024-09-14T11:59:40.028411+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:59:40.028411+0000","last_undegraded":"2024-09-14T11:59:40.028411+0000","last_fullsized":"2024-09-14T11:59:40.028411+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.028314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.028314+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.028314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:22.449070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.258722+0000","last_change":"2024-09-14T11:59:39.258722+0000","last_active":"2024-09-14T11:59:39.258722+0000","last_peered":"2024-09-14T11:59:39.258722+0000","last_clean":"2024-09-14T11:59:39.258722+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:59:39.258722+0000","last_undegraded":"2024-09-14T11:59:39.258722+0000","last_fullsized":"2024-09-14T11:59:39.258722+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:39.258626+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:39.258626+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.258626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.618320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.075554+0000","last_change":"2024-09-14T11:59:07.075554+0000","last_active":"2024-09-14T11:59:07.075554+0000","last_peered":"2024-09-14T11:59:07.075554+0000","last_clean":"2024-09-14T11:59:07.075554+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:59:07.075554+0000","last_undegraded":"2024-09-14T11:59:07.075554+0000","last_fullsized":"2024-09-14T11:59:07.075554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.075458+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:32.773384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.059348+0000","last_change":"2024-09-14T11:59:05.059348+0000","last_active":"2024-09-14T11:59:05.059348+0000","last_peered":"2024-09-14T11:59:05.059348+0000","last_clean":"2024-09-14T11:59:05.059348+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:59:05.059348+0000","last_undegraded":"2024-09-14T11:59:05.059348+0000","last_fullsized":"2024-09-14T11:59:05.059348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.059255+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:17.564726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.178042+0000","last_change":"2024-09-14T11:59:32.178042+0000","last_active":"2024-09-14T11:59:32.178042+0000","last_peered":"2024-09-14T11:59:32.178042+0000","last_clean":"2024-09-14T11:59:32.178042+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:59:32.178042+0000","last_undegraded":"2024-09-14T11:59:32.178042+0000","last_fullsized":"2024-09-14T11:59:32.178042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.177942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.177942+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.177942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:51.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.752399+0000","last_change":"2024-09-14T11:59:31.752399+0000","last_active":"2024-09-14T11:59:31.752399+0000","last_peered":"2024-09-14T11:59:31.752399+0000","last_clean":"2024-09-14T11:59:31.752399+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:59:31.752399+0000","last_undegraded":"2024-09-14T11:59:31.752399+0000","last_fullsized":"2024-09-14T11:59:31.752399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:31.752297+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:31.752297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.752297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:26.275166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.003116+0000","last_change":"2024-09-14T11:59:30.003116+0000","last_active":"2024-09-14T11:59:30.003116+0000","last_peered":"2024-09-14T11:59:30.003116+0000","last_clean":"2024-09-14T11:59:30.003116+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:59:30.003116+0000","last_undegraded":"2024-09-14T11:59:30.003116+0000","last_fullsized":"2024-09-14T11:59:30.003116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:30.003027+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:30.003027+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.003027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:05.836932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.156741+0000","last_change":"2024-09-14T11:59:25.156652+0000","last_active":"2024-09-14T11:59:25.156741+0000","last_peered":"2024-09-14T11:59:25.156741+0000","last_clean":"2024-09-14T11:59:25.156741+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:59:25.156741+0000","last_undegraded":"2024-09-14T11:59:25.156741+0000","last_fullsized":"2024-09-14T11:59:25.156741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:59:25.156536+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:59:25.156536+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.156536+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:04.694265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":24,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440825+0000","last_change":"2024-09-14T11:32:11.438868+0000","last_active":"2024-09-14T11:56:22.440825+0000","last_peered":"2024-09-14T11:56:22.440825+0000","last_clean":"2024-09-14T11:56:22.440825+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:56:22.440825+0000","last_undegraded":"2024-09-14T11:56:22.440825+0000","last_fullsized":"2024-09-14T11:56:22.440825+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'9","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.864155+0000","last_change":"2024-09-14T11:59:25.864155+0000","last_active":"2024-09-14T11:59:25.864155+0000","last_peered":"2024-09-14T11:59:25.864155+0000","last_clean":"2024-09-14T11:59:25.864155+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:59:25.864155+0000","last_undegraded":"2024-09-14T11:59:25.864155+0000","last_fullsized":"2024-09-14T11:59:25.864155+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:25.864058+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:25.864058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.864058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:02.149112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.780964+0000","last_change":"2024-09-14T11:59:23.780898+0000","last_active":"2024-09-14T11:59:23.780964+0000","last_peered":"2024-09-14T11:59:23.780964+0000","last_clean":"2024-09-14T11:59:23.780964+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:59:23.780964+0000","last_undegraded":"2024-09-14T11:59:23.780964+0000","last_fullsized":"2024-09-14T11:59:23.780964+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:23.780807+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:23.780807+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.780807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:15.265683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.144264+0000","last_change":"2024-09-14T11:59:24.144264+0000","last_active":"2024-09-14T11:59:24.144264+0000","last_peered":"2024-09-14T11:59:24.144264+0000","last_clean":"2024-09-14T11:59:24.144264+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:59:24.144264+0000","last_undegraded":"2024-09-14T11:59:24.144264+0000","last_fullsized":"2024-09-14T11:59:24.144264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T11:59:24.144170+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T11:59:24.144170+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.144170+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:59.810887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.001092+0000","last_change":"2024-09-14T11:59:40.001092+0000","last_active":"2024-09-14T11:59:40.001092+0000","last_peered":"2024-09-14T11:59:40.001092+0000","last_clean":"2024-09-14T11:59:40.001092+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:59:40.001092+0000","last_undegraded":"2024-09-14T11:59:40.001092+0000","last_fullsized":"2024-09-14T11:59:40.001092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.001001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.001001+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.001001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:34.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.940907+0000","last_change":"2024-09-14T11:59:20.940907+0000","last_active":"2024-09-14T11:59:20.940907+0000","last_peered":"2024-09-14T11:59:20.940907+0000","last_clean":"2024-09-14T11:59:20.940907+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:59:20.940907+0000","last_undegraded":"2024-09-14T11:59:20.940907+0000","last_fullsized":"2024-09-14T11:59:20.940907+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.940817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:58.585992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.303317+0000","last_change":"2024-09-14T11:59:35.303229+0000","last_active":"2024-09-14T11:59:35.303317+0000","last_peered":"2024-09-14T11:59:35.303317+0000","last_clean":"2024-09-14T11:59:35.303317+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:59:35.303317+0000","last_undegraded":"2024-09-14T11:59:35.303317+0000","last_fullsized":"2024-09-14T11:59:35.303317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:35.303137+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:35.303137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.303137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.487357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.114333+0000","last_change":"2024-09-14T11:59:24.114333+0000","last_active":"2024-09-14T11:59:24.114333+0000","last_peered":"2024-09-14T11:59:24.114333+0000","last_clean":"2024-09-14T11:59:24.114333+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:59:24.114333+0000","last_undegraded":"2024-09-14T11:59:24.114333+0000","last_fullsized":"2024-09-14T11:59:24.114333+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-14T11:59:24.114233+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-14T11:59:24.114233+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.114233+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:52.519200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.053802+0000","last_change":"2024-09-14T11:59:42.053802+0000","last_active":"2024-09-14T11:59:42.053802+0000","last_peered":"2024-09-14T11:59:42.053802+0000","last_clean":"2024-09-14T11:59:42.053802+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:59:42.053802+0000","last_undegraded":"2024-09-14T11:59:42.053802+0000","last_fullsized":"2024-09-14T11:59:42.053802+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:42.053698+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:42.053698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.053698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:08.872690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":49,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.257382+0000","last_change":"2024-09-14T11:59:38.257382+0000","last_active":"2024-09-14T11:59:38.257382+0000","last_peered":"2024-09-14T11:59:38.257382+0000","last_clean":"2024-09-14T11:59:38.257382+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:59:38.257382+0000","last_undegraded":"2024-09-14T11:59:38.257382+0000","last_fullsized":"2024-09-14T11:59:38.257382+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:38.257284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:38.257284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.257284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:55.712630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781182+0000","last_change":"2024-09-14T11:59:16.781098+0000","last_active":"2024-09-14T11:59:16.781182+0000","last_peered":"2024-09-14T11:59:16.781182+0000","last_clean":"2024-09-14T11:59:16.781182+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:59:16.781182+0000","last_undegraded":"2024-09-14T11:59:16.781182+0000","last_fullsized":"2024-09-14T11:59:16.781182+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.781001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:55.027672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.754047+0000","last_change":"2024-09-14T11:59:24.754047+0000","last_active":"2024-09-14T11:59:24.754047+0000","last_peered":"2024-09-14T11:59:24.754047+0000","last_clean":"2024-09-14T11:59:24.754047+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:59:24.754047+0000","last_undegraded":"2024-09-14T11:59:24.754047+0000","last_fullsized":"2024-09-14T11:59:24.754047+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-14T11:59:24.753913+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-14T11:59:24.753913+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.753913+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:46.401507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'1","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:22.440794+0000","last_change":"2024-09-14T11:32:11.437339+0000","last_active":"2024-09-14T11:56:22.440794+0000","last_peered":"2024-09-14T11:56:22.440794+0000","last_clean":"2024-09-14T11:56:22.440794+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:56:22.440794+0000","last_undegraded":"2024-09-14T11:56:22.440794+0000","last_fullsized":"2024-09-14T11:56:22.440794+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.801416+0000","last_change":"2024-09-14T11:59:18.801416+0000","last_active":"2024-09-14T11:59:18.801416+0000","last_peered":"2024-09-14T11:59:18.801416+0000","last_clean":"2024-09-14T11:59:18.801416+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:59:18.801416+0000","last_undegraded":"2024-09-14T11:59:18.801416+0000","last_fullsized":"2024-09-14T11:59:18.801416+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.801330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:29.523992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.251027+0000","last_change":"2024-09-14T11:59:27.250927+0000","last_active":"2024-09-14T11:59:27.251027+0000","last_peered":"2024-09-14T11:59:27.251027+0000","last_clean":"2024-09-14T11:59:27.251027+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:59:27.251027+0000","last_undegraded":"2024-09-14T11:59:27.251027+0000","last_fullsized":"2024-09-14T11:59:27.251027+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:59:27.250822+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:59:27.250822+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.250822+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.536199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.327229+0000","last_change":"2024-09-14T11:59:28.327229+0000","last_active":"2024-09-14T11:59:28.327229+0000","last_peered":"2024-09-14T11:59:28.327229+0000","last_clean":"2024-09-14T11:59:28.327229+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:59:28.327229+0000","last_undegraded":"2024-09-14T11:59:28.327229+0000","last_fullsized":"2024-09-14T11:59:28.327229+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-14T11:59:28.327134+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-14T11:59:28.327134+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.327134+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:15.665026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.101682+0000","last_change":"2024-09-14T11:59:11.101682+0000","last_active":"2024-09-14T11:59:11.101682+0000","last_peered":"2024-09-14T11:59:11.101682+0000","last_clean":"2024-09-14T11:59:11.101682+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:59:11.101682+0000","last_undegraded":"2024-09-14T11:59:11.101682+0000","last_fullsized":"2024-09-14T11:59:11.101682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.101584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.108804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.347242+0000","last_change":"2024-09-14T11:59:34.347242+0000","last_active":"2024-09-14T11:59:34.347242+0000","last_peered":"2024-09-14T11:59:34.347242+0000","last_clean":"2024-09-14T11:59:34.347242+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:59:34.347242+0000","last_undegraded":"2024-09-14T11:59:34.347242+0000","last_fullsized":"2024-09-14T11:59:34.347242+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:34.347151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:34.347151+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.347151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:02.797811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.078640+0000","last_change":"2024-09-14T11:59:31.078640+0000","last_active":"2024-09-14T11:59:31.078640+0000","last_peered":"2024-09-14T11:59:31.078640+0000","last_clean":"2024-09-14T11:59:31.078640+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:59:31.078640+0000","last_undegraded":"2024-09-14T11:59:31.078640+0000","last_fullsized":"2024-09-14T11:59:31.078640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:31.078542+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:31.078542+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.078542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:55.439289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3079,"num_write":6,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.362867+0000","last_change":"2024-09-14T11:59:27.362867+0000","last_active":"2024-09-14T11:59:27.362867+0000","last_peered":"2024-09-14T11:59:27.362867+0000","last_clean":"2024-09-14T11:59:27.362867+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:59:27.362867+0000","last_undegraded":"2024-09-14T11:59:27.362867+0000","last_fullsized":"2024-09-14T11:59:27.362867+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'57","last_scrub_stamp":"2024-09-14T11:59:27.362800+0000","last_deep_scrub":"263'57","last_deep_scrub_stamp":"2024-09-14T11:59:27.362800+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.362800+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:04.501325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.042404+0000","last_change":"2024-09-14T11:59:42.042404+0000","last_active":"2024-09-14T11:59:42.042404+0000","last_peered":"2024-09-14T11:59:42.042404+0000","last_clean":"2024-09-14T11:59:42.042404+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:59:42.042404+0000","last_undegraded":"2024-09-14T11:59:42.042404+0000","last_fullsized":"2024-09-14T11:59:42.042404+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.042279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.042279+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.042279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:43.281693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.298003+0000","last_change":"2024-09-14T11:59:33.298003+0000","last_active":"2024-09-14T11:59:33.298003+0000","last_peered":"2024-09-14T11:59:33.298003+0000","last_clean":"2024-09-14T11:59:33.298003+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:59:33.298003+0000","last_undegraded":"2024-09-14T11:59:33.298003+0000","last_fullsized":"2024-09-14T11:59:33.298003+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:33.297907+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:33.297907+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.297907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:07.937163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.113881+0000","last_change":"2024-09-14T11:59:08.113881+0000","last_active":"2024-09-14T11:59:08.113881+0000","last_peered":"2024-09-14T11:59:08.113881+0000","last_clean":"2024-09-14T11:59:08.113881+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:59:08.113881+0000","last_undegraded":"2024-09-14T11:59:08.113881+0000","last_fullsized":"2024-09-14T11:59:08.113881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.113784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:24.490857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":118,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.231209+0000","last_change":"2024-09-14T11:59:24.231209+0000","last_active":"2024-09-14T11:59:24.231209+0000","last_peered":"2024-09-14T11:59:24.231209+0000","last_clean":"2024-09-14T11:59:24.231209+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:59:24.231209+0000","last_undegraded":"2024-09-14T11:59:24.231209+0000","last_fullsized":"2024-09-14T11:59:24.231209+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-09-14T11:59:24.231114+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-09-14T11:59:24.231114+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.231114+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:51.272771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.783252+0000","last_change":"2024-09-14T11:59:21.783252+0000","last_active":"2024-09-14T11:59:21.783252+0000","last_peered":"2024-09-14T11:59:21.783252+0000","last_clean":"2024-09-14T11:59:21.783252+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:59:21.783252+0000","last_undegraded":"2024-09-14T11:59:21.783252+0000","last_fullsized":"2024-09-14T11:59:21.783252+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.783139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:06.762141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.963077+0000","last_change":"2024-09-14T11:59:19.963077+0000","last_active":"2024-09-14T11:59:19.963077+0000","last_peered":"2024-09-14T11:59:19.963077+0000","last_clean":"2024-09-14T11:59:19.963077+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:59:19.963077+0000","last_undegraded":"2024-09-14T11:59:19.963077+0000","last_fullsized":"2024-09-14T11:59:19.963077+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.962996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:15.918979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.031631+0000","last_change":"2024-09-14T11:59:41.031631+0000","last_active":"2024-09-14T11:59:41.031631+0000","last_peered":"2024-09-14T11:59:41.031631+0000","last_clean":"2024-09-14T11:59:41.031631+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:59:41.031631+0000","last_undegraded":"2024-09-14T11:59:41.031631+0000","last_fullsized":"2024-09-14T11:59:41.031631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:41.031537+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.031537+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.031537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:04.945895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.746668+0000","last_change":"2024-09-14T11:59:13.746668+0000","last_active":"2024-09-14T11:59:13.746668+0000","last_peered":"2024-09-14T11:59:13.746668+0000","last_clean":"2024-09-14T11:59:13.746668+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:59:13.746668+0000","last_undegraded":"2024-09-14T11:59:13.746668+0000","last_fullsized":"2024-09-14T11:59:13.746668+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.746567+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:14.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.947689+0000","last_change":"2024-09-14T11:59:36.947689+0000","last_active":"2024-09-14T11:59:36.947689+0000","last_peered":"2024-09-14T11:59:36.947689+0000","last_clean":"2024-09-14T11:59:36.947689+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:59:36.947689+0000","last_undegraded":"2024-09-14T11:59:36.947689+0000","last_fullsized":"2024-09-14T11:59:36.947689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:36.947601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:36.947601+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.947601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:10.497492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.273323+0000","last_change":"2024-09-14T11:59:36.273323+0000","last_active":"2024-09-14T11:59:36.273323+0000","last_peered":"2024-09-14T11:59:36.273323+0000","last_clean":"2024-09-14T11:59:36.273323+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:59:36.273323+0000","last_undegraded":"2024-09-14T11:59:36.273323+0000","last_fullsized":"2024-09-14T11:59:36.273323+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:36.273210+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:36.273210+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.273210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:28.694185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.021805+0000","last_change":"2024-09-14T11:59:17.021805+0000","last_active":"2024-09-14T11:59:17.021805+0000","last_peered":"2024-09-14T11:59:17.021805+0000","last_clean":"2024-09-14T11:59:17.021805+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:59:17.021805+0000","last_undegraded":"2024-09-14T11:59:17.021805+0000","last_fullsized":"2024-09-14T11:59:17.021805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.021712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:50.412612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":197,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.047142+0000","last_change":"2024-09-14T11:59:04.047142+0000","last_active":"2024-09-14T11:59:04.047142+0000","last_peered":"2024-09-14T11:59:04.047142+0000","last_clean":"2024-09-14T11:59:04.047142+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:59:04.047142+0000","last_undegraded":"2024-09-14T11:59:04.047142+0000","last_fullsized":"2024-09-14T11:59:04.047142+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.047040+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:05.840200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.324511+0000","last_change":"2024-09-14T11:59:42.324511+0000","last_active":"2024-09-14T11:59:42.324511+0000","last_peered":"2024-09-14T11:59:42.324511+0000","last_clean":"2024-09-14T11:59:42.324511+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:59:42.324511+0000","last_undegraded":"2024-09-14T11:59:42.324511+0000","last_fullsized":"2024-09-14T11:59:42.324511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.324411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.324411+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.324411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:20.420976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.778337+0000","last_change":"2024-09-14T11:59:30.778337+0000","last_active":"2024-09-14T11:59:30.778337+0000","last_peered":"2024-09-14T11:59:30.778337+0000","last_clean":"2024-09-14T11:59:30.778337+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:59:30.778337+0000","last_undegraded":"2024-09-14T11:59:30.778337+0000","last_fullsized":"2024-09-14T11:59:30.778337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:30.778237+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:30.778237+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.778237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:01.725618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2106,"num_write":6,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.055426+0000","last_change":"2024-09-14T11:59:32.055426+0000","last_active":"2024-09-14T11:59:32.055426+0000","last_peered":"2024-09-14T11:59:32.055426+0000","last_clean":"2024-09-14T11:59:32.055426+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:59:32.055426+0000","last_undegraded":"2024-09-14T11:59:32.055426+0000","last_fullsized":"2024-09-14T11:59:32.055426+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:32.055341+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:32.055341+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.055341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:59.626815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":138,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.130851+0000","last_change":"2024-09-14T11:59:23.130851+0000","last_active":"2024-09-14T11:59:23.130851+0000","last_peered":"2024-09-14T11:59:23.130851+0000","last_clean":"2024-09-14T11:59:23.130851+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:59:23.130851+0000","last_undegraded":"2024-09-14T11:59:23.130851+0000","last_fullsized":"2024-09-14T11:59:23.130851+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:59:23.130761+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:59:23.130761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.130761+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:40.996215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.006983+0000","last_change":"2024-09-14T11:59:39.006983+0000","last_active":"2024-09-14T11:59:39.006983+0000","last_peered":"2024-09-14T11:59:39.006983+0000","last_clean":"2024-09-14T11:59:39.006983+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:59:39.006983+0000","last_undegraded":"2024-09-14T11:59:39.006983+0000","last_fullsized":"2024-09-14T11:59:39.006983+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:39.006874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:39.006874+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.006874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:33.926363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'12","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.065579+0000","last_change":"2024-09-14T11:59:33.065579+0000","last_active":"2024-09-14T11:59:33.065579+0000","last_peered":"2024-09-14T11:59:33.065579+0000","last_clean":"2024-09-14T11:59:33.065579+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:59:33.065579+0000","last_undegraded":"2024-09-14T11:59:33.065579+0000","last_fullsized":"2024-09-14T11:59:33.065579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:59:33.065483+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:59:33.065483+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.065483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.308824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9238,"num_write":22,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.084075+0000","last_change":"2024-09-14T11:59:14.084075+0000","last_active":"2024-09-14T11:59:14.084075+0000","last_peered":"2024-09-14T11:59:14.084075+0000","last_clean":"2024-09-14T11:59:14.084075+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:59:14.084075+0000","last_undegraded":"2024-09-14T11:59:14.084075+0000","last_fullsized":"2024-09-14T11:59:14.084075+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.083986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.169123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.168457+0000","last_change":"2024-09-14T11:59:23.168457+0000","last_active":"2024-09-14T11:59:23.168457+0000","last_peered":"2024-09-14T11:59:23.168457+0000","last_clean":"2024-09-14T11:59:23.168457+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:59:23.168457+0000","last_undegraded":"2024-09-14T11:59:23.168457+0000","last_fullsized":"2024-09-14T11:59:23.168457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.168364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.168364+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.168364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.580325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.971555+0000","last_change":"2024-09-14T11:59:37.971555+0000","last_active":"2024-09-14T11:59:37.971555+0000","last_peered":"2024-09-14T11:59:37.971555+0000","last_clean":"2024-09-14T11:59:37.971555+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:59:37.971555+0000","last_undegraded":"2024-09-14T11:59:37.971555+0000","last_fullsized":"2024-09-14T11:59:37.971555+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:37.971449+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:37.971449+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.971449+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:23.580134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.852336+0000","last_change":"2024-09-14T11:59:24.852336+0000","last_active":"2024-09-14T11:59:24.852336+0000","last_peered":"2024-09-14T11:59:24.852336+0000","last_clean":"2024-09-14T11:59:24.852336+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:59:24.852336+0000","last_undegraded":"2024-09-14T11:59:24.852336+0000","last_fullsized":"2024-09-14T11:59:24.852336+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.852250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.852250+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.852250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:54.770657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.979623+0000","last_change":"2024-09-14T11:59:28.979623+0000","last_active":"2024-09-14T11:59:28.979623+0000","last_peered":"2024-09-14T11:59:28.979623+0000","last_clean":"2024-09-14T11:59:28.979623+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:59:28.979623+0000","last_undegraded":"2024-09-14T11:59:28.979623+0000","last_fullsized":"2024-09-14T11:59:28.979623+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:28.979530+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:28.979530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.979530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:29.770385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.320561+0000","last_change":"2024-09-14T11:59:26.320561+0000","last_active":"2024-09-14T11:59:26.320561+0000","last_peered":"2024-09-14T11:59:26.320561+0000","last_clean":"2024-09-14T11:59:26.320561+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:59:26.320561+0000","last_undegraded":"2024-09-14T11:59:26.320561+0000","last_fullsized":"2024-09-14T11:59:26.320561+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:59:26.320433+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:59:26.320433+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.320433+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:22.183132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":25,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:56:57.441694+0000","last_change":"2024-09-14T11:32:11.435128+0000","last_active":"2024-09-14T11:56:57.441694+0000","last_peered":"2024-09-14T11:56:57.441694+0000","last_clean":"2024-09-14T11:56:57.441694+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:56:57.441694+0000","last_undegraded":"2024-09-14T11:56:57.441694+0000","last_fullsized":"2024-09-14T11:56:57.441694+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:32:10.408067+0000","last_clean_scrub_stamp":"2024-09-14T11:32:10.408067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'9","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.030075+0000","last_change":"2024-09-14T11:59:34.030075+0000","last_active":"2024-09-14T11:59:34.030075+0000","last_peered":"2024-09-14T11:59:34.030075+0000","last_clean":"2024-09-14T11:59:34.030075+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:59:34.030075+0000","last_undegraded":"2024-09-14T11:59:34.030075+0000","last_fullsized":"2024-09-14T11:59:34.030075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:34.029981+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:34.029981+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.029981+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:11.856084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9236,"num_write":14,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.742815+0000","last_change":"2024-09-14T11:59:22.742815+0000","last_active":"2024-09-14T11:59:22.742815+0000","last_peered":"2024-09-14T11:59:22.742815+0000","last_clean":"2024-09-14T11:59:22.742815+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:59:22.742815+0000","last_undegraded":"2024-09-14T11:59:22.742815+0000","last_fullsized":"2024-09-14T11:59:22.742815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.742721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.744647+0000","last_change":"2024-09-14T11:59:12.744647+0000","last_active":"2024-09-14T11:59:12.744647+0000","last_peered":"2024-09-14T11:59:12.744647+0000","last_clean":"2024-09-14T11:59:12.744647+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:59:12.744647+0000","last_undegraded":"2024-09-14T11:59:12.744647+0000","last_fullsized":"2024-09-14T11:59:12.744647+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.744566+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:09.980455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.986100+0000","last_change":"2024-09-14T11:59:34.986100+0000","last_active":"2024-09-14T11:59:34.986100+0000","last_peered":"2024-09-14T11:59:34.986100+0000","last_clean":"2024-09-14T11:59:34.986100+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:59:34.986100+0000","last_undegraded":"2024-09-14T11:59:34.986100+0000","last_fullsized":"2024-09-14T11:59:34.986100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:34.986009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:34.986009+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.986009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:23.917025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.026652+0000","last_change":"2024-09-14T11:59:36.026652+0000","last_active":"2024-09-14T11:59:36.026652+0000","last_peered":"2024-09-14T11:59:36.026652+0000","last_clean":"2024-09-14T11:59:36.026652+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:59:36.026652+0000","last_undegraded":"2024-09-14T11:59:36.026652+0000","last_fullsized":"2024-09-14T11:59:36.026652+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:36.026546+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:36.026546+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.026546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:43.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.060955+0000","last_change":"2024-09-14T11:59:28.060955+0000","last_active":"2024-09-14T11:59:28.060955+0000","last_peered":"2024-09-14T11:59:28.060955+0000","last_clean":"2024-09-14T11:59:28.060955+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:59:28.060955+0000","last_undegraded":"2024-09-14T11:59:28.060955+0000","last_fullsized":"2024-09-14T11:59:28.060955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:28.060863+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:28.060863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.060863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.869037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.158018+0000","last_change":"2024-09-14T11:59:22.158018+0000","last_active":"2024-09-14T11:59:22.158018+0000","last_peered":"2024-09-14T11:59:22.158018+0000","last_clean":"2024-09-14T11:59:22.158018+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:59:22.158018+0000","last_undegraded":"2024-09-14T11:59:22.158018+0000","last_fullsized":"2024-09-14T11:59:22.158018+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.157923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:01.473904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.159594+0000","last_change":"2024-09-14T11:59:31.159594+0000","last_active":"2024-09-14T11:59:31.159594+0000","last_peered":"2024-09-14T11:59:31.159594+0000","last_clean":"2024-09-14T11:59:31.159594+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:59:31.159594+0000","last_undegraded":"2024-09-14T11:59:31.159594+0000","last_fullsized":"2024-09-14T11:59:31.159594+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.159495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.159495+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.159495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:36.869191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.041487+0000","last_change":"2024-09-14T11:59:33.041487+0000","last_active":"2024-09-14T11:59:33.041487+0000","last_peered":"2024-09-14T11:59:33.041487+0000","last_clean":"2024-09-14T11:59:33.041487+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:59:33.041487+0000","last_undegraded":"2024-09-14T11:59:33.041487+0000","last_fullsized":"2024-09-14T11:59:33.041487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:33.041395+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:33.041395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.041395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.077370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.062681+0000","last_change":"2024-09-14T11:59:06.062559+0000","last_active":"2024-09-14T11:59:06.062681+0000","last_peered":"2024-09-14T11:59:06.062681+0000","last_clean":"2024-09-14T11:59:06.062681+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:59:06.062681+0000","last_undegraded":"2024-09-14T11:59:06.062681+0000","last_fullsized":"2024-09-14T11:59:06.062681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.062448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.178762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.739744+0000","last_change":"2024-09-14T11:59:11.739744+0000","last_active":"2024-09-14T11:59:11.739744+0000","last_peered":"2024-09-14T11:59:11.739744+0000","last_clean":"2024-09-14T11:59:11.739744+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:59:11.739744+0000","last_undegraded":"2024-09-14T11:59:11.739744+0000","last_fullsized":"2024-09-14T11:59:11.739744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.739660+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:24.442901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.898170+0000","last_change":"2024-09-14T11:59:23.898170+0000","last_active":"2024-09-14T11:59:23.898170+0000","last_peered":"2024-09-14T11:59:23.898170+0000","last_clean":"2024-09-14T11:59:23.898170+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:59:23.898170+0000","last_undegraded":"2024-09-14T11:59:23.898170+0000","last_fullsized":"2024-09-14T11:59:23.898170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.898076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.898076+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.898076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:36.098847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.041491+0000","last_change":"2024-09-14T11:59:32.041491+0000","last_active":"2024-09-14T11:59:32.041491+0000","last_peered":"2024-09-14T11:59:32.041491+0000","last_clean":"2024-09-14T11:59:32.041491+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:59:32.041491+0000","last_undegraded":"2024-09-14T11:59:32.041491+0000","last_fullsized":"2024-09-14T11:59:32.041491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.041390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.041390+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.041390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:51.744908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.207489+0000","last_change":"2024-09-14T11:59:25.207489+0000","last_active":"2024-09-14T11:59:25.207489+0000","last_peered":"2024-09-14T11:59:25.207489+0000","last_clean":"2024-09-14T11:59:25.207489+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:59:25.207489+0000","last_undegraded":"2024-09-14T11:59:25.207489+0000","last_fullsized":"2024-09-14T11:59:25.207489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:59:25.207395+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:59:25.207395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.207395+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:47.177943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.182624+0000","last_change":"2024-09-14T11:59:22.182624+0000","last_active":"2024-09-14T11:59:22.182624+0000","last_peered":"2024-09-14T11:59:22.182624+0000","last_clean":"2024-09-14T11:59:22.182624+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:59:22.182624+0000","last_undegraded":"2024-09-14T11:59:22.182624+0000","last_fullsized":"2024-09-14T11:59:22.182624+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.182530+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:03.582278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.783719+0000","last_change":"2024-09-14T11:59:32.783719+0000","last_active":"2024-09-14T11:59:32.783719+0000","last_peered":"2024-09-14T11:59:32.783719+0000","last_clean":"2024-09-14T11:59:32.783719+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:59:32.783719+0000","last_undegraded":"2024-09-14T11:59:32.783719+0000","last_fullsized":"2024-09-14T11:59:32.783719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.783595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.783595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.783595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:01.809310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759869+0000","last_change":"2024-09-14T11:59:29.759869+0000","last_active":"2024-09-14T11:59:29.759869+0000","last_peered":"2024-09-14T11:59:29.759869+0000","last_clean":"2024-09-14T11:59:29.759869+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:59:29.759869+0000","last_undegraded":"2024-09-14T11:59:29.759869+0000","last_fullsized":"2024-09-14T11:59:29.759869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:29.759774+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.759774+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.759774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:26.957169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.107699+0000","last_change":"2024-09-14T11:59:29.107699+0000","last_active":"2024-09-14T11:59:29.107699+0000","last_peered":"2024-09-14T11:59:29.107699+0000","last_clean":"2024-09-14T11:59:29.107699+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:59:29.107699+0000","last_undegraded":"2024-09-14T11:59:29.107699+0000","last_fullsized":"2024-09-14T11:59:29.107699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:29.107615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.107615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.107615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:51.653410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.098178+0000","last_change":"2024-09-14T11:59:13.098178+0000","last_active":"2024-09-14T11:59:13.098178+0000","last_peered":"2024-09-14T11:59:13.098178+0000","last_clean":"2024-09-14T11:59:13.098178+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:59:13.098178+0000","last_undegraded":"2024-09-14T11:59:13.098178+0000","last_fullsized":"2024-09-14T11:59:13.098178+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.098094+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:19.834460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.143092+0000","last_change":"2024-09-14T11:59:10.143092+0000","last_active":"2024-09-14T11:59:10.143092+0000","last_peered":"2024-09-14T11:59:10.143092+0000","last_clean":"2024-09-14T11:59:10.143092+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:59:10.143092+0000","last_undegraded":"2024-09-14T11:59:10.143092+0000","last_fullsized":"2024-09-14T11:59:10.143092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.142995+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:46.424281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.936680+0000","last_change":"2024-09-14T11:59:18.936680+0000","last_active":"2024-09-14T11:59:18.936680+0000","last_peered":"2024-09-14T11:59:18.936680+0000","last_clean":"2024-09-14T11:59:18.936680+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:59:18.936680+0000","last_undegraded":"2024-09-14T11:59:18.936680+0000","last_fullsized":"2024-09-14T11:59:18.936680+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.936581+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:35.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16376,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.130617+0000","last_change":"2024-09-14T11:59:26.130549+0000","last_active":"2024-09-14T11:59:26.130617+0000","last_peered":"2024-09-14T11:59:26.130617+0000","last_clean":"2024-09-14T11:59:26.130617+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:59:26.130617+0000","last_undegraded":"2024-09-14T11:59:26.130617+0000","last_fullsized":"2024-09-14T11:59:26.130617+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:26.130463+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:26.130463+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.130463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:24.664977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7164,"num_write":12,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.199893+0000","last_change":"2024-09-14T11:59:23.199893+0000","last_active":"2024-09-14T11:59:23.199893+0000","last_peered":"2024-09-14T11:59:23.199893+0000","last_clean":"2024-09-14T11:59:23.199893+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:59:23.199893+0000","last_undegraded":"2024-09-14T11:59:23.199893+0000","last_fullsized":"2024-09-14T11:59:23.199893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:59:23.199789+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:59:23.199789+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.199789+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.511890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.046829+0000","last_change":"2024-09-14T11:59:38.046829+0000","last_active":"2024-09-14T11:59:38.046829+0000","last_peered":"2024-09-14T11:59:38.046829+0000","last_clean":"2024-09-14T11:59:38.046829+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:59:38.046829+0000","last_undegraded":"2024-09-14T11:59:38.046829+0000","last_fullsized":"2024-09-14T11:59:38.046829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:38.046722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:38.046722+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.046722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:06.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'10","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.204208+0000","last_change":"2024-09-14T11:59:28.204105+0000","last_active":"2024-09-14T11:59:28.204208+0000","last_peered":"2024-09-14T11:59:28.204208+0000","last_clean":"2024-09-14T11:59:28.204208+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:59:28.204208+0000","last_undegraded":"2024-09-14T11:59:28.204208+0000","last_fullsized":"2024-09-14T11:59:28.204208+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:59:28.204011+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:59:28.204011+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.204011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.929375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12313,"num_write":20,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.091046+0000","last_change":"2024-09-14T11:59:27.091046+0000","last_active":"2024-09-14T11:59:27.091046+0000","last_peered":"2024-09-14T11:59:27.091046+0000","last_clean":"2024-09-14T11:59:27.091046+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:59:27.091046+0000","last_undegraded":"2024-09-14T11:59:27.091046+0000","last_fullsized":"2024-09-14T11:59:27.091046+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.090962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.090962+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.090962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:07.964245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.709355+0000","last_change":"2024-09-14T11:59:21.709355+0000","last_active":"2024-09-14T11:59:21.709355+0000","last_peered":"2024-09-14T11:59:21.709355+0000","last_clean":"2024-09-14T11:59:21.709355+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:59:21.709355+0000","last_undegraded":"2024-09-14T11:59:21.709355+0000","last_fullsized":"2024-09-14T11:59:21.709355+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.709270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.017771+0000","last_change":"2024-09-14T11:59:37.017771+0000","last_active":"2024-09-14T11:59:37.017771+0000","last_peered":"2024-09-14T11:59:37.017771+0000","last_clean":"2024-09-14T11:59:37.017771+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:59:37.017771+0000","last_undegraded":"2024-09-14T11:59:37.017771+0000","last_fullsized":"2024-09-14T11:59:37.017771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.017659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.017659+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.017659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.453255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.783156+0000","last_change":"2024-09-14T11:59:17.783156+0000","last_active":"2024-09-14T11:59:17.783156+0000","last_peered":"2024-09-14T11:59:17.783156+0000","last_clean":"2024-09-14T11:59:17.783156+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:59:17.783156+0000","last_undegraded":"2024-09-14T11:59:17.783156+0000","last_fullsized":"2024-09-14T11:59:17.783156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.783071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:40.106669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.998678+0000","last_change":"2024-09-14T11:59:15.998678+0000","last_active":"2024-09-14T11:59:15.998678+0000","last_peered":"2024-09-14T11:59:15.998678+0000","last_clean":"2024-09-14T11:59:15.998678+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:59:15.998678+0000","last_undegraded":"2024-09-14T11:59:15.998678+0000","last_fullsized":"2024-09-14T11:59:15.998678+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.998590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:10.917760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.764138+0000","last_change":"2024-09-14T11:59:10.764138+0000","last_active":"2024-09-14T11:59:10.764138+0000","last_peered":"2024-09-14T11:59:10.764138+0000","last_clean":"2024-09-14T11:59:10.764138+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:59:10.764138+0000","last_undegraded":"2024-09-14T11:59:10.764138+0000","last_fullsized":"2024-09-14T11:59:10.764138+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.764059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:35.059111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.994524+0000","last_change":"2024-09-14T11:59:35.994524+0000","last_active":"2024-09-14T11:59:35.994524+0000","last_peered":"2024-09-14T11:59:35.994524+0000","last_clean":"2024-09-14T11:59:35.994524+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:59:35.994524+0000","last_undegraded":"2024-09-14T11:59:35.994524+0000","last_fullsized":"2024-09-14T11:59:35.994524+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.994380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.994380+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.994380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.459753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.757295+0000","last_change":"2024-09-14T11:59:28.757295+0000","last_active":"2024-09-14T11:59:28.757295+0000","last_peered":"2024-09-14T11:59:28.757295+0000","last_clean":"2024-09-14T11:59:28.757295+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:59:28.757295+0000","last_undegraded":"2024-09-14T11:59:28.757295+0000","last_fullsized":"2024-09-14T11:59:28.757295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:59:28.757203+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:59:28.757203+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.757203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.194261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.759764+0000","last_change":"2024-09-14T11:59:15.759764+0000","last_active":"2024-09-14T11:59:15.759764+0000","last_peered":"2024-09-14T11:59:15.759764+0000","last_clean":"2024-09-14T11:59:15.759764+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:59:15.759764+0000","last_undegraded":"2024-09-14T11:59:15.759764+0000","last_fullsized":"2024-09-14T11:59:15.759764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.759654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:43.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.091154+0000","last_change":"2024-09-14T11:59:20.091154+0000","last_active":"2024-09-14T11:59:20.091154+0000","last_peered":"2024-09-14T11:59:20.091154+0000","last_clean":"2024-09-14T11:59:20.091154+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:59:20.091154+0000","last_undegraded":"2024-09-14T11:59:20.091154+0000","last_fullsized":"2024-09-14T11:59:20.091154+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.091080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:22.171147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'362","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.193832+0000","last_change":"2024-09-14T11:59:01.193740+0000","last_active":"2024-09-14T11:59:01.193832+0000","last_peered":"2024-09-14T11:59:01.193832+0000","last_clean":"2024-09-14T11:59:01.193832+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:59:01.193832+0000","last_undegraded":"2024-09-14T11:59:01.193832+0000","last_fullsized":"2024-09-14T11:59:01.193832+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.193613+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:48.418030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":9138,"num_write":1125,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'442","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.642141+0000","last_change":"2024-09-14T11:59:04.642052+0000","last_active":"2024-09-14T11:59:04.642141+0000","last_peered":"2024-09-14T11:59:04.642141+0000","last_clean":"2024-09-14T11:59:04.642141+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:59:04.642141+0000","last_undegraded":"2024-09-14T11:59:04.642141+0000","last_fullsized":"2024-09-14T11:59:04.642141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.641934+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:19.634497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'360","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.148658+0000","last_change":"2024-09-14T11:58:48.148587+0000","last_active":"2024-09-14T11:58:48.148658+0000","last_peered":"2024-09-14T11:58:48.148658+0000","last_clean":"2024-09-14T11:58:48.148658+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:48.148658+0000","last_undegraded":"2024-09-14T11:58:48.148658+0000","last_fullsized":"2024-09-14T11:58:48.148658+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.148462+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:26.110691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7650412,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":625,"num_read_kb":47838,"num_write":1199,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'491","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.159534+0000","last_change":"2024-09-14T11:59:03.159475+0000","last_active":"2024-09-14T11:59:03.159534+0000","last_peered":"2024-09-14T11:59:03.159534+0000","last_clean":"2024-09-14T11:59:03.159534+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:59:03.159534+0000","last_undegraded":"2024-09-14T11:59:03.159534+0000","last_fullsized":"2024-09-14T11:59:03.159534+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.159398+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:15.424664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'408","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.093127+0000","last_change":"2024-09-14T11:58:49.093046+0000","last_active":"2024-09-14T11:58:49.093127+0000","last_peered":"2024-09-14T11:58:49.093127+0000","last_clean":"2024-09-14T11:58:49.093127+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:49.093127+0000","last_undegraded":"2024-09-14T11:58:49.093127+0000","last_fullsized":"2024-09-14T11:58:49.093127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.092922+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:17.953603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":833,"num_read_kb":44180,"num_write":1273,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'376","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.808251+0000","last_change":"2024-09-14T11:59:04.808153+0000","last_active":"2024-09-14T11:59:04.808251+0000","last_peered":"2024-09-14T11:59:04.808251+0000","last_clean":"2024-09-14T11:59:04.808251+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:59:04.808251+0000","last_undegraded":"2024-09-14T11:59:04.808251+0000","last_fullsized":"2024-09-14T11:59:04.808251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.808029+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:56.690295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3028,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'478","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.664464+0000","last_change":"2024-09-14T11:58:58.664464+0000","last_active":"2024-09-14T11:58:58.664464+0000","last_peered":"2024-09-14T11:58:58.664464+0000","last_clean":"2024-09-14T11:58:58.664464+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:58.664464+0000","last_undegraded":"2024-09-14T11:58:58.664464+0000","last_fullsized":"2024-09-14T11:58:58.664464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.664259+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:35.300032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730156,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":988,"num_read_kb":27790,"num_write":1317,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1227","reported_seq":2919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.997326+0000","last_change":"2024-09-14T11:58:57.997268+0000","last_active":"2024-09-14T11:58:57.997326+0000","last_peered":"2024-09-14T11:58:57.997326+0000","last_clean":"2024-09-14T11:58:57.997326+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:58:57.997326+0000","last_undegraded":"2024-09-14T11:58:57.997326+0000","last_fullsized":"2024-09-14T11:58:57.997326+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1227","last_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_deep_scrub":"263'1227","last_deep_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.997174+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.497164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'356","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.259835+0000","last_change":"2024-09-14T11:58:57.259740+0000","last_active":"2024-09-14T11:58:57.259835+0000","last_peered":"2024-09-14T11:58:57.259835+0000","last_clean":"2024-09-14T11:58:57.259835+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:57.259835+0000","last_undegraded":"2024-09-14T11:58:57.259835+0000","last_fullsized":"2024-09-14T11:58:57.259835+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.259603+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:49.299765+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":13771,"num_write":1092,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'580","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751244+0000","last_change":"2024-09-14T11:58:56.751244+0000","last_active":"2024-09-14T11:58:56.751244+0000","last_peered":"2024-09-14T11:58:56.751244+0000","last_clean":"2024-09-14T11:58:56.751244+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:58:56.751244+0000","last_undegraded":"2024-09-14T11:58:56.751244+0000","last_fullsized":"2024-09-14T11:58:56.751244+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'580","last_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_deep_scrub":"263'580","last_deep_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751162+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:07.015372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'342","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.696332+0000","last_change":"2024-09-14T11:58:56.696232+0000","last_active":"2024-09-14T11:58:56.696332+0000","last_peered":"2024-09-14T11:58:56.696332+0000","last_clean":"2024-09-14T11:58:56.696332+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:56.696332+0000","last_undegraded":"2024-09-14T11:58:56.696332+0000","last_fullsized":"2024-09-14T11:58:56.696332+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.696022+0000","objects_scrubbed":11,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.669606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":503,"num_read_kb":13548,"num_write":1089,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'835","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.773405+0000","last_change":"2024-09-14T11:59:03.773348+0000","last_active":"2024-09-14T11:59:03.773405+0000","last_peered":"2024-09-14T11:59:03.773405+0000","last_clean":"2024-09-14T11:59:03.773405+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:59:03.773405+0000","last_undegraded":"2024-09-14T11:59:03.773405+0000","last_fullsized":"2024-09-14T11:59:03.773405+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'835","last_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_deep_scrub":"263'835","last_deep_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.773269+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:28.622910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'331","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.247600+0000","last_change":"2024-09-14T11:58:56.247534+0000","last_active":"2024-09-14T11:58:56.247600+0000","last_peered":"2024-09-14T11:58:56.247600+0000","last_clean":"2024-09-14T11:58:56.247600+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:56.247600+0000","last_undegraded":"2024-09-14T11:58:56.247600+0000","last_fullsized":"2024-09-14T11:58:56.247600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.247425+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:59.925743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730161,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":635,"num_read_kb":14446,"num_write":1067,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.619014+0000","last_change":"2024-09-14T11:59:05.618880+0000","last_active":"2024-09-14T11:59:05.619014+0000","last_peered":"2024-09-14T11:59:05.619014+0000","last_clean":"2024-09-14T11:59:05.619014+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:59:05.619014+0000","last_undegraded":"2024-09-14T11:59:05.619014+0000","last_fullsized":"2024-09-14T11:59:05.619014+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'902","last_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_deep_scrub":"263'902","last_deep_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.618786+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:06.981410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'348","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.257046+0000","last_change":"2024-09-14T11:58:54.256977+0000","last_active":"2024-09-14T11:58:54.257046+0000","last_peered":"2024-09-14T11:58:54.257046+0000","last_clean":"2024-09-14T11:58:54.257046+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:54.257046+0000","last_undegraded":"2024-09-14T11:58:54.257046+0000","last_fullsized":"2024-09-14T11:58:54.257046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.256878+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:40.203214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":23067,"num_write":1167,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'426","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.111927+0000","last_change":"2024-09-14T11:58:50.111851+0000","last_active":"2024-09-14T11:58:50.111927+0000","last_peered":"2024-09-14T11:58:50.111927+0000","last_clean":"2024-09-14T11:58:50.111927+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:58:50.111927+0000","last_undegraded":"2024-09-14T11:58:50.111927+0000","last_fullsized":"2024-09-14T11:58:50.111927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.111748+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:42.879545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'458","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.809548+0000","last_change":"2024-09-14T11:58:59.809485+0000","last_active":"2024-09-14T11:58:59.809548+0000","last_peered":"2024-09-14T11:58:59.809548+0000","last_clean":"2024-09-14T11:58:59.809548+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:58:59.809548+0000","last_undegraded":"2024-09-14T11:58:59.809548+0000","last_fullsized":"2024-09-14T11:58:59.809548+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.809380+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:00.989122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'433","reported_seq":1165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.215839+0000","last_change":"2024-09-14T11:58:58.215773+0000","last_active":"2024-09-14T11:58:58.215839+0000","last_peered":"2024-09-14T11:58:58.215839+0000","last_clean":"2024-09-14T11:58:58.215839+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:58.215839+0000","last_undegraded":"2024-09-14T11:58:58.215839+0000","last_fullsized":"2024-09-14T11:58:58.215839+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.215635+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:41.047428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":936,"num_read_kb":12852,"num_write":1596,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'534","reported_seq":2297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.145450+0000","last_change":"2024-09-14T11:59:02.145362+0000","last_active":"2024-09-14T11:59:02.145450+0000","last_peered":"2024-09-14T11:59:02.145450+0000","last_clean":"2024-09-14T11:59:02.145450+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:59:02.145450+0000","last_undegraded":"2024-09-14T11:59:02.145450+0000","last_fullsized":"2024-09-14T11:59:02.145450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.145274+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:24.998860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'342","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700586+0000","last_change":"2024-09-14T11:58:52.700509+0000","last_active":"2024-09-14T11:58:52.700586+0000","last_peered":"2024-09-14T11:58:52.700586+0000","last_clean":"2024-09-14T11:58:52.700586+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:52.700586+0000","last_undegraded":"2024-09-14T11:58:52.700586+0000","last_fullsized":"2024-09-14T11:58:52.700586+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700378+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:26.328993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":13589,"num_write":1026,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'640","reported_seq":2102,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.631183+0000","last_change":"2024-09-14T11:59:02.631183+0000","last_active":"2024-09-14T11:59:02.631183+0000","last_peered":"2024-09-14T11:59:02.631183+0000","last_clean":"2024-09-14T11:59:02.631183+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:59:02.631183+0000","last_undegraded":"2024-09-14T11:59:02.631183+0000","last_fullsized":"2024-09-14T11:59:02.631183+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'640","last_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_deep_scrub":"263'640","last_deep_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.631096+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:52.105995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'390","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.716106+0000","last_change":"2024-09-14T11:58:51.716046+0000","last_active":"2024-09-14T11:58:51.716106+0000","last_peered":"2024-09-14T11:58:51.716106+0000","last_clean":"2024-09-14T11:58:51.716106+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:51.716106+0000","last_undegraded":"2024-09-14T11:58:51.716106+0000","last_fullsized":"2024-09-14T11:58:51.716106+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'390","last_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_deep_scrub":"263'390","last_deep_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.715916+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:38.249633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":713,"num_read_kb":72218,"num_write":1254,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1148","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.092931+0000","last_change":"2024-09-14T11:58:54.092857+0000","last_active":"2024-09-14T11:58:54.092931+0000","last_peered":"2024-09-14T11:58:54.092931+0000","last_clean":"2024-09-14T11:58:54.092931+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:58:54.092931+0000","last_undegraded":"2024-09-14T11:58:54.092931+0000","last_fullsized":"2024-09-14T11:58:54.092931+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.092741+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:41.284736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'354","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.762990+0000","last_change":"2024-09-14T11:58:49.762926+0000","last_active":"2024-09-14T11:58:49.762990+0000","last_peered":"2024-09-14T11:58:49.762990+0000","last_clean":"2024-09-14T11:58:49.762990+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:49.762990+0000","last_undegraded":"2024-09-14T11:58:49.762990+0000","last_fullsized":"2024-09-14T11:58:49.762990+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.762804+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:03.472810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":653,"num_read_kb":16353,"num_write":1203,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'441","reported_seq":2068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.097718+0000","last_change":"2024-09-14T11:58:53.097650+0000","last_active":"2024-09-14T11:58:53.097718+0000","last_peered":"2024-09-14T11:58:53.097718+0000","last_clean":"2024-09-14T11:58:53.097718+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:58:53.097718+0000","last_undegraded":"2024-09-14T11:58:53.097718+0000","last_fullsized":"2024-09-14T11:58:53.097718+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.097548+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:21.145958+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1179,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'325","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.248701+0000","last_change":"2024-09-14T11:58:50.248618+0000","last_active":"2024-09-14T11:58:50.248701+0000","last_peered":"2024-09-14T11:58:50.248701+0000","last_clean":"2024-09-14T11:58:50.248701+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:50.248701+0000","last_undegraded":"2024-09-14T11:58:50.248701+0000","last_fullsized":"2024-09-14T11:58:50.248701+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.248492+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:11.374577+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730152,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":6224,"num_write":1046,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'761","reported_seq":2349,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.808932+0000","last_change":"2024-09-14T11:59:01.808871+0000","last_active":"2024-09-14T11:59:01.808932+0000","last_peered":"2024-09-14T11:59:01.808932+0000","last_clean":"2024-09-14T11:59:01.808932+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:59:01.808932+0000","last_undegraded":"2024-09-14T11:59:01.808932+0000","last_fullsized":"2024-09-14T11:59:01.808932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.808745+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:36.042147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'370","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.123218+0000","last_change":"2024-09-14T11:58:47.123218+0000","last_active":"2024-09-14T11:58:47.123218+0000","last_peered":"2024-09-14T11:58:47.123218+0000","last_clean":"2024-09-14T11:58:47.123218+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:47.123218+0000","last_undegraded":"2024-09-14T11:58:47.123218+0000","last_fullsized":"2024-09-14T11:58:47.123218+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.123129+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:41.680446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170217,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":11097,"num_write":1169,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.739868+0000","last_change":"2024-09-14T11:59:18.739808+0000","last_active":"2024-09-14T11:59:18.739868+0000","last_peered":"2024-09-14T11:59:18.739868+0000","last_clean":"2024-09-14T11:59:18.739868+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:59:18.739868+0000","last_undegraded":"2024-09-14T11:59:18.739868+0000","last_fullsized":"2024-09-14T11:59:18.739868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.739718+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:04.826400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'438","reported_seq":2163,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.290385+0000","last_change":"2024-09-14T11:58:57.290385+0000","last_active":"2024-09-14T11:58:57.290385+0000","last_peered":"2024-09-14T11:58:57.290385+0000","last_clean":"2024-09-14T11:58:57.290385+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:57.290385+0000","last_undegraded":"2024-09-14T11:58:57.290385+0000","last_fullsized":"2024-09-14T11:58:57.290385+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.290287+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:14.201274+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'363","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.185308+0000","last_change":"2024-09-14T11:58:53.185211+0000","last_active":"2024-09-14T11:58:53.185308+0000","last_peered":"2024-09-14T11:58:53.185308+0000","last_clean":"2024-09-14T11:58:53.185308+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:53.185308+0000","last_undegraded":"2024-09-14T11:58:53.185308+0000","last_fullsized":"2024-09-14T11:58:53.185308+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.185066+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:33.650629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":709,"num_read_kb":79863,"num_write":1135,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.555205+0000","last_change":"2024-09-14T11:59:08.555143+0000","last_active":"2024-09-14T11:59:08.555205+0000","last_peered":"2024-09-14T11:59:08.555205+0000","last_clean":"2024-09-14T11:59:08.555205+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:59:08.555205+0000","last_undegraded":"2024-09-14T11:59:08.555205+0000","last_fullsized":"2024-09-14T11:59:08.555205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.555050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.084087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.035276+0000","last_change":"2024-09-14T11:59:08.035219+0000","last_active":"2024-09-14T11:59:08.035276+0000","last_peered":"2024-09-14T11:59:08.035276+0000","last_clean":"2024-09-14T11:59:08.035276+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:59:08.035276+0000","last_undegraded":"2024-09-14T11:59:08.035276+0000","last_fullsized":"2024-09-14T11:59:08.035276+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.035130+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:34.188253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1166,"num_write":430,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.132712+0000","last_change":"2024-09-14T11:59:17.132653+0000","last_active":"2024-09-14T11:59:17.132712+0000","last_peered":"2024-09-14T11:59:17.132712+0000","last_clean":"2024-09-14T11:59:17.132712+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:59:17.132712+0000","last_undegraded":"2024-09-14T11:59:17.132712+0000","last_fullsized":"2024-09-14T11:59:17.132712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.132565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2513","reported_seq":4340,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.259163+0000","last_change":"2024-09-14T11:59:21.259163+0000","last_active":"2024-09-14T11:59:21.259163+0000","last_peered":"2024-09-14T11:59:21.259163+0000","last_clean":"2024-09-14T11:59:21.259163+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:59:21.259163+0000","last_undegraded":"2024-09-14T11:59:21.259163+0000","last_fullsized":"2024-09-14T11:59:21.259163+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2513","last_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_deep_scrub":"263'2513","last_deep_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.259077+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":2500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:46.514561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1509","reported_seq":3178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.671832+0000","last_change":"2024-09-14T11:58:59.671768+0000","last_active":"2024-09-14T11:58:59.671832+0000","last_peered":"2024-09-14T11:58:59.671832+0000","last_clean":"2024-09-14T11:58:59.671832+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:58:59.671832+0000","last_undegraded":"2024-09-14T11:58:59.671832+0000","last_fullsized":"2024-09-14T11:58:59.671832+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1509","last_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_deep_scrub":"263'1509","last_deep_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.671671+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":1400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:49.912175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'351","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.126303+0000","last_change":"2024-09-14T11:58:45.126234+0000","last_active":"2024-09-14T11:58:45.126303+0000","last_peered":"2024-09-14T11:58:45.126303+0000","last_clean":"2024-09-14T11:58:45.126303+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:45.126303+0000","last_undegraded":"2024-09-14T11:58:45.126303+0000","last_fullsized":"2024-09-14T11:58:45.126303+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.126037+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:48.415741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":7357,"num_write":1125,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.195824+0000","last_change":"2024-09-14T11:59:04.195824+0000","last_active":"2024-09-14T11:59:04.195824+0000","last_peered":"2024-09-14T11:59:04.195824+0000","last_clean":"2024-09-14T11:59:04.195824+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:59:04.195824+0000","last_undegraded":"2024-09-14T11:59:04.195824+0000","last_fullsized":"2024-09-14T11:59:04.195824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.195724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:15.148217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'108","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.828594+0000","last_change":"2024-09-14T11:59:11.828534+0000","last_active":"2024-09-14T11:59:11.828594+0000","last_peered":"2024-09-14T11:59:11.828594+0000","last_clean":"2024-09-14T11:59:11.828594+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:59:11.828594+0000","last_undegraded":"2024-09-14T11:59:11.828594+0000","last_fullsized":"2024-09-14T11:59:11.828594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.828433+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:51.968761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.692870+0000","last_change":"2024-09-14T11:59:14.692789+0000","last_active":"2024-09-14T11:59:14.692870+0000","last_peered":"2024-09-14T11:59:14.692870+0000","last_clean":"2024-09-14T11:59:14.692870+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:59:14.692870+0000","last_undegraded":"2024-09-14T11:59:14.692870+0000","last_fullsized":"2024-09-14T11:59:14.692870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.692686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:53.432442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.085836+0000","last_change":"2024-09-14T11:59:18.085710+0000","last_active":"2024-09-14T11:59:18.085836+0000","last_peered":"2024-09-14T11:59:18.085836+0000","last_clean":"2024-09-14T11:59:18.085836+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:59:18.085836+0000","last_undegraded":"2024-09-14T11:59:18.085836+0000","last_fullsized":"2024-09-14T11:59:18.085836+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.085608+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:28.679206+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'633","reported_seq":2386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.033519+0000","last_change":"2024-09-14T11:58:53.033445+0000","last_active":"2024-09-14T11:58:53.033519+0000","last_peered":"2024-09-14T11:58:53.033519+0000","last_clean":"2024-09-14T11:58:53.033519+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:53.033519+0000","last_undegraded":"2024-09-14T11:58:53.033519+0000","last_fullsized":"2024-09-14T11:58:53.033519+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'633","last_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_deep_scrub":"263'633","last_deep_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.033339+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.139377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'372","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.195094+0000","last_change":"2024-09-14T11:58:52.195024+0000","last_active":"2024-09-14T11:58:52.195094+0000","last_peered":"2024-09-14T11:58:52.195094+0000","last_clean":"2024-09-14T11:58:52.195094+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:52.195094+0000","last_undegraded":"2024-09-14T11:58:52.195094+0000","last_fullsized":"2024-09-14T11:58:52.195094+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.194890+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:09.932572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":77744,"num_write":1160,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.177807+0000","last_change":"2024-09-14T11:59:07.177747+0000","last_active":"2024-09-14T11:59:07.177807+0000","last_peered":"2024-09-14T11:59:07.177807+0000","last_clean":"2024-09-14T11:59:07.177807+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:59:07.177807+0000","last_undegraded":"2024-09-14T11:59:07.177807+0000","last_fullsized":"2024-09-14T11:59:07.177807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.177676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:55.805641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'145","reported_seq":696,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.120684+0000","last_change":"2024-09-14T11:59:00.120684+0000","last_active":"2024-09-14T11:59:00.120684+0000","last_peered":"2024-09-14T11:59:00.120684+0000","last_clean":"2024-09-14T11:59:00.120684+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:59:00.120684+0000","last_undegraded":"2024-09-14T11:59:00.120684+0000","last_fullsized":"2024-09-14T11:59:00.120684+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.120596+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:09.503078+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'777","reported_seq":4527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.164587+0000","last_change":"2024-09-14T11:59:16.164519+0000","last_active":"2024-09-14T11:59:16.164587+0000","last_peered":"2024-09-14T11:59:16.164587+0000","last_clean":"2024-09-14T11:59:16.164587+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:59:16.164587+0000","last_undegraded":"2024-09-14T11:59:16.164587+0000","last_fullsized":"2024-09-14T11:59:16.164587+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.164426+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:13.531172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.666630+0000","last_change":"2024-09-14T11:59:20.666555+0000","last_active":"2024-09-14T11:59:20.666630+0000","last_peered":"2024-09-14T11:59:20.666630+0000","last_clean":"2024-09-14T11:59:20.666630+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:59:20.666630+0000","last_undegraded":"2024-09-14T11:59:20.666630+0000","last_fullsized":"2024-09-14T11:59:20.666630+0000","mapping_epoch":35,"log_start":"263'201","ondisk_log_start":"263'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.666459+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:01.439570+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'436","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.286138+0000","last_change":"2024-09-14T11:58:59.286059+0000","last_active":"2024-09-14T11:58:59.286138+0000","last_peered":"2024-09-14T11:58:59.286138+0000","last_clean":"2024-09-14T11:58:59.286138+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:58:59.286138+0000","last_undegraded":"2024-09-14T11:58:59.286138+0000","last_fullsized":"2024-09-14T11:58:59.286138+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.285928+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:01.883072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'327","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.702820+0000","last_change":"2024-09-14T11:58:47.702760+0000","last_active":"2024-09-14T11:58:47.702820+0000","last_peered":"2024-09-14T11:58:47.702820+0000","last_clean":"2024-09-14T11:58:47.702820+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:47.702820+0000","last_undegraded":"2024-09-14T11:58:47.702820+0000","last_fullsized":"2024-09-14T11:58:47.702820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.702654+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:45.134369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":94667,"num_write":978,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.520893+0000","last_change":"2024-09-14T11:59:10.520832+0000","last_active":"2024-09-14T11:59:10.520893+0000","last_peered":"2024-09-14T11:59:10.520893+0000","last_clean":"2024-09-14T11:59:10.520893+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:59:10.520893+0000","last_undegraded":"2024-09-14T11:59:10.520893+0000","last_fullsized":"2024-09-14T11:59:10.520893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.520751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:23.745612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'278","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.175990+0000","last_change":"2024-09-14T11:59:11.175916+0000","last_active":"2024-09-14T11:59:11.175990+0000","last_peered":"2024-09-14T11:59:11.175990+0000","last_clean":"2024-09-14T11:59:11.175990+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:59:11.175990+0000","last_undegraded":"2024-09-14T11:59:11.175990+0000","last_fullsized":"2024-09-14T11:59:11.175990+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.175829+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.855512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47840,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":445,"num_read_kb":1034,"num_write":358,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'812","reported_seq":2651,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.248791+0000","last_change":"2024-09-14T11:59:17.248791+0000","last_active":"2024-09-14T11:59:17.248791+0000","last_peered":"2024-09-14T11:59:17.248791+0000","last_clean":"2024-09-14T11:59:17.248791+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:59:17.248791+0000","last_undegraded":"2024-09-14T11:59:17.248791+0000","last_fullsized":"2024-09-14T11:59:17.248791+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'812","last_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_deep_scrub":"263'812","last_deep_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.248692+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:23.181243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'660","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.688886+0000","last_change":"2024-09-14T11:58:57.688828+0000","last_active":"2024-09-14T11:58:57.688886+0000","last_peered":"2024-09-14T11:58:57.688886+0000","last_clean":"2024-09-14T11:58:57.688886+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:57.688886+0000","last_undegraded":"2024-09-14T11:58:57.688886+0000","last_fullsized":"2024-09-14T11:58:57.688886+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'660","last_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_deep_scrub":"263'660","last_deep_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.688740+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:09.797199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'344","reported_seq":970,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.245207+0000","last_change":"2024-09-14T11:58:51.245207+0000","last_active":"2024-09-14T11:58:51.245207+0000","last_peered":"2024-09-14T11:58:51.245207+0000","last_clean":"2024-09-14T11:58:51.245207+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:51.245207+0000","last_undegraded":"2024-09-14T11:58:51.245207+0000","last_fullsized":"2024-09-14T11:58:51.245207+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.245091+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:42.023295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730185,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17523,"num_write":1016,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.097693+0000","last_change":"2024-09-14T11:59:05.097644+0000","last_active":"2024-09-14T11:59:05.097693+0000","last_peered":"2024-09-14T11:59:05.097693+0000","last_clean":"2024-09-14T11:59:05.097693+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:59:05.097693+0000","last_undegraded":"2024-09-14T11:59:05.097693+0000","last_fullsized":"2024-09-14T11:59:05.097693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.097558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:04.561569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'421","reported_seq":1045,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.512036+0000","last_change":"2024-09-14T11:59:12.512036+0000","last_active":"2024-09-14T11:59:12.512036+0000","last_peered":"2024-09-14T11:59:12.512036+0000","last_clean":"2024-09-14T11:59:12.512036+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:59:12.512036+0000","last_undegraded":"2024-09-14T11:59:12.512036+0000","last_fullsized":"2024-09-14T11:59:12.512036+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.511928+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.113276+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46953,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":681,"num_read_kb":1474,"num_write":542,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.031924+0000","last_change":"2024-09-14T11:59:05.031924+0000","last_active":"2024-09-14T11:59:05.031924+0000","last_peered":"2024-09-14T11:59:05.031924+0000","last_clean":"2024-09-14T11:59:05.031924+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:59:05.031924+0000","last_undegraded":"2024-09-14T11:59:05.031924+0000","last_fullsized":"2024-09-14T11:59:05.031924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.031837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:42.237118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'587","reported_seq":1408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.356816+0000","last_change":"2024-09-14T11:59:17.356754+0000","last_active":"2024-09-14T11:59:17.356816+0000","last_peered":"2024-09-14T11:59:17.356816+0000","last_clean":"2024-09-14T11:59:17.356816+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:59:17.356816+0000","last_undegraded":"2024-09-14T11:59:17.356816+0000","last_fullsized":"2024-09-14T11:59:17.356816+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'587","last_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_deep_scrub":"263'587","last_deep_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.356652+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.326137+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'452","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.816893+0000","last_change":"2024-09-14T11:58:54.816837+0000","last_active":"2024-09-14T11:58:54.816893+0000","last_peered":"2024-09-14T11:58:54.816893+0000","last_clean":"2024-09-14T11:58:54.816893+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:58:54.816893+0000","last_undegraded":"2024-09-14T11:58:54.816893+0000","last_fullsized":"2024-09-14T11:58:54.816893+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.816749+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:50.855590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'367","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.236737+0000","last_change":"2024-09-14T11:58:50.236667+0000","last_active":"2024-09-14T11:58:50.236737+0000","last_peered":"2024-09-14T11:58:50.236737+0000","last_clean":"2024-09-14T11:58:50.236737+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:50.236737+0000","last_undegraded":"2024-09-14T11:58:50.236737+0000","last_fullsized":"2024-09-14T11:58:50.236737+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.236566+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:38.811873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":60976,"num_write":1200,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"263'6","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.085267+0000","last_change":"2024-09-14T11:58:57.085209+0000","last_active":"2024-09-14T11:58:57.085267+0000","last_peered":"2024-09-14T11:58:57.085267+0000","last_clean":"2024-09-14T11:58:57.085267+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:57.085267+0000","last_undegraded":"2024-09-14T11:58:57.085267+0000","last_fullsized":"2024-09-14T11:58:57.085267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.085117+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:15.512672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'284","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.201561+0000","last_change":"2024-09-14T11:59:10.201561+0000","last_active":"2024-09-14T11:59:10.201561+0000","last_peered":"2024-09-14T11:59:10.201561+0000","last_clean":"2024-09-14T11:59:10.201561+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:59:10.201561+0000","last_undegraded":"2024-09-14T11:59:10.201561+0000","last_fullsized":"2024-09-14T11:59:10.201561+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.201469+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:48.613270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":494,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.268879+0000","last_change":"2024-09-14T11:59:16.268879+0000","last_active":"2024-09-14T11:59:16.268879+0000","last_peered":"2024-09-14T11:59:16.268879+0000","last_clean":"2024-09-14T11:59:16.268879+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:59:16.268879+0000","last_undegraded":"2024-09-14T11:59:16.268879+0000","last_fullsized":"2024-09-14T11:59:16.268879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.268790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:38.351368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'111","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.756721+0000","last_change":"2024-09-14T11:59:06.756656+0000","last_active":"2024-09-14T11:59:06.756721+0000","last_peered":"2024-09-14T11:59:06.756721+0000","last_clean":"2024-09-14T11:59:06.756721+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:59:06.756721+0000","last_undegraded":"2024-09-14T11:59:06.756721+0000","last_fullsized":"2024-09-14T11:59:06.756721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.756562+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:37.023051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'438","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.759714+0000","last_change":"2024-09-14T11:58:58.759653+0000","last_active":"2024-09-14T11:58:58.759714+0000","last_peered":"2024-09-14T11:58:58.759714+0000","last_clean":"2024-09-14T11:58:58.759714+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:58.759714+0000","last_undegraded":"2024-09-14T11:58:58.759714+0000","last_fullsized":"2024-09-14T11:58:58.759714+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.759554+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:42.260528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'324","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.255674+0000","last_change":"2024-09-14T11:58:49.255581+0000","last_active":"2024-09-14T11:58:49.255674+0000","last_peered":"2024-09-14T11:58:49.255674+0000","last_clean":"2024-09-14T11:58:49.255674+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:49.255674+0000","last_undegraded":"2024-09-14T11:58:49.255674+0000","last_fullsized":"2024-09-14T11:58:49.255674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.255417+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.505258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":11458,"num_write":967,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.050008+0000","last_change":"2024-09-14T11:58:58.050008+0000","last_active":"2024-09-14T11:58:58.050008+0000","last_peered":"2024-09-14T11:58:58.050008+0000","last_clean":"2024-09-14T11:58:58.050008+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:58:58.050008+0000","last_undegraded":"2024-09-14T11:58:58.050008+0000","last_fullsized":"2024-09-14T11:58:58.050008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.049910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:15.923228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'302","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.215641+0000","last_change":"2024-09-14T11:59:10.215574+0000","last_active":"2024-09-14T11:59:10.215641+0000","last_peered":"2024-09-14T11:59:10.215641+0000","last_clean":"2024-09-14T11:59:10.215641+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:59:10.215641+0000","last_undegraded":"2024-09-14T11:59:10.215641+0000","last_fullsized":"2024-09-14T11:59:10.215641+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.215461+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.687739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50465,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":1040,"num_write":378,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.998959+0000","last_change":"2024-09-14T11:59:03.998865+0000","last_active":"2024-09-14T11:59:03.998959+0000","last_peered":"2024-09-14T11:59:03.998959+0000","last_clean":"2024-09-14T11:59:03.998959+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:59:03.998959+0000","last_undegraded":"2024-09-14T11:59:03.998959+0000","last_fullsized":"2024-09-14T11:59:03.998959+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.998777+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.585506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'146","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.046023+0000","last_change":"2024-09-14T11:59:16.045957+0000","last_active":"2024-09-14T11:59:16.046023+0000","last_peered":"2024-09-14T11:59:16.046023+0000","last_clean":"2024-09-14T11:59:16.046023+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:59:16.046023+0000","last_undegraded":"2024-09-14T11:59:16.046023+0000","last_fullsized":"2024-09-14T11:59:16.046023+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.045861+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:48.038828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'439","reported_seq":2007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.012158+0000","last_change":"2024-09-14T11:58:57.012062+0000","last_active":"2024-09-14T11:58:57.012158+0000","last_peered":"2024-09-14T11:58:57.012158+0000","last_clean":"2024-09-14T11:58:57.012158+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:58:57.012158+0000","last_undegraded":"2024-09-14T11:58:57.012158+0000","last_fullsized":"2024-09-14T11:58:57.012158+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.011931+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:47.884035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.124210+0000","last_change":"2024-09-14T11:58:45.124210+0000","last_active":"2024-09-14T11:58:45.124210+0000","last_peered":"2024-09-14T11:58:45.124210+0000","last_clean":"2024-09-14T11:58:45.124210+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:45.124210+0000","last_undegraded":"2024-09-14T11:58:45.124210+0000","last_fullsized":"2024-09-14T11:58:45.124210+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.124078+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:42.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730158,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":20707,"num_write":1086,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.106858+0000","last_change":"2024-09-14T11:58:55.106800+0000","last_active":"2024-09-14T11:58:55.106858+0000","last_peered":"2024-09-14T11:58:55.106858+0000","last_clean":"2024-09-14T11:58:55.106858+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:58:55.106858+0000","last_undegraded":"2024-09-14T11:58:55.106858+0000","last_fullsized":"2024-09-14T11:58:55.106858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.106702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:25.435659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'496","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.014990+0000","last_change":"2024-09-14T11:59:01.014926+0000","last_active":"2024-09-14T11:59:01.014990+0000","last_peered":"2024-09-14T11:59:01.014990+0000","last_clean":"2024-09-14T11:59:01.014990+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:59:01.014990+0000","last_undegraded":"2024-09-14T11:59:01.014990+0000","last_fullsized":"2024-09-14T11:59:01.014990+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.014817+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:05.088724+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104584,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":850,"num_read_kb":2088,"num_write":692,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.103671+0000","last_change":"2024-09-14T11:59:01.103600+0000","last_active":"2024-09-14T11:59:01.103671+0000","last_peered":"2024-09-14T11:59:01.103671+0000","last_clean":"2024-09-14T11:59:01.103671+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:59:01.103671+0000","last_undegraded":"2024-09-14T11:59:01.103671+0000","last_fullsized":"2024-09-14T11:59:01.103671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.103512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.351272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'154","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.165391+0000","last_change":"2024-09-14T11:59:11.165330+0000","last_active":"2024-09-14T11:59:11.165391+0000","last_peered":"2024-09-14T11:59:11.165391+0000","last_clean":"2024-09-14T11:59:11.165391+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:59:11.165391+0000","last_undegraded":"2024-09-14T11:59:11.165391+0000","last_fullsized":"2024-09-14T11:59:11.165391+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.165237+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:39.619620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'486","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.754545+0000","last_change":"2024-09-14T11:58:50.754456+0000","last_active":"2024-09-14T11:58:50.754545+0000","last_peered":"2024-09-14T11:58:50.754545+0000","last_clean":"2024-09-14T11:58:50.754545+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:50.754545+0000","last_undegraded":"2024-09-14T11:58:50.754545+0000","last_fullsized":"2024-09-14T11:58:50.754545+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'486","last_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_deep_scrub":"263'486","last_deep_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.754357+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:01.136208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'383","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.397679+0000","last_change":"2024-09-14T11:58:45.397624+0000","last_active":"2024-09-14T11:58:45.397679+0000","last_peered":"2024-09-14T11:58:45.397679+0000","last_clean":"2024-09-14T11:58:45.397679+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:45.397679+0000","last_undegraded":"2024-09-14T11:58:45.397679+0000","last_fullsized":"2024-09-14T11:58:45.397679+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.397519+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:00.442423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460262,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":720,"num_read_kb":26829,"num_write":1334,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.076851+0000","last_change":"2024-09-14T11:58:56.076851+0000","last_active":"2024-09-14T11:58:56.076851+0000","last_peered":"2024-09-14T11:58:56.076851+0000","last_clean":"2024-09-14T11:58:56.076851+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:58:56.076851+0000","last_undegraded":"2024-09-14T11:58:56.076851+0000","last_fullsized":"2024-09-14T11:58:56.076851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.076745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:27.744336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'343","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.832169+0000","last_change":"2024-09-14T11:59:10.832169+0000","last_active":"2024-09-14T11:59:10.832169+0000","last_peered":"2024-09-14T11:59:10.832169+0000","last_clean":"2024-09-14T11:59:10.832169+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:59:10.832169+0000","last_undegraded":"2024-09-14T11:59:10.832169+0000","last_fullsized":"2024-09-14T11:59:10.832169+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.832082+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:56.975816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.079968+0000","last_change":"2024-09-14T11:59:15.079968+0000","last_active":"2024-09-14T11:59:15.079968+0000","last_peered":"2024-09-14T11:59:15.079968+0000","last_clean":"2024-09-14T11:59:15.079968+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:59:15.079968+0000","last_undegraded":"2024-09-14T11:59:15.079968+0000","last_fullsized":"2024-09-14T11:59:15.079968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.079878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.130970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.254538+0000","last_change":"2024-09-14T11:59:24.254538+0000","last_active":"2024-09-14T11:59:24.254538+0000","last_peered":"2024-09-14T11:59:24.254538+0000","last_clean":"2024-09-14T11:59:24.254538+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:59:24.254538+0000","last_undegraded":"2024-09-14T11:59:24.254538+0000","last_fullsized":"2024-09-14T11:59:24.254538+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:59:24.254431+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:59:24.254431+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.254431+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:11.699979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'768","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.761030+0000","last_change":"2024-09-14T11:58:51.760938+0000","last_active":"2024-09-14T11:58:51.761030+0000","last_peered":"2024-09-14T11:58:51.761030+0000","last_clean":"2024-09-14T11:58:51.761030+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:51.761030+0000","last_undegraded":"2024-09-14T11:58:51.761030+0000","last_fullsized":"2024-09-14T11:58:51.761030+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.760830+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.067687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4017,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.685593+0000","last_change":"2024-09-14T11:58:46.685522+0000","last_active":"2024-09-14T11:58:46.685593+0000","last_peered":"2024-09-14T11:58:46.685593+0000","last_clean":"2024-09-14T11:58:46.685593+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:46.685593+0000","last_undegraded":"2024-09-14T11:58:46.685593+0000","last_fullsized":"2024-09-14T11:58:46.685593+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.685398+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:45.698748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":27548,"num_write":1230,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.121243+0000","last_change":"2024-09-14T11:58:59.121243+0000","last_active":"2024-09-14T11:58:59.121243+0000","last_peered":"2024-09-14T11:58:59.121243+0000","last_clean":"2024-09-14T11:58:59.121243+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:58:59.121243+0000","last_undegraded":"2024-09-14T11:58:59.121243+0000","last_fullsized":"2024-09-14T11:58:59.121243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.121156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'352","reported_seq":957,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.098104+0000","last_change":"2024-09-14T11:58:59.098104+0000","last_active":"2024-09-14T11:58:59.098104+0000","last_peered":"2024-09-14T11:58:59.098104+0000","last_clean":"2024-09-14T11:58:59.098104+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:59.098104+0000","last_undegraded":"2024-09-14T11:58:59.098104+0000","last_fullsized":"2024-09-14T11:58:59.098104+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.098007+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:42.018589+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'754","reported_seq":2339,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.094373+0000","last_change":"2024-09-14T11:59:02.094373+0000","last_active":"2024-09-14T11:59:02.094373+0000","last_peered":"2024-09-14T11:59:02.094373+0000","last_clean":"2024-09-14T11:59:02.094373+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:59:02.094373+0000","last_undegraded":"2024-09-14T11:59:02.094373+0000","last_fullsized":"2024-09-14T11:59:02.094373+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.094282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:59.227105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'123","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.151465+0000","last_change":"2024-09-14T11:59:08.151371+0000","last_active":"2024-09-14T11:59:08.151465+0000","last_peered":"2024-09-14T11:59:08.151465+0000","last_clean":"2024-09-14T11:59:08.151465+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:59:08.151465+0000","last_undegraded":"2024-09-14T11:59:08.151465+0000","last_fullsized":"2024-09-14T11:59:08.151465+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.151256+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.059464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'748","reported_seq":2270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.737402+0000","last_change":"2024-09-14T11:58:52.737338+0000","last_active":"2024-09-14T11:58:52.737402+0000","last_peered":"2024-09-14T11:58:52.737402+0000","last_clean":"2024-09-14T11:58:52.737402+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:58:52.737402+0000","last_undegraded":"2024-09-14T11:58:52.737402+0000","last_fullsized":"2024-09-14T11:58:52.737402+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.737257+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:36.814154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.699843+0000","last_change":"2024-09-14T11:58:45.699782+0000","last_active":"2024-09-14T11:58:45.699843+0000","last_peered":"2024-09-14T11:58:45.699843+0000","last_clean":"2024-09-14T11:58:45.699843+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:45.699843+0000","last_undegraded":"2024-09-14T11:58:45.699843+0000","last_fullsized":"2024-09-14T11:58:45.699843+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.699650+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:10.613326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":90386,"num_write":1114,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1457,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.598642+0000","last_change":"2024-09-14T11:59:07.598642+0000","last_active":"2024-09-14T11:59:07.598642+0000","last_peered":"2024-09-14T11:59:07.598642+0000","last_clean":"2024-09-14T11:59:07.598642+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:59:07.598642+0000","last_undegraded":"2024-09-14T11:59:07.598642+0000","last_fullsized":"2024-09-14T11:59:07.598642+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.598558+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:48.979302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'97","reported_seq":629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.229635+0000","last_change":"2024-09-14T11:59:08.229635+0000","last_active":"2024-09-14T11:59:08.229635+0000","last_peered":"2024-09-14T11:59:08.229635+0000","last_clean":"2024-09-14T11:59:08.229635+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:59:08.229635+0000","last_undegraded":"2024-09-14T11:59:08.229635+0000","last_fullsized":"2024-09-14T11:59:08.229635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.229543+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:06.240077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'776","reported_seq":2409,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.752708+0000","last_change":"2024-09-14T11:59:03.752708+0000","last_active":"2024-09-14T11:59:03.752708+0000","last_peered":"2024-09-14T11:59:03.752708+0000","last_clean":"2024-09-14T11:59:03.752708+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:59:03.752708+0000","last_undegraded":"2024-09-14T11:59:03.752708+0000","last_fullsized":"2024-09-14T11:59:03.752708+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.752612+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:52.775220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.704072+0000","last_change":"2024-09-14T11:59:19.704011+0000","last_active":"2024-09-14T11:59:19.704072+0000","last_peered":"2024-09-14T11:59:19.704072+0000","last_clean":"2024-09-14T11:59:19.704072+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:59:19.704072+0000","last_undegraded":"2024-09-14T11:59:19.704072+0000","last_fullsized":"2024-09-14T11:59:19.704072+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.703915+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:03.125097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'790","reported_seq":2352,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.214441+0000","last_change":"2024-09-14T11:58:54.214441+0000","last_active":"2024-09-14T11:58:54.214441+0000","last_peered":"2024-09-14T11:58:54.214441+0000","last_clean":"2024-09-14T11:58:54.214441+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:58:54.214441+0000","last_undegraded":"2024-09-14T11:58:54.214441+0000","last_fullsized":"2024-09-14T11:58:54.214441+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.214346+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:33.379939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'328","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.320537+0000","last_change":"2024-09-14T11:58:48.320469+0000","last_active":"2024-09-14T11:58:48.320537+0000","last_peered":"2024-09-14T11:58:48.320537+0000","last_clean":"2024-09-14T11:58:48.320537+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:48.320537+0000","last_undegraded":"2024-09-14T11:58:48.320537+0000","last_fullsized":"2024-09-14T11:58:48.320537+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.320357+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.438966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029101,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1389,"num_write":1004,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.890178+0000","last_change":"2024-09-14T11:59:06.890106+0000","last_active":"2024-09-14T11:59:06.890178+0000","last_peered":"2024-09-14T11:59:06.890178+0000","last_clean":"2024-09-14T11:59:06.890178+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:59:06.890178+0000","last_undegraded":"2024-09-14T11:59:06.890178+0000","last_fullsized":"2024-09-14T11:59:06.890178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.890026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:38.506072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'404","reported_seq":1020,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.470070+0000","last_change":"2024-09-14T11:59:13.470070+0000","last_active":"2024-09-14T11:59:13.470070+0000","last_peered":"2024-09-14T11:59:13.470070+0000","last_clean":"2024-09-14T11:59:13.470070+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:59:13.470070+0000","last_undegraded":"2024-09-14T11:59:13.470070+0000","last_fullsized":"2024-09-14T11:59:13.470070+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.469964+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.308998+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45959,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1239,"num_read_kb":1795,"num_write":1786,"num_write_kb":1623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.747632+0000","last_change":"2024-09-14T11:59:02.747632+0000","last_active":"2024-09-14T11:59:02.747632+0000","last_peered":"2024-09-14T11:59:02.747632+0000","last_clean":"2024-09-14T11:59:02.747632+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:59:02.747632+0000","last_undegraded":"2024-09-14T11:59:02.747632+0000","last_fullsized":"2024-09-14T11:59:02.747632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.747498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'197","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.165634+0000","last_change":"2024-09-14T11:59:09.165579+0000","last_active":"2024-09-14T11:59:09.165634+0000","last_peered":"2024-09-14T11:59:09.165634+0000","last_clean":"2024-09-14T11:59:09.165634+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:59:09.165634+0000","last_undegraded":"2024-09-14T11:59:09.165634+0000","last_fullsized":"2024-09-14T11:59:09.165634+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.165485+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:37.416199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'648","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.745492+0000","last_change":"2024-09-14T11:58:53.745432+0000","last_active":"2024-09-14T11:58:53.745492+0000","last_peered":"2024-09-14T11:58:53.745492+0000","last_clean":"2024-09-14T11:58:53.745492+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:58:53.745492+0000","last_undegraded":"2024-09-14T11:58:53.745492+0000","last_fullsized":"2024-09-14T11:58:53.745492+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'648","last_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_deep_scrub":"263'648","last_deep_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.745349+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":600,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:32.204852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.168663+0000","last_change":"2024-09-14T11:58:46.168663+0000","last_active":"2024-09-14T11:58:46.168663+0000","last_peered":"2024-09-14T11:58:46.168663+0000","last_clean":"2024-09-14T11:58:46.168663+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:58:46.168663+0000","last_undegraded":"2024-09-14T11:58:46.168663+0000","last_fullsized":"2024-09-14T11:58:46.168663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.168543+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:01.548000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.569275+0000","last_change":"2024-09-14T11:58:46.569219+0000","last_active":"2024-09-14T11:58:46.569275+0000","last_peered":"2024-09-14T11:58:46.569275+0000","last_clean":"2024-09-14T11:58:46.569275+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:58:46.569275+0000","last_undegraded":"2024-09-14T11:58:46.569275+0000","last_fullsized":"2024-09-14T11:58:46.569275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.569138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:18.058116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'352","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.444433+0000","last_change":"2024-09-14T11:58:44.444382+0000","last_active":"2024-09-14T11:58:44.444433+0000","last_peered":"2024-09-14T11:58:44.444433+0000","last_clean":"2024-09-14T11:58:44.444433+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:44.444433+0000","last_undegraded":"2024-09-14T11:58:44.444433+0000","last_fullsized":"2024-09-14T11:58:44.444433+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.444289+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:32.649496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":656,"num_read_kb":39235,"num_write":1025,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.108459+0000","last_change":"2024-09-14T11:59:04.108374+0000","last_active":"2024-09-14T11:59:04.108459+0000","last_peered":"2024-09-14T11:59:04.108459+0000","last_clean":"2024-09-14T11:59:04.108459+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:59:04.108459+0000","last_undegraded":"2024-09-14T11:59:04.108459+0000","last_fullsized":"2024-09-14T11:59:04.108459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.108274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:04.664406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'800","reported_seq":1507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.503767+0000","last_change":"2024-09-14T11:59:11.503710+0000","last_active":"2024-09-14T11:59:11.503767+0000","last_peered":"2024-09-14T11:59:11.503767+0000","last_clean":"2024-09-14T11:59:11.503767+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:59:11.503767+0000","last_undegraded":"2024-09-14T11:59:11.503767+0000","last_fullsized":"2024-09-14T11:59:11.503767+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.503605+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:34.646109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159942,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1557,"num_read_kb":3699,"num_write":1498,"num_write_kb":1345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106782,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.022630+0000","last_change":"2024-09-14T11:59:06.022564+0000","last_active":"2024-09-14T11:59:06.022630+0000","last_peered":"2024-09-14T11:59:06.022630+0000","last_clean":"2024-09-14T11:59:06.022630+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:59:06.022630+0000","last_undegraded":"2024-09-14T11:59:06.022630+0000","last_fullsized":"2024-09-14T11:59:06.022630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.022472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:49.065861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'192","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.787470+0000","last_change":"2024-09-14T11:59:08.787410+0000","last_active":"2024-09-14T11:59:08.787470+0000","last_peered":"2024-09-14T11:59:08.787470+0000","last_clean":"2024-09-14T11:59:08.787470+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:59:08.787470+0000","last_undegraded":"2024-09-14T11:59:08.787470+0000","last_fullsized":"2024-09-14T11:59:08.787470+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.787313+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.951609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.091215+0000","last_change":"2024-09-14T11:58:51.091140+0000","last_active":"2024-09-14T11:58:51.091215+0000","last_peered":"2024-09-14T11:58:51.091215+0000","last_clean":"2024-09-14T11:58:51.091215+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:58:51.091215+0000","last_undegraded":"2024-09-14T11:58:51.091215+0000","last_fullsized":"2024-09-14T11:58:51.091215+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.091045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:45.745869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.185772+0000","last_change":"2024-09-14T11:58:47.185772+0000","last_active":"2024-09-14T11:58:47.185772+0000","last_peered":"2024-09-14T11:58:47.185772+0000","last_clean":"2024-09-14T11:58:47.185772+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:58:47.185772+0000","last_undegraded":"2024-09-14T11:58:47.185772+0000","last_fullsized":"2024-09-14T11:58:47.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:42.752443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'294","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.189454+0000","last_change":"2024-09-14T11:58:43.189335+0000","last_active":"2024-09-14T11:58:43.189454+0000","last_peered":"2024-09-14T11:58:43.189454+0000","last_clean":"2024-09-14T11:58:43.189454+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:43.189454+0000","last_undegraded":"2024-09-14T11:58:43.189454+0000","last_fullsized":"2024-09-14T11:58:43.189454+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.189192+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.174639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":19285,"num_write":870,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.631742+0000","last_change":"2024-09-14T11:59:06.631675+0000","last_active":"2024-09-14T11:59:06.631742+0000","last_peered":"2024-09-14T11:59:06.631742+0000","last_clean":"2024-09-14T11:59:06.631742+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:59:06.631742+0000","last_undegraded":"2024-09-14T11:59:06.631742+0000","last_fullsized":"2024-09-14T11:59:06.631742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.631578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:27.585412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1337","reported_seq":3031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.084394+0000","last_change":"2024-09-14T11:59:04.084328+0000","last_active":"2024-09-14T11:59:04.084394+0000","last_peered":"2024-09-14T11:59:04.084394+0000","last_clean":"2024-09-14T11:59:04.084394+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:59:04.084394+0000","last_undegraded":"2024-09-14T11:59:04.084394+0000","last_fullsized":"2024-09-14T11:59:04.084394+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1337","last_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_deep_scrub":"263'1337","last_deep_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.084232+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":1300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.280837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147529,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":4061,"num_write":1198,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.204755+0000","last_change":"2024-09-14T11:59:14.204694+0000","last_active":"2024-09-14T11:59:14.204755+0000","last_peered":"2024-09-14T11:59:14.204755+0000","last_clean":"2024-09-14T11:59:14.204755+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:59:14.204755+0000","last_undegraded":"2024-09-14T11:59:14.204755+0000","last_fullsized":"2024-09-14T11:59:14.204755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.204609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:29.615881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":599,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.143196+0000","last_change":"2024-09-14T11:59:12.143196+0000","last_active":"2024-09-14T11:59:12.143196+0000","last_peered":"2024-09-14T11:59:12.143196+0000","last_clean":"2024-09-14T11:59:12.143196+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:59:12.143196+0000","last_undegraded":"2024-09-14T11:59:12.143196+0000","last_fullsized":"2024-09-14T11:59:12.143196+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.143119+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:39.907735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'940","reported_seq":2816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.240569+0000","last_change":"2024-09-14T11:58:52.240513+0000","last_active":"2024-09-14T11:58:52.240569+0000","last_peered":"2024-09-14T11:58:52.240569+0000","last_clean":"2024-09-14T11:58:52.240569+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:58:52.240569+0000","last_undegraded":"2024-09-14T11:58:52.240569+0000","last_fullsized":"2024-09-14T11:58:52.240569+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'940","last_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_deep_scrub":"263'940","last_deep_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.240421+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:19.620785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.087405+0000","last_change":"2024-09-14T11:58:44.087353+0000","last_active":"2024-09-14T11:58:44.087405+0000","last_peered":"2024-09-14T11:58:44.087405+0000","last_clean":"2024-09-14T11:58:44.087405+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:58:44.087405+0000","last_undegraded":"2024-09-14T11:58:44.087405+0000","last_fullsized":"2024-09-14T11:58:44.087405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.087274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.959220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.207333+0000","last_change":"2024-09-14T11:58:44.207283+0000","last_active":"2024-09-14T11:58:44.207333+0000","last_peered":"2024-09-14T11:58:44.207333+0000","last_clean":"2024-09-14T11:58:44.207333+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:44.207333+0000","last_undegraded":"2024-09-14T11:58:44.207333+0000","last_fullsized":"2024-09-14T11:58:44.207333+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.207202+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.074753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":14745,"num_write":993,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.123433+0000","last_change":"2024-09-14T11:58:52.123366+0000","last_active":"2024-09-14T11:58:52.123433+0000","last_peered":"2024-09-14T11:58:52.123433+0000","last_clean":"2024-09-14T11:58:52.123433+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:58:52.123433+0000","last_undegraded":"2024-09-14T11:58:52.123433+0000","last_fullsized":"2024-09-14T11:58:52.123433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.123283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:43.905032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'300","reported_seq":1582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.173907+0000","last_change":"2024-09-14T11:59:09.173844+0000","last_active":"2024-09-14T11:59:09.173907+0000","last_peered":"2024-09-14T11:59:09.173907+0000","last_clean":"2024-09-14T11:59:09.173907+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:59:09.173907+0000","last_undegraded":"2024-09-14T11:59:09.173907+0000","last_fullsized":"2024-09-14T11:59:09.173907+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.173746+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:19.388852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.984467+0000","last_change":"2024-09-14T11:59:04.984412+0000","last_active":"2024-09-14T11:59:04.984467+0000","last_peered":"2024-09-14T11:59:04.984467+0000","last_clean":"2024-09-14T11:59:04.984467+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:59:04.984467+0000","last_undegraded":"2024-09-14T11:59:04.984467+0000","last_fullsized":"2024-09-14T11:59:04.984467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.984302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:51.608454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'266","reported_seq":867,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.282776+0000","last_change":"2024-09-14T11:59:20.282776+0000","last_active":"2024-09-14T11:59:20.282776+0000","last_peered":"2024-09-14T11:59:20.282776+0000","last_clean":"2024-09-14T11:59:20.282776+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:59:20.282776+0000","last_undegraded":"2024-09-14T11:59:20.282776+0000","last_fullsized":"2024-09-14T11:59:20.282776+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'266","last_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_deep_scrub":"263'266","last_deep_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.282670+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:28.650824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'532","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.215680+0000","last_change":"2024-09-14T11:58:55.215616+0000","last_active":"2024-09-14T11:58:55.215680+0000","last_peered":"2024-09-14T11:58:55.215680+0000","last_clean":"2024-09-14T11:58:55.215680+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:58:55.215680+0000","last_undegraded":"2024-09-14T11:58:55.215680+0000","last_fullsized":"2024-09-14T11:58:55.215680+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.215524+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:07.598615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.528258+0000","last_change":"2024-09-14T11:58:45.528200+0000","last_active":"2024-09-14T11:58:45.528258+0000","last_peered":"2024-09-14T11:58:45.528258+0000","last_clean":"2024-09-14T11:58:45.528258+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:58:45.528258+0000","last_undegraded":"2024-09-14T11:58:45.528258+0000","last_fullsized":"2024-09-14T11:58:45.528258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.528111+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:55.865518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'318","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.744061+0000","last_change":"2024-09-14T11:58:44.744001+0000","last_active":"2024-09-14T11:58:44.744061+0000","last_peered":"2024-09-14T11:58:44.744061+0000","last_clean":"2024-09-14T11:58:44.744061+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:44.744061+0000","last_undegraded":"2024-09-14T11:58:44.744061+0000","last_fullsized":"2024-09-14T11:58:44.744061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.743862+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.790267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":28769,"num_write":1006,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.075990+0000","last_change":"2024-09-14T11:59:11.075932+0000","last_active":"2024-09-14T11:59:11.075990+0000","last_peered":"2024-09-14T11:59:11.075990+0000","last_clean":"2024-09-14T11:59:11.075990+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:59:11.075990+0000","last_undegraded":"2024-09-14T11:59:11.075990+0000","last_fullsized":"2024-09-14T11:59:11.075990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.075841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:14.957973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'149","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.277368+0000","last_change":"2024-09-14T11:59:13.277307+0000","last_active":"2024-09-14T11:59:13.277368+0000","last_peered":"2024-09-14T11:59:13.277368+0000","last_clean":"2024-09-14T11:59:13.277368+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:59:13.277368+0000","last_undegraded":"2024-09-14T11:59:13.277368+0000","last_fullsized":"2024-09-14T11:59:13.277368+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.277197+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:07.842082+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.741570+0000","last_change":"2024-09-14T11:59:01.741491+0000","last_active":"2024-09-14T11:59:01.741570+0000","last_peered":"2024-09-14T11:59:01.741570+0000","last_clean":"2024-09-14T11:59:01.741570+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:59:01.741570+0000","last_undegraded":"2024-09-14T11:59:01.741570+0000","last_fullsized":"2024-09-14T11:59:01.741570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.741352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:48.805285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.291769+0000","last_change":"2024-09-14T11:59:19.291665+0000","last_active":"2024-09-14T11:59:19.291769+0000","last_peered":"2024-09-14T11:59:19.291769+0000","last_clean":"2024-09-14T11:59:19.291769+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:59:19.291769+0000","last_undegraded":"2024-09-14T11:59:19.291769+0000","last_fullsized":"2024-09-14T11:59:19.291769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.291569+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:45.556534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'389","reported_seq":1850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.196607+0000","last_change":"2024-09-14T11:58:51.196546+0000","last_active":"2024-09-14T11:58:51.196607+0000","last_peered":"2024-09-14T11:58:51.196607+0000","last_clean":"2024-09-14T11:58:51.196607+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:58:51.196607+0000","last_undegraded":"2024-09-14T11:58:51.196607+0000","last_fullsized":"2024-09-14T11:58:51.196607+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.196437+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:05.805557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'431","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.608058+0000","last_change":"2024-09-14T11:58:48.607993+0000","last_active":"2024-09-14T11:58:48.608058+0000","last_peered":"2024-09-14T11:58:48.608058+0000","last_clean":"2024-09-14T11:58:48.608058+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:48.608058+0000","last_undegraded":"2024-09-14T11:58:48.608058+0000","last_fullsized":"2024-09-14T11:58:48.608058+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.607870+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:44.650142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":3743,"num_write":1340,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.231477+0000","last_change":"2024-09-14T11:58:43.231436+0000","last_active":"2024-09-14T11:58:43.231477+0000","last_peered":"2024-09-14T11:58:43.231477+0000","last_clean":"2024-09-14T11:58:43.231477+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:58:43.231477+0000","last_undegraded":"2024-09-14T11:58:43.231477+0000","last_fullsized":"2024-09-14T11:58:43.231477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.231372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:04.024193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.032264+0000","last_change":"2024-09-14T11:59:02.032210+0000","last_active":"2024-09-14T11:59:02.032264+0000","last_peered":"2024-09-14T11:59:02.032264+0000","last_clean":"2024-09-14T11:59:02.032264+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:59:02.032264+0000","last_undegraded":"2024-09-14T11:59:02.032264+0000","last_fullsized":"2024-09-14T11:59:02.032264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.032101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.130324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'621","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.011394+0000","last_change":"2024-09-14T11:59:00.011394+0000","last_active":"2024-09-14T11:59:00.011394+0000","last_peered":"2024-09-14T11:59:00.011394+0000","last_clean":"2024-09-14T11:59:00.011394+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:59:00.011394+0000","last_undegraded":"2024-09-14T11:59:00.011394+0000","last_fullsized":"2024-09-14T11:59:00.011394+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'621","last_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_deep_scrub":"263'621","last_deep_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.011288+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:50.798461+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":2305,"num_write":884,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.705324+0000","last_change":"2024-09-14T11:59:15.705258+0000","last_active":"2024-09-14T11:59:15.705324+0000","last_peered":"2024-09-14T11:59:15.705324+0000","last_clean":"2024-09-14T11:59:15.705324+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:59:15.705324+0000","last_undegraded":"2024-09-14T11:59:15.705324+0000","last_fullsized":"2024-09-14T11:59:15.705324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.705170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:32.898069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.119668+0000","last_change":"2024-09-14T11:59:19.119668+0000","last_active":"2024-09-14T11:59:19.119668+0000","last_peered":"2024-09-14T11:59:19.119668+0000","last_clean":"2024-09-14T11:59:19.119668+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:59:19.119668+0000","last_undegraded":"2024-09-14T11:59:19.119668+0000","last_fullsized":"2024-09-14T11:59:19.119668+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.119565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:16.877063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.066843+0000","last_change":"2024-09-14T11:58:55.066775+0000","last_active":"2024-09-14T11:58:55.066843+0000","last_peered":"2024-09-14T11:58:55.066843+0000","last_clean":"2024-09-14T11:58:55.066843+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:58:55.066843+0000","last_undegraded":"2024-09-14T11:58:55.066843+0000","last_fullsized":"2024-09-14T11:58:55.066843+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.066670+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.411005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.152742+0000","last_change":"2024-09-14T11:58:50.152595+0000","last_active":"2024-09-14T11:58:50.152742+0000","last_peered":"2024-09-14T11:58:50.152742+0000","last_clean":"2024-09-14T11:58:50.152742+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:50.152742+0000","last_undegraded":"2024-09-14T11:58:50.152742+0000","last_fullsized":"2024-09-14T11:58:50.152742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.152451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:15.470870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":39755,"num_write":947,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.221566+0000","last_change":"2024-09-14T11:58:48.221461+0000","last_active":"2024-09-14T11:58:48.221566+0000","last_peered":"2024-09-14T11:58:48.221566+0000","last_clean":"2024-09-14T11:58:48.221566+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:58:48.221566+0000","last_undegraded":"2024-09-14T11:58:48.221566+0000","last_fullsized":"2024-09-14T11:58:48.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.221349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:16.934950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.788591+0000","last_change":"2024-09-14T11:58:57.788524+0000","last_active":"2024-09-14T11:58:57.788591+0000","last_peered":"2024-09-14T11:58:57.788591+0000","last_clean":"2024-09-14T11:58:57.788591+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:58:57.788591+0000","last_undegraded":"2024-09-14T11:58:57.788591+0000","last_fullsized":"2024-09-14T11:58:57.788591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.788438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.196517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'198","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.091120+0000","last_change":"2024-09-14T11:59:03.091060+0000","last_active":"2024-09-14T11:59:03.091120+0000","last_peered":"2024-09-14T11:59:03.091120+0000","last_clean":"2024-09-14T11:59:03.091120+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:59:03.091120+0000","last_undegraded":"2024-09-14T11:59:03.091120+0000","last_fullsized":"2024-09-14T11:59:03.091120+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.090961+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:07.204455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'800","reported_seq":2606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.406681+0000","last_change":"2024-09-14T11:59:15.406681+0000","last_active":"2024-09-14T11:59:15.406681+0000","last_peered":"2024-09-14T11:59:15.406681+0000","last_clean":"2024-09-14T11:59:15.406681+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:59:15.406681+0000","last_undegraded":"2024-09-14T11:59:15.406681+0000","last_fullsized":"2024-09-14T11:59:15.406681+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.406593+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:33.921083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'137","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.322847+0000","last_change":"2024-09-14T11:59:19.322847+0000","last_active":"2024-09-14T11:59:19.322847+0000","last_peered":"2024-09-14T11:59:19.322847+0000","last_clean":"2024-09-14T11:59:19.322847+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:59:19.322847+0000","last_undegraded":"2024-09-14T11:59:19.322847+0000","last_fullsized":"2024-09-14T11:59:19.322847+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.322696+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:24.890324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.283321+0000","last_change":"2024-09-14T11:58:55.283205+0000","last_active":"2024-09-14T11:58:55.283321+0000","last_peered":"2024-09-14T11:58:55.283321+0000","last_clean":"2024-09-14T11:58:55.283321+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:58:55.283321+0000","last_undegraded":"2024-09-14T11:58:55.283321+0000","last_fullsized":"2024-09-14T11:58:55.283321+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.283109+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:51.916150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'358","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.209925+0000","last_change":"2024-09-14T11:58:51.209859+0000","last_active":"2024-09-14T11:58:51.209925+0000","last_peered":"2024-09-14T11:58:51.209925+0000","last_clean":"2024-09-14T11:58:51.209925+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:51.209925+0000","last_undegraded":"2024-09-14T11:58:51.209925+0000","last_fullsized":"2024-09-14T11:58:51.209925+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.209715+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:49.586185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":699,"num_read_kb":30583,"num_write":1068,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.215800+0000","last_change":"2024-09-14T11:58:45.215756+0000","last_active":"2024-09-14T11:58:45.215800+0000","last_peered":"2024-09-14T11:58:45.215800+0000","last_clean":"2024-09-14T11:58:45.215800+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:58:45.215800+0000","last_undegraded":"2024-09-14T11:58:45.215800+0000","last_fullsized":"2024-09-14T11:58:45.215800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.215695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:26.730819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.845801+0000","last_change":"2024-09-14T11:59:05.845748+0000","last_active":"2024-09-14T11:59:05.845801+0000","last_peered":"2024-09-14T11:59:05.845801+0000","last_clean":"2024-09-14T11:59:05.845801+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:59:05.845801+0000","last_undegraded":"2024-09-14T11:59:05.845801+0000","last_fullsized":"2024-09-14T11:59:05.845801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.845663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:31.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'124","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.816674+0000","last_change":"2024-09-14T11:59:09.816611+0000","last_active":"2024-09-14T11:59:09.816674+0000","last_peered":"2024-09-14T11:59:09.816674+0000","last_clean":"2024-09-14T11:59:09.816674+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:59:09.816674+0000","last_undegraded":"2024-09-14T11:59:09.816674+0000","last_fullsized":"2024-09-14T11:59:09.816674+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.816525+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:12.664495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'814","reported_seq":3008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.285037+0000","last_change":"2024-09-14T11:59:18.285037+0000","last_active":"2024-09-14T11:59:18.285037+0000","last_peered":"2024-09-14T11:59:18.285037+0000","last_clean":"2024-09-14T11:59:18.285037+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:59:18.285037+0000","last_undegraded":"2024-09-14T11:59:18.285037+0000","last_fullsized":"2024-09-14T11:59:18.285037+0000","mapping_epoch":33,"log_start":"263'801","ondisk_log_start":"263'801","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.284950+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:39.729906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'293","reported_seq":812,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.079637+0000","last_change":"2024-09-14T11:59:17.079637+0000","last_active":"2024-09-14T11:59:17.079637+0000","last_peered":"2024-09-14T11:59:17.079637+0000","last_clean":"2024-09-14T11:59:17.079637+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:59:17.079637+0000","last_undegraded":"2024-09-14T11:59:17.079637+0000","last_fullsized":"2024-09-14T11:59:17.079637+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.079557+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.126100+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.756071+0000","last_change":"2024-09-14T11:58:48.756014+0000","last_active":"2024-09-14T11:58:48.756071+0000","last_peered":"2024-09-14T11:58:48.756071+0000","last_clean":"2024-09-14T11:58:48.756071+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:58:48.756071+0000","last_undegraded":"2024-09-14T11:58:48.756071+0000","last_fullsized":"2024-09-14T11:58:48.756071+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.755922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:53.686958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'458","reported_seq":1184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.129906+0000","last_change":"2024-09-14T11:58:46.129855+0000","last_active":"2024-09-14T11:58:46.129906+0000","last_peered":"2024-09-14T11:58:46.129906+0000","last_clean":"2024-09-14T11:58:46.129906+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:46.129906+0000","last_undegraded":"2024-09-14T11:58:46.129906+0000","last_fullsized":"2024-09-14T11:58:46.129906+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.129767+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:43.560691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1014,"num_read_kb":14136,"num_write":1501,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.707186+0000","last_change":"2024-09-14T11:58:45.707137+0000","last_active":"2024-09-14T11:58:45.707186+0000","last_peered":"2024-09-14T11:58:45.707186+0000","last_clean":"2024-09-14T11:58:45.707186+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:58:45.707186+0000","last_undegraded":"2024-09-14T11:58:45.707186+0000","last_fullsized":"2024-09-14T11:58:45.707186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.707053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.841690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.273723+0000","last_change":"2024-09-14T11:59:01.273664+0000","last_active":"2024-09-14T11:59:01.273723+0000","last_peered":"2024-09-14T11:59:01.273723+0000","last_clean":"2024-09-14T11:59:01.273723+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:59:01.273723+0000","last_undegraded":"2024-09-14T11:59:01.273723+0000","last_fullsized":"2024-09-14T11:59:01.273723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.273570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:42.443452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'782","reported_seq":1508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.198534+0000","last_change":"2024-09-14T11:59:08.198466+0000","last_active":"2024-09-14T11:59:08.198534+0000","last_peered":"2024-09-14T11:59:08.198534+0000","last_clean":"2024-09-14T11:59:08.198534+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:59:08.198534+0000","last_undegraded":"2024-09-14T11:59:08.198534+0000","last_fullsized":"2024-09-14T11:59:08.198534+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.198359+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.340430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1390,"num_read_kb":3483,"num_write":1134,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.233728+0000","last_change":"2024-09-14T11:59:12.233637+0000","last_active":"2024-09-14T11:59:12.233728+0000","last_peered":"2024-09-14T11:59:12.233728+0000","last_clean":"2024-09-14T11:59:12.233728+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:59:12.233728+0000","last_undegraded":"2024-09-14T11:59:12.233728+0000","last_fullsized":"2024-09-14T11:59:12.233728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.233510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:37.460007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'157","reported_seq":702,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.335827+0000","last_change":"2024-09-14T11:59:18.335827+0000","last_active":"2024-09-14T11:59:18.335827+0000","last_peered":"2024-09-14T11:59:18.335827+0000","last_clean":"2024-09-14T11:59:18.335827+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:59:18.335827+0000","last_undegraded":"2024-09-14T11:59:18.335827+0000","last_fullsized":"2024-09-14T11:59:18.335827+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.335731+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:55.839157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'169","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.122842+0000","last_change":"2024-09-14T11:59:21.122780+0000","last_active":"2024-09-14T11:59:21.122842+0000","last_peered":"2024-09-14T11:59:21.122842+0000","last_clean":"2024-09-14T11:59:21.122842+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:59:21.122842+0000","last_undegraded":"2024-09-14T11:59:21.122842+0000","last_fullsized":"2024-09-14T11:59:21.122842+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'169","last_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_deep_scrub":"263'169","last_deep_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.122685+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:05.175454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1125","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.774111+0000","last_change":"2024-09-14T11:58:53.774053+0000","last_active":"2024-09-14T11:58:53.774111+0000","last_peered":"2024-09-14T11:58:53.774111+0000","last_clean":"2024-09-14T11:58:53.774111+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:58:53.774111+0000","last_undegraded":"2024-09-14T11:58:53.774111+0000","last_fullsized":"2024-09-14T11:58:53.774111+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1125","last_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_deep_scrub":"263'1125","last_deep_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.773964+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:13.075424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'419","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.745556+0000","last_change":"2024-09-14T11:58:47.745556+0000","last_active":"2024-09-14T11:58:47.745556+0000","last_peered":"2024-09-14T11:58:47.745556+0000","last_clean":"2024-09-14T11:58:47.745556+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:47.745556+0000","last_undegraded":"2024-09-14T11:58:47.745556+0000","last_fullsized":"2024-09-14T11:58:47.745556+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.745449+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:44.093108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":639,"num_read_kb":10191,"num_write":1201,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.112762+0000","last_change":"2024-09-14T11:59:00.112762+0000","last_active":"2024-09-14T11:59:00.112762+0000","last_peered":"2024-09-14T11:59:00.112762+0000","last_clean":"2024-09-14T11:59:00.112762+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:59:00.112762+0000","last_undegraded":"2024-09-14T11:59:00.112762+0000","last_fullsized":"2024-09-14T11:59:00.112762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.112668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:16.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'338","reported_seq":924,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.231431+0000","last_change":"2024-09-14T11:59:09.231431+0000","last_active":"2024-09-14T11:59:09.231431+0000","last_peered":"2024-09-14T11:59:09.231431+0000","last_clean":"2024-09-14T11:59:09.231431+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:59:09.231431+0000","last_undegraded":"2024-09-14T11:59:09.231431+0000","last_fullsized":"2024-09-14T11:59:09.231431+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.231332+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:55.280074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":1418,"num_write":456,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.238818+0000","last_change":"2024-09-14T11:59:21.238818+0000","last_active":"2024-09-14T11:59:21.238818+0000","last_peered":"2024-09-14T11:59:21.238818+0000","last_clean":"2024-09-14T11:59:21.238818+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:59:21.238818+0000","last_undegraded":"2024-09-14T11:59:21.238818+0000","last_fullsized":"2024-09-14T11:59:21.238818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.238721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:05.674834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.284064+0000","last_change":"2024-09-14T11:59:25.284064+0000","last_active":"2024-09-14T11:59:25.284064+0000","last_peered":"2024-09-14T11:59:25.284064+0000","last_clean":"2024-09-14T11:59:25.284064+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:59:25.284064+0000","last_undegraded":"2024-09-14T11:59:25.284064+0000","last_fullsized":"2024-09-14T11:59:25.284064+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:25.283964+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:25.283964+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.283964+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:33.972463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1059","reported_seq":2877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.245877+0000","last_change":"2024-09-14T11:58:53.245818+0000","last_active":"2024-09-14T11:58:53.245877+0000","last_peered":"2024-09-14T11:58:53.245877+0000","last_clean":"2024-09-14T11:58:53.245877+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:58:53.245877+0000","last_undegraded":"2024-09-14T11:58:53.245877+0000","last_fullsized":"2024-09-14T11:58:53.245877+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1059","last_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_deep_scrub":"263'1059","last_deep_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.245711+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:12.381249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'438","reported_seq":1124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.173659+0000","last_change":"2024-09-14T11:58:54.173546+0000","last_active":"2024-09-14T11:58:54.173659+0000","last_peered":"2024-09-14T11:58:54.173659+0000","last_clean":"2024-09-14T11:58:54.173659+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:54.173659+0000","last_undegraded":"2024-09-14T11:58:54.173659+0000","last_fullsized":"2024-09-14T11:58:54.173659+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.173383+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.863811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":832,"num_read_kb":46830,"num_write":1292,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.197160+0000","last_change":"2024-09-14T11:59:06.197160+0000","last_active":"2024-09-14T11:59:06.197160+0000","last_peered":"2024-09-14T11:59:06.197160+0000","last_clean":"2024-09-14T11:59:06.197160+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:59:06.197160+0000","last_undegraded":"2024-09-14T11:59:06.197160+0000","last_fullsized":"2024-09-14T11:59:06.197160+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.197073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.229151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":555,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.039824+0000","last_change":"2024-09-14T11:59:03.039824+0000","last_active":"2024-09-14T11:59:03.039824+0000","last_peered":"2024-09-14T11:59:03.039824+0000","last_clean":"2024-09-14T11:59:03.039824+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:59:03.039824+0000","last_undegraded":"2024-09-14T11:59:03.039824+0000","last_fullsized":"2024-09-14T11:59:03.039824+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.039699+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:26.320715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.195567+0000","last_change":"2024-09-14T11:59:15.195567+0000","last_active":"2024-09-14T11:59:15.195567+0000","last_peered":"2024-09-14T11:59:15.195567+0000","last_clean":"2024-09-14T11:59:15.195567+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:59:15.195567+0000","last_undegraded":"2024-09-14T11:59:15.195567+0000","last_fullsized":"2024-09-14T11:59:15.195567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.195475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:39.566828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.092260+0000","last_change":"2024-09-14T11:59:20.092198+0000","last_active":"2024-09-14T11:59:20.092260+0000","last_peered":"2024-09-14T11:59:20.092260+0000","last_clean":"2024-09-14T11:59:20.092260+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:59:20.092260+0000","last_undegraded":"2024-09-14T11:59:20.092260+0000","last_fullsized":"2024-09-14T11:59:20.092260+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.092085+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:45.013902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'556","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.329648+0000","last_change":"2024-09-14T11:58:56.329578+0000","last_active":"2024-09-14T11:58:56.329648+0000","last_peered":"2024-09-14T11:58:56.329648+0000","last_clean":"2024-09-14T11:58:56.329648+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:56.329648+0000","last_undegraded":"2024-09-14T11:58:56.329648+0000","last_fullsized":"2024-09-14T11:58:56.329648+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.329487+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:16.173830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'400","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.572300+0000","last_change":"2024-09-14T11:58:47.572237+0000","last_active":"2024-09-14T11:58:47.572300+0000","last_peered":"2024-09-14T11:58:47.572300+0000","last_clean":"2024-09-14T11:58:47.572300+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:47.572300+0000","last_undegraded":"2024-09-14T11:58:47.572300+0000","last_fullsized":"2024-09-14T11:58:47.572300+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.572136+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.322151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":842,"num_read_kb":27462,"num_write":1412,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.154840+0000","last_change":"2024-09-14T11:59:07.154840+0000","last_active":"2024-09-14T11:59:07.154840+0000","last_peered":"2024-09-14T11:59:07.154840+0000","last_clean":"2024-09-14T11:59:07.154840+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:59:07.154840+0000","last_undegraded":"2024-09-14T11:59:07.154840+0000","last_fullsized":"2024-09-14T11:59:07.154840+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.154746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:10.308624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'332","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.282815+0000","last_change":"2024-09-14T11:59:14.282815+0000","last_active":"2024-09-14T11:59:14.282815+0000","last_peered":"2024-09-14T11:59:14.282815+0000","last_clean":"2024-09-14T11:59:14.282815+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:59:14.282815+0000","last_undegraded":"2024-09-14T11:59:14.282815+0000","last_fullsized":"2024-09-14T11:59:14.282815+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.282700+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:59.118738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1216,"num_write":428,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.733126+0000","last_change":"2024-09-14T11:59:04.733126+0000","last_active":"2024-09-14T11:59:04.733126+0000","last_peered":"2024-09-14T11:59:04.733126+0000","last_clean":"2024-09-14T11:59:04.733126+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:59:04.733126+0000","last_undegraded":"2024-09-14T11:59:04.733126+0000","last_fullsized":"2024-09-14T11:59:04.733126+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.733044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:38.911493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'133","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.229832+0000","last_change":"2024-09-14T11:59:22.229765+0000","last_active":"2024-09-14T11:59:22.229832+0000","last_peered":"2024-09-14T11:59:22.229832+0000","last_clean":"2024-09-14T11:59:22.229832+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:59:22.229832+0000","last_undegraded":"2024-09-14T11:59:22.229832+0000","last_fullsized":"2024-09-14T11:59:22.229832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.229680+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:51.141588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'546","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.288427+0000","last_change":"2024-09-14T11:58:58.288352+0000","last_active":"2024-09-14T11:58:58.288427+0000","last_peered":"2024-09-14T11:58:58.288427+0000","last_clean":"2024-09-14T11:58:58.288427+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:58:58.288427+0000","last_undegraded":"2024-09-14T11:58:58.288427+0000","last_fullsized":"2024-09-14T11:58:58.288427+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'546","last_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_deep_scrub":"263'546","last_deep_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.288260+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:34.628427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'377","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.149092+0000","last_change":"2024-09-14T11:58:44.149039+0000","last_active":"2024-09-14T11:58:44.149092+0000","last_peered":"2024-09-14T11:58:44.149092+0000","last_clean":"2024-09-14T11:58:44.149092+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:44.149092+0000","last_undegraded":"2024-09-14T11:58:44.149092+0000","last_fullsized":"2024-09-14T11:58:44.149092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.148961+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:02.627312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":41704,"num_write":1258,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.766875+0000","last_change":"2024-09-14T11:58:59.766783+0000","last_active":"2024-09-14T11:58:59.766875+0000","last_peered":"2024-09-14T11:58:59.766875+0000","last_clean":"2024-09-14T11:58:59.766875+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:58:59.766875+0000","last_undegraded":"2024-09-14T11:58:59.766875+0000","last_fullsized":"2024-09-14T11:58:59.766875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.766639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:45.001749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":854,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.186708+0000","last_change":"2024-09-14T11:59:12.186708+0000","last_active":"2024-09-14T11:59:12.186708+0000","last_peered":"2024-09-14T11:59:12.186708+0000","last_clean":"2024-09-14T11:59:12.186708+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:59:12.186708+0000","last_undegraded":"2024-09-14T11:59:12.186708+0000","last_fullsized":"2024-09-14T11:59:12.186708+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'286","last_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_deep_scrub":"263'286","last_deep_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.186612+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:43.838896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1119,"num_write":378,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.021108+0000","last_change":"2024-09-14T11:59:07.021108+0000","last_active":"2024-09-14T11:59:07.021108+0000","last_peered":"2024-09-14T11:59:07.021108+0000","last_clean":"2024-09-14T11:59:07.021108+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:59:07.021108+0000","last_undegraded":"2024-09-14T11:59:07.021108+0000","last_fullsized":"2024-09-14T11:59:07.021108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.021000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:10.337668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'483","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.786147+0000","last_change":"2024-09-14T11:58:55.786085+0000","last_active":"2024-09-14T11:58:55.786147+0000","last_peered":"2024-09-14T11:58:55.786147+0000","last_clean":"2024-09-14T11:58:55.786147+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:58:55.786147+0000","last_undegraded":"2024-09-14T11:58:55.786147+0000","last_fullsized":"2024-09-14T11:58:55.786147+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.786005+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:32.817114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2487,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'309","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.219125+0000","last_change":"2024-09-14T11:58:52.219033+0000","last_active":"2024-09-14T11:58:52.219125+0000","last_peered":"2024-09-14T11:58:52.219125+0000","last_clean":"2024-09-14T11:58:52.219125+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:52.219125+0000","last_undegraded":"2024-09-14T11:58:52.219125+0000","last_fullsized":"2024-09-14T11:58:52.219125+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.218942+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.549674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":570,"num_read_kb":63784,"num_write":891,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.961984+0000","last_change":"2024-09-14T11:58:58.961984+0000","last_active":"2024-09-14T11:58:58.961984+0000","last_peered":"2024-09-14T11:58:58.961984+0000","last_clean":"2024-09-14T11:58:58.961984+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:58.961984+0000","last_undegraded":"2024-09-14T11:58:58.961984+0000","last_fullsized":"2024-09-14T11:58:58.961984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.961880+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:20.687210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'502","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.080424+0000","last_change":"2024-09-14T11:59:06.080362+0000","last_active":"2024-09-14T11:59:06.080424+0000","last_peered":"2024-09-14T11:59:06.080424+0000","last_clean":"2024-09-14T11:59:06.080424+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:59:06.080424+0000","last_undegraded":"2024-09-14T11:59:06.080424+0000","last_fullsized":"2024-09-14T11:59:06.080424+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.080267+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:23.259445+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":902,"num_read_kb":2267,"num_write":774,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.393681+0000","last_change":"2024-09-14T11:59:16.393625+0000","last_active":"2024-09-14T11:59:16.393681+0000","last_peered":"2024-09-14T11:59:16.393681+0000","last_clean":"2024-09-14T11:59:16.393681+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:59:16.393681+0000","last_undegraded":"2024-09-14T11:59:16.393681+0000","last_fullsized":"2024-09-14T11:59:16.393681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.393539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:39.648638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'142","reported_seq":645,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.226854+0000","last_change":"2024-09-14T11:59:23.226854+0000","last_active":"2024-09-14T11:59:23.226854+0000","last_peered":"2024-09-14T11:59:23.226854+0000","last_clean":"2024-09-14T11:59:23.226854+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:59:23.226854+0000","last_undegraded":"2024-09-14T11:59:23.226854+0000","last_fullsized":"2024-09-14T11:59:23.226854+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T11:59:23.226760+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T11:59:23.226760+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.226760+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.924705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'457","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.051229+0000","last_change":"2024-09-14T11:58:56.051229+0000","last_active":"2024-09-14T11:58:56.051229+0000","last_peered":"2024-09-14T11:58:56.051229+0000","last_clean":"2024-09-14T11:58:56.051229+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:58:56.051229+0000","last_undegraded":"2024-09-14T11:58:56.051229+0000","last_fullsized":"2024-09-14T11:58:56.051229+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.051133+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:38.593201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'347","reported_seq":991,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.201425+0000","last_change":"2024-09-14T11:58:46.201425+0000","last_active":"2024-09-14T11:58:46.201425+0000","last_peered":"2024-09-14T11:58:46.201425+0000","last_clean":"2024-09-14T11:58:46.201425+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:46.201425+0000","last_undegraded":"2024-09-14T11:58:46.201425+0000","last_fullsized":"2024-09-14T11:58:46.201425+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.201295+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:11.588159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":604,"num_read_kb":50717,"num_write":1053,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.777074+0000","last_change":"2024-09-14T11:59:00.776994+0000","last_active":"2024-09-14T11:59:00.777074+0000","last_peered":"2024-09-14T11:59:00.777074+0000","last_clean":"2024-09-14T11:59:00.777074+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:59:00.777074+0000","last_undegraded":"2024-09-14T11:59:00.777074+0000","last_fullsized":"2024-09-14T11:59:00.777074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.776887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:37.705302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'322","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.209305+0000","last_change":"2024-09-14T11:59:13.209243+0000","last_active":"2024-09-14T11:59:13.209305+0000","last_peered":"2024-09-14T11:59:13.209305+0000","last_clean":"2024-09-14T11:59:13.209305+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:59:13.209305+0000","last_undegraded":"2024-09-14T11:59:13.209305+0000","last_fullsized":"2024-09-14T11:59:13.209305+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.209134+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:29.981909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51994,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":540,"num_read_kb":1196,"num_write":444,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.132697+0000","last_change":"2024-09-14T11:59:10.132626+0000","last_active":"2024-09-14T11:59:10.132697+0000","last_peered":"2024-09-14T11:59:10.132697+0000","last_clean":"2024-09-14T11:59:10.132697+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:59:10.132697+0000","last_undegraded":"2024-09-14T11:59:10.132697+0000","last_fullsized":"2024-09-14T11:59:10.132697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.132530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.624497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'155","reported_seq":655,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.777821+0000","last_change":"2024-09-14T11:59:09.777821+0000","last_active":"2024-09-14T11:59:09.777821+0000","last_peered":"2024-09-14T11:59:09.777821+0000","last_clean":"2024-09-14T11:59:09.777821+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:59:09.777821+0000","last_undegraded":"2024-09-14T11:59:09.777821+0000","last_fullsized":"2024-09-14T11:59:09.777821+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.777731+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:44.407066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'557","reported_seq":2173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.195787+0000","last_change":"2024-09-14T11:59:03.195720+0000","last_active":"2024-09-14T11:59:03.195787+0000","last_peered":"2024-09-14T11:59:03.195787+0000","last_clean":"2024-09-14T11:59:03.195787+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:59:03.195787+0000","last_undegraded":"2024-09-14T11:59:03.195787+0000","last_fullsized":"2024-09-14T11:59:03.195787+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.195624+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:14.590310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'339","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.715221+0000","last_change":"2024-09-14T11:58:46.715160+0000","last_active":"2024-09-14T11:58:46.715221+0000","last_peered":"2024-09-14T11:58:46.715221+0000","last_clean":"2024-09-14T11:58:46.715221+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:46.715221+0000","last_undegraded":"2024-09-14T11:58:46.715221+0000","last_fullsized":"2024-09-14T11:58:46.715221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.715001+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.562859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":82907,"num_write":1088,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.817803+0000","last_change":"2024-09-14T11:59:08.817719+0000","last_active":"2024-09-14T11:59:08.817803+0000","last_peered":"2024-09-14T11:59:08.817803+0000","last_clean":"2024-09-14T11:59:08.817803+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:59:08.817803+0000","last_undegraded":"2024-09-14T11:59:08.817803+0000","last_fullsized":"2024-09-14T11:59:08.817803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.817631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:04.693866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'311","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.220153+0000","last_change":"2024-09-14T11:59:11.220081+0000","last_active":"2024-09-14T11:59:11.220153+0000","last_peered":"2024-09-14T11:59:11.220153+0000","last_clean":"2024-09-14T11:59:11.220153+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:59:11.220153+0000","last_undegraded":"2024-09-14T11:59:11.220153+0000","last_fullsized":"2024-09-14T11:59:11.220153+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.219995+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:55.442982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1144,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.100004+0000","last_change":"2024-09-14T11:59:07.100004+0000","last_active":"2024-09-14T11:59:07.100004+0000","last_peered":"2024-09-14T11:59:07.100004+0000","last_clean":"2024-09-14T11:59:07.100004+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:59:07.100004+0000","last_undegraded":"2024-09-14T11:59:07.100004+0000","last_fullsized":"2024-09-14T11:59:07.100004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.099923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:57.135245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'171","reported_seq":672,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.261233+0000","last_change":"2024-09-14T11:59:20.261233+0000","last_active":"2024-09-14T11:59:20.261233+0000","last_peered":"2024-09-14T11:59:20.261233+0000","last_clean":"2024-09-14T11:59:20.261233+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:59:20.261233+0000","last_undegraded":"2024-09-14T11:59:20.261233+0000","last_fullsized":"2024-09-14T11:59:20.261233+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.261131+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:48.354170+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'530","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.149325+0000","last_change":"2024-09-14T11:58:51.149263+0000","last_active":"2024-09-14T11:58:51.149325+0000","last_peered":"2024-09-14T11:58:51.149325+0000","last_clean":"2024-09-14T11:58:51.149325+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:51.149325+0000","last_undegraded":"2024-09-14T11:58:51.149325+0000","last_fullsized":"2024-09-14T11:58:51.149325+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'530","last_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_deep_scrub":"263'530","last_deep_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.149169+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:45.648421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.124810+0000","last_change":"2024-09-14T11:58:48.124725+0000","last_active":"2024-09-14T11:58:48.124810+0000","last_peered":"2024-09-14T11:58:48.124810+0000","last_clean":"2024-09-14T11:58:48.124810+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:48.124810+0000","last_undegraded":"2024-09-14T11:58:48.124810+0000","last_fullsized":"2024-09-14T11:58:48.124810+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.124576+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:36.223458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":42073,"num_write":1144,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.117211+0000","last_change":"2024-09-14T11:59:02.117157+0000","last_active":"2024-09-14T11:59:02.117211+0000","last_peered":"2024-09-14T11:59:02.117211+0000","last_clean":"2024-09-14T11:59:02.117211+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:59:02.117211+0000","last_undegraded":"2024-09-14T11:59:02.117211+0000","last_fullsized":"2024-09-14T11:59:02.117211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.117068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:46.630742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'108","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.745968+0000","last_change":"2024-09-14T11:59:13.745968+0000","last_active":"2024-09-14T11:59:13.745968+0000","last_peered":"2024-09-14T11:59:13.745968+0000","last_clean":"2024-09-14T11:59:13.745968+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:59:13.745968+0000","last_undegraded":"2024-09-14T11:59:13.745968+0000","last_fullsized":"2024-09-14T11:59:13.745968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.745840+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:38.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2688,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'777","reported_seq":4318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.779729+0000","last_change":"2024-09-14T11:59:07.779669+0000","last_active":"2024-09-14T11:59:07.779729+0000","last_peered":"2024-09-14T11:59:07.779729+0000","last_clean":"2024-09-14T11:59:07.779729+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:59:07.779729+0000","last_undegraded":"2024-09-14T11:59:07.779729+0000","last_fullsized":"2024-09-14T11:59:07.779729+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.779585+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:41.418684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":619,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.104511+0000","last_change":"2024-09-14T11:59:18.104511+0000","last_active":"2024-09-14T11:59:18.104511+0000","last_peered":"2024-09-14T11:59:18.104511+0000","last_clean":"2024-09-14T11:59:18.104511+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:59:18.104511+0000","last_undegraded":"2024-09-14T11:59:18.104511+0000","last_fullsized":"2024-09-14T11:59:18.104511+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.104432+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:04.905650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'414","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.771567+0000","last_change":"2024-09-14T11:58:56.771503+0000","last_active":"2024-09-14T11:58:56.771567+0000","last_peered":"2024-09-14T11:58:56.771567+0000","last_clean":"2024-09-14T11:58:56.771567+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:58:56.771567+0000","last_undegraded":"2024-09-14T11:58:56.771567+0000","last_fullsized":"2024-09-14T11:58:56.771567+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.771427+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:50.649246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'292","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.632108+0000","last_change":"2024-09-14T11:58:50.632043+0000","last_active":"2024-09-14T11:58:50.632108+0000","last_peered":"2024-09-14T11:58:50.632108+0000","last_clean":"2024-09-14T11:58:50.632108+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:50.632108+0000","last_undegraded":"2024-09-14T11:58:50.632108+0000","last_fullsized":"2024-09-14T11:58:50.632108+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.631922+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:24.620243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":9665,"num_write":976,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.128127+0000","last_change":"2024-09-14T11:59:06.128064+0000","last_active":"2024-09-14T11:59:06.128127+0000","last_peered":"2024-09-14T11:59:06.128127+0000","last_clean":"2024-09-14T11:59:06.128127+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:59:06.128127+0000","last_undegraded":"2024-09-14T11:59:06.128127+0000","last_fullsized":"2024-09-14T11:59:06.128127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.127974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:38.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'328","reported_seq":919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.421820+0000","last_change":"2024-09-14T11:59:14.421820+0000","last_active":"2024-09-14T11:59:14.421820+0000","last_peered":"2024-09-14T11:59:14.421820+0000","last_clean":"2024-09-14T11:59:14.421820+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:59:14.421820+0000","last_undegraded":"2024-09-14T11:59:14.421820+0000","last_fullsized":"2024-09-14T11:59:14.421820+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.421721+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.045444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.066673+0000","last_change":"2024-09-14T11:59:10.066601+0000","last_active":"2024-09-14T11:59:10.066673+0000","last_peered":"2024-09-14T11:59:10.066673+0000","last_clean":"2024-09-14T11:59:10.066673+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:59:10.066673+0000","last_undegraded":"2024-09-14T11:59:10.066673+0000","last_fullsized":"2024-09-14T11:59:10.066673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.066508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'127","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.116100+0000","last_change":"2024-09-14T11:59:19.116026+0000","last_active":"2024-09-14T11:59:19.116100+0000","last_peered":"2024-09-14T11:59:19.116100+0000","last_clean":"2024-09-14T11:59:19.116100+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:59:19.116100+0000","last_undegraded":"2024-09-14T11:59:19.116100+0000","last_fullsized":"2024-09-14T11:59:19.116100+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.115921+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.392234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'399","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.798794+0000","last_change":"2024-09-14T11:58:57.798697+0000","last_active":"2024-09-14T11:58:57.798794+0000","last_peered":"2024-09-14T11:58:57.798794+0000","last_clean":"2024-09-14T11:58:57.798794+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:58:57.798794+0000","last_undegraded":"2024-09-14T11:58:57.798794+0000","last_fullsized":"2024-09-14T11:58:57.798794+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.798592+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:10.547579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'329","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.595764+0000","last_change":"2024-09-14T11:58:49.595701+0000","last_active":"2024-09-14T11:58:49.595764+0000","last_peered":"2024-09-14T11:58:49.595764+0000","last_clean":"2024-09-14T11:58:49.595764+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:49.595764+0000","last_undegraded":"2024-09-14T11:58:49.595764+0000","last_fullsized":"2024-09-14T11:58:49.595764+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.595597+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:05.088352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":577,"num_read_kb":29813,"num_write":1080,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.564191+0000","last_change":"2024-09-14T11:59:09.564131+0000","last_active":"2024-09-14T11:59:09.564191+0000","last_peered":"2024-09-14T11:59:09.564191+0000","last_clean":"2024-09-14T11:59:09.564191+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:59:09.564191+0000","last_undegraded":"2024-09-14T11:59:09.564191+0000","last_fullsized":"2024-09-14T11:59:09.564191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.564019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:59.535304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.080150+0000","last_change":"2024-09-14T11:59:09.080079+0000","last_active":"2024-09-14T11:59:09.080150+0000","last_peered":"2024-09-14T11:59:09.080150+0000","last_clean":"2024-09-14T11:59:09.080150+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:59:09.080150+0000","last_undegraded":"2024-09-14T11:59:09.080150+0000","last_fullsized":"2024-09-14T11:59:09.080150+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.079948+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:36.756322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.775934+0000","last_change":"2024-09-14T11:59:05.775934+0000","last_active":"2024-09-14T11:59:05.775934+0000","last_peered":"2024-09-14T11:59:05.775934+0000","last_clean":"2024-09-14T11:59:05.775934+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:59:05.775934+0000","last_undegraded":"2024-09-14T11:59:05.775934+0000","last_fullsized":"2024-09-14T11:59:05.775934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.775845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:06.480989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'106","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.239560+0000","last_change":"2024-09-14T11:59:22.239465+0000","last_active":"2024-09-14T11:59:22.239560+0000","last_peered":"2024-09-14T11:59:22.239560+0000","last_clean":"2024-09-14T11:59:22.239560+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:59:22.239560+0000","last_undegraded":"2024-09-14T11:59:22.239560+0000","last_fullsized":"2024-09-14T11:59:22.239560+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.239338+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:32.855003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'353","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.647791+0000","last_change":"2024-09-14T11:59:01.647791+0000","last_active":"2024-09-14T11:59:01.647791+0000","last_peered":"2024-09-14T11:59:01.647791+0000","last_clean":"2024-09-14T11:59:01.647791+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:59:01.647791+0000","last_undegraded":"2024-09-14T11:59:01.647791+0000","last_fullsized":"2024-09-14T11:59:01.647791+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.647703+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:52.541769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'405","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.374616+0000","last_change":"2024-09-14T11:58:46.374551+0000","last_active":"2024-09-14T11:58:46.374616+0000","last_peered":"2024-09-14T11:58:46.374616+0000","last_clean":"2024-09-14T11:58:46.374616+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:46.374616+0000","last_undegraded":"2024-09-14T11:58:46.374616+0000","last_fullsized":"2024-09-14T11:58:46.374616+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.374434+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:59.892127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":727,"num_read_kb":11025,"num_write":1267,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.860273+0000","last_change":"2024-09-14T11:59:07.860193+0000","last_active":"2024-09-14T11:59:07.860273+0000","last_peered":"2024-09-14T11:59:07.860273+0000","last_clean":"2024-09-14T11:59:07.860273+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:59:07.860273+0000","last_undegraded":"2024-09-14T11:59:07.860273+0000","last_fullsized":"2024-09-14T11:59:07.860273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.860100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:58.269568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'240","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.311259+0000","last_change":"2024-09-14T11:59:15.311185+0000","last_active":"2024-09-14T11:59:15.311259+0000","last_peered":"2024-09-14T11:59:15.311259+0000","last_clean":"2024-09-14T11:59:15.311259+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:59:15.311259+0000","last_undegraded":"2024-09-14T11:59:15.311259+0000","last_fullsized":"2024-09-14T11:59:15.311259+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.311087+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:06.682204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":992,"num_write":326,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.725892+0000","last_change":"2024-09-14T11:59:17.725830+0000","last_active":"2024-09-14T11:59:17.725892+0000","last_peered":"2024-09-14T11:59:17.725892+0000","last_clean":"2024-09-14T11:59:17.725892+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:59:17.725892+0000","last_undegraded":"2024-09-14T11:59:17.725892+0000","last_fullsized":"2024-09-14T11:59:17.725892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.725743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:34.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'165","reported_seq":1629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.140834+0000","last_change":"2024-09-14T11:59:21.140772+0000","last_active":"2024-09-14T11:59:21.140834+0000","last_peered":"2024-09-14T11:59:21.140834+0000","last_clean":"2024-09-14T11:59:21.140834+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:59:21.140834+0000","last_undegraded":"2024-09-14T11:59:21.140834+0000","last_fullsized":"2024-09-14T11:59:21.140834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.140669+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:41.420270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'472","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.777136+0000","last_change":"2024-09-14T11:58:55.777077+0000","last_active":"2024-09-14T11:58:55.777136+0000","last_peered":"2024-09-14T11:58:55.777136+0000","last_clean":"2024-09-14T11:58:55.777136+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:58:55.777136+0000","last_undegraded":"2024-09-14T11:58:55.777136+0000","last_fullsized":"2024-09-14T11:58:55.777136+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'472","last_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_deep_scrub":"263'472","last_deep_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.776981+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:44.267879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2936,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'401","reported_seq":1074,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.196149+0000","last_change":"2024-09-14T11:58:47.196149+0000","last_active":"2024-09-14T11:58:47.196149+0000","last_peered":"2024-09-14T11:58:47.196149+0000","last_clean":"2024-09-14T11:58:47.196149+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:47.196149+0000","last_undegraded":"2024-09-14T11:58:47.196149+0000","last_fullsized":"2024-09-14T11:58:47.196149+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.196028+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:09.718768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":747,"num_read_kb":46945,"num_write":1297,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.080514+0000","last_change":"2024-09-14T11:59:01.080514+0000","last_active":"2024-09-14T11:59:01.080514+0000","last_peered":"2024-09-14T11:59:01.080514+0000","last_clean":"2024-09-14T11:59:01.080514+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:59:01.080514+0000","last_undegraded":"2024-09-14T11:59:01.080514+0000","last_fullsized":"2024-09-14T11:59:01.080514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.080425+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:41.322185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'305","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.789404+0000","last_change":"2024-09-14T11:59:12.789300+0000","last_active":"2024-09-14T11:59:12.789404+0000","last_peered":"2024-09-14T11:59:12.789404+0000","last_clean":"2024-09-14T11:59:12.789404+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:59:12.789404+0000","last_undegraded":"2024-09-14T11:59:12.789404+0000","last_fullsized":"2024-09-14T11:59:12.789404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.789182+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:43.211846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1073,"num_write":380,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.117611+0000","last_change":"2024-09-14T11:59:14.117549+0000","last_active":"2024-09-14T11:59:14.117611+0000","last_peered":"2024-09-14T11:59:14.117611+0000","last_clean":"2024-09-14T11:59:14.117611+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:59:14.117611+0000","last_undegraded":"2024-09-14T11:59:14.117611+0000","last_fullsized":"2024-09-14T11:59:14.117611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.117458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:26.797657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'137","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.714249+0000","last_change":"2024-09-14T11:59:16.714249+0000","last_active":"2024-09-14T11:59:16.714249+0000","last_peered":"2024-09-14T11:59:16.714249+0000","last_clean":"2024-09-14T11:59:16.714249+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:59:16.714249+0000","last_undegraded":"2024-09-14T11:59:16.714249+0000","last_fullsized":"2024-09-14T11:59:16.714249+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.714152+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:50.948493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'586","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.175710+0000","last_change":"2024-09-14T11:58:56.175638+0000","last_active":"2024-09-14T11:58:56.175710+0000","last_peered":"2024-09-14T11:58:56.175710+0000","last_clean":"2024-09-14T11:58:56.175710+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:58:56.175710+0000","last_undegraded":"2024-09-14T11:58:56.175710+0000","last_fullsized":"2024-09-14T11:58:56.175710+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'586","last_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_deep_scrub":"263'586","last_deep_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.175551+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:06.302948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'351","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.760102+0000","last_change":"2024-09-14T11:58:49.760006+0000","last_active":"2024-09-14T11:58:49.760102+0000","last_peered":"2024-09-14T11:58:49.760102+0000","last_clean":"2024-09-14T11:58:49.760102+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:49.760102+0000","last_undegraded":"2024-09-14T11:58:49.760102+0000","last_fullsized":"2024-09-14T11:58:49.760102+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.759805+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:27.741535+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":646,"num_read_kb":60949,"num_write":1082,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1054","reported_seq":2944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.153388+0000","last_change":"2024-09-14T11:58:58.153320+0000","last_active":"2024-09-14T11:58:58.153388+0000","last_peered":"2024-09-14T11:58:58.153388+0000","last_clean":"2024-09-14T11:58:58.153388+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:58:58.153388+0000","last_undegraded":"2024-09-14T11:58:58.153388+0000","last_fullsized":"2024-09-14T11:58:58.153388+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1054","last_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_deep_scrub":"263'1054","last_deep_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.153235+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":1000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:25.111446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3040,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'359","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.165462+0000","last_change":"2024-09-14T11:58:46.165361+0000","last_active":"2024-09-14T11:58:46.165462+0000","last_peered":"2024-09-14T11:58:46.165462+0000","last_clean":"2024-09-14T11:58:46.165462+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:46.165462+0000","last_undegraded":"2024-09-14T11:58:46.165462+0000","last_fullsized":"2024-09-14T11:58:46.165462+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.165246+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.126478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":22760,"num_write":1134,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1000","reported_seq":2623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.625700+0000","last_change":"2024-09-14T11:59:00.625634+0000","last_active":"2024-09-14T11:59:00.625700+0000","last_peered":"2024-09-14T11:59:00.625700+0000","last_clean":"2024-09-14T11:59:00.625700+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:59:00.625700+0000","last_undegraded":"2024-09-14T11:59:00.625700+0000","last_fullsized":"2024-09-14T11:59:00.625700+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1000","last_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_deep_scrub":"263'1000","last_deep_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.625532+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.706881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'338","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.660072+0000","last_change":"2024-09-14T11:58:51.659978+0000","last_active":"2024-09-14T11:58:51.660072+0000","last_peered":"2024-09-14T11:58:51.660072+0000","last_clean":"2024-09-14T11:58:51.660072+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:51.660072+0000","last_undegraded":"2024-09-14T11:58:51.660072+0000","last_fullsized":"2024-09-14T11:58:51.660072+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.659787+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:18.224027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":988,"num_read_kb":42151,"num_write":1083,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'861","reported_seq":2452,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.135105+0000","last_change":"2024-09-14T11:58:57.135043+0000","last_active":"2024-09-14T11:58:57.135105+0000","last_peered":"2024-09-14T11:58:57.135105+0000","last_clean":"2024-09-14T11:58:57.135105+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:58:57.135105+0000","last_undegraded":"2024-09-14T11:58:57.135105+0000","last_fullsized":"2024-09-14T11:58:57.135105+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'861","last_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_deep_scrub":"263'861","last_deep_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.134958+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.253599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.137502+0000","last_change":"2024-09-14T11:58:50.137399+0000","last_active":"2024-09-14T11:58:50.137502+0000","last_peered":"2024-09-14T11:58:50.137502+0000","last_clean":"2024-09-14T11:58:50.137502+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:50.137502+0000","last_undegraded":"2024-09-14T11:58:50.137502+0000","last_fullsized":"2024-09-14T11:58:50.137502+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.137192+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:56.624534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":875,"num_read_kb":14120,"num_write":1246,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1638","reported_seq":3367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.242879+0000","last_change":"2024-09-14T11:59:02.242786+0000","last_active":"2024-09-14T11:59:02.242879+0000","last_peered":"2024-09-14T11:59:02.242879+0000","last_clean":"2024-09-14T11:59:02.242879+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:59:02.242879+0000","last_undegraded":"2024-09-14T11:59:02.242879+0000","last_fullsized":"2024-09-14T11:59:02.242879+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1638","last_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_deep_scrub":"263'1638","last_deep_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.242676+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":1600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:30.360125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'410","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.363215+0000","last_change":"2024-09-14T11:58:47.363150+0000","last_active":"2024-09-14T11:58:47.363215+0000","last_peered":"2024-09-14T11:58:47.363215+0000","last_clean":"2024-09-14T11:58:47.363215+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:47.363215+0000","last_undegraded":"2024-09-14T11:58:47.363215+0000","last_fullsized":"2024-09-14T11:58:47.363215+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.363039+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:01.895164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":770,"num_read_kb":3391,"num_write":1187,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'527","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.787198+0000","last_change":"2024-09-14T11:59:02.787143+0000","last_active":"2024-09-14T11:59:02.787198+0000","last_peered":"2024-09-14T11:59:02.787198+0000","last_clean":"2024-09-14T11:59:02.787198+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:59:02.787198+0000","last_undegraded":"2024-09-14T11:59:02.787198+0000","last_fullsized":"2024-09-14T11:59:02.787198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.787058+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:30.375500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'413","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.188464+0000","last_change":"2024-09-14T11:58:47.188393+0000","last_active":"2024-09-14T11:58:47.188464+0000","last_peered":"2024-09-14T11:58:47.188464+0000","last_clean":"2024-09-14T11:58:47.188464+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:47.188464+0000","last_undegraded":"2024-09-14T11:58:47.188464+0000","last_fullsized":"2024-09-14T11:58:47.188464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.188302+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:16.690313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1077,"num_read_kb":5071,"num_write":1242,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'776","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.236909+0000","last_change":"2024-09-14T11:59:00.236838+0000","last_active":"2024-09-14T11:59:00.236909+0000","last_peered":"2024-09-14T11:59:00.236909+0000","last_clean":"2024-09-14T11:59:00.236909+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:59:00.236909+0000","last_undegraded":"2024-09-14T11:59:00.236909+0000","last_fullsized":"2024-09-14T11:59:00.236909+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.236741+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:54.394852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'362","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.715869+0000","last_change":"2024-09-14T11:58:48.715807+0000","last_active":"2024-09-14T11:58:48.715869+0000","last_peered":"2024-09-14T11:58:48.715869+0000","last_clean":"2024-09-14T11:58:48.715869+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:48.715869+0000","last_undegraded":"2024-09-14T11:58:48.715869+0000","last_fullsized":"2024-09-14T11:58:48.715869+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.715659+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:22.302518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":6911,"num_write":1146,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'416","reported_seq":1956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.754902+0000","last_change":"2024-09-14T11:58:54.754848+0000","last_active":"2024-09-14T11:58:54.754902+0000","last_peered":"2024-09-14T11:58:54.754902+0000","last_clean":"2024-09-14T11:58:54.754902+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:54.754902+0000","last_undegraded":"2024-09-14T11:58:54.754902+0000","last_fullsized":"2024-09-14T11:58:54.754902+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.754764+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:57.847444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'437","reported_seq":1306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.244343+0000","last_change":"2024-09-14T11:58:53.244256+0000","last_active":"2024-09-14T11:58:53.244343+0000","last_peered":"2024-09-14T11:58:53.244343+0000","last_clean":"2024-09-14T11:58:53.244343+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:53.244343+0000","last_undegraded":"2024-09-14T11:58:53.244343+0000","last_fullsized":"2024-09-14T11:58:53.244343+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.244161+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.178653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1316,"num_read_kb":48095,"num_write":1372,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'719","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.085668+0000","last_change":"2024-09-14T11:59:13.085584+0000","last_active":"2024-09-14T11:59:13.085668+0000","last_peered":"2024-09-14T11:59:13.085668+0000","last_clean":"2024-09-14T11:59:13.085668+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:59:13.085668+0000","last_undegraded":"2024-09-14T11:59:13.085668+0000","last_fullsized":"2024-09-14T11:59:13.085668+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'719","last_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_deep_scrub":"263'719","last_deep_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.085497+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:04.036153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'420","reported_seq":1132,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700278+0000","last_change":"2024-09-14T11:58:52.700278+0000","last_active":"2024-09-14T11:58:52.700278+0000","last_peered":"2024-09-14T11:58:52.700278+0000","last_clean":"2024-09-14T11:58:52.700278+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:52.700278+0000","last_undegraded":"2024-09-14T11:58:52.700278+0000","last_fullsized":"2024-09-14T11:58:52.700278+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'420","last_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_deep_scrub":"263'420","last_deep_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700176+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:03.862543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":12822,"num_write":1366,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'499","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.765045+0000","last_change":"2024-09-14T11:59:00.764942+0000","last_active":"2024-09-14T11:59:00.765045+0000","last_peered":"2024-09-14T11:59:00.765045+0000","last_clean":"2024-09-14T11:59:00.765045+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:59:00.765045+0000","last_undegraded":"2024-09-14T11:59:00.765045+0000","last_fullsized":"2024-09-14T11:59:00.765045+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.764847+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:24.807051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'451","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.271784+0000","last_change":"2024-09-14T11:58:49.271709+0000","last_active":"2024-09-14T11:58:49.271784+0000","last_peered":"2024-09-14T11:58:49.271784+0000","last_clean":"2024-09-14T11:58:49.271784+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:49.271784+0000","last_undegraded":"2024-09-14T11:58:49.271784+0000","last_fullsized":"2024-09-14T11:58:49.271784+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.271605+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:36.880499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1544,"num_read_kb":34981,"num_write":1381,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1165","reported_seq":2733,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.151543+0000","last_change":"2024-09-14T11:58:49.151543+0000","last_active":"2024-09-14T11:58:49.151543+0000","last_peered":"2024-09-14T11:58:49.151543+0000","last_clean":"2024-09-14T11:58:49.151543+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:58:49.151543+0000","last_undegraded":"2024-09-14T11:58:49.151543+0000","last_fullsized":"2024-09-14T11:58:49.151543+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1165","last_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_deep_scrub":"263'1165","last_deep_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.151466+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:18.332268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'313","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.736441+0000","last_change":"2024-09-14T11:58:53.736359+0000","last_active":"2024-09-14T11:58:53.736441+0000","last_peered":"2024-09-14T11:58:53.736441+0000","last_clean":"2024-09-14T11:58:53.736441+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:53.736441+0000","last_undegraded":"2024-09-14T11:58:53.736441+0000","last_fullsized":"2024-09-14T11:58:53.736441+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.736196+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:44.006375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":3420,"num_write":993,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'622","reported_seq":2445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.810981+0000","last_change":"2024-09-14T11:58:58.810902+0000","last_active":"2024-09-14T11:58:58.810981+0000","last_peered":"2024-09-14T11:58:58.810981+0000","last_clean":"2024-09-14T11:58:58.810981+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:58:58.810981+0000","last_undegraded":"2024-09-14T11:58:58.810981+0000","last_fullsized":"2024-09-14T11:58:58.810981+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.810813+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:28.032812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2730,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'341","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.055100+0000","last_change":"2024-09-14T11:58:52.055033+0000","last_active":"2024-09-14T11:58:52.055100+0000","last_peered":"2024-09-14T11:58:52.055100+0000","last_clean":"2024-09-14T11:58:52.055100+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:52.055100+0000","last_undegraded":"2024-09-14T11:58:52.055100+0000","last_fullsized":"2024-09-14T11:58:52.055100+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.054914+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:01.336250+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":7722,"num_write":1033,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1677","reported_seq":3386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.173758+0000","last_change":"2024-09-14T11:59:00.173696+0000","last_active":"2024-09-14T11:59:00.173758+0000","last_peered":"2024-09-14T11:59:00.173758+0000","last_clean":"2024-09-14T11:59:00.173758+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:59:00.173758+0000","last_undegraded":"2024-09-14T11:59:00.173758+0000","last_fullsized":"2024-09-14T11:59:00.173758+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1677","last_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_deep_scrub":"263'1677","last_deep_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.173612+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":1600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:07.415310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'359","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.767011+0000","last_change":"2024-09-14T11:58:50.766923+0000","last_active":"2024-09-14T11:58:50.767011+0000","last_peered":"2024-09-14T11:58:50.767011+0000","last_clean":"2024-09-14T11:58:50.767011+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:50.767011+0000","last_undegraded":"2024-09-14T11:58:50.767011+0000","last_fullsized":"2024-09-14T11:58:50.767011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.766799+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:21.140749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":21069,"num_write":1116,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'704","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.036238+0000","last_change":"2024-09-14T11:58:54.036175+0000","last_active":"2024-09-14T11:58:54.036238+0000","last_peered":"2024-09-14T11:58:54.036238+0000","last_clean":"2024-09-14T11:58:54.036238+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:58:54.036238+0000","last_undegraded":"2024-09-14T11:58:54.036238+0000","last_fullsized":"2024-09-14T11:58:54.036238+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'704","last_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_deep_scrub":"263'704","last_deep_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.036089+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.473534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'327","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.208361+0000","last_change":"2024-09-14T11:58:55.208361+0000","last_active":"2024-09-14T11:58:55.208361+0000","last_peered":"2024-09-14T11:58:55.208361+0000","last_clean":"2024-09-14T11:58:55.208361+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:55.208361+0000","last_undegraded":"2024-09-14T11:58:55.208361+0000","last_fullsized":"2024-09-14T11:58:55.208361+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.208243+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:46.410805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":36238,"num_write":1055,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'410","reported_seq":1912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.214647+0000","last_change":"2024-09-14T11:59:05.214583+0000","last_active":"2024-09-14T11:59:05.214647+0000","last_peered":"2024-09-14T11:59:05.214647+0000","last_clean":"2024-09-14T11:59:05.214647+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:59:05.214647+0000","last_undegraded":"2024-09-14T11:59:05.214647+0000","last_fullsized":"2024-09-14T11:59:05.214647+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.214496+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:43.529192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'371","reported_seq":1110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.189379+0000","last_change":"2024-09-14T11:58:48.189295+0000","last_active":"2024-09-14T11:58:48.189379+0000","last_peered":"2024-09-14T11:58:48.189379+0000","last_clean":"2024-09-14T11:58:48.189379+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:48.189379+0000","last_undegraded":"2024-09-14T11:58:48.189379+0000","last_fullsized":"2024-09-14T11:58:48.189379+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.189198+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:51.338474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":882,"num_read_kb":32736,"num_write":1182,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'728","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.188566+0000","last_change":"2024-09-14T11:58:59.188459+0000","last_active":"2024-09-14T11:58:59.188566+0000","last_peered":"2024-09-14T11:58:59.188566+0000","last_clean":"2024-09-14T11:58:59.188566+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:58:59.188566+0000","last_undegraded":"2024-09-14T11:58:59.188566+0000","last_fullsized":"2024-09-14T11:58:59.188566+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.188347+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:48.449081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'355","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.698532+0000","last_change":"2024-09-14T11:58:54.698436+0000","last_active":"2024-09-14T11:58:54.698532+0000","last_peered":"2024-09-14T11:58:54.698532+0000","last_clean":"2024-09-14T11:58:54.698532+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:54.698532+0000","last_undegraded":"2024-09-14T11:58:54.698532+0000","last_fullsized":"2024-09-14T11:58:54.698532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.698288+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:08.401763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":35326,"num_write":1083,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'299","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.679579+0000","last_change":"2024-09-14T11:58:55.679499+0000","last_active":"2024-09-14T11:58:55.679579+0000","last_peered":"2024-09-14T11:58:55.679579+0000","last_clean":"2024-09-14T11:58:55.679579+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:55.679579+0000","last_undegraded":"2024-09-14T11:58:55.679579+0000","last_fullsized":"2024-09-14T11:58:55.679579+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.679380+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:45.132704+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":8144,"num_write":967,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'850","reported_seq":2550,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.088899+0000","last_change":"2024-09-14T11:59:12.088830+0000","last_active":"2024-09-14T11:59:12.088899+0000","last_peered":"2024-09-14T11:59:12.088899+0000","last_clean":"2024-09-14T11:59:12.088899+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:59:12.088899+0000","last_undegraded":"2024-09-14T11:59:12.088899+0000","last_fullsized":"2024-09-14T11:59:12.088899+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'850","last_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_deep_scrub":"263'850","last_deep_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.088731+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:07.995815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'398","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.117096+0000","last_change":"2024-09-14T11:58:49.117031+0000","last_active":"2024-09-14T11:58:49.117096+0000","last_peered":"2024-09-14T11:58:49.117096+0000","last_clean":"2024-09-14T11:58:49.117096+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:49.117096+0000","last_undegraded":"2024-09-14T11:58:49.117096+0000","last_fullsized":"2024-09-14T11:58:49.117096+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.116906+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:11.076523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":40288,"num_write":1313,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'392","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.625356+0000","last_change":"2024-09-14T11:59:03.625263+0000","last_active":"2024-09-14T11:59:03.625356+0000","last_peered":"2024-09-14T11:59:03.625356+0000","last_clean":"2024-09-14T11:59:03.625356+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:59:03.625356+0000","last_undegraded":"2024-09-14T11:59:03.625356+0000","last_fullsized":"2024-09-14T11:59:03.625356+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.625149+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:36.235567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1885,"ondisk_log_size":1885,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":505,"ondisk_log_size":505,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1660817,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18638,"num_read_kb":39748,"num_write":15595,"num_write_kb":12041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702580,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35737,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3751,"ondisk_log_size":3751,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":43145697,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44629,"num_read_kb":1932119,"num_write":73662,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59392000,"data_stored":59392000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3707,"ondisk_log_size":3707,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":187491,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":178270,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510207,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296288,"kb_used_data":12432,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075552,"statfs":{"total":96636764160,"available":96333365248,"internally_reserved":0,"allocated":12730368,"data_stored":10789257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510204,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130676,"kb_used_data":13412,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94241164,"statfs":{"total":96636764160,"available":96502951936,"internally_reserved":0,"allocated":13733888,"data_stored":11812366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542906,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313544,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94058296,"statfs":{"total":96636764160,"available":96315695104,"internally_reserved":0,"allocated":11919360,"data_stored":9919858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542909,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176908,"kb_used_data":11132,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194932,"statfs":{"total":96636764160,"available":96455610368,"internally_reserved":0,"allocated":11399168,"data_stored":9381666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542907,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301348,"kb_used_data":9172,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94070492,"statfs":{"total":96636764160,"available":96328183808,"internally_reserved":0,"allocated":9392128,"data_stored":7423434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542911,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121572,"kb_used_data":5716,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94250268,"statfs":{"total":96636764160,"available":96512274432,"internally_reserved":0,"allocated":5853184,"data_stored":3932499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542908,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188836,"kb_used_data":13332,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94183004,"statfs":{"total":96636764160,"available":96443396096,"internally_reserved":0,"allocated":13651968,"data_stored":11690363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542907,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285244,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94086596,"statfs":{"total":96636764160,"available":96344674304,"internally_reserved":0,"allocated":15642624,"data_stored":13655531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5169152,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":9560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":7127040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8536064,"data_stored":8536064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7073792,"data_stored":7073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:59:47.455 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.455 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.456 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.456 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.456 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.457 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:32:10.408067+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=32, tm_sec=10, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=40, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:59:47.460 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T12:00:07.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T12:00:07.822 INFO:teuthology.orchestra.run.smithi029.stdout: 2024-09-14T12:00:07.836 INFO:teuthology.orchestra.run.smithi029.stderr:dumped all 2024-09-14T12:00:07.838 INFO:teuthology.orchestra.run.smithi029.stdout:{"pg_ready":true,"pg_map":{"version":2167,"stamp":"2024-09-14T12:00:05.931963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":45414219,"num_objects":743,"num_object_clones":0,"num_object_copies":2046,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":743,"num_whiteouts":0,"num_read":312784,"num_read_kb":2565821,"num_write":166013,"num_write_kb":2614752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":198,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":742144,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13280,"ondisk_log_size":13280,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1814416,"kb_used_data":92112,"kb_used_omap":12,"kb_used_meta":1722163,"kb_avail":753160304,"statfs":{"total":773094113280,"available":771236151296,"internally_reserved":0,"allocated":94322688,"data_stored":78604974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1763495472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006268"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.185656+0000","last_change":"2024-09-14T11:59:33.185591+0000","last_active":"2024-09-14T11:59:33.185656+0000","last_peered":"2024-09-14T11:59:33.185656+0000","last_clean":"2024-09-14T11:59:33.185656+0000","last_became_active":"2024-09-14T11:32:11.438302+0000","last_became_peered":"2024-09-14T11:32:11.438302+0000","last_unstale":"2024-09-14T11:59:33.185656+0000","last_undegraded":"2024-09-14T11:59:33.185656+0000","last_fullsized":"2024-09-14T11:59:33.185656+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:33.185507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:33.185507+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.185507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:53.897191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"263'9","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.134775+0000","last_change":"2024-09-14T11:59:30.134775+0000","last_active":"2024-09-14T11:59:30.134775+0000","last_peered":"2024-09-14T11:59:30.134775+0000","last_clean":"2024-09-14T11:59:30.134775+0000","last_became_active":"2024-09-14T11:15:25.394784+0000","last_became_peered":"2024-09-14T11:15:25.394784+0000","last_unstale":"2024-09-14T11:59:30.134775+0000","last_undegraded":"2024-09-14T11:59:30.134775+0000","last_fullsized":"2024-09-14T11:59:30.134775+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:30.134653+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:30.134653+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.134653+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:35.686820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":13318,"num_write":14,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.326926+0000","last_change":"2024-09-14T11:59:32.326926+0000","last_active":"2024-09-14T11:59:32.326926+0000","last_peered":"2024-09-14T11:59:32.326926+0000","last_clean":"2024-09-14T11:59:32.326926+0000","last_became_active":"2024-09-14T11:15:22.372136+0000","last_became_peered":"2024-09-14T11:15:22.372136+0000","last_unstale":"2024-09-14T11:59:32.326926+0000","last_undegraded":"2024-09-14T11:59:32.326926+0000","last_fullsized":"2024-09-14T11:59:32.326926+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:32.326836+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:32.326836+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.326836+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:45.835770+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"263'35","reported_seq":158,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.008316+0000","last_change":"2024-09-14T11:59:28.008316+0000","last_active":"2024-09-14T11:59:28.008316+0000","last_peered":"2024-09-14T11:59:28.008316+0000","last_clean":"2024-09-14T11:59:28.008316+0000","last_became_active":"2024-09-14T11:12:39.155183+0000","last_became_peered":"2024-09-14T11:12:39.155183+0000","last_unstale":"2024-09-14T11:59:28.008316+0000","last_undegraded":"2024-09-14T11:59:28.008316+0000","last_fullsized":"2024-09-14T11:59:28.008316+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'35","last_scrub_stamp":"2024-09-14T11:59:28.008222+0000","last_deep_scrub":"263'35","last_deep_scrub_stamp":"2024-09-14T11:59:28.008222+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.008222+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:23.688179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":273,"num_read_kb":174,"num_write":88,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.133068+0000","last_change":"2024-09-14T11:59:13.133003+0000","last_active":"2024-09-14T11:59:13.133068+0000","last_peered":"2024-09-14T11:59:13.133068+0000","last_clean":"2024-09-14T11:59:13.133068+0000","last_became_active":"2024-09-14T11:32:11.437324+0000","last_became_peered":"2024-09-14T11:32:11.437324+0000","last_unstale":"2024-09-14T11:59:13.133068+0000","last_undegraded":"2024-09-14T11:59:13.133068+0000","last_fullsized":"2024-09-14T11:59:13.133068+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:13.132915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.132915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:41.513062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"263'8","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.753213+0000","last_change":"2024-09-14T11:59:33.753213+0000","last_active":"2024-09-14T11:59:33.753213+0000","last_peered":"2024-09-14T11:59:33.753213+0000","last_clean":"2024-09-14T11:59:33.753213+0000","last_became_active":"2024-09-14T11:15:25.392077+0000","last_became_peered":"2024-09-14T11:15:25.392077+0000","last_unstale":"2024-09-14T11:59:33.753213+0000","last_undegraded":"2024-09-14T11:59:33.753213+0000","last_fullsized":"2024-09-14T11:59:33.753213+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:59:33.753081+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:59:33.753081+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.753081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:25.972004+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":24554,"num_write":8,"num_write_kb":12276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.984429+0000","last_change":"2024-09-14T11:59:17.984429+0000","last_active":"2024-09-14T11:59:17.984429+0000","last_peered":"2024-09-14T11:59:17.984429+0000","last_clean":"2024-09-14T11:59:17.984429+0000","last_became_active":"2024-09-14T11:15:22.381861+0000","last_became_peered":"2024-09-14T11:15:22.381861+0000","last_unstale":"2024-09-14T11:59:17.984429+0000","last_undegraded":"2024-09-14T11:59:17.984429+0000","last_fullsized":"2024-09-14T11:59:17.984429+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:17.984338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.984338+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:16.588236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"263'34","reported_seq":159,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.059073+0000","last_change":"2024-09-14T11:59:03.059073+0000","last_active":"2024-09-14T11:59:03.059073+0000","last_peered":"2024-09-14T11:59:03.059073+0000","last_clean":"2024-09-14T11:59:03.059073+0000","last_became_active":"2024-09-14T11:12:39.149665+0000","last_became_peered":"2024-09-14T11:12:39.149665+0000","last_unstale":"2024-09-14T11:59:03.059073+0000","last_undegraded":"2024-09-14T11:59:03.059073+0000","last_fullsized":"2024-09-14T11:59:03.059073+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'34","last_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_deep_scrub":"263'34","last_deep_scrub_stamp":"2024-09-14T11:59:03.058984+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.058984+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:45.926589+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":275,"num_read_kb":196,"num_write":79,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.734191+0000","last_change":"2024-09-14T11:59:22.734191+0000","last_active":"2024-09-14T11:59:22.734191+0000","last_peered":"2024-09-14T11:59:22.734191+0000","last_clean":"2024-09-14T11:59:22.734191+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:59:22.734191+0000","last_undegraded":"2024-09-14T11:59:22.734191+0000","last_fullsized":"2024-09-14T11:59:22.734191+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.734105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.734105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:38.515792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.075059+0000","last_change":"2024-09-14T11:59:35.075059+0000","last_active":"2024-09-14T11:59:35.075059+0000","last_peered":"2024-09-14T11:59:35.075059+0000","last_clean":"2024-09-14T11:59:35.075059+0000","last_became_active":"2024-09-14T11:15:25.381159+0000","last_became_peered":"2024-09-14T11:15:25.381159+0000","last_unstale":"2024-09-14T11:59:35.075059+0000","last_undegraded":"2024-09-14T11:59:35.075059+0000","last_fullsized":"2024-09-14T11:59:35.075059+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.074968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.074968+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.074968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:09.049293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"260'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.163641+0000","last_change":"2024-09-14T11:59:09.163519+0000","last_active":"2024-09-14T11:59:09.163641+0000","last_peered":"2024-09-14T11:59:09.163641+0000","last_clean":"2024-09-14T11:59:09.163641+0000","last_became_active":"2024-09-14T11:15:22.378507+0000","last_became_peered":"2024-09-14T11:15:22.378507+0000","last_unstale":"2024-09-14T11:59:09.163641+0000","last_undegraded":"2024-09-14T11:59:09.163641+0000","last_fullsized":"2024-09-14T11:59:09.163641+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:09.163385+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.163385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:01.529582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4115,"num_write":4,"num_write_kb":4115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"263'26","reported_seq":133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.021878+0000","last_change":"2024-09-14T11:59:27.021878+0000","last_active":"2024-09-14T11:59:27.021878+0000","last_peered":"2024-09-14T11:59:27.021878+0000","last_clean":"2024-09-14T11:59:27.021878+0000","last_became_active":"2024-09-14T11:12:39.151472+0000","last_became_peered":"2024-09-14T11:12:39.151472+0000","last_unstale":"2024-09-14T11:59:27.021878+0000","last_undegraded":"2024-09-14T11:59:27.021878+0000","last_fullsized":"2024-09-14T11:59:27.021878+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:59:27.021785+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:59:27.021785+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.021785+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:09.411815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":130,"num_write":66,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:44.260536+0000","last_change":"2024-09-14T11:59:44.260536+0000","last_active":"2024-09-14T11:59:44.260536+0000","last_peered":"2024-09-14T11:59:44.260536+0000","last_clean":"2024-09-14T11:59:44.260536+0000","last_became_active":"2024-09-14T11:32:11.438669+0000","last_became_peered":"2024-09-14T11:32:11.438669+0000","last_unstale":"2024-09-14T11:59:44.260536+0000","last_undegraded":"2024-09-14T11:59:44.260536+0000","last_fullsized":"2024-09-14T11:59:44.260536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:44.260441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:44.260441+0000","last_clean_scrub_stamp":"2024-09-14T11:59:44.260441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:17:56.546704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"263'5","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.314440+0000","last_change":"2024-09-14T11:59:41.314440+0000","last_active":"2024-09-14T11:59:41.314440+0000","last_peered":"2024-09-14T11:59:41.314440+0000","last_clean":"2024-09-14T11:59:41.314440+0000","last_became_active":"2024-09-14T11:15:25.398841+0000","last_became_peered":"2024-09-14T11:15:25.398841+0000","last_unstale":"2024-09-14T11:59:41.314440+0000","last_undegraded":"2024-09-14T11:59:41.314440+0000","last_fullsized":"2024-09-14T11:59:41.314440+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-14T11:59:41.314330+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-14T11:59:41.314330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.314330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:00.859570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":10,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"263'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.778984+0000","last_change":"2024-09-14T11:59:27.778984+0000","last_active":"2024-09-14T11:59:27.778984+0000","last_peered":"2024-09-14T11:59:27.778984+0000","last_clean":"2024-09-14T11:59:27.778984+0000","last_became_active":"2024-09-14T11:15:22.376039+0000","last_became_peered":"2024-09-14T11:15:22.376039+0000","last_unstale":"2024-09-14T11:59:27.778984+0000","last_undegraded":"2024-09-14T11:59:27.778984+0000","last_fullsized":"2024-09-14T11:59:27.778984+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:27.778889+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:27.778889+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.778889+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:19.502798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"263'26","reported_seq":128,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.339700+0000","last_change":"2024-09-14T11:59:31.339700+0000","last_active":"2024-09-14T11:59:31.339700+0000","last_peered":"2024-09-14T11:59:31.339700+0000","last_clean":"2024-09-14T11:59:31.339700+0000","last_became_active":"2024-09-14T11:12:39.148583+0000","last_became_peered":"2024-09-14T11:12:39.148583+0000","last_unstale":"2024-09-14T11:59:31.339700+0000","last_undegraded":"2024-09-14T11:59:31.339700+0000","last_fullsized":"2024-09-14T11:59:31.339700+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'26","last_scrub_stamp":"2024-09-14T11:59:31.339612+0000","last_deep_scrub":"263'26","last_deep_scrub_stamp":"2024-09-14T11:59:31.339612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.339612+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:44.420355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":132,"num_write":69,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:46.246596+0000","last_change":"2024-09-14T11:59:46.246596+0000","last_active":"2024-09-14T11:59:46.246596+0000","last_peered":"2024-09-14T11:59:46.246596+0000","last_clean":"2024-09-14T11:59:46.246596+0000","last_became_active":"2024-09-14T11:32:11.441818+0000","last_became_peered":"2024-09-14T11:32:11.441818+0000","last_unstale":"2024-09-14T11:59:46.246596+0000","last_undegraded":"2024-09-14T11:59:46.246596+0000","last_fullsized":"2024-09-14T11:59:46.246596+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:46.246503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:46.246503+0000","last_clean_scrub_stamp":"2024-09-14T11:59:46.246503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:10.509351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"260'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.167041+0000","last_change":"2024-09-14T11:59:29.167041+0000","last_active":"2024-09-14T11:59:29.167041+0000","last_peered":"2024-09-14T11:59:29.167041+0000","last_clean":"2024-09-14T11:59:29.167041+0000","last_became_active":"2024-09-14T11:15:25.394529+0000","last_became_peered":"2024-09-14T11:15:25.394529+0000","last_unstale":"2024-09-14T11:59:29.167041+0000","last_undegraded":"2024-09-14T11:59:29.167041+0000","last_fullsized":"2024-09-14T11:59:29.167041+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:29.166921+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.166921+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.166921+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:32:58.981878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"260'3","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.067598+0000","last_change":"2024-09-14T11:59:34.067598+0000","last_active":"2024-09-14T11:59:34.067598+0000","last_peered":"2024-09-14T11:59:34.067598+0000","last_clean":"2024-09-14T11:59:34.067598+0000","last_became_active":"2024-09-14T11:15:22.370510+0000","last_became_peered":"2024-09-14T11:15:22.370510+0000","last_unstale":"2024-09-14T11:59:34.067598+0000","last_undegraded":"2024-09-14T11:59:34.067598+0000","last_fullsized":"2024-09-14T11:59:34.067598+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'3","last_scrub_stamp":"2024-09-14T11:59:34.067493+0000","last_deep_scrub":"260'3","last_deep_scrub_stamp":"2024-09-14T11:59:34.067493+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.067493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:37.418505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"258'10","reported_seq":89,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.367059+0000","last_change":"2024-09-14T11:59:30.367059+0000","last_active":"2024-09-14T11:59:30.367059+0000","last_peered":"2024-09-14T11:59:30.367059+0000","last_clean":"2024-09-14T11:59:30.367059+0000","last_became_active":"2024-09-14T11:12:39.149763+0000","last_became_peered":"2024-09-14T11:12:39.149763+0000","last_unstale":"2024-09-14T11:59:30.367059+0000","last_undegraded":"2024-09-14T11:59:30.367059+0000","last_fullsized":"2024-09-14T11:59:30.367059+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"258'10","last_scrub_stamp":"2024-09-14T11:59:30.366965+0000","last_deep_scrub":"258'10","last_deep_scrub_stamp":"2024-09-14T11:59:30.366965+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.366965+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:23.323487+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.923408+0000","last_change":"2024-09-14T11:59:22.923408+0000","last_active":"2024-09-14T11:59:22.923408+0000","last_peered":"2024-09-14T11:59:22.923408+0000","last_clean":"2024-09-14T11:59:22.923408+0000","last_became_active":"2024-09-14T11:32:11.438367+0000","last_became_peered":"2024-09-14T11:32:11.438367+0000","last_unstale":"2024-09-14T11:59:22.923408+0000","last_undegraded":"2024-09-14T11:59:22.923408+0000","last_fullsized":"2024-09-14T11:59:22.923408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:22.923308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:22.923308+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.923308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:16.187316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"263'6","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.791580+0000","last_change":"2024-09-14T11:59:19.791580+0000","last_active":"2024-09-14T11:59:19.791580+0000","last_peered":"2024-09-14T11:59:19.791580+0000","last_clean":"2024-09-14T11:59:19.791580+0000","last_became_active":"2024-09-14T11:15:25.394732+0000","last_became_peered":"2024-09-14T11:15:25.394732+0000","last_unstale":"2024-09-14T11:59:19.791580+0000","last_undegraded":"2024-09-14T11:59:19.791580+0000","last_fullsized":"2024-09-14T11:59:19.791580+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:19.791500+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.791500+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:50.852626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10232,"num_write":6,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.794389+0000","last_change":"2024-09-14T11:59:25.794389+0000","last_active":"2024-09-14T11:59:25.794389+0000","last_peered":"2024-09-14T11:59:25.794389+0000","last_clean":"2024-09-14T11:59:25.794389+0000","last_became_active":"2024-09-14T11:15:22.370809+0000","last_became_peered":"2024-09-14T11:15:22.370809+0000","last_unstale":"2024-09-14T11:59:25.794389+0000","last_undegraded":"2024-09-14T11:59:25.794389+0000","last_fullsized":"2024-09-14T11:59:25.794389+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:25.794299+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:25.794299+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.794299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.495288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"263'14","reported_seq":97,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.735183+0000","last_change":"2024-09-14T11:59:14.735183+0000","last_active":"2024-09-14T11:59:14.735183+0000","last_peered":"2024-09-14T11:59:14.735183+0000","last_clean":"2024-09-14T11:59:14.735183+0000","last_became_active":"2024-09-14T11:12:39.151921+0000","last_became_peered":"2024-09-14T11:12:39.151921+0000","last_unstale":"2024-09-14T11:59:14.735183+0000","last_undegraded":"2024-09-14T11:59:14.735183+0000","last_fullsized":"2024-09-14T11:59:14.735183+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:59:14.735096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.735096+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:36.716450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":70,"num_write":36,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.078128+0000","last_change":"2024-09-14T11:59:41.078066+0000","last_active":"2024-09-14T11:59:41.078128+0000","last_peered":"2024-09-14T11:59:41.078128+0000","last_clean":"2024-09-14T11:59:41.078128+0000","last_became_active":"2024-09-14T11:32:11.436500+0000","last_became_peered":"2024-09-14T11:32:11.436500+0000","last_unstale":"2024-09-14T11:59:41.078128+0000","last_undegraded":"2024-09-14T11:59:41.078128+0000","last_fullsized":"2024-09-14T11:59:41.078128+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:41.077982+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:41.077982+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.077982+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:47.488819+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.749192+0000","last_change":"2024-09-14T11:59:20.749192+0000","last_active":"2024-09-14T11:59:20.749192+0000","last_peered":"2024-09-14T11:59:20.749192+0000","last_clean":"2024-09-14T11:59:20.749192+0000","last_became_active":"2024-09-14T11:15:25.385541+0000","last_became_peered":"2024-09-14T11:15:25.385541+0000","last_unstale":"2024-09-14T11:59:20.749192+0000","last_undegraded":"2024-09-14T11:59:20.749192+0000","last_fullsized":"2024-09-14T11:59:20.749192+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:20.749100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.749100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:38.196873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"263'8","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.808730+0000","last_change":"2024-09-14T11:59:26.808730+0000","last_active":"2024-09-14T11:59:26.808730+0000","last_peered":"2024-09-14T11:59:26.808730+0000","last_clean":"2024-09-14T11:59:26.808730+0000","last_became_active":"2024-09-14T11:15:22.380484+0000","last_became_peered":"2024-09-14T11:15:22.380484+0000","last_unstale":"2024-09-14T11:59:26.808730+0000","last_undegraded":"2024-09-14T11:59:26.808730+0000","last_fullsized":"2024-09-14T11:59:26.808730+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-14T11:59:26.808644+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-14T11:59:26.808644+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.808644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:43.305290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":12284,"num_write":18,"num_write_kb":12284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"263'154","reported_seq":511,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.100913+0000","last_change":"2024-09-14T11:59:25.100913+0000","last_active":"2024-09-14T11:59:25.100913+0000","last_peered":"2024-09-14T11:59:25.100913+0000","last_clean":"2024-09-14T11:59:25.100913+0000","last_became_active":"2024-09-14T11:12:39.151442+0000","last_became_peered":"2024-09-14T11:12:39.151442+0000","last_unstale":"2024-09-14T11:59:25.100913+0000","last_undegraded":"2024-09-14T11:59:25.100913+0000","last_fullsized":"2024-09-14T11:59:25.100913+0000","mapping_epoch":250,"log_start":"260'100","ondisk_log_start":"260'100","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T11:59:25.100823+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T11:59:25.100823+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.100823+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:04.338869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1395,"num_read_kb":1334,"num_write":334,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.070229+0000","last_change":"2024-09-14T11:59:43.070229+0000","last_active":"2024-09-14T11:59:43.070229+0000","last_peered":"2024-09-14T11:59:43.070229+0000","last_clean":"2024-09-14T11:59:43.070229+0000","last_became_active":"2024-09-14T11:32:11.443650+0000","last_became_peered":"2024-09-14T11:32:11.443650+0000","last_unstale":"2024-09-14T11:59:43.070229+0000","last_undegraded":"2024-09-14T11:59:43.070229+0000","last_fullsized":"2024-09-14T11:59:43.070229+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:43.070105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:43.070105+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.070105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:33.294883+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"263'3","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.303540+0000","last_change":"2024-09-14T11:59:40.303540+0000","last_active":"2024-09-14T11:59:40.303540+0000","last_peered":"2024-09-14T11:59:40.303540+0000","last_clean":"2024-09-14T11:59:40.303540+0000","last_became_active":"2024-09-14T11:15:25.396956+0000","last_became_peered":"2024-09-14T11:15:25.396956+0000","last_unstale":"2024-09-14T11:59:40.303540+0000","last_undegraded":"2024-09-14T11:59:40.303540+0000","last_fullsized":"2024-09-14T11:59:40.303540+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:40.303449+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:40.303449+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.303449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:09.476961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.015449+0000","last_change":"2024-09-14T11:59:31.015449+0000","last_active":"2024-09-14T11:59:31.015449+0000","last_peered":"2024-09-14T11:59:31.015449+0000","last_clean":"2024-09-14T11:59:31.015449+0000","last_became_active":"2024-09-14T11:15:22.371626+0000","last_became_peered":"2024-09-14T11:15:22.371626+0000","last_unstale":"2024-09-14T11:59:31.015449+0000","last_undegraded":"2024-09-14T11:59:31.015449+0000","last_fullsized":"2024-09-14T11:59:31.015449+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.015349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.015349+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.015349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:47:40.863122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"263'18","reported_seq":111,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.046761+0000","last_change":"2024-09-14T11:59:15.046761+0000","last_active":"2024-09-14T11:59:15.046761+0000","last_peered":"2024-09-14T11:59:15.046761+0000","last_clean":"2024-09-14T11:59:15.046761+0000","last_became_active":"2024-09-14T11:12:39.148597+0000","last_became_peered":"2024-09-14T11:12:39.148597+0000","last_unstale":"2024-09-14T11:59:15.046761+0000","last_undegraded":"2024-09-14T11:59:15.046761+0000","last_fullsized":"2024-09-14T11:59:15.046761+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'18","last_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_deep_scrub":"263'18","last_deep_scrub_stamp":"2024-09-14T11:59:15.046667+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.046667+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:31.667121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":96,"num_write":47,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.966622+0000","last_change":"2024-09-14T11:59:21.966622+0000","last_active":"2024-09-14T11:59:21.966622+0000","last_peered":"2024-09-14T11:59:21.966622+0000","last_clean":"2024-09-14T11:59:21.966622+0000","last_became_active":"2024-09-14T11:32:11.440997+0000","last_became_peered":"2024-09-14T11:32:11.440997+0000","last_unstale":"2024-09-14T11:59:21.966622+0000","last_undegraded":"2024-09-14T11:59:21.966622+0000","last_fullsized":"2024-09-14T11:59:21.966622+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.966514+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.966514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:37.272047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"263'4","reported_seq":48,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.019700+0000","last_change":"2024-09-14T11:59:39.019637+0000","last_active":"2024-09-14T11:59:39.019700+0000","last_peered":"2024-09-14T11:59:39.019700+0000","last_clean":"2024-09-14T11:59:39.019700+0000","last_became_active":"2024-09-14T11:16:16.965128+0000","last_became_peered":"2024-09-14T11:16:16.965128+0000","last_unstale":"2024-09-14T11:59:39.019700+0000","last_undegraded":"2024-09-14T11:59:39.019700+0000","last_fullsized":"2024-09-14T11:59:39.019700+0000","mapping_epoch":259,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":260,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:39.019493+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:39.019493+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.019493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:26.293176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1032,"num_write":4,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.209626+0000","last_change":"2024-09-14T11:59:26.209533+0000","last_active":"2024-09-14T11:59:26.209626+0000","last_peered":"2024-09-14T11:59:26.209626+0000","last_clean":"2024-09-14T11:59:26.209626+0000","last_became_active":"2024-09-14T11:15:22.372187+0000","last_became_peered":"2024-09-14T11:15:22.372187+0000","last_unstale":"2024-09-14T11:59:26.209626+0000","last_undegraded":"2024-09-14T11:59:26.209626+0000","last_fullsized":"2024-09-14T11:59:26.209626+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:26.209431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:26.209431+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.209431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:19.695508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"263'59","reported_seq":222,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.051785+0000","last_change":"2024-09-14T11:59:26.051785+0000","last_active":"2024-09-14T11:59:26.051785+0000","last_peered":"2024-09-14T11:59:26.051785+0000","last_clean":"2024-09-14T11:59:26.051785+0000","last_became_active":"2024-09-14T11:12:39.153218+0000","last_became_peered":"2024-09-14T11:12:39.153218+0000","last_unstale":"2024-09-14T11:59:26.051785+0000","last_undegraded":"2024-09-14T11:59:26.051785+0000","last_fullsized":"2024-09-14T11:59:26.051785+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-14T11:59:26.051689+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-14T11:59:26.051689+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.051689+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:55.172209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":473,"num_read_kb":305,"num_write":147,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.100053+0000","last_change":"2024-09-14T11:59:12.100053+0000","last_active":"2024-09-14T11:59:12.100053+0000","last_peered":"2024-09-14T11:59:12.100053+0000","last_clean":"2024-09-14T11:59:12.100053+0000","last_became_active":"2024-09-14T11:32:11.425400+0000","last_became_peered":"2024-09-14T11:32:11.425400+0000","last_unstale":"2024-09-14T11:59:12.100053+0000","last_undegraded":"2024-09-14T11:59:12.100053+0000","last_fullsized":"2024-09-14T11:59:12.100053+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:12.099973+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.099973+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:00.241604+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.243254+0000","last_change":"2024-09-14T11:59:37.243188+0000","last_active":"2024-09-14T11:59:37.243254+0000","last_peered":"2024-09-14T11:59:37.243254+0000","last_clean":"2024-09-14T11:59:37.243254+0000","last_became_active":"2024-09-14T11:15:25.398719+0000","last_became_peered":"2024-09-14T11:15:25.398719+0000","last_unstale":"2024-09-14T11:59:37.243254+0000","last_undegraded":"2024-09-14T11:59:37.243254+0000","last_fullsized":"2024-09-14T11:59:37.243254+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.243090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.243090+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.243090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:13.636173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"260'4","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.066777+0000","last_change":"2024-09-14T11:59:30.066777+0000","last_active":"2024-09-14T11:59:30.066777+0000","last_peered":"2024-09-14T11:59:30.066777+0000","last_clean":"2024-09-14T11:59:30.066777+0000","last_became_active":"2024-09-14T11:15:22.376870+0000","last_became_peered":"2024-09-14T11:15:22.376870+0000","last_unstale":"2024-09-14T11:59:30.066777+0000","last_undegraded":"2024-09-14T11:59:30.066777+0000","last_fullsized":"2024-09-14T11:59:30.066777+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:30.066675+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:30.066675+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.066675+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:41.913874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":12278,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"263'228","reported_seq":741,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.359884+0000","last_change":"2024-09-14T11:59:29.359884+0000","last_active":"2024-09-14T11:59:29.359884+0000","last_peered":"2024-09-14T11:59:29.359884+0000","last_clean":"2024-09-14T11:59:29.359884+0000","last_became_active":"2024-09-14T11:12:39.154641+0000","last_became_peered":"2024-09-14T11:12:39.154641+0000","last_unstale":"2024-09-14T11:59:29.359884+0000","last_undegraded":"2024-09-14T11:59:29.359884+0000","last_fullsized":"2024-09-14T11:59:29.359884+0000","mapping_epoch":250,"log_start":"260'200","ondisk_log_start":"260'200","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'228","last_scrub_stamp":"2024-09-14T11:59:29.359794+0000","last_deep_scrub":"263'228","last_deep_scrub_stamp":"2024-09-14T11:59:29.359794+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.359794+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:06.244789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2069,"num_read_kb":2494,"num_write":435,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.028411+0000","last_change":"2024-09-14T11:59:40.028411+0000","last_active":"2024-09-14T11:59:40.028411+0000","last_peered":"2024-09-14T11:59:40.028411+0000","last_clean":"2024-09-14T11:59:40.028411+0000","last_became_active":"2024-09-14T11:32:11.434500+0000","last_became_peered":"2024-09-14T11:32:11.434500+0000","last_unstale":"2024-09-14T11:59:40.028411+0000","last_undegraded":"2024-09-14T11:59:40.028411+0000","last_fullsized":"2024-09-14T11:59:40.028411+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.028314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.028314+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.028314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:22.449070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.258722+0000","last_change":"2024-09-14T11:59:39.258722+0000","last_active":"2024-09-14T11:59:39.258722+0000","last_peered":"2024-09-14T11:59:39.258722+0000","last_clean":"2024-09-14T11:59:39.258722+0000","last_became_active":"2024-09-14T11:15:25.399715+0000","last_became_peered":"2024-09-14T11:15:25.399715+0000","last_unstale":"2024-09-14T11:59:39.258722+0000","last_undegraded":"2024-09-14T11:59:39.258722+0000","last_fullsized":"2024-09-14T11:59:39.258722+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:39.258626+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:39.258626+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.258626+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:40:29.618320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8184,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"263'13","reported_seq":81,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.075554+0000","last_change":"2024-09-14T11:59:07.075554+0000","last_active":"2024-09-14T11:59:07.075554+0000","last_peered":"2024-09-14T11:59:07.075554+0000","last_clean":"2024-09-14T11:59:07.075554+0000","last_became_active":"2024-09-14T11:15:22.363336+0000","last_became_peered":"2024-09-14T11:15:22.363336+0000","last_unstale":"2024-09-14T11:59:07.075554+0000","last_undegraded":"2024-09-14T11:59:07.075554+0000","last_fullsized":"2024-09-14T11:59:07.075554+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'13","last_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_deep_scrub":"263'13","last_deep_scrub_stamp":"2024-09-14T11:59:07.075458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.075458+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:32.773384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":27666,"num_write":18,"num_write_kb":13324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"263'25","reported_seq":130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.059348+0000","last_change":"2024-09-14T11:59:05.059348+0000","last_active":"2024-09-14T11:59:05.059348+0000","last_peered":"2024-09-14T11:59:05.059348+0000","last_clean":"2024-09-14T11:59:05.059348+0000","last_became_active":"2024-09-14T11:12:39.148134+0000","last_became_peered":"2024-09-14T11:12:39.148134+0000","last_unstale":"2024-09-14T11:59:05.059348+0000","last_undegraded":"2024-09-14T11:59:05.059348+0000","last_fullsized":"2024-09-14T11:59:05.059348+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'25","last_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_deep_scrub":"263'25","last_deep_scrub_stamp":"2024-09-14T11:59:05.059255+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.059255+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:37:17.564726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":135,"num_write":59,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.178042+0000","last_change":"2024-09-14T11:59:32.178042+0000","last_active":"2024-09-14T11:59:32.178042+0000","last_peered":"2024-09-14T11:59:32.178042+0000","last_clean":"2024-09-14T11:59:32.178042+0000","last_became_active":"2024-09-14T11:32:11.436484+0000","last_became_peered":"2024-09-14T11:32:11.436484+0000","last_unstale":"2024-09-14T11:59:32.178042+0000","last_undegraded":"2024-09-14T11:59:32.178042+0000","last_fullsized":"2024-09-14T11:59:32.178042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.177942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.177942+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.177942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:51.348432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.752399+0000","last_change":"2024-09-14T11:59:31.752399+0000","last_active":"2024-09-14T11:59:31.752399+0000","last_peered":"2024-09-14T11:59:31.752399+0000","last_clean":"2024-09-14T11:59:31.752399+0000","last_became_active":"2024-09-14T11:15:25.389374+0000","last_became_peered":"2024-09-14T11:15:25.389374+0000","last_unstale":"2024-09-14T11:59:31.752399+0000","last_undegraded":"2024-09-14T11:59:31.752399+0000","last_fullsized":"2024-09-14T11:59:31.752399+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:31.752297+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:31.752297+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.752297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:26.275166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"263'2","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.003116+0000","last_change":"2024-09-14T11:59:30.003116+0000","last_active":"2024-09-14T11:59:30.003116+0000","last_peered":"2024-09-14T11:59:30.003116+0000","last_clean":"2024-09-14T11:59:30.003116+0000","last_became_active":"2024-09-14T11:15:22.371707+0000","last_became_peered":"2024-09-14T11:15:22.371707+0000","last_unstale":"2024-09-14T11:59:30.003116+0000","last_undegraded":"2024-09-14T11:59:30.003116+0000","last_fullsized":"2024-09-14T11:59:30.003116+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:30.003027+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:30.003027+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.003027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:05.836932+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"263'12","reported_seq":93,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.156741+0000","last_change":"2024-09-14T11:59:25.156652+0000","last_active":"2024-09-14T11:59:25.156741+0000","last_peered":"2024-09-14T11:59:25.156741+0000","last_clean":"2024-09-14T11:59:25.156741+0000","last_became_active":"2024-09-14T11:12:39.146756+0000","last_became_peered":"2024-09-14T11:12:39.146756+0000","last_unstale":"2024-09-14T11:59:25.156741+0000","last_undegraded":"2024-09-14T11:59:25.156741+0000","last_fullsized":"2024-09-14T11:59:25.156741+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:59:25.156536+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:59:25.156536+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.156536+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:04.694265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:45.225037+0000","last_change":"2024-09-14T11:59:45.225037+0000","last_active":"2024-09-14T11:59:45.225037+0000","last_peered":"2024-09-14T11:59:45.225037+0000","last_clean":"2024-09-14T11:59:45.225037+0000","last_became_active":"2024-09-14T11:32:11.438169+0000","last_became_peered":"2024-09-14T11:32:11.438169+0000","last_unstale":"2024-09-14T11:59:45.225037+0000","last_undegraded":"2024-09-14T11:59:45.225037+0000","last_fullsized":"2024-09-14T11:59:45.225037+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:45.224930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:45.224930+0000","last_clean_scrub_stamp":"2024-09-14T11:59:45.224930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:51.461042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"263'9","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.864248+0000","last_change":"2024-09-14T11:59:25.864155+0000","last_active":"2024-09-14T11:59:25.864248+0000","last_peered":"2024-09-14T11:59:25.864248+0000","last_clean":"2024-09-14T11:59:25.864248+0000","last_became_active":"2024-09-14T11:15:25.392352+0000","last_became_peered":"2024-09-14T11:15:25.392352+0000","last_unstale":"2024-09-14T11:59:25.864248+0000","last_undegraded":"2024-09-14T11:59:25.864248+0000","last_fullsized":"2024-09-14T11:59:25.864248+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:25.864058+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:25.864058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.864058+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:02.149112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":15350,"num_write":14,"num_write_kb":9208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.780964+0000","last_change":"2024-09-14T11:59:23.780898+0000","last_active":"2024-09-14T11:59:23.780964+0000","last_peered":"2024-09-14T11:59:23.780964+0000","last_clean":"2024-09-14T11:59:23.780964+0000","last_became_active":"2024-09-14T11:15:22.376823+0000","last_became_peered":"2024-09-14T11:15:22.376823+0000","last_unstale":"2024-09-14T11:59:23.780964+0000","last_undegraded":"2024-09-14T11:59:23.780964+0000","last_fullsized":"2024-09-14T11:59:23.780964+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:23.780807+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:23.780807+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.780807+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:15.265683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"263'38","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.144264+0000","last_change":"2024-09-14T11:59:24.144264+0000","last_active":"2024-09-14T11:59:24.144264+0000","last_peered":"2024-09-14T11:59:24.144264+0000","last_clean":"2024-09-14T11:59:24.144264+0000","last_became_active":"2024-09-14T11:12:39.147956+0000","last_became_peered":"2024-09-14T11:12:39.147956+0000","last_unstale":"2024-09-14T11:59:24.144264+0000","last_undegraded":"2024-09-14T11:59:24.144264+0000","last_fullsized":"2024-09-14T11:59:24.144264+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'38","last_scrub_stamp":"2024-09-14T11:59:24.144170+0000","last_deep_scrub":"263'38","last_deep_scrub_stamp":"2024-09-14T11:59:24.144170+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.144170+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:59.810887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":197,"num_write":96,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":32,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:40.001092+0000","last_change":"2024-09-14T11:59:40.001092+0000","last_active":"2024-09-14T11:59:40.001092+0000","last_peered":"2024-09-14T11:59:40.001092+0000","last_clean":"2024-09-14T11:59:40.001092+0000","last_became_active":"2024-09-14T11:32:11.434609+0000","last_became_peered":"2024-09-14T11:32:11.434609+0000","last_unstale":"2024-09-14T11:59:40.001092+0000","last_undegraded":"2024-09-14T11:59:40.001092+0000","last_fullsized":"2024-09-14T11:59:40.001092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:40.001001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:40.001001+0000","last_clean_scrub_stamp":"2024-09-14T11:59:40.001001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:34.504118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"263'11","reported_seq":72,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.940964+0000","last_change":"2024-09-14T11:59:20.940907+0000","last_active":"2024-09-14T11:59:20.940964+0000","last_peered":"2024-09-14T11:59:20.940964+0000","last_clean":"2024-09-14T11:59:20.940964+0000","last_became_active":"2024-09-14T11:15:25.390414+0000","last_became_peered":"2024-09-14T11:15:25.390414+0000","last_unstale":"2024-09-14T11:59:20.940964+0000","last_undegraded":"2024-09-14T11:59:20.940964+0000","last_fullsized":"2024-09-14T11:59:20.940964+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-14T11:59:20.940817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.940817+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:58.585992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13326,"num_write":16,"num_write_kb":10244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"263'7","reported_seq":66,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.303317+0000","last_change":"2024-09-14T11:59:35.303229+0000","last_active":"2024-09-14T11:59:35.303317+0000","last_peered":"2024-09-14T11:59:35.303317+0000","last_clean":"2024-09-14T11:59:35.303317+0000","last_became_active":"2024-09-14T11:15:22.367408+0000","last_became_peered":"2024-09-14T11:15:22.367408+0000","last_unstale":"2024-09-14T11:59:35.303317+0000","last_undegraded":"2024-09-14T11:59:35.303317+0000","last_fullsized":"2024-09-14T11:59:35.303317+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:35.303137+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:35.303137+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.303137+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:30.487357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":12,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"263'39","reported_seq":173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.114333+0000","last_change":"2024-09-14T11:59:24.114333+0000","last_active":"2024-09-14T11:59:24.114333+0000","last_peered":"2024-09-14T11:59:24.114333+0000","last_clean":"2024-09-14T11:59:24.114333+0000","last_became_active":"2024-09-14T11:12:39.154845+0000","last_became_peered":"2024-09-14T11:12:39.154845+0000","last_unstale":"2024-09-14T11:59:24.114333+0000","last_undegraded":"2024-09-14T11:59:24.114333+0000","last_fullsized":"2024-09-14T11:59:24.114333+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'39","last_scrub_stamp":"2024-09-14T11:59:24.114233+0000","last_deep_scrub":"263'39","last_deep_scrub_stamp":"2024-09-14T11:59:24.114233+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.114233+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:52.519200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":328,"num_read_kb":243,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.053802+0000","last_change":"2024-09-14T11:59:42.053802+0000","last_active":"2024-09-14T11:59:42.053802+0000","last_peered":"2024-09-14T11:59:42.053802+0000","last_clean":"2024-09-14T11:59:42.053802+0000","last_became_active":"2024-09-14T11:32:11.431280+0000","last_became_peered":"2024-09-14T11:32:11.431280+0000","last_unstale":"2024-09-14T11:59:42.053802+0000","last_undegraded":"2024-09-14T11:59:42.053802+0000","last_fullsized":"2024-09-14T11:59:42.053802+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:42.053698+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:42.053698+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.053698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:08.872690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.257449+0000","last_change":"2024-09-14T11:59:38.257382+0000","last_active":"2024-09-14T11:59:38.257449+0000","last_peered":"2024-09-14T11:59:38.257449+0000","last_clean":"2024-09-14T11:59:38.257449+0000","last_became_active":"2024-09-14T11:15:25.395703+0000","last_became_peered":"2024-09-14T11:15:25.395703+0000","last_unstale":"2024-09-14T11:59:38.257449+0000","last_undegraded":"2024-09-14T11:59:38.257449+0000","last_fullsized":"2024-09-14T11:59:38.257449+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:38.257284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:38.257284+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.257284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:55.712630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"260'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.781182+0000","last_change":"2024-09-14T11:59:16.781098+0000","last_active":"2024-09-14T11:59:16.781182+0000","last_peered":"2024-09-14T11:59:16.781182+0000","last_clean":"2024-09-14T11:59:16.781182+0000","last_became_active":"2024-09-14T11:15:22.379913+0000","last_became_peered":"2024-09-14T11:15:22.379913+0000","last_unstale":"2024-09-14T11:59:16.781182+0000","last_undegraded":"2024-09-14T11:59:16.781182+0000","last_fullsized":"2024-09-14T11:59:16.781182+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:16.781001+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.781001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:55.027672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"263'59","reported_seq":227,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.754047+0000","last_change":"2024-09-14T11:59:24.754047+0000","last_active":"2024-09-14T11:59:24.754047+0000","last_peered":"2024-09-14T11:59:24.754047+0000","last_clean":"2024-09-14T11:59:24.754047+0000","last_became_active":"2024-09-14T11:12:39.149238+0000","last_became_peered":"2024-09-14T11:12:39.149238+0000","last_unstale":"2024-09-14T11:59:24.754047+0000","last_undegraded":"2024-09-14T11:59:24.754047+0000","last_fullsized":"2024-09-14T11:59:24.754047+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'59","last_scrub_stamp":"2024-09-14T11:59:24.753913+0000","last_deep_scrub":"263'59","last_deep_scrub_stamp":"2024-09-14T11:59:24.753913+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.753913+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:46.401507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":510,"num_read_kb":357,"num_write":138,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"263'2","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.303942+0000","last_change":"2024-09-14T11:59:43.303942+0000","last_active":"2024-09-14T11:59:43.303942+0000","last_peered":"2024-09-14T11:59:43.303942+0000","last_clean":"2024-09-14T11:59:43.303942+0000","last_became_active":"2024-09-14T11:32:11.437062+0000","last_became_peered":"2024-09-14T11:32:11.437062+0000","last_unstale":"2024-09-14T11:59:43.303942+0000","last_undegraded":"2024-09-14T11:59:43.303942+0000","last_fullsized":"2024-09-14T11:59:43.303942+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:43.303853+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:43.303853+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.303853+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:34.329890+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"260'2","reported_seq":54,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.801497+0000","last_change":"2024-09-14T11:59:18.801416+0000","last_active":"2024-09-14T11:59:18.801497+0000","last_peered":"2024-09-14T11:59:18.801497+0000","last_clean":"2024-09-14T11:59:18.801497+0000","last_became_active":"2024-09-14T11:15:25.394001+0000","last_became_peered":"2024-09-14T11:15:25.394001+0000","last_unstale":"2024-09-14T11:59:18.801497+0000","last_undegraded":"2024-09-14T11:59:18.801497+0000","last_fullsized":"2024-09-14T11:59:18.801497+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:18.801330+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.801330+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:29.523992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"263'15","reported_seq":82,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.251027+0000","last_change":"2024-09-14T11:59:27.250927+0000","last_active":"2024-09-14T11:59:27.251027+0000","last_peered":"2024-09-14T11:59:27.251027+0000","last_clean":"2024-09-14T11:59:27.251027+0000","last_became_active":"2024-09-14T11:15:22.376718+0000","last_became_peered":"2024-09-14T11:15:22.376718+0000","last_unstale":"2024-09-14T11:59:27.251027+0000","last_undegraded":"2024-09-14T11:59:27.251027+0000","last_fullsized":"2024-09-14T11:59:27.251027+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:59:27.250822+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:59:27.250822+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.250822+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:55.536199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":15412,"num_write":20,"num_write_kb":7216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"263'53","reported_seq":203,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.327229+0000","last_change":"2024-09-14T11:59:28.327229+0000","last_active":"2024-09-14T11:59:28.327229+0000","last_peered":"2024-09-14T11:59:28.327229+0000","last_clean":"2024-09-14T11:59:28.327229+0000","last_became_active":"2024-09-14T11:12:39.148297+0000","last_became_peered":"2024-09-14T11:12:39.148297+0000","last_unstale":"2024-09-14T11:59:28.327229+0000","last_undegraded":"2024-09-14T11:59:28.327229+0000","last_fullsized":"2024-09-14T11:59:28.327229+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'53","last_scrub_stamp":"2024-09-14T11:59:28.327134+0000","last_deep_scrub":"263'53","last_deep_scrub_stamp":"2024-09-14T11:59:28.327134+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.327134+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:15.665026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":404,"num_read_kb":262,"num_write":135,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.101682+0000","last_change":"2024-09-14T11:59:11.101682+0000","last_active":"2024-09-14T11:59:11.101682+0000","last_peered":"2024-09-14T11:59:11.101682+0000","last_clean":"2024-09-14T11:59:11.101682+0000","last_became_active":"2024-09-14T11:32:11.424991+0000","last_became_peered":"2024-09-14T11:32:11.424991+0000","last_unstale":"2024-09-14T11:59:11.101682+0000","last_undegraded":"2024-09-14T11:59:11.101682+0000","last_fullsized":"2024-09-14T11:59:11.101682+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.101584+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.101584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.108804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.347242+0000","last_change":"2024-09-14T11:59:34.347242+0000","last_active":"2024-09-14T11:59:34.347242+0000","last_peered":"2024-09-14T11:59:34.347242+0000","last_clean":"2024-09-14T11:59:34.347242+0000","last_became_active":"2024-09-14T11:15:25.387666+0000","last_became_peered":"2024-09-14T11:15:25.387666+0000","last_unstale":"2024-09-14T11:59:34.347242+0000","last_undegraded":"2024-09-14T11:59:34.347242+0000","last_fullsized":"2024-09-14T11:59:34.347242+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:34.347151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:34.347151+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.347151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:02.797811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.078640+0000","last_change":"2024-09-14T11:59:31.078640+0000","last_active":"2024-09-14T11:59:31.078640+0000","last_peered":"2024-09-14T11:59:31.078640+0000","last_clean":"2024-09-14T11:59:31.078640+0000","last_became_active":"2024-09-14T11:15:22.375905+0000","last_became_peered":"2024-09-14T11:15:22.375905+0000","last_unstale":"2024-09-14T11:59:31.078640+0000","last_undegraded":"2024-09-14T11:59:31.078640+0000","last_fullsized":"2024-09-14T11:59:31.078640+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:31.078542+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:31.078542+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.078542+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:45:55.439289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":3079,"num_write":6,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"263'57","reported_seq":212,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.362867+0000","last_change":"2024-09-14T11:59:27.362867+0000","last_active":"2024-09-14T11:59:27.362867+0000","last_peered":"2024-09-14T11:59:27.362867+0000","last_clean":"2024-09-14T11:59:27.362867+0000","last_became_active":"2024-09-14T11:12:39.152847+0000","last_became_peered":"2024-09-14T11:12:39.152847+0000","last_unstale":"2024-09-14T11:59:27.362867+0000","last_undegraded":"2024-09-14T11:59:27.362867+0000","last_fullsized":"2024-09-14T11:59:27.362867+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'57","last_scrub_stamp":"2024-09-14T11:59:27.362800+0000","last_deep_scrub":"263'57","last_deep_scrub_stamp":"2024-09-14T11:59:27.362800+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.362800+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:04.501325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":424,"num_read_kb":251,"num_write":142,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.042404+0000","last_change":"2024-09-14T11:59:42.042404+0000","last_active":"2024-09-14T11:59:42.042404+0000","last_peered":"2024-09-14T11:59:42.042404+0000","last_clean":"2024-09-14T11:59:42.042404+0000","last_became_active":"2024-09-14T11:32:11.441609+0000","last_became_peered":"2024-09-14T11:32:11.441609+0000","last_unstale":"2024-09-14T11:59:42.042404+0000","last_undegraded":"2024-09-14T11:59:42.042404+0000","last_fullsized":"2024-09-14T11:59:42.042404+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.042279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.042279+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.042279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:43.281693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":53,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.298003+0000","last_change":"2024-09-14T11:59:33.298003+0000","last_active":"2024-09-14T11:59:33.298003+0000","last_peered":"2024-09-14T11:59:33.298003+0000","last_clean":"2024-09-14T11:59:33.298003+0000","last_became_active":"2024-09-14T11:15:25.396110+0000","last_became_peered":"2024-09-14T11:15:25.396110+0000","last_unstale":"2024-09-14T11:59:33.298003+0000","last_undegraded":"2024-09-14T11:59:33.298003+0000","last_fullsized":"2024-09-14T11:59:33.298003+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:33.297907+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:33.297907+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.297907+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:07.937163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"260'5","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.113881+0000","last_change":"2024-09-14T11:59:08.113881+0000","last_active":"2024-09-14T11:59:08.113881+0000","last_peered":"2024-09-14T11:59:08.113881+0000","last_clean":"2024-09-14T11:59:08.113881+0000","last_became_active":"2024-09-14T11:15:22.370636+0000","last_became_peered":"2024-09-14T11:15:22.370636+0000","last_unstale":"2024-09-14T11:59:08.113881+0000","last_undegraded":"2024-09-14T11:59:08.113881+0000","last_fullsized":"2024-09-14T11:59:08.113881+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:59:08.113784+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.113784+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:24.490857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6152,"num_write":10,"num_write_kb":6152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"263'22","reported_seq":119,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.231314+0000","last_change":"2024-09-14T11:59:24.231209+0000","last_active":"2024-09-14T11:59:24.231314+0000","last_peered":"2024-09-14T11:59:24.231314+0000","last_clean":"2024-09-14T11:59:24.231314+0000","last_became_active":"2024-09-14T11:12:39.148293+0000","last_became_peered":"2024-09-14T11:12:39.148293+0000","last_unstale":"2024-09-14T11:59:24.231314+0000","last_undegraded":"2024-09-14T11:59:24.231314+0000","last_fullsized":"2024-09-14T11:59:24.231314+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'22","last_scrub_stamp":"2024-09-14T11:59:24.231114+0000","last_deep_scrub":"263'22","last_deep_scrub_stamp":"2024-09-14T11:59:24.231114+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.231114+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:51.272771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":104,"num_write":56,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.783252+0000","last_change":"2024-09-14T11:59:21.783252+0000","last_active":"2024-09-14T11:59:21.783252+0000","last_peered":"2024-09-14T11:59:21.783252+0000","last_clean":"2024-09-14T11:59:21.783252+0000","last_became_active":"2024-09-14T11:32:11.434951+0000","last_became_peered":"2024-09-14T11:32:11.434951+0000","last_unstale":"2024-09-14T11:59:21.783252+0000","last_undegraded":"2024-09-14T11:59:21.783252+0000","last_fullsized":"2024-09-14T11:59:21.783252+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.783139+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.783139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:54:06.762141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"263'4","reported_seq":57,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.963077+0000","last_change":"2024-09-14T11:59:19.963077+0000","last_active":"2024-09-14T11:59:19.963077+0000","last_peered":"2024-09-14T11:59:19.963077+0000","last_clean":"2024-09-14T11:59:19.963077+0000","last_became_active":"2024-09-14T11:15:25.389453+0000","last_became_peered":"2024-09-14T11:15:25.389453+0000","last_unstale":"2024-09-14T11:59:19.963077+0000","last_undegraded":"2024-09-14T11:59:19.963077+0000","last_fullsized":"2024-09-14T11:59:19.963077+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:19.962996+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.962996+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:15.918979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"263'3","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:41.031631+0000","last_change":"2024-09-14T11:59:41.031631+0000","last_active":"2024-09-14T11:59:41.031631+0000","last_peered":"2024-09-14T11:59:41.031631+0000","last_clean":"2024-09-14T11:59:41.031631+0000","last_became_active":"2024-09-14T11:15:22.377927+0000","last_became_peered":"2024-09-14T11:15:22.377927+0000","last_unstale":"2024-09-14T11:59:41.031631+0000","last_undegraded":"2024-09-14T11:59:41.031631+0000","last_fullsized":"2024-09-14T11:59:41.031631+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:59:41.031537+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:59:41.031537+0000","last_clean_scrub_stamp":"2024-09-14T11:59:41.031537+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:04.945895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"260'16","reported_seq":112,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.746735+0000","last_change":"2024-09-14T11:59:13.746668+0000","last_active":"2024-09-14T11:59:13.746735+0000","last_peered":"2024-09-14T11:59:13.746735+0000","last_clean":"2024-09-14T11:59:13.746735+0000","last_became_active":"2024-09-14T11:12:39.147087+0000","last_became_peered":"2024-09-14T11:12:39.147087+0000","last_unstale":"2024-09-14T11:59:13.746735+0000","last_undegraded":"2024-09-14T11:59:13.746735+0000","last_fullsized":"2024-09-14T11:59:13.746735+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'16","last_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_deep_scrub":"260'16","last_deep_scrub_stamp":"2024-09-14T11:59:13.746567+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.746567+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:14.790290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":78,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.947689+0000","last_change":"2024-09-14T11:59:36.947689+0000","last_active":"2024-09-14T11:59:36.947689+0000","last_peered":"2024-09-14T11:59:36.947689+0000","last_clean":"2024-09-14T11:59:36.947689+0000","last_became_active":"2024-09-14T11:32:11.438309+0000","last_became_peered":"2024-09-14T11:32:11.438309+0000","last_unstale":"2024-09-14T11:59:36.947689+0000","last_undegraded":"2024-09-14T11:59:36.947689+0000","last_fullsized":"2024-09-14T11:59:36.947689+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:36.947601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:36.947601+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.947601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:10.497492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"260'4","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.273323+0000","last_change":"2024-09-14T11:59:36.273323+0000","last_active":"2024-09-14T11:59:36.273323+0000","last_peered":"2024-09-14T11:59:36.273323+0000","last_clean":"2024-09-14T11:59:36.273323+0000","last_became_active":"2024-09-14T11:15:25.393909+0000","last_became_peered":"2024-09-14T11:15:25.393909+0000","last_unstale":"2024-09-14T11:59:36.273323+0000","last_undegraded":"2024-09-14T11:59:36.273323+0000","last_fullsized":"2024-09-14T11:59:36.273323+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:36.273210+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:36.273210+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.273210+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:28.694185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3074,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.021805+0000","last_change":"2024-09-14T11:59:17.021805+0000","last_active":"2024-09-14T11:59:17.021805+0000","last_peered":"2024-09-14T11:59:17.021805+0000","last_clean":"2024-09-14T11:59:17.021805+0000","last_became_active":"2024-09-14T11:15:22.378773+0000","last_became_peered":"2024-09-14T11:15:22.378773+0000","last_unstale":"2024-09-14T11:59:17.021805+0000","last_undegraded":"2024-09-14T11:59:17.021805+0000","last_fullsized":"2024-09-14T11:59:17.021805+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.021712+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.021712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:50.412612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"263'49","reported_seq":198,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.047241+0000","last_change":"2024-09-14T11:59:04.047142+0000","last_active":"2024-09-14T11:59:04.047241+0000","last_peered":"2024-09-14T11:59:04.047241+0000","last_clean":"2024-09-14T11:59:04.047241+0000","last_became_active":"2024-09-14T11:12:39.149130+0000","last_became_peered":"2024-09-14T11:12:39.149130+0000","last_unstale":"2024-09-14T11:59:04.047241+0000","last_undegraded":"2024-09-14T11:59:04.047241+0000","last_fullsized":"2024-09-14T11:59:04.047241+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:04.047040+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.047040+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:05.840200+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":393,"num_read_kb":272,"num_write":119,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:42.324511+0000","last_change":"2024-09-14T11:59:42.324511+0000","last_active":"2024-09-14T11:59:42.324511+0000","last_peered":"2024-09-14T11:59:42.324511+0000","last_clean":"2024-09-14T11:59:42.324511+0000","last_became_active":"2024-09-14T11:32:11.441773+0000","last_became_peered":"2024-09-14T11:32:11.441773+0000","last_unstale":"2024-09-14T11:59:42.324511+0000","last_undegraded":"2024-09-14T11:59:42.324511+0000","last_fullsized":"2024-09-14T11:59:42.324511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:42.324411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:42.324411+0000","last_clean_scrub_stamp":"2024-09-14T11:59:42.324411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:20.420976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"263'6","reported_seq":62,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:30.778337+0000","last_change":"2024-09-14T11:59:30.778337+0000","last_active":"2024-09-14T11:59:30.778337+0000","last_peered":"2024-09-14T11:59:30.778337+0000","last_clean":"2024-09-14T11:59:30.778337+0000","last_became_active":"2024-09-14T11:15:25.396919+0000","last_became_peered":"2024-09-14T11:15:25.396919+0000","last_unstale":"2024-09-14T11:59:30.778337+0000","last_undegraded":"2024-09-14T11:59:30.778337+0000","last_fullsized":"2024-09-14T11:59:30.778337+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:30.778237+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:30.778237+0000","last_clean_scrub_stamp":"2024-09-14T11:59:30.778237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:01.725618+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2106,"num_write":6,"num_write_kb":1077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.055426+0000","last_change":"2024-09-14T11:59:32.055426+0000","last_active":"2024-09-14T11:59:32.055426+0000","last_peered":"2024-09-14T11:59:32.055426+0000","last_clean":"2024-09-14T11:59:32.055426+0000","last_became_active":"2024-09-14T11:15:22.373058+0000","last_became_peered":"2024-09-14T11:15:22.373058+0000","last_unstale":"2024-09-14T11:59:32.055426+0000","last_undegraded":"2024-09-14T11:59:32.055426+0000","last_fullsized":"2024-09-14T11:59:32.055426+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:32.055341+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:32.055341+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.055341+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:59.626815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9208,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"263'28","reported_seq":139,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.130920+0000","last_change":"2024-09-14T11:59:23.130851+0000","last_active":"2024-09-14T11:59:23.130920+0000","last_peered":"2024-09-14T11:59:23.130920+0000","last_clean":"2024-09-14T11:59:23.130920+0000","last_became_active":"2024-09-14T11:12:39.152060+0000","last_became_peered":"2024-09-14T11:12:39.152060+0000","last_unstale":"2024-09-14T11:59:23.130920+0000","last_undegraded":"2024-09-14T11:59:23.130920+0000","last_fullsized":"2024-09-14T11:59:23.130920+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:59:23.130761+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:59:23.130761+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.130761+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:40.996215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":142,"num_write":77,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:39.006983+0000","last_change":"2024-09-14T11:59:39.006983+0000","last_active":"2024-09-14T11:59:39.006983+0000","last_peered":"2024-09-14T11:59:39.006983+0000","last_clean":"2024-09-14T11:59:39.006983+0000","last_became_active":"2024-09-14T11:32:11.439079+0000","last_became_peered":"2024-09-14T11:32:11.439079+0000","last_unstale":"2024-09-14T11:59:39.006983+0000","last_undegraded":"2024-09-14T11:59:39.006983+0000","last_fullsized":"2024-09-14T11:59:39.006983+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:39.006874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:39.006874+0000","last_clean_scrub_stamp":"2024-09-14T11:59:39.006874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:33.926363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"263'12","reported_seq":74,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.065579+0000","last_change":"2024-09-14T11:59:33.065579+0000","last_active":"2024-09-14T11:59:33.065579+0000","last_peered":"2024-09-14T11:59:33.065579+0000","last_clean":"2024-09-14T11:59:33.065579+0000","last_became_active":"2024-09-14T11:15:25.386768+0000","last_became_peered":"2024-09-14T11:15:25.386768+0000","last_unstale":"2024-09-14T11:59:33.065579+0000","last_undegraded":"2024-09-14T11:59:33.065579+0000","last_fullsized":"2024-09-14T11:59:33.065579+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-14T11:59:33.065483+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-14T11:59:33.065483+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.065483+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:55.308824+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":9238,"num_write":22,"num_write_kb":6156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"263'6","reported_seq":68,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.084075+0000","last_change":"2024-09-14T11:59:14.084075+0000","last_active":"2024-09-14T11:59:14.084075+0000","last_peered":"2024-09-14T11:59:14.084075+0000","last_clean":"2024-09-14T11:59:14.084075+0000","last_became_active":"2024-09-14T11:15:22.373858+0000","last_became_peered":"2024-09-14T11:15:22.373858+0000","last_unstale":"2024-09-14T11:59:14.084075+0000","last_undegraded":"2024-09-14T11:59:14.084075+0000","last_fullsized":"2024-09-14T11:59:14.084075+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:59:14.083986+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.083986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:34.169123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"0'0","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.168457+0000","last_change":"2024-09-14T11:59:23.168457+0000","last_active":"2024-09-14T11:59:23.168457+0000","last_peered":"2024-09-14T11:59:23.168457+0000","last_clean":"2024-09-14T11:59:23.168457+0000","last_became_active":"2024-09-14T11:12:39.150530+0000","last_became_peered":"2024-09-14T11:12:39.150530+0000","last_unstale":"2024-09-14T11:59:23.168457+0000","last_undegraded":"2024-09-14T11:59:23.168457+0000","last_fullsized":"2024-09-14T11:59:23.168457+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.168364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.168364+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.168364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.580325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.971555+0000","last_change":"2024-09-14T11:59:37.971555+0000","last_active":"2024-09-14T11:59:37.971555+0000","last_peered":"2024-09-14T11:59:37.971555+0000","last_clean":"2024-09-14T11:59:37.971555+0000","last_became_active":"2024-09-14T11:32:11.435134+0000","last_became_peered":"2024-09-14T11:32:11.435134+0000","last_unstale":"2024-09-14T11:59:37.971555+0000","last_undegraded":"2024-09-14T11:59:37.971555+0000","last_fullsized":"2024-09-14T11:59:37.971555+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:37.971449+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:37.971449+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.971449+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:23.580134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":50,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.852336+0000","last_change":"2024-09-14T11:59:24.852336+0000","last_active":"2024-09-14T11:59:24.852336+0000","last_peered":"2024-09-14T11:59:24.852336+0000","last_clean":"2024-09-14T11:59:24.852336+0000","last_became_active":"2024-09-14T11:15:25.393428+0000","last_became_peered":"2024-09-14T11:15:25.393428+0000","last_unstale":"2024-09-14T11:59:24.852336+0000","last_undegraded":"2024-09-14T11:59:24.852336+0000","last_fullsized":"2024-09-14T11:59:24.852336+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:24.852250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:24.852250+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.852250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:54.770657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.979623+0000","last_change":"2024-09-14T11:59:28.979623+0000","last_active":"2024-09-14T11:59:28.979623+0000","last_peered":"2024-09-14T11:59:28.979623+0000","last_clean":"2024-09-14T11:59:28.979623+0000","last_became_active":"2024-09-14T11:15:22.371770+0000","last_became_peered":"2024-09-14T11:15:22.371770+0000","last_unstale":"2024-09-14T11:59:28.979623+0000","last_undegraded":"2024-09-14T11:59:28.979623+0000","last_fullsized":"2024-09-14T11:59:28.979623+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:28.979530+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:28.979530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.979530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:29.770385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"263'14","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.320561+0000","last_change":"2024-09-14T11:59:26.320561+0000","last_active":"2024-09-14T11:59:26.320561+0000","last_peered":"2024-09-14T11:59:26.320561+0000","last_clean":"2024-09-14T11:59:26.320561+0000","last_became_active":"2024-09-14T11:12:39.150485+0000","last_became_peered":"2024-09-14T11:12:39.150485+0000","last_unstale":"2024-09-14T11:59:26.320561+0000","last_undegraded":"2024-09-14T11:59:26.320561+0000","last_fullsized":"2024-09-14T11:59:26.320561+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'14","last_scrub_stamp":"2024-09-14T11:59:26.320433+0000","last_deep_scrub":"263'14","last_deep_scrub_stamp":"2024-09-14T11:59:26.320433+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.320433+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:22.183132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:43.013219+0000","last_change":"2024-09-14T11:59:43.013219+0000","last_active":"2024-09-14T11:59:43.013219+0000","last_peered":"2024-09-14T11:59:43.013219+0000","last_clean":"2024-09-14T11:59:43.013219+0000","last_became_active":"2024-09-14T11:32:11.434841+0000","last_became_peered":"2024-09-14T11:32:11.434841+0000","last_unstale":"2024-09-14T11:59:43.013219+0000","last_undegraded":"2024-09-14T11:59:43.013219+0000","last_fullsized":"2024-09-14T11:59:43.013219+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:43.013104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:43.013104+0000","last_clean_scrub_stamp":"2024-09-14T11:59:43.013104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:51.658467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"263'9","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.030075+0000","last_change":"2024-09-14T11:59:34.030075+0000","last_active":"2024-09-14T11:59:34.030075+0000","last_peered":"2024-09-14T11:59:34.030075+0000","last_clean":"2024-09-14T11:59:34.030075+0000","last_became_active":"2024-09-14T11:15:25.391658+0000","last_became_peered":"2024-09-14T11:15:25.391658+0000","last_unstale":"2024-09-14T11:59:34.030075+0000","last_undegraded":"2024-09-14T11:59:34.030075+0000","last_fullsized":"2024-09-14T11:59:34.030075+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'9","last_scrub_stamp":"2024-09-14T11:59:34.029981+0000","last_deep_scrub":"263'9","last_deep_scrub_stamp":"2024-09-14T11:59:34.029981+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.029981+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:11.856084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9236,"num_write":14,"num_write_kb":12300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"263'2","reported_seq":59,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.742815+0000","last_change":"2024-09-14T11:59:22.742815+0000","last_active":"2024-09-14T11:59:22.742815+0000","last_peered":"2024-09-14T11:59:22.742815+0000","last_clean":"2024-09-14T11:59:22.742815+0000","last_became_active":"2024-09-14T11:15:22.379685+0000","last_became_peered":"2024-09-14T11:15:22.379685+0000","last_unstale":"2024-09-14T11:59:22.742815+0000","last_undegraded":"2024-09-14T11:59:22.742815+0000","last_fullsized":"2024-09-14T11:59:22.742815+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:22.742721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.742721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.766400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"263'17","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.744647+0000","last_change":"2024-09-14T11:59:12.744647+0000","last_active":"2024-09-14T11:59:12.744647+0000","last_peered":"2024-09-14T11:59:12.744647+0000","last_clean":"2024-09-14T11:59:12.744647+0000","last_became_active":"2024-09-14T11:12:39.147902+0000","last_became_peered":"2024-09-14T11:12:39.147902+0000","last_unstale":"2024-09-14T11:59:12.744647+0000","last_undegraded":"2024-09-14T11:59:12.744647+0000","last_fullsized":"2024-09-14T11:59:12.744647+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'17","last_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_deep_scrub":"263'17","last_deep_scrub_stamp":"2024-09-14T11:59:12.744566+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.744566+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:46:09.980455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":78,"num_write":43,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:34.986100+0000","last_change":"2024-09-14T11:59:34.986100+0000","last_active":"2024-09-14T11:59:34.986100+0000","last_peered":"2024-09-14T11:59:34.986100+0000","last_clean":"2024-09-14T11:59:34.986100+0000","last_became_active":"2024-09-14T11:32:11.440073+0000","last_became_peered":"2024-09-14T11:32:11.440073+0000","last_unstale":"2024-09-14T11:59:34.986100+0000","last_undegraded":"2024-09-14T11:59:34.986100+0000","last_fullsized":"2024-09-14T11:59:34.986100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:34.986009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:34.986009+0000","last_clean_scrub_stamp":"2024-09-14T11:59:34.986009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:23.917025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"260'2","reported_seq":56,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:36.026652+0000","last_change":"2024-09-14T11:59:36.026652+0000","last_active":"2024-09-14T11:59:36.026652+0000","last_peered":"2024-09-14T11:59:36.026652+0000","last_clean":"2024-09-14T11:59:36.026652+0000","last_became_active":"2024-09-14T11:15:25.394607+0000","last_became_peered":"2024-09-14T11:15:25.394607+0000","last_unstale":"2024-09-14T11:59:36.026652+0000","last_undegraded":"2024-09-14T11:59:36.026652+0000","last_fullsized":"2024-09-14T11:59:36.026652+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:36.026546+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:36.026546+0000","last_clean_scrub_stamp":"2024-09-14T11:59:36.026546+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:43.562657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"263'7","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.060955+0000","last_change":"2024-09-14T11:59:28.060955+0000","last_active":"2024-09-14T11:59:28.060955+0000","last_peered":"2024-09-14T11:59:28.060955+0000","last_clean":"2024-09-14T11:59:28.060955+0000","last_became_active":"2024-09-14T11:15:22.375807+0000","last_became_peered":"2024-09-14T11:15:22.375807+0000","last_unstale":"2024-09-14T11:59:28.060955+0000","last_undegraded":"2024-09-14T11:59:28.060955+0000","last_fullsized":"2024-09-14T11:59:28.060955+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:28.060863+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:28.060863+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.060863+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:39.869037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":2056,"num_write":12,"num_write_kb":2056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"263'16","reported_seq":109,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.158018+0000","last_change":"2024-09-14T11:59:22.158018+0000","last_active":"2024-09-14T11:59:22.158018+0000","last_peered":"2024-09-14T11:59:22.158018+0000","last_clean":"2024-09-14T11:59:22.158018+0000","last_became_active":"2024-09-14T11:12:39.156161+0000","last_became_peered":"2024-09-14T11:12:39.156161+0000","last_unstale":"2024-09-14T11:59:22.158018+0000","last_undegraded":"2024-09-14T11:59:22.158018+0000","last_fullsized":"2024-09-14T11:59:22.158018+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-14T11:59:22.157923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.157923+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:01.473904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":83,"num_write":41,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:31.159594+0000","last_change":"2024-09-14T11:59:31.159594+0000","last_active":"2024-09-14T11:59:31.159594+0000","last_peered":"2024-09-14T11:59:31.159594+0000","last_clean":"2024-09-14T11:59:31.159594+0000","last_became_active":"2024-09-14T11:32:11.440666+0000","last_became_peered":"2024-09-14T11:32:11.440666+0000","last_unstale":"2024-09-14T11:59:31.159594+0000","last_undegraded":"2024-09-14T11:59:31.159594+0000","last_fullsized":"2024-09-14T11:59:31.159594+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:31.159495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:31.159495+0000","last_clean_scrub_stamp":"2024-09-14T11:59:31.159495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:36.869191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"263'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:33.041487+0000","last_change":"2024-09-14T11:59:33.041487+0000","last_active":"2024-09-14T11:59:33.041487+0000","last_peered":"2024-09-14T11:59:33.041487+0000","last_clean":"2024-09-14T11:59:33.041487+0000","last_became_active":"2024-09-14T11:15:25.381020+0000","last_became_peered":"2024-09-14T11:15:25.381020+0000","last_unstale":"2024-09-14T11:59:33.041487+0000","last_undegraded":"2024-09-14T11:59:33.041487+0000","last_fullsized":"2024-09-14T11:59:33.041487+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:33.041395+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:33.041395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:33.041395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:46.077370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"263'4","reported_seq":65,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.062681+0000","last_change":"2024-09-14T11:59:06.062559+0000","last_active":"2024-09-14T11:59:06.062681+0000","last_peered":"2024-09-14T11:59:06.062681+0000","last_clean":"2024-09-14T11:59:06.062681+0000","last_became_active":"2024-09-14T11:15:22.371848+0000","last_became_peered":"2024-09-14T11:15:22.371848+0000","last_unstale":"2024-09-14T11:59:06.062681+0000","last_undegraded":"2024-09-14T11:59:06.062681+0000","last_fullsized":"2024-09-14T11:59:06.062681+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:06.062448+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.062448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:41.178762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"263'40","reported_seq":171,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.739744+0000","last_change":"2024-09-14T11:59:11.739744+0000","last_active":"2024-09-14T11:59:11.739744+0000","last_peered":"2024-09-14T11:59:11.739744+0000","last_clean":"2024-09-14T11:59:11.739744+0000","last_became_active":"2024-09-14T11:12:39.150423+0000","last_became_peered":"2024-09-14T11:12:39.150423+0000","last_unstale":"2024-09-14T11:59:11.739744+0000","last_undegraded":"2024-09-14T11:59:11.739744+0000","last_fullsized":"2024-09-14T11:59:11.739744+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'40","last_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_deep_scrub":"263'40","last_deep_scrub_stamp":"2024-09-14T11:59:11.739660+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.739660+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:24.442901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":202,"num_write":114,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.898170+0000","last_change":"2024-09-14T11:59:23.898170+0000","last_active":"2024-09-14T11:59:23.898170+0000","last_peered":"2024-09-14T11:59:23.898170+0000","last_clean":"2024-09-14T11:59:23.898170+0000","last_became_active":"2024-09-14T11:32:11.441380+0000","last_became_peered":"2024-09-14T11:32:11.441380+0000","last_unstale":"2024-09-14T11:59:23.898170+0000","last_undegraded":"2024-09-14T11:59:23.898170+0000","last_fullsized":"2024-09-14T11:59:23.898170+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:23.898076+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:23.898076+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.898076+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:36.098847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":51,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.041491+0000","last_change":"2024-09-14T11:59:32.041491+0000","last_active":"2024-09-14T11:59:32.041491+0000","last_peered":"2024-09-14T11:59:32.041491+0000","last_clean":"2024-09-14T11:59:32.041491+0000","last_became_active":"2024-09-14T11:15:25.391266+0000","last_became_peered":"2024-09-14T11:15:25.391266+0000","last_unstale":"2024-09-14T11:59:32.041491+0000","last_undegraded":"2024-09-14T11:59:32.041491+0000","last_fullsized":"2024-09-14T11:59:32.041491+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.041390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.041390+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.041390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:51.744908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"260'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.207489+0000","last_change":"2024-09-14T11:59:25.207489+0000","last_active":"2024-09-14T11:59:25.207489+0000","last_peered":"2024-09-14T11:59:25.207489+0000","last_clean":"2024-09-14T11:59:25.207489+0000","last_became_active":"2024-09-14T11:15:22.372182+0000","last_became_peered":"2024-09-14T11:15:22.372182+0000","last_unstale":"2024-09-14T11:59:25.207489+0000","last_undegraded":"2024-09-14T11:59:25.207489+0000","last_fullsized":"2024-09-14T11:59:25.207489+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'7","last_scrub_stamp":"2024-09-14T11:59:25.207395+0000","last_deep_scrub":"260'7","last_deep_scrub_stamp":"2024-09-14T11:59:25.207395+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.207395+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:47.177943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7166,"num_write":12,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"263'31","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.182624+0000","last_change":"2024-09-14T11:59:22.182624+0000","last_active":"2024-09-14T11:59:22.182624+0000","last_peered":"2024-09-14T11:59:22.182624+0000","last_clean":"2024-09-14T11:59:22.182624+0000","last_became_active":"2024-09-14T11:12:39.151885+0000","last_became_peered":"2024-09-14T11:12:39.151885+0000","last_unstale":"2024-09-14T11:59:22.182624+0000","last_undegraded":"2024-09-14T11:59:22.182624+0000","last_fullsized":"2024-09-14T11:59:22.182624+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:59:22.182530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.182530+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:03.582278+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":185,"num_write":85,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:32.783719+0000","last_change":"2024-09-14T11:59:32.783719+0000","last_active":"2024-09-14T11:59:32.783719+0000","last_peered":"2024-09-14T11:59:32.783719+0000","last_clean":"2024-09-14T11:59:32.783719+0000","last_became_active":"2024-09-14T11:32:11.441613+0000","last_became_peered":"2024-09-14T11:32:11.441613+0000","last_unstale":"2024-09-14T11:59:32.783719+0000","last_undegraded":"2024-09-14T11:59:32.783719+0000","last_fullsized":"2024-09-14T11:59:32.783719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:32.783595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:32.783595+0000","last_clean_scrub_stamp":"2024-09-14T11:59:32.783595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:08:01.809310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"260'2","reported_seq":55,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.759869+0000","last_change":"2024-09-14T11:59:29.759869+0000","last_active":"2024-09-14T11:59:29.759869+0000","last_peered":"2024-09-14T11:59:29.759869+0000","last_clean":"2024-09-14T11:59:29.759869+0000","last_became_active":"2024-09-14T11:15:25.393235+0000","last_became_peered":"2024-09-14T11:15:25.393235+0000","last_unstale":"2024-09-14T11:59:29.759869+0000","last_undegraded":"2024-09-14T11:59:29.759869+0000","last_fullsized":"2024-09-14T11:59:29.759869+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'2","last_scrub_stamp":"2024-09-14T11:59:29.759774+0000","last_deep_scrub":"260'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.759774+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.759774+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:26.957169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"263'2","reported_seq":60,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:29.107699+0000","last_change":"2024-09-14T11:59:29.107699+0000","last_active":"2024-09-14T11:59:29.107699+0000","last_peered":"2024-09-14T11:59:29.107699+0000","last_clean":"2024-09-14T11:59:29.107699+0000","last_became_active":"2024-09-14T11:15:22.375258+0000","last_became_peered":"2024-09-14T11:15:22.375258+0000","last_unstale":"2024-09-14T11:59:29.107699+0000","last_undegraded":"2024-09-14T11:59:29.107699+0000","last_fullsized":"2024-09-14T11:59:29.107699+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:29.107615+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:29.107615+0000","last_clean_scrub_stamp":"2024-09-14T11:59:29.107615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:51.653410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1032,"num_write":2,"num_write_kb":1032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"263'28","reported_seq":140,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.098178+0000","last_change":"2024-09-14T11:59:13.098178+0000","last_active":"2024-09-14T11:59:13.098178+0000","last_peered":"2024-09-14T11:59:13.098178+0000","last_clean":"2024-09-14T11:59:13.098178+0000","last_became_active":"2024-09-14T11:12:39.147256+0000","last_became_peered":"2024-09-14T11:12:39.147256+0000","last_unstale":"2024-09-14T11:59:13.098178+0000","last_undegraded":"2024-09-14T11:59:13.098178+0000","last_fullsized":"2024-09-14T11:59:13.098178+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'28","last_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_deep_scrub":"263'28","last_deep_scrub_stamp":"2024-09-14T11:59:13.098094+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.098094+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:03:19.834460+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":139,"num_write":72,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'2","reported_seq":35,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.143092+0000","last_change":"2024-09-14T11:59:10.143092+0000","last_active":"2024-09-14T11:59:10.143092+0000","last_peered":"2024-09-14T11:59:10.143092+0000","last_clean":"2024-09-14T11:59:10.143092+0000","last_became_active":"2024-09-14T11:32:11.429268+0000","last_became_peered":"2024-09-14T11:32:11.429268+0000","last_unstale":"2024-09-14T11:59:10.143092+0000","last_undegraded":"2024-09-14T11:59:10.143092+0000","last_fullsized":"2024-09-14T11:59:10.143092+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:10.142995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.142995+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:46.424281+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"263'7","reported_seq":64,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.936680+0000","last_change":"2024-09-14T11:59:18.936680+0000","last_active":"2024-09-14T11:59:18.936680+0000","last_peered":"2024-09-14T11:59:18.936680+0000","last_clean":"2024-09-14T11:59:18.936680+0000","last_became_active":"2024-09-14T11:15:25.393324+0000","last_became_peered":"2024-09-14T11:15:25.393324+0000","last_unstale":"2024-09-14T11:59:18.936680+0000","last_undegraded":"2024-09-14T11:59:18.936680+0000","last_fullsized":"2024-09-14T11:59:18.936680+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:18.936581+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.936581+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:35.640318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":16376,"num_write":12,"num_write_kb":12280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"263'7","reported_seq":71,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:26.130617+0000","last_change":"2024-09-14T11:59:26.130549+0000","last_active":"2024-09-14T11:59:26.130617+0000","last_peered":"2024-09-14T11:59:26.130617+0000","last_clean":"2024-09-14T11:59:26.130617+0000","last_became_active":"2024-09-14T11:15:22.373483+0000","last_became_peered":"2024-09-14T11:15:22.373483+0000","last_unstale":"2024-09-14T11:59:26.130617+0000","last_undegraded":"2024-09-14T11:59:26.130617+0000","last_fullsized":"2024-09-14T11:59:26.130617+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-14T11:59:26.130463+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-14T11:59:26.130463+0000","last_clean_scrub_stamp":"2024-09-14T11:59:26.130463+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:24.664977+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":7164,"num_write":12,"num_write_kb":6140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"263'31","reported_seq":150,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.199893+0000","last_change":"2024-09-14T11:59:23.199893+0000","last_active":"2024-09-14T11:59:23.199893+0000","last_peered":"2024-09-14T11:59:23.199893+0000","last_clean":"2024-09-14T11:59:23.199893+0000","last_became_active":"2024-09-14T11:12:39.150339+0000","last_became_peered":"2024-09-14T11:12:39.150339+0000","last_unstale":"2024-09-14T11:59:23.199893+0000","last_undegraded":"2024-09-14T11:59:23.199893+0000","last_fullsized":"2024-09-14T11:59:23.199893+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'31","last_scrub_stamp":"2024-09-14T11:59:23.199789+0000","last_deep_scrub":"263'31","last_deep_scrub_stamp":"2024-09-14T11:59:23.199789+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.199789+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:33.511890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":157,"num_write":84,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:38.046829+0000","last_change":"2024-09-14T11:59:38.046829+0000","last_active":"2024-09-14T11:59:38.046829+0000","last_peered":"2024-09-14T11:59:38.046829+0000","last_clean":"2024-09-14T11:59:38.046829+0000","last_became_active":"2024-09-14T11:32:11.431033+0000","last_became_peered":"2024-09-14T11:32:11.431033+0000","last_unstale":"2024-09-14T11:59:38.046829+0000","last_undegraded":"2024-09-14T11:59:38.046829+0000","last_fullsized":"2024-09-14T11:59:38.046829+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:38.046722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:38.046722+0000","last_clean_scrub_stamp":"2024-09-14T11:59:38.046722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:06.803621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"263'10","reported_seq":70,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.204208+0000","last_change":"2024-09-14T11:59:28.204105+0000","last_active":"2024-09-14T11:59:28.204208+0000","last_peered":"2024-09-14T11:59:28.204208+0000","last_clean":"2024-09-14T11:59:28.204208+0000","last_became_active":"2024-09-14T11:15:25.386199+0000","last_became_peered":"2024-09-14T11:15:25.386199+0000","last_unstale":"2024-09-14T11:59:28.204208+0000","last_undegraded":"2024-09-14T11:59:28.204208+0000","last_fullsized":"2024-09-14T11:59:28.204208+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'10","last_scrub_stamp":"2024-09-14T11:59:28.204011+0000","last_deep_scrub":"263'10","last_deep_scrub_stamp":"2024-09-14T11:59:28.204011+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.204011+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:04.929375+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12313,"num_write":20,"num_write_kb":8215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:27.091046+0000","last_change":"2024-09-14T11:59:27.091046+0000","last_active":"2024-09-14T11:59:27.091046+0000","last_peered":"2024-09-14T11:59:27.091046+0000","last_clean":"2024-09-14T11:59:27.091046+0000","last_became_active":"2024-09-14T11:15:22.374877+0000","last_became_peered":"2024-09-14T11:15:22.374877+0000","last_unstale":"2024-09-14T11:59:27.091046+0000","last_undegraded":"2024-09-14T11:59:27.091046+0000","last_fullsized":"2024-09-14T11:59:27.091046+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:27.090962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:27.090962+0000","last_clean_scrub_stamp":"2024-09-14T11:59:27.090962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:07.964245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"263'36","reported_seq":165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.709355+0000","last_change":"2024-09-14T11:59:21.709355+0000","last_active":"2024-09-14T11:59:21.709355+0000","last_peered":"2024-09-14T11:59:21.709355+0000","last_clean":"2024-09-14T11:59:21.709355+0000","last_became_active":"2024-09-14T11:12:39.146318+0000","last_became_peered":"2024-09-14T11:12:39.146318+0000","last_unstale":"2024-09-14T11:59:21.709355+0000","last_undegraded":"2024-09-14T11:59:21.709355+0000","last_fullsized":"2024-09-14T11:59:21.709355+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'36","last_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_deep_scrub":"263'36","last_deep_scrub_stamp":"2024-09-14T11:59:21.709270+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.709270+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:13.459696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":280,"num_read_kb":195,"num_write":91,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:37.017771+0000","last_change":"2024-09-14T11:59:37.017771+0000","last_active":"2024-09-14T11:59:37.017771+0000","last_peered":"2024-09-14T11:59:37.017771+0000","last_clean":"2024-09-14T11:59:37.017771+0000","last_became_active":"2024-09-14T11:32:11.435769+0000","last_became_peered":"2024-09-14T11:32:11.435769+0000","last_unstale":"2024-09-14T11:59:37.017771+0000","last_undegraded":"2024-09-14T11:59:37.017771+0000","last_fullsized":"2024-09-14T11:59:37.017771+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:37.017659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:37.017659+0000","last_clean_scrub_stamp":"2024-09-14T11:59:37.017659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:30.453255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":52,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.783156+0000","last_change":"2024-09-14T11:59:17.783156+0000","last_active":"2024-09-14T11:59:17.783156+0000","last_peered":"2024-09-14T11:59:17.783156+0000","last_clean":"2024-09-14T11:59:17.783156+0000","last_became_active":"2024-09-14T11:15:25.396334+0000","last_became_peered":"2024-09-14T11:15:25.396334+0000","last_unstale":"2024-09-14T11:59:17.783156+0000","last_undegraded":"2024-09-14T11:59:17.783156+0000","last_fullsized":"2024-09-14T11:59:17.783156+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.783071+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.783071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:40.106669+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":58,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.998678+0000","last_change":"2024-09-14T11:59:15.998678+0000","last_active":"2024-09-14T11:59:15.998678+0000","last_peered":"2024-09-14T11:59:15.998678+0000","last_clean":"2024-09-14T11:59:15.998678+0000","last_became_active":"2024-09-14T11:15:22.378200+0000","last_became_peered":"2024-09-14T11:15:22.378200+0000","last_unstale":"2024-09-14T11:59:15.998678+0000","last_undegraded":"2024-09-14T11:59:15.998678+0000","last_fullsized":"2024-09-14T11:59:15.998678+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.998590+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.998590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:10.917760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"263'15","reported_seq":107,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.764138+0000","last_change":"2024-09-14T11:59:10.764138+0000","last_active":"2024-09-14T11:59:10.764138+0000","last_peered":"2024-09-14T11:59:10.764138+0000","last_clean":"2024-09-14T11:59:10.764138+0000","last_became_active":"2024-09-14T11:12:39.142702+0000","last_became_peered":"2024-09-14T11:12:39.142702+0000","last_unstale":"2024-09-14T11:59:10.764138+0000","last_undegraded":"2024-09-14T11:59:10.764138+0000","last_fullsized":"2024-09-14T11:59:10.764138+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'15","last_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_deep_scrub":"263'15","last_deep_scrub_stamp":"2024-09-14T11:59:10.764059+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.764059+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:35.059111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":85,"num_write":44,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":34,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:35.994524+0000","last_change":"2024-09-14T11:59:35.994524+0000","last_active":"2024-09-14T11:59:35.994524+0000","last_peered":"2024-09-14T11:59:35.994524+0000","last_clean":"2024-09-14T11:59:35.994524+0000","last_became_active":"2024-09-14T11:32:11.437902+0000","last_became_peered":"2024-09-14T11:32:11.437902+0000","last_unstale":"2024-09-14T11:59:35.994524+0000","last_undegraded":"2024-09-14T11:59:35.994524+0000","last_fullsized":"2024-09-14T11:59:35.994524+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:35.994380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:35.994380+0000","last_clean_scrub_stamp":"2024-09-14T11:59:35.994380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:21.459753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"260'5","reported_seq":61,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:28.757295+0000","last_change":"2024-09-14T11:59:28.757295+0000","last_active":"2024-09-14T11:59:28.757295+0000","last_peered":"2024-09-14T11:59:28.757295+0000","last_clean":"2024-09-14T11:59:28.757295+0000","last_became_active":"2024-09-14T11:15:25.384798+0000","last_became_peered":"2024-09-14T11:15:25.384798+0000","last_unstale":"2024-09-14T11:59:28.757295+0000","last_undegraded":"2024-09-14T11:59:28.757295+0000","last_fullsized":"2024-09-14T11:59:28.757295+0000","mapping_epoch":256,"log_start":"0'0","ondisk_log_start":"0'0","created":256,"last_epoch_clean":257,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'5","last_scrub_stamp":"2024-09-14T11:59:28.757203+0000","last_deep_scrub":"260'5","last_deep_scrub_stamp":"2024-09-14T11:59:28.757203+0000","last_clean_scrub_stamp":"2024-09-14T11:59:28.757203+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:34.194261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8188,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"260'4","reported_seq":67,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.759764+0000","last_change":"2024-09-14T11:59:15.759764+0000","last_active":"2024-09-14T11:59:15.759764+0000","last_peered":"2024-09-14T11:59:15.759764+0000","last_clean":"2024-09-14T11:59:15.759764+0000","last_became_active":"2024-09-14T11:15:22.375632+0000","last_became_peered":"2024-09-14T11:15:22.375632+0000","last_unstale":"2024-09-14T11:59:15.759764+0000","last_undegraded":"2024-09-14T11:59:15.759764+0000","last_fullsized":"2024-09-14T11:59:15.759764+0000","mapping_epoch":253,"log_start":"0'0","ondisk_log_start":"0'0","created":253,"last_epoch_clean":254,"parent":"0.0","parent_split_bits":0,"last_scrub":"260'4","last_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_deep_scrub":"260'4","last_deep_scrub_stamp":"2024-09-14T11:59:15.759654+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.759654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:43.935227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":3086,"num_write":4,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"263'41","reported_seq":174,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.091154+0000","last_change":"2024-09-14T11:59:20.091154+0000","last_active":"2024-09-14T11:59:20.091154+0000","last_peered":"2024-09-14T11:59:20.091154+0000","last_clean":"2024-09-14T11:59:20.091154+0000","last_became_active":"2024-09-14T11:12:39.149485+0000","last_became_peered":"2024-09-14T11:12:39.149485+0000","last_unstale":"2024-09-14T11:59:20.091154+0000","last_undegraded":"2024-09-14T11:59:20.091154+0000","last_fullsized":"2024-09-14T11:59:20.091154+0000","mapping_epoch":250,"log_start":"0'0","ondisk_log_start":"0'0","created":250,"last_epoch_clean":251,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-14T11:59:20.091080+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.091080+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:22.171147+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":316,"num_read_kb":200,"num_write":106,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"263'362","reported_seq":1014,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.193832+0000","last_change":"2024-09-14T11:59:01.193740+0000","last_active":"2024-09-14T11:59:01.193832+0000","last_peered":"2024-09-14T11:59:01.193832+0000","last_clean":"2024-09-14T11:59:01.193832+0000","last_became_active":"2024-09-14T10:56:39.692519+0000","last_became_peered":"2024-09-14T10:56:39.692519+0000","last_unstale":"2024-09-14T11:59:01.193832+0000","last_undegraded":"2024-09-14T11:59:01.193832+0000","last_fullsized":"2024-09-14T11:59:01.193832+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:59:01.193613+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.193613+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:48.418030+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":622,"num_read_kb":9138,"num_write":1125,"num_write_kb":29946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"263'442","reported_seq":1962,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.642141+0000","last_change":"2024-09-14T11:59:04.642052+0000","last_active":"2024-09-14T11:59:04.642141+0000","last_peered":"2024-09-14T11:59:04.642141+0000","last_clean":"2024-09-14T11:59:04.642141+0000","last_became_active":"2024-09-14T10:56:41.689926+0000","last_became_peered":"2024-09-14T10:56:41.689926+0000","last_unstale":"2024-09-14T11:59:04.642141+0000","last_undegraded":"2024-09-14T11:59:04.642141+0000","last_fullsized":"2024-09-14T11:59:04.642141+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'442","last_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_deep_scrub":"263'442","last_deep_scrub_stamp":"2024-09-14T11:59:04.641934+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.641934+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:19.634497+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2284,"num_read_kb":2154,"num_write":502,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"263'360","reported_seq":1022,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.148658+0000","last_change":"2024-09-14T11:58:48.148587+0000","last_active":"2024-09-14T11:58:48.148658+0000","last_peered":"2024-09-14T11:58:48.148658+0000","last_clean":"2024-09-14T11:58:48.148658+0000","last_became_active":"2024-09-14T10:56:39.678526+0000","last_became_peered":"2024-09-14T10:56:39.678526+0000","last_unstale":"2024-09-14T11:58:48.148658+0000","last_undegraded":"2024-09-14T11:58:48.148658+0000","last_fullsized":"2024-09-14T11:58:48.148658+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'360","last_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_deep_scrub":"263'360","last_deep_scrub_stamp":"2024-09-14T11:58:48.148462+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.148462+0000","objects_scrubbed":6,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:26.110691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7650412,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":625,"num_read_kb":47838,"num_write":1199,"num_write_kb":35002,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"263'491","reported_seq":2210,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.159534+0000","last_change":"2024-09-14T11:59:03.159475+0000","last_active":"2024-09-14T11:59:03.159534+0000","last_peered":"2024-09-14T11:59:03.159534+0000","last_clean":"2024-09-14T11:59:03.159534+0000","last_became_active":"2024-09-14T10:56:41.699383+0000","last_became_peered":"2024-09-14T10:56:41.699383+0000","last_unstale":"2024-09-14T11:59:03.159534+0000","last_undegraded":"2024-09-14T11:59:03.159534+0000","last_fullsized":"2024-09-14T11:59:03.159534+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'491","last_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_deep_scrub":"263'491","last_deep_scrub_stamp":"2024-09-14T11:59:03.159398+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.159398+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:15.424664+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2771,"num_read_kb":2633,"num_write":598,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"263'408","reported_seq":1103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.093127+0000","last_change":"2024-09-14T11:58:49.093046+0000","last_active":"2024-09-14T11:58:49.093127+0000","last_peered":"2024-09-14T11:58:49.093127+0000","last_clean":"2024-09-14T11:58:49.093127+0000","last_became_active":"2024-09-14T10:56:39.672621+0000","last_became_peered":"2024-09-14T10:56:39.672621+0000","last_unstale":"2024-09-14T11:58:49.093127+0000","last_undegraded":"2024-09-14T11:58:49.093127+0000","last_fullsized":"2024-09-14T11:58:49.093127+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'408","last_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_deep_scrub":"263'408","last_deep_scrub_stamp":"2024-09-14T11:58:49.092922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.092922+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:17.953603+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":833,"num_read_kb":44180,"num_write":1273,"num_write_kb":32903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,7],"acting":[0,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"263'376","reported_seq":1885,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.808251+0000","last_change":"2024-09-14T11:59:04.808153+0000","last_active":"2024-09-14T11:59:04.808251+0000","last_peered":"2024-09-14T11:59:04.808251+0000","last_clean":"2024-09-14T11:59:04.808251+0000","last_became_active":"2024-09-14T10:56:41.694656+0000","last_became_peered":"2024-09-14T10:56:41.694656+0000","last_unstale":"2024-09-14T11:59:04.808251+0000","last_undegraded":"2024-09-14T11:59:04.808251+0000","last_fullsized":"2024-09-14T11:59:04.808251+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'376","last_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_deep_scrub":"263'376","last_deep_scrub_stamp":"2024-09-14T11:59:04.808029+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.808029+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:56.690295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2284,"num_read_kb":2161,"num_write":454,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3028,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"263'478","reported_seq":1172,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.664464+0000","last_change":"2024-09-14T11:58:58.664464+0000","last_active":"2024-09-14T11:58:58.664464+0000","last_peered":"2024-09-14T11:58:58.664464+0000","last_clean":"2024-09-14T11:58:58.664464+0000","last_became_active":"2024-09-14T10:56:39.693348+0000","last_became_peered":"2024-09-14T10:56:39.693348+0000","last_unstale":"2024-09-14T11:58:58.664464+0000","last_undegraded":"2024-09-14T11:58:58.664464+0000","last_fullsized":"2024-09-14T11:58:58.664464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'478","last_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_deep_scrub":"263'478","last_deep_scrub_stamp":"2024-09-14T11:58:58.664259+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.664259+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:35.300032+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730156,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":988,"num_read_kb":27790,"num_write":1317,"num_write_kb":34871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"263'1227","reported_seq":2919,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.997326+0000","last_change":"2024-09-14T11:58:57.997268+0000","last_active":"2024-09-14T11:58:57.997326+0000","last_peered":"2024-09-14T11:58:57.997326+0000","last_clean":"2024-09-14T11:58:57.997326+0000","last_became_active":"2024-09-14T10:56:41.697723+0000","last_became_peered":"2024-09-14T10:56:41.697723+0000","last_unstale":"2024-09-14T11:58:57.997326+0000","last_undegraded":"2024-09-14T11:58:57.997326+0000","last_fullsized":"2024-09-14T11:58:57.997326+0000","mapping_epoch":27,"log_start":"263'1200","ondisk_log_start":"263'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1227","last_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_deep_scrub":"263'1227","last_deep_scrub_stamp":"2024-09-14T11:58:57.997174+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.997174+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":1200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:44.497164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5681,"num_read_kb":5031,"num_write":1686,"num_write_kb":683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"263'356","reported_seq":965,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.259835+0000","last_change":"2024-09-14T11:58:57.259740+0000","last_active":"2024-09-14T11:58:57.259835+0000","last_peered":"2024-09-14T11:58:57.259835+0000","last_clean":"2024-09-14T11:58:57.259835+0000","last_became_active":"2024-09-14T10:56:39.690215+0000","last_became_peered":"2024-09-14T10:56:39.690215+0000","last_unstale":"2024-09-14T11:58:57.259835+0000","last_undegraded":"2024-09-14T11:58:57.259835+0000","last_fullsized":"2024-09-14T11:58:57.259835+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'356","last_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_deep_scrub":"263'356","last_deep_scrub_stamp":"2024-09-14T11:58:57.259603+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.259603+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:49.299765+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":554,"num_read_kb":13771,"num_write":1092,"num_write_kb":45101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"263'580","reported_seq":2143,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.751244+0000","last_change":"2024-09-14T11:58:56.751244+0000","last_active":"2024-09-14T11:58:56.751244+0000","last_peered":"2024-09-14T11:58:56.751244+0000","last_clean":"2024-09-14T11:58:56.751244+0000","last_became_active":"2024-09-14T10:56:41.688311+0000","last_became_peered":"2024-09-14T10:56:41.688311+0000","last_unstale":"2024-09-14T11:58:56.751244+0000","last_undegraded":"2024-09-14T11:58:56.751244+0000","last_fullsized":"2024-09-14T11:58:56.751244+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'580","last_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_deep_scrub":"263'580","last_deep_scrub_stamp":"2024-09-14T11:58:56.751162+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.751162+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":500,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:45:07.015372+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2950,"num_read_kb":2708,"num_write":769,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"263'342","reported_seq":943,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.696332+0000","last_change":"2024-09-14T11:58:56.696232+0000","last_active":"2024-09-14T11:58:56.696332+0000","last_peered":"2024-09-14T11:58:56.696332+0000","last_clean":"2024-09-14T11:58:56.696332+0000","last_became_active":"2024-09-14T10:56:39.686767+0000","last_became_peered":"2024-09-14T10:56:39.686767+0000","last_unstale":"2024-09-14T11:58:56.696332+0000","last_undegraded":"2024-09-14T11:58:56.696332+0000","last_fullsized":"2024-09-14T11:58:56.696332+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:56.696022+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.696022+0000","objects_scrubbed":11,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:34.669606+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730157,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":503,"num_read_kb":13548,"num_write":1089,"num_write_kb":39613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"263'835","reported_seq":2435,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.773405+0000","last_change":"2024-09-14T11:59:03.773348+0000","last_active":"2024-09-14T11:59:03.773405+0000","last_peered":"2024-09-14T11:59:03.773405+0000","last_clean":"2024-09-14T11:59:03.773405+0000","last_became_active":"2024-09-14T10:56:41.691892+0000","last_became_peered":"2024-09-14T10:56:41.691892+0000","last_unstale":"2024-09-14T11:59:03.773405+0000","last_undegraded":"2024-09-14T11:59:03.773405+0000","last_fullsized":"2024-09-14T11:59:03.773405+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'835","last_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_deep_scrub":"263'835","last_deep_scrub_stamp":"2024-09-14T11:59:03.773269+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.773269+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:28.622910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5834,"num_read_kb":5368,"num_write":1279,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"263'331","reported_seq":972,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.247600+0000","last_change":"2024-09-14T11:58:56.247534+0000","last_active":"2024-09-14T11:58:56.247600+0000","last_peered":"2024-09-14T11:58:56.247600+0000","last_clean":"2024-09-14T11:58:56.247600+0000","last_became_active":"2024-09-14T10:56:39.694258+0000","last_became_peered":"2024-09-14T10:56:39.694258+0000","last_unstale":"2024-09-14T11:58:56.247600+0000","last_undegraded":"2024-09-14T11:58:56.247600+0000","last_fullsized":"2024-09-14T11:58:56.247600+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'331","last_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_deep_scrub":"263'331","last_deep_scrub_stamp":"2024-09-14T11:58:56.247425+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.247425+0000","objects_scrubbed":6,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:59.925743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730161,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":635,"num_read_kb":14446,"num_write":1067,"num_write_kb":29912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"263'902","reported_seq":2462,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.619014+0000","last_change":"2024-09-14T11:59:05.618880+0000","last_active":"2024-09-14T11:59:05.619014+0000","last_peered":"2024-09-14T11:59:05.619014+0000","last_clean":"2024-09-14T11:59:05.619014+0000","last_became_active":"2024-09-14T10:56:41.689138+0000","last_became_peered":"2024-09-14T10:56:41.689138+0000","last_unstale":"2024-09-14T11:59:05.619014+0000","last_undegraded":"2024-09-14T11:59:05.619014+0000","last_fullsized":"2024-09-14T11:59:05.619014+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'902","last_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_deep_scrub":"263'902","last_deep_scrub_stamp":"2024-09-14T11:59:05.618786+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.618786+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":800,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:06.981410+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4196,"num_read_kb":3731,"num_write":1201,"num_write_kb":449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"263'348","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.257046+0000","last_change":"2024-09-14T11:58:54.256977+0000","last_active":"2024-09-14T11:58:54.257046+0000","last_peered":"2024-09-14T11:58:54.257046+0000","last_clean":"2024-09-14T11:58:54.257046+0000","last_became_active":"2024-09-14T10:56:39.676559+0000","last_became_peered":"2024-09-14T10:56:39.676559+0000","last_unstale":"2024-09-14T11:58:54.257046+0000","last_undegraded":"2024-09-14T11:58:54.257046+0000","last_fullsized":"2024-09-14T11:58:54.257046+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'348","last_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_deep_scrub":"263'348","last_deep_scrub_stamp":"2024-09-14T11:58:54.256878+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.256878+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:40.203214+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":23067,"num_write":1167,"num_write_kb":38453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"263'426","reported_seq":1882,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.111927+0000","last_change":"2024-09-14T11:58:50.111851+0000","last_active":"2024-09-14T11:58:50.111927+0000","last_peered":"2024-09-14T11:58:50.111927+0000","last_clean":"2024-09-14T11:58:50.111927+0000","last_became_active":"2024-09-14T10:56:41.680875+0000","last_became_peered":"2024-09-14T10:56:41.680875+0000","last_unstale":"2024-09-14T11:58:50.111927+0000","last_undegraded":"2024-09-14T11:58:50.111927+0000","last_fullsized":"2024-09-14T11:58:50.111927+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'426","last_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_deep_scrub":"263'426","last_deep_scrub_stamp":"2024-09-14T11:58:50.111748+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.111748+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:42.879545+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2255,"num_read_kb":2107,"num_write":535,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"263'458","reported_seq":1892,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.809548+0000","last_change":"2024-09-14T11:58:59.809485+0000","last_active":"2024-09-14T11:58:59.809548+0000","last_peered":"2024-09-14T11:58:59.809548+0000","last_clean":"2024-09-14T11:58:59.809548+0000","last_became_active":"2024-09-14T10:56:41.694682+0000","last_became_peered":"2024-09-14T10:56:41.694682+0000","last_unstale":"2024-09-14T11:58:59.809548+0000","last_undegraded":"2024-09-14T11:58:59.809548+0000","last_fullsized":"2024-09-14T11:58:59.809548+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:59.809380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.809380+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:00.989122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2393,"num_read_kb":2198,"num_write":573,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"263'433","reported_seq":1165,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.215839+0000","last_change":"2024-09-14T11:58:58.215773+0000","last_active":"2024-09-14T11:58:58.215839+0000","last_peered":"2024-09-14T11:58:58.215839+0000","last_clean":"2024-09-14T11:58:58.215839+0000","last_became_active":"2024-09-14T10:56:39.693002+0000","last_became_peered":"2024-09-14T10:56:39.693002+0000","last_unstale":"2024-09-14T11:58:58.215839+0000","last_undegraded":"2024-09-14T11:58:58.215839+0000","last_fullsized":"2024-09-14T11:58:58.215839+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'433","last_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_deep_scrub":"263'433","last_deep_scrub_stamp":"2024-09-14T11:58:58.215635+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.215635+0000","objects_scrubbed":9,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:41.047428+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730118,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":936,"num_read_kb":12852,"num_write":1596,"num_write_kb":14290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"263'534","reported_seq":2297,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.145450+0000","last_change":"2024-09-14T11:59:02.145362+0000","last_active":"2024-09-14T11:59:02.145450+0000","last_peered":"2024-09-14T11:59:02.145450+0000","last_clean":"2024-09-14T11:59:02.145450+0000","last_became_active":"2024-09-14T10:56:41.700067+0000","last_became_peered":"2024-09-14T10:56:41.700067+0000","last_unstale":"2024-09-14T11:59:02.145450+0000","last_undegraded":"2024-09-14T11:59:02.145450+0000","last_fullsized":"2024-09-14T11:59:02.145450+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'534","last_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_deep_scrub":"263'534","last_deep_scrub_stamp":"2024-09-14T11:59:02.145274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.145274+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":500,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:24.998860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3056,"num_read_kb":2875,"num_write":653,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"263'342","reported_seq":953,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700586+0000","last_change":"2024-09-14T11:58:52.700509+0000","last_active":"2024-09-14T11:58:52.700586+0000","last_peered":"2024-09-14T11:58:52.700586+0000","last_clean":"2024-09-14T11:58:52.700586+0000","last_became_active":"2024-09-14T10:56:39.679612+0000","last_became_peered":"2024-09-14T10:56:39.679612+0000","last_unstale":"2024-09-14T11:58:52.700586+0000","last_undegraded":"2024-09-14T11:58:52.700586+0000","last_fullsized":"2024-09-14T11:58:52.700586+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:52.700378+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700378+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:26.328993+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":13589,"num_write":1026,"num_write_kb":55854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"263'640","reported_seq":2103,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.631253+0000","last_change":"2024-09-14T11:59:02.631183+0000","last_active":"2024-09-14T11:59:02.631253+0000","last_peered":"2024-09-14T11:59:02.631253+0000","last_clean":"2024-09-14T11:59:02.631253+0000","last_became_active":"2024-09-14T10:56:41.683922+0000","last_became_peered":"2024-09-14T10:56:41.683922+0000","last_unstale":"2024-09-14T11:59:02.631253+0000","last_undegraded":"2024-09-14T11:59:02.631253+0000","last_fullsized":"2024-09-14T11:59:02.631253+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'640","last_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_deep_scrub":"263'640","last_deep_scrub_stamp":"2024-09-14T11:59:02.631096+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.631096+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":600,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:52.105995+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3148,"num_read_kb":2797,"num_write":871,"num_write_kb":317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"263'390","reported_seq":1067,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.716106+0000","last_change":"2024-09-14T11:58:51.716046+0000","last_active":"2024-09-14T11:58:51.716106+0000","last_peered":"2024-09-14T11:58:51.716106+0000","last_clean":"2024-09-14T11:58:51.716106+0000","last_became_active":"2024-09-14T10:56:39.689314+0000","last_became_peered":"2024-09-14T10:56:39.689314+0000","last_unstale":"2024-09-14T11:58:51.716106+0000","last_undegraded":"2024-09-14T11:58:51.716106+0000","last_fullsized":"2024-09-14T11:58:51.716106+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'390","last_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_deep_scrub":"263'390","last_deep_scrub_stamp":"2024-09-14T11:58:51.715916+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.715916+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:38.249633+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":713,"num_read_kb":72218,"num_write":1254,"num_write_kb":47691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"263'1148","reported_seq":2705,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.092931+0000","last_change":"2024-09-14T11:58:54.092857+0000","last_active":"2024-09-14T11:58:54.092931+0000","last_peered":"2024-09-14T11:58:54.092931+0000","last_clean":"2024-09-14T11:58:54.092931+0000","last_became_active":"2024-09-14T10:56:41.690056+0000","last_became_peered":"2024-09-14T10:56:41.690056+0000","last_unstale":"2024-09-14T11:58:54.092931+0000","last_undegraded":"2024-09-14T11:58:54.092931+0000","last_fullsized":"2024-09-14T11:58:54.092931+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1148","last_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_deep_scrub":"263'1148","last_deep_scrub_stamp":"2024-09-14T11:58:54.092741+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.092741+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":1100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:41.284736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5327,"num_read_kb":4709,"num_write":1574,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"263'354","reported_seq":1004,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.762990+0000","last_change":"2024-09-14T11:58:49.762926+0000","last_active":"2024-09-14T11:58:49.762990+0000","last_peered":"2024-09-14T11:58:49.762990+0000","last_clean":"2024-09-14T11:58:49.762990+0000","last_became_active":"2024-09-14T10:56:39.672970+0000","last_became_peered":"2024-09-14T10:56:39.672970+0000","last_unstale":"2024-09-14T11:58:49.762990+0000","last_undegraded":"2024-09-14T11:58:49.762990+0000","last_fullsized":"2024-09-14T11:58:49.762990+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'354","last_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_deep_scrub":"263'354","last_deep_scrub_stamp":"2024-09-14T11:58:49.762804+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.762804+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:03.472810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":653,"num_read_kb":16353,"num_write":1203,"num_write_kb":29303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,0],"acting":[4,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"263'441","reported_seq":2068,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.097718+0000","last_change":"2024-09-14T11:58:53.097650+0000","last_active":"2024-09-14T11:58:53.097718+0000","last_peered":"2024-09-14T11:58:53.097718+0000","last_clean":"2024-09-14T11:58:53.097718+0000","last_became_active":"2024-09-14T10:56:41.689657+0000","last_became_peered":"2024-09-14T10:56:41.689657+0000","last_unstale":"2024-09-14T11:58:53.097718+0000","last_undegraded":"2024-09-14T11:58:53.097718+0000","last_fullsized":"2024-09-14T11:58:53.097718+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'441","last_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_deep_scrub":"263'441","last_deep_scrub_stamp":"2024-09-14T11:58:53.097548+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.097548+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:21.145958+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2474,"num_read_kb":2362,"num_write":478,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1179,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"263'325","reported_seq":944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.248701+0000","last_change":"2024-09-14T11:58:50.248618+0000","last_active":"2024-09-14T11:58:50.248701+0000","last_peered":"2024-09-14T11:58:50.248701+0000","last_clean":"2024-09-14T11:58:50.248701+0000","last_became_active":"2024-09-14T10:56:39.682187+0000","last_became_peered":"2024-09-14T10:56:39.682187+0000","last_unstale":"2024-09-14T11:58:50.248701+0000","last_undegraded":"2024-09-14T11:58:50.248701+0000","last_fullsized":"2024-09-14T11:58:50.248701+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'325","last_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_deep_scrub":"263'325","last_deep_scrub_stamp":"2024-09-14T11:58:50.248492+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.248492+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:11.374577+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730152,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":6224,"num_write":1046,"num_write_kb":19952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"263'761","reported_seq":2349,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.808932+0000","last_change":"2024-09-14T11:59:01.808871+0000","last_active":"2024-09-14T11:59:01.808932+0000","last_peered":"2024-09-14T11:59:01.808932+0000","last_clean":"2024-09-14T11:59:01.808932+0000","last_became_active":"2024-09-14T10:56:41.699368+0000","last_became_peered":"2024-09-14T10:56:41.699368+0000","last_unstale":"2024-09-14T11:59:01.808932+0000","last_undegraded":"2024-09-14T11:59:01.808932+0000","last_fullsized":"2024-09-14T11:59:01.808932+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'761","last_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_deep_scrub":"263'761","last_deep_scrub_stamp":"2024-09-14T11:59:01.808745+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.808745+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:36.042147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3772,"num_read_kb":3427,"num_write":1007,"num_write_kb":362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":233,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"263'370","reported_seq":1009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.123275+0000","last_change":"2024-09-14T11:58:47.123218+0000","last_active":"2024-09-14T11:58:47.123275+0000","last_peered":"2024-09-14T11:58:47.123275+0000","last_clean":"2024-09-14T11:58:47.123275+0000","last_became_active":"2024-09-14T10:56:39.681852+0000","last_became_peered":"2024-09-14T10:56:39.681852+0000","last_unstale":"2024-09-14T11:58:47.123275+0000","last_undegraded":"2024-09-14T11:58:47.123275+0000","last_fullsized":"2024-09-14T11:58:47.123275+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'370","last_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_deep_scrub":"263'370","last_deep_scrub_stamp":"2024-09-14T11:58:47.123129+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.123129+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:41.680446+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170217,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":657,"num_read_kb":11097,"num_write":1169,"num_write_kb":48462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"263'106","reported_seq":633,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.739868+0000","last_change":"2024-09-14T11:59:18.739808+0000","last_active":"2024-09-14T11:59:18.739868+0000","last_peered":"2024-09-14T11:59:18.739868+0000","last_clean":"2024-09-14T11:59:18.739868+0000","last_became_active":"2024-09-14T10:56:49.738087+0000","last_became_peered":"2024-09-14T10:56:49.738087+0000","last_unstale":"2024-09-14T11:59:18.739868+0000","last_undegraded":"2024-09-14T11:59:18.739868+0000","last_fullsized":"2024-09-14T11:59:18.739868+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:18.739718+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.739718+0000","objects_scrubbed":4,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:04.826400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":814,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":165,"num_read_kb":153,"num_write":242,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"263'438","reported_seq":2164,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.290481+0000","last_change":"2024-09-14T11:58:57.290385+0000","last_active":"2024-09-14T11:58:57.290481+0000","last_peered":"2024-09-14T11:58:57.290481+0000","last_clean":"2024-09-14T11:58:57.290481+0000","last_became_active":"2024-09-14T10:56:41.692077+0000","last_became_peered":"2024-09-14T10:56:41.692077+0000","last_unstale":"2024-09-14T11:58:57.290481+0000","last_undegraded":"2024-09-14T11:58:57.290481+0000","last_fullsized":"2024-09-14T11:58:57.290481+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:57.290287+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.290287+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:14.201274+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2525,"num_read_kb":2425,"num_write":481,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"263'363","reported_seq":1043,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.185308+0000","last_change":"2024-09-14T11:58:53.185211+0000","last_active":"2024-09-14T11:58:53.185308+0000","last_peered":"2024-09-14T11:58:53.185308+0000","last_clean":"2024-09-14T11:58:53.185308+0000","last_became_active":"2024-09-14T10:56:39.689929+0000","last_became_peered":"2024-09-14T10:56:39.689929+0000","last_unstale":"2024-09-14T11:58:53.185308+0000","last_undegraded":"2024-09-14T11:58:53.185308+0000","last_fullsized":"2024-09-14T11:58:53.185308+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'363","last_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_deep_scrub":"263'363","last_deep_scrub_stamp":"2024-09-14T11:58:53.185066+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.185066+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:33.650629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":709,"num_read_kb":79863,"num_write":1135,"num_write_kb":40175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.555205+0000","last_change":"2024-09-14T11:59:08.555143+0000","last_active":"2024-09-14T11:59:08.555205+0000","last_peered":"2024-09-14T11:59:08.555205+0000","last_clean":"2024-09-14T11:59:08.555205+0000","last_became_active":"2024-09-14T10:56:43.703151+0000","last_became_peered":"2024-09-14T10:56:43.703151+0000","last_unstale":"2024-09-14T11:59:08.555205+0000","last_undegraded":"2024-09-14T11:59:08.555205+0000","last_fullsized":"2024-09-14T11:59:08.555205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.555050+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.555050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:39.084087+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"263'341","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.035276+0000","last_change":"2024-09-14T11:59:08.035219+0000","last_active":"2024-09-14T11:59:08.035276+0000","last_peered":"2024-09-14T11:59:08.035276+0000","last_clean":"2024-09-14T11:59:08.035276+0000","last_became_active":"2024-09-14T10:56:45.716143+0000","last_became_peered":"2024-09-14T10:56:45.716143+0000","last_unstale":"2024-09-14T11:59:08.035276+0000","last_undegraded":"2024-09-14T11:59:08.035276+0000","last_fullsized":"2024-09-14T11:59:08.035276+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:59:08.035130+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.035130+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:34.188253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47916,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":550,"num_read_kb":1166,"num_write":430,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":481,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.132712+0000","last_change":"2024-09-14T11:59:17.132653+0000","last_active":"2024-09-14T11:59:17.132712+0000","last_peered":"2024-09-14T11:59:17.132712+0000","last_clean":"2024-09-14T11:59:17.132712+0000","last_became_active":"2024-09-14T10:56:47.731610+0000","last_became_peered":"2024-09-14T10:56:47.731610+0000","last_unstale":"2024-09-14T11:59:17.132712+0000","last_undegraded":"2024-09-14T11:59:17.132712+0000","last_fullsized":"2024-09-14T11:59:17.132712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.132565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.132565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:12.354065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"263'2513","reported_seq":4341,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.259218+0000","last_change":"2024-09-14T11:59:21.259163+0000","last_active":"2024-09-14T11:59:21.259218+0000","last_peered":"2024-09-14T11:59:21.259218+0000","last_clean":"2024-09-14T11:59:21.259218+0000","last_became_active":"2024-09-14T10:56:49.748214+0000","last_became_peered":"2024-09-14T10:56:49.748214+0000","last_unstale":"2024-09-14T11:59:21.259218+0000","last_undegraded":"2024-09-14T11:59:21.259218+0000","last_fullsized":"2024-09-14T11:59:21.259218+0000","mapping_epoch":35,"log_start":"263'2500","ondisk_log_start":"263'2500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2513","last_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_deep_scrub":"263'2513","last_deep_scrub_stamp":"2024-09-14T11:59:21.259077+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.259077+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":2500,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:46.514561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6226,"num_read_kb":6218,"num_write":5054,"num_write_kb":1857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"263'1509","reported_seq":3178,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.671832+0000","last_change":"2024-09-14T11:58:59.671768+0000","last_active":"2024-09-14T11:58:59.671832+0000","last_peered":"2024-09-14T11:58:59.671832+0000","last_clean":"2024-09-14T11:58:59.671832+0000","last_became_active":"2024-09-14T10:56:41.689745+0000","last_became_peered":"2024-09-14T10:56:41.689745+0000","last_unstale":"2024-09-14T11:58:59.671832+0000","last_undegraded":"2024-09-14T11:58:59.671832+0000","last_fullsized":"2024-09-14T11:58:59.671832+0000","mapping_epoch":27,"log_start":"263'1400","ondisk_log_start":"263'1400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1509","last_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_deep_scrub":"263'1509","last_deep_scrub_stamp":"2024-09-14T11:58:59.671671+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.671671+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":1400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:49.912175+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":6760,"num_read_kb":5923,"num_write":2113,"num_write_kb":901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"263'351","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.126303+0000","last_change":"2024-09-14T11:58:45.126234+0000","last_active":"2024-09-14T11:58:45.126303+0000","last_peered":"2024-09-14T11:58:45.126303+0000","last_clean":"2024-09-14T11:58:45.126303+0000","last_became_active":"2024-09-14T10:56:39.693073+0000","last_became_peered":"2024-09-14T10:56:39.693073+0000","last_unstale":"2024-09-14T11:58:45.126303+0000","last_undegraded":"2024-09-14T11:58:45.126303+0000","last_fullsized":"2024-09-14T11:58:45.126303+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:45.126037+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.126037+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:48.415741+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":583,"num_read_kb":7357,"num_write":1125,"num_write_kb":36973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.195876+0000","last_change":"2024-09-14T11:59:04.195824+0000","last_active":"2024-09-14T11:59:04.195876+0000","last_peered":"2024-09-14T11:59:04.195876+0000","last_clean":"2024-09-14T11:59:04.195876+0000","last_became_active":"2024-09-14T10:56:43.698692+0000","last_became_peered":"2024-09-14T10:56:43.698692+0000","last_unstale":"2024-09-14T11:59:04.195876+0000","last_undegraded":"2024-09-14T11:59:04.195876+0000","last_fullsized":"2024-09-14T11:59:04.195876+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.195724+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.195724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:15.148217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"263'108","reported_seq":647,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.828594+0000","last_change":"2024-09-14T11:59:11.828534+0000","last_active":"2024-09-14T11:59:11.828594+0000","last_peered":"2024-09-14T11:59:11.828594+0000","last_clean":"2024-09-14T11:59:11.828594+0000","last_became_active":"2024-09-14T10:56:45.722427+0000","last_became_peered":"2024-09-14T10:56:45.722427+0000","last_unstale":"2024-09-14T11:59:11.828594+0000","last_undegraded":"2024-09-14T11:59:11.828594+0000","last_fullsized":"2024-09-14T11:59:11.828594+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:11.828433+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.828433+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:51.968761+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":111,"num_read_kb":107,"num_write":76,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.692870+0000","last_change":"2024-09-14T11:59:14.692789+0000","last_active":"2024-09-14T11:59:14.692870+0000","last_peered":"2024-09-14T11:59:14.692870+0000","last_clean":"2024-09-14T11:59:14.692870+0000","last_became_active":"2024-09-14T10:56:47.735779+0000","last_became_peered":"2024-09-14T10:56:47.735779+0000","last_unstale":"2024-09-14T11:59:14.692870+0000","last_undegraded":"2024-09-14T11:59:14.692870+0000","last_fullsized":"2024-09-14T11:59:14.692870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.692686+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.692686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:53.432442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"263'119","reported_seq":621,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.085836+0000","last_change":"2024-09-14T11:59:18.085710+0000","last_active":"2024-09-14T11:59:18.085836+0000","last_peered":"2024-09-14T11:59:18.085836+0000","last_clean":"2024-09-14T11:59:18.085836+0000","last_became_active":"2024-09-14T10:56:49.750653+0000","last_became_peered":"2024-09-14T10:56:49.750653+0000","last_unstale":"2024-09-14T11:59:18.085836+0000","last_undegraded":"2024-09-14T11:59:18.085836+0000","last_fullsized":"2024-09-14T11:59:18.085836+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'119","last_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_deep_scrub":"263'119","last_deep_scrub_stamp":"2024-09-14T11:59:18.085608+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.085608+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:28.679206+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":689,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":121,"num_write":276,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"263'633","reported_seq":2386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.033519+0000","last_change":"2024-09-14T11:58:53.033445+0000","last_active":"2024-09-14T11:58:53.033519+0000","last_peered":"2024-09-14T11:58:53.033519+0000","last_clean":"2024-09-14T11:58:53.033519+0000","last_became_active":"2024-09-14T10:56:41.693811+0000","last_became_peered":"2024-09-14T10:56:41.693811+0000","last_unstale":"2024-09-14T11:58:53.033519+0000","last_undegraded":"2024-09-14T11:58:53.033519+0000","last_fullsized":"2024-09-14T11:58:53.033519+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'633","last_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_deep_scrub":"263'633","last_deep_scrub_stamp":"2024-09-14T11:58:53.033339+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.033339+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":600,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:43.139377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3419,"num_read_kb":3146,"num_write":824,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":225,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"263'372","reported_seq":1041,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.195094+0000","last_change":"2024-09-14T11:58:52.195024+0000","last_active":"2024-09-14T11:58:52.195094+0000","last_peered":"2024-09-14T11:58:52.195094+0000","last_clean":"2024-09-14T11:58:52.195094+0000","last_became_active":"2024-09-14T10:56:39.692267+0000","last_became_peered":"2024-09-14T10:56:39.692267+0000","last_unstale":"2024-09-14T11:58:52.195094+0000","last_undegraded":"2024-09-14T11:58:52.195094+0000","last_fullsized":"2024-09-14T11:58:52.195094+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:52.194890+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.194890+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:09.932572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":616,"num_read_kb":77744,"num_write":1160,"num_write_kb":36235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.177807+0000","last_change":"2024-09-14T11:59:07.177747+0000","last_active":"2024-09-14T11:59:07.177807+0000","last_peered":"2024-09-14T11:59:07.177807+0000","last_clean":"2024-09-14T11:59:07.177807+0000","last_became_active":"2024-09-14T10:56:43.701468+0000","last_became_peered":"2024-09-14T10:56:43.701468+0000","last_unstale":"2024-09-14T11:59:07.177807+0000","last_undegraded":"2024-09-14T11:59:07.177807+0000","last_fullsized":"2024-09-14T11:59:07.177807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.177676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.177676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:55.805641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"263'145","reported_seq":697,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.120748+0000","last_change":"2024-09-14T11:59:00.120684+0000","last_active":"2024-09-14T11:59:00.120748+0000","last_peered":"2024-09-14T11:59:00.120748+0000","last_clean":"2024-09-14T11:59:00.120748+0000","last_became_active":"2024-09-14T10:56:45.721197+0000","last_became_peered":"2024-09-14T10:56:45.721197+0000","last_unstale":"2024-09-14T11:59:00.120748+0000","last_undegraded":"2024-09-14T11:59:00.120748+0000","last_fullsized":"2024-09-14T11:59:00.120748+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:00.120596+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.120596+0000","objects_scrubbed":6,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:09.503078+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":153,"num_read_kb":147,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"263'777","reported_seq":4527,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.164587+0000","last_change":"2024-09-14T11:59:16.164519+0000","last_active":"2024-09-14T11:59:16.164587+0000","last_peered":"2024-09-14T11:59:16.164587+0000","last_clean":"2024-09-14T11:59:16.164587+0000","last_became_active":"2024-09-14T10:56:47.730862+0000","last_became_peered":"2024-09-14T10:56:47.730862+0000","last_unstale":"2024-09-14T11:59:16.164587+0000","last_undegraded":"2024-09-14T11:59:16.164587+0000","last_fullsized":"2024-09-14T11:59:16.164587+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:16.164426+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.164426+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:13.531172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"263'213","reported_seq":1052,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.666630+0000","last_change":"2024-09-14T11:59:20.666555+0000","last_active":"2024-09-14T11:59:20.666630+0000","last_peered":"2024-09-14T11:59:20.666630+0000","last_clean":"2024-09-14T11:59:20.666630+0000","last_became_active":"2024-09-14T10:56:49.740388+0000","last_became_peered":"2024-09-14T10:56:49.740388+0000","last_unstale":"2024-09-14T11:59:20.666630+0000","last_undegraded":"2024-09-14T11:59:20.666630+0000","last_fullsized":"2024-09-14T11:59:20.666630+0000","mapping_epoch":35,"log_start":"263'201","ondisk_log_start":"263'201","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'213","last_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_deep_scrub":"263'213","last_deep_scrub_stamp":"2024-09-14T11:59:20.666459+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.666459+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":201,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:01.439570+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":633,"num_read_kb":620,"num_write":451,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"263'436","reported_seq":2065,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.286138+0000","last_change":"2024-09-14T11:58:59.286059+0000","last_active":"2024-09-14T11:58:59.286138+0000","last_peered":"2024-09-14T11:58:59.286138+0000","last_clean":"2024-09-14T11:58:59.286138+0000","last_became_active":"2024-09-14T10:56:41.694941+0000","last_became_peered":"2024-09-14T10:56:41.694941+0000","last_unstale":"2024-09-14T11:58:59.286138+0000","last_undegraded":"2024-09-14T11:58:59.286138+0000","last_fullsized":"2024-09-14T11:58:59.286138+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'436","last_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_deep_scrub":"263'436","last_deep_scrub_stamp":"2024-09-14T11:58:59.285928+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.285928+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:01.883072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2427,"num_read_kb":2310,"num_write":514,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"263'327","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.702820+0000","last_change":"2024-09-14T11:58:47.702760+0000","last_active":"2024-09-14T11:58:47.702820+0000","last_peered":"2024-09-14T11:58:47.702820+0000","last_clean":"2024-09-14T11:58:47.702820+0000","last_became_active":"2024-09-14T10:56:39.686352+0000","last_became_peered":"2024-09-14T10:56:39.686352+0000","last_unstale":"2024-09-14T11:58:47.702820+0000","last_undegraded":"2024-09-14T11:58:47.702820+0000","last_fullsized":"2024-09-14T11:58:47.702820+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:47.702654+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.702654+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:45.134369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":522,"num_read_kb":94667,"num_write":978,"num_write_kb":41760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.520893+0000","last_change":"2024-09-14T11:59:10.520832+0000","last_active":"2024-09-14T11:59:10.520893+0000","last_peered":"2024-09-14T11:59:10.520893+0000","last_clean":"2024-09-14T11:59:10.520893+0000","last_became_active":"2024-09-14T10:56:43.702315+0000","last_became_peered":"2024-09-14T10:56:43.702315+0000","last_unstale":"2024-09-14T11:59:10.520893+0000","last_undegraded":"2024-09-14T11:59:10.520893+0000","last_fullsized":"2024-09-14T11:59:10.520893+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.520751+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.520751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:23.745612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"263'278","reported_seq":846,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.175990+0000","last_change":"2024-09-14T11:59:11.175916+0000","last_active":"2024-09-14T11:59:11.175990+0000","last_peered":"2024-09-14T11:59:11.175990+0000","last_clean":"2024-09-14T11:59:11.175990+0000","last_became_active":"2024-09-14T10:56:45.717055+0000","last_became_peered":"2024-09-14T10:56:45.717055+0000","last_unstale":"2024-09-14T11:59:11.175990+0000","last_undegraded":"2024-09-14T11:59:11.175990+0000","last_fullsized":"2024-09-14T11:59:11.175990+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'278","last_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_deep_scrub":"263'278","last_deep_scrub_stamp":"2024-09-14T11:59:11.175829+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.175829+0000","objects_scrubbed":5,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:51.855512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47840,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":445,"num_read_kb":1034,"num_write":358,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"263'812","reported_seq":2652,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.248871+0000","last_change":"2024-09-14T11:59:17.248791+0000","last_active":"2024-09-14T11:59:17.248871+0000","last_peered":"2024-09-14T11:59:17.248871+0000","last_clean":"2024-09-14T11:59:17.248871+0000","last_became_active":"2024-09-14T10:56:47.734197+0000","last_became_peered":"2024-09-14T10:56:47.734197+0000","last_unstale":"2024-09-14T11:59:17.248871+0000","last_undegraded":"2024-09-14T11:59:17.248871+0000","last_fullsized":"2024-09-14T11:59:17.248871+0000","mapping_epoch":33,"log_start":"263'800","ondisk_log_start":"263'800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'812","last_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_deep_scrub":"263'812","last_deep_scrub_stamp":"2024-09-14T11:59:17.248692+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.248692+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:23.181243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"263'660","reported_seq":2030,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.688886+0000","last_change":"2024-09-14T11:58:57.688828+0000","last_active":"2024-09-14T11:58:57.688886+0000","last_peered":"2024-09-14T11:58:57.688886+0000","last_clean":"2024-09-14T11:58:57.688886+0000","last_became_active":"2024-09-14T10:56:41.690102+0000","last_became_peered":"2024-09-14T10:56:41.690102+0000","last_unstale":"2024-09-14T11:58:57.688886+0000","last_undegraded":"2024-09-14T11:58:57.688886+0000","last_fullsized":"2024-09-14T11:58:57.688886+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'660","last_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_deep_scrub":"263'660","last_deep_scrub_stamp":"2024-09-14T11:58:57.688740+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.688740+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":600,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:09.797199+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3150,"num_read_kb":2855,"num_write":866,"num_write_kb":309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"263'344","reported_seq":971,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.245273+0000","last_change":"2024-09-14T11:58:51.245207+0000","last_active":"2024-09-14T11:58:51.245273+0000","last_peered":"2024-09-14T11:58:51.245273+0000","last_clean":"2024-09-14T11:58:51.245273+0000","last_became_active":"2024-09-14T10:56:39.697615+0000","last_became_peered":"2024-09-14T10:56:39.697615+0000","last_unstale":"2024-09-14T11:58:51.245273+0000","last_undegraded":"2024-09-14T11:58:51.245273+0000","last_fullsized":"2024-09-14T11:58:51.245273+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'344","last_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_deep_scrub":"263'344","last_deep_scrub_stamp":"2024-09-14T11:58:51.245091+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.245091+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:42.023295+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730185,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":530,"num_read_kb":17523,"num_write":1016,"num_write_kb":39930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.097693+0000","last_change":"2024-09-14T11:59:05.097644+0000","last_active":"2024-09-14T11:59:05.097693+0000","last_peered":"2024-09-14T11:59:05.097693+0000","last_clean":"2024-09-14T11:59:05.097693+0000","last_became_active":"2024-09-14T10:56:43.698452+0000","last_became_peered":"2024-09-14T10:56:43.698452+0000","last_unstale":"2024-09-14T11:59:05.097693+0000","last_undegraded":"2024-09-14T11:59:05.097693+0000","last_fullsized":"2024-09-14T11:59:05.097693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.097558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.097558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:04.561569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"263'421","reported_seq":1046,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.512095+0000","last_change":"2024-09-14T11:59:12.512036+0000","last_active":"2024-09-14T11:59:12.512095+0000","last_peered":"2024-09-14T11:59:12.512095+0000","last_clean":"2024-09-14T11:59:12.512095+0000","last_became_active":"2024-09-14T10:56:45.715092+0000","last_became_peered":"2024-09-14T10:56:45.715092+0000","last_unstale":"2024-09-14T11:59:12.512095+0000","last_undegraded":"2024-09-14T11:59:12.512095+0000","last_fullsized":"2024-09-14T11:59:12.512095+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'421","last_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_deep_scrub":"263'421","last_deep_scrub_stamp":"2024-09-14T11:59:12.511928+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.511928+0000","objects_scrubbed":9,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:30:36.113276+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46953,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":681,"num_read_kb":1474,"num_write":542,"num_write_kb":366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.031986+0000","last_change":"2024-09-14T11:59:05.031924+0000","last_active":"2024-09-14T11:59:05.031986+0000","last_peered":"2024-09-14T11:59:05.031986+0000","last_clean":"2024-09-14T11:59:05.031986+0000","last_became_active":"2024-09-14T10:56:47.727560+0000","last_became_peered":"2024-09-14T10:56:47.727560+0000","last_unstale":"2024-09-14T11:59:05.031986+0000","last_undegraded":"2024-09-14T11:59:05.031986+0000","last_fullsized":"2024-09-14T11:59:05.031986+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.031837+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.031837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:42.237118+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"263'587","reported_seq":1408,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.356816+0000","last_change":"2024-09-14T11:59:17.356754+0000","last_active":"2024-09-14T11:59:17.356816+0000","last_peered":"2024-09-14T11:59:17.356816+0000","last_clean":"2024-09-14T11:59:17.356816+0000","last_became_active":"2024-09-14T10:56:49.748182+0000","last_became_peered":"2024-09-14T10:56:49.748182+0000","last_unstale":"2024-09-14T11:59:17.356816+0000","last_undegraded":"2024-09-14T11:59:17.356816+0000","last_fullsized":"2024-09-14T11:59:17.356816+0000","mapping_epoch":35,"log_start":"263'500","ondisk_log_start":"263'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'587","last_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_deep_scrub":"263'587","last_deep_scrub_stamp":"2024-09-14T11:59:17.356652+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.356652+0000","objects_scrubbed":6,"log_size":87,"log_dups_size":500,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:37.326137+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":907,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1339,"num_read_kb":1320,"num_write":1208,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"263'452","reported_seq":2130,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.816893+0000","last_change":"2024-09-14T11:58:54.816837+0000","last_active":"2024-09-14T11:58:54.816893+0000","last_peered":"2024-09-14T11:58:54.816893+0000","last_clean":"2024-09-14T11:58:54.816893+0000","last_became_active":"2024-09-14T10:56:41.699323+0000","last_became_peered":"2024-09-14T10:56:41.699323+0000","last_unstale":"2024-09-14T11:58:54.816893+0000","last_undegraded":"2024-09-14T11:58:54.816893+0000","last_fullsized":"2024-09-14T11:58:54.816893+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'452","last_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_deep_scrub":"263'452","last_deep_scrub_stamp":"2024-09-14T11:58:54.816749+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.816749+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:34:50.855590+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2542,"num_read_kb":2412,"num_write":519,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"263'367","reported_seq":1026,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.236737+0000","last_change":"2024-09-14T11:58:50.236667+0000","last_active":"2024-09-14T11:58:50.236737+0000","last_peered":"2024-09-14T11:58:50.236737+0000","last_clean":"2024-09-14T11:58:50.236737+0000","last_became_active":"2024-09-14T10:56:39.691168+0000","last_became_peered":"2024-09-14T10:56:39.691168+0000","last_unstale":"2024-09-14T11:58:50.236737+0000","last_undegraded":"2024-09-14T11:58:50.236737+0000","last_fullsized":"2024-09-14T11:58:50.236737+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'367","last_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_deep_scrub":"263'367","last_deep_scrub_stamp":"2024-09-14T11:58:50.236566+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.236566+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:38.811873+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":682,"num_read_kb":60976,"num_write":1200,"num_write_kb":28271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"263'6","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.085267+0000","last_change":"2024-09-14T11:58:57.085209+0000","last_active":"2024-09-14T11:58:57.085267+0000","last_peered":"2024-09-14T11:58:57.085267+0000","last_clean":"2024-09-14T11:58:57.085267+0000","last_became_active":"2024-09-14T10:56:43.702284+0000","last_became_peered":"2024-09-14T10:56:43.702284+0000","last_unstale":"2024-09-14T11:58:57.085267+0000","last_undegraded":"2024-09-14T11:58:57.085267+0000","last_fullsized":"2024-09-14T11:58:57.085267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-14T11:58:57.085117+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.085117+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:15.512672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":732,"num_read_kb":1199,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"263'284","reported_seq":865,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.201653+0000","last_change":"2024-09-14T11:59:10.201561+0000","last_active":"2024-09-14T11:59:10.201653+0000","last_peered":"2024-09-14T11:59:10.201653+0000","last_clean":"2024-09-14T11:59:10.201653+0000","last_became_active":"2024-09-14T10:56:45.716904+0000","last_became_peered":"2024-09-14T10:56:45.716904+0000","last_unstale":"2024-09-14T11:59:10.201653+0000","last_undegraded":"2024-09-14T11:59:10.201653+0000","last_fullsized":"2024-09-14T11:59:10.201653+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'284","last_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_deep_scrub":"263'284","last_deep_scrub_stamp":"2024-09-14T11:59:10.201469+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.201469+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:48.613270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46489,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":456,"num_read_kb":1060,"num_write":370,"num_write_kb":282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.268938+0000","last_change":"2024-09-14T11:59:16.268879+0000","last_active":"2024-09-14T11:59:16.268938+0000","last_peered":"2024-09-14T11:59:16.268938+0000","last_clean":"2024-09-14T11:59:16.268938+0000","last_became_active":"2024-09-14T10:56:47.728430+0000","last_became_peered":"2024-09-14T10:56:47.728430+0000","last_unstale":"2024-09-14T11:59:16.268938+0000","last_undegraded":"2024-09-14T11:59:16.268938+0000","last_fullsized":"2024-09-14T11:59:16.268938+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.268790+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.268790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:38.351368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"263'111","reported_seq":601,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.756721+0000","last_change":"2024-09-14T11:59:06.756656+0000","last_active":"2024-09-14T11:59:06.756721+0000","last_peered":"2024-09-14T11:59:06.756721+0000","last_clean":"2024-09-14T11:59:06.756721+0000","last_became_active":"2024-09-14T10:56:49.740171+0000","last_became_peered":"2024-09-14T10:56:49.740171+0000","last_unstale":"2024-09-14T11:59:06.756721+0000","last_undegraded":"2024-09-14T11:59:06.756721+0000","last_fullsized":"2024-09-14T11:59:06.756721+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'111","last_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_deep_scrub":"263'111","last_deep_scrub_stamp":"2024-09-14T11:59:06.756562+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.756562+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:37.023051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":98,"num_write":260,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"263'438","reported_seq":1877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.759714+0000","last_change":"2024-09-14T11:58:58.759653+0000","last_active":"2024-09-14T11:58:58.759714+0000","last_peered":"2024-09-14T11:58:58.759714+0000","last_clean":"2024-09-14T11:58:58.759714+0000","last_became_active":"2024-09-14T10:56:41.698727+0000","last_became_peered":"2024-09-14T10:56:41.698727+0000","last_unstale":"2024-09-14T11:58:58.759714+0000","last_undegraded":"2024-09-14T11:58:58.759714+0000","last_fullsized":"2024-09-14T11:58:58.759714+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:58.759554+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.759554+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:42.260528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2097,"num_write":511,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"263'324","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.255674+0000","last_change":"2024-09-14T11:58:49.255581+0000","last_active":"2024-09-14T11:58:49.255674+0000","last_peered":"2024-09-14T11:58:49.255674+0000","last_clean":"2024-09-14T11:58:49.255674+0000","last_became_active":"2024-09-14T10:56:39.695151+0000","last_became_peered":"2024-09-14T10:56:39.695151+0000","last_unstale":"2024-09-14T11:58:49.255674+0000","last_undegraded":"2024-09-14T11:58:49.255674+0000","last_fullsized":"2024-09-14T11:58:49.255674+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'324","last_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_deep_scrub":"263'324","last_deep_scrub_stamp":"2024-09-14T11:58:49.255417+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.255417+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:12.505258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730102,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":520,"num_read_kb":11458,"num_write":967,"num_write_kb":38670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,6],"acting":[7,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.050065+0000","last_change":"2024-09-14T11:58:58.050008+0000","last_active":"2024-09-14T11:58:58.050065+0000","last_peered":"2024-09-14T11:58:58.050065+0000","last_clean":"2024-09-14T11:58:58.050065+0000","last_became_active":"2024-09-14T10:56:43.701409+0000","last_became_peered":"2024-09-14T10:56:43.701409+0000","last_unstale":"2024-09-14T11:58:58.050065+0000","last_undegraded":"2024-09-14T11:58:58.050065+0000","last_fullsized":"2024-09-14T11:58:58.050065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:58.049910+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.049910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:15.923228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"263'302","reported_seq":894,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.215641+0000","last_change":"2024-09-14T11:59:10.215574+0000","last_active":"2024-09-14T11:59:10.215641+0000","last_peered":"2024-09-14T11:59:10.215641+0000","last_clean":"2024-09-14T11:59:10.215641+0000","last_became_active":"2024-09-14T10:56:45.715089+0000","last_became_peered":"2024-09-14T10:56:45.715089+0000","last_unstale":"2024-09-14T11:59:10.215641+0000","last_undegraded":"2024-09-14T11:59:10.215641+0000","last_fullsized":"2024-09-14T11:59:10.215641+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'302","last_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_deep_scrub":"263'302","last_deep_scrub_stamp":"2024-09-14T11:59:10.215461+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.215461+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:54.687739+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50465,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":488,"num_read_kb":1040,"num_write":378,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"263'796","reported_seq":2934,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.998959+0000","last_change":"2024-09-14T11:59:03.998865+0000","last_active":"2024-09-14T11:59:03.998959+0000","last_peered":"2024-09-14T11:59:03.998959+0000","last_clean":"2024-09-14T11:59:03.998959+0000","last_became_active":"2024-09-14T10:56:47.732369+0000","last_became_peered":"2024-09-14T10:56:47.732369+0000","last_unstale":"2024-09-14T11:59:03.998959+0000","last_undegraded":"2024-09-14T11:59:03.998959+0000","last_fullsized":"2024-09-14T11:59:03.998959+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'796","last_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_deep_scrub":"263'796","last_deep_scrub_stamp":"2024-09-14T11:59:03.998777+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.998777+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:39.585506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"263'146","reported_seq":654,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.046023+0000","last_change":"2024-09-14T11:59:16.045957+0000","last_active":"2024-09-14T11:59:16.046023+0000","last_peered":"2024-09-14T11:59:16.046023+0000","last_clean":"2024-09-14T11:59:16.046023+0000","last_became_active":"2024-09-14T10:56:49.750778+0000","last_became_peered":"2024-09-14T10:56:49.750778+0000","last_unstale":"2024-09-14T11:59:16.046023+0000","last_undegraded":"2024-09-14T11:59:16.046023+0000","last_fullsized":"2024-09-14T11:59:16.046023+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'146","last_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_deep_scrub":"263'146","last_deep_scrub_stamp":"2024-09-14T11:59:16.045861+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.045861+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:48.038828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":355,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"263'439","reported_seq":2007,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.012158+0000","last_change":"2024-09-14T11:58:57.012062+0000","last_active":"2024-09-14T11:58:57.012158+0000","last_peered":"2024-09-14T11:58:57.012158+0000","last_clean":"2024-09-14T11:58:57.012158+0000","last_became_active":"2024-09-14T10:56:41.698954+0000","last_became_peered":"2024-09-14T10:56:41.698954+0000","last_unstale":"2024-09-14T11:58:57.012158+0000","last_undegraded":"2024-09-14T11:58:57.012158+0000","last_fullsized":"2024-09-14T11:58:57.012158+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'439","last_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_deep_scrub":"263'439","last_deep_scrub_stamp":"2024-09-14T11:58:57.011931+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.011931+0000","objects_scrubbed":2,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:47.884035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2329,"num_read_kb":2202,"num_write":484,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"263'342","reported_seq":1000,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.124210+0000","last_change":"2024-09-14T11:58:45.124210+0000","last_active":"2024-09-14T11:58:45.124210+0000","last_peered":"2024-09-14T11:58:45.124210+0000","last_clean":"2024-09-14T11:58:45.124210+0000","last_became_active":"2024-09-14T10:57:16.313169+0000","last_became_peered":"2024-09-14T10:57:16.313169+0000","last_unstale":"2024-09-14T11:58:45.124210+0000","last_undegraded":"2024-09-14T11:58:45.124210+0000","last_fullsized":"2024-09-14T11:58:45.124210+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'342","last_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_deep_scrub":"263'342","last_deep_scrub_stamp":"2024-09-14T11:58:45.124078+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.124078+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:42.103214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730158,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":735,"num_read_kb":20707,"num_write":1086,"num_write_kb":36422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,1],"acting":[2,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.106858+0000","last_change":"2024-09-14T11:58:55.106800+0000","last_active":"2024-09-14T11:58:55.106858+0000","last_peered":"2024-09-14T11:58:55.106858+0000","last_clean":"2024-09-14T11:58:55.106858+0000","last_became_active":"2024-09-14T10:56:43.700488+0000","last_became_peered":"2024-09-14T10:56:43.700488+0000","last_unstale":"2024-09-14T11:58:55.106858+0000","last_undegraded":"2024-09-14T11:58:55.106858+0000","last_fullsized":"2024-09-14T11:58:55.106858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:55.106702+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.106702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:25.435659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"263'496","reported_seq":1136,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.014990+0000","last_change":"2024-09-14T11:59:01.014926+0000","last_active":"2024-09-14T11:59:01.014990+0000","last_peered":"2024-09-14T11:59:01.014990+0000","last_clean":"2024-09-14T11:59:01.014990+0000","last_became_active":"2024-09-14T10:56:45.716255+0000","last_became_peered":"2024-09-14T10:56:45.716255+0000","last_unstale":"2024-09-14T11:59:01.014990+0000","last_undegraded":"2024-09-14T11:59:01.014990+0000","last_fullsized":"2024-09-14T11:59:01.014990+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'496","last_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_deep_scrub":"263'496","last_deep_scrub_stamp":"2024-09-14T11:59:01.014817+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.014817+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:06:05.088724+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104584,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":850,"num_read_kb":2088,"num_write":692,"num_write_kb":578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.103671+0000","last_change":"2024-09-14T11:59:01.103600+0000","last_active":"2024-09-14T11:59:01.103671+0000","last_peered":"2024-09-14T11:59:01.103671+0000","last_clean":"2024-09-14T11:59:01.103671+0000","last_became_active":"2024-09-14T10:56:47.726830+0000","last_became_peered":"2024-09-14T10:56:47.726830+0000","last_unstale":"2024-09-14T11:59:01.103671+0000","last_undegraded":"2024-09-14T11:59:01.103671+0000","last_fullsized":"2024-09-14T11:59:01.103671+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.103512+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.103512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:55.351272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"263'154","reported_seq":666,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.165391+0000","last_change":"2024-09-14T11:59:11.165330+0000","last_active":"2024-09-14T11:59:11.165391+0000","last_peered":"2024-09-14T11:59:11.165391+0000","last_clean":"2024-09-14T11:59:11.165391+0000","last_became_active":"2024-09-14T10:56:49.744935+0000","last_became_peered":"2024-09-14T10:56:49.744935+0000","last_unstale":"2024-09-14T11:59:11.165391+0000","last_undegraded":"2024-09-14T11:59:11.165391+0000","last_fullsized":"2024-09-14T11:59:11.165391+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'154","last_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_deep_scrub":"263'154","last_deep_scrub_stamp":"2024-09-14T11:59:11.165237+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.165237+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:39.619620+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":146,"num_write":367,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"263'486","reported_seq":2272,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.754545+0000","last_change":"2024-09-14T11:58:50.754456+0000","last_active":"2024-09-14T11:58:50.754545+0000","last_peered":"2024-09-14T11:58:50.754545+0000","last_clean":"2024-09-14T11:58:50.754545+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:50.754545+0000","last_undegraded":"2024-09-14T11:58:50.754545+0000","last_fullsized":"2024-09-14T11:58:50.754545+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'486","last_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_deep_scrub":"263'486","last_deep_scrub_stamp":"2024-09-14T11:58:50.754357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.754357+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:10:01.136208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2810,"num_read_kb":2678,"num_write":568,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"263'383","reported_seq":1064,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.397679+0000","last_change":"2024-09-14T11:58:45.397624+0000","last_active":"2024-09-14T11:58:45.397679+0000","last_peered":"2024-09-14T11:58:45.397679+0000","last_clean":"2024-09-14T11:58:45.397679+0000","last_became_active":"2024-09-14T10:56:39.686152+0000","last_became_peered":"2024-09-14T10:56:39.686152+0000","last_unstale":"2024-09-14T11:58:45.397679+0000","last_undegraded":"2024-09-14T11:58:45.397679+0000","last_fullsized":"2024-09-14T11:58:45.397679+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'383","last_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_deep_scrub":"263'383","last_deep_scrub_stamp":"2024-09-14T11:58:45.397519+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.397519+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:00.442423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460262,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":720,"num_read_kb":26829,"num_write":1334,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.076996+0000","last_change":"2024-09-14T11:58:56.076851+0000","last_active":"2024-09-14T11:58:56.076996+0000","last_peered":"2024-09-14T11:58:56.076996+0000","last_clean":"2024-09-14T11:58:56.076996+0000","last_became_active":"2024-09-14T10:56:43.701526+0000","last_became_peered":"2024-09-14T10:56:43.701526+0000","last_unstale":"2024-09-14T11:58:56.076996+0000","last_undegraded":"2024-09-14T11:58:56.076996+0000","last_fullsized":"2024-09-14T11:58:56.076996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:56.076745+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.076745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:27.744336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"263'343","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.832235+0000","last_change":"2024-09-14T11:59:10.832169+0000","last_active":"2024-09-14T11:59:10.832235+0000","last_peered":"2024-09-14T11:59:10.832235+0000","last_clean":"2024-09-14T11:59:10.832235+0000","last_became_active":"2024-09-14T10:56:45.720609+0000","last_became_peered":"2024-09-14T10:56:45.720609+0000","last_unstale":"2024-09-14T11:59:10.832235+0000","last_undegraded":"2024-09-14T11:59:10.832235+0000","last_fullsized":"2024-09-14T11:59:10.832235+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'343","last_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_deep_scrub":"263'343","last_deep_scrub_stamp":"2024-09-14T11:59:10.832082+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.832082+0000","objects_scrubbed":6,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:56.975816+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":565,"num_read_kb":1258,"num_write":510,"num_write_kb":397,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.080037+0000","last_change":"2024-09-14T11:59:15.079968+0000","last_active":"2024-09-14T11:59:15.080037+0000","last_peered":"2024-09-14T11:59:15.080037+0000","last_clean":"2024-09-14T11:59:15.080037+0000","last_became_active":"2024-09-14T10:56:47.732164+0000","last_became_peered":"2024-09-14T10:56:47.732164+0000","last_unstale":"2024-09-14T11:59:15.080037+0000","last_undegraded":"2024-09-14T11:59:15.080037+0000","last_fullsized":"2024-09-14T11:59:15.080037+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.079878+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.079878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:46.130970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"263'133","reported_seq":642,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:24.254538+0000","last_change":"2024-09-14T11:59:24.254538+0000","last_active":"2024-09-14T11:59:24.254538+0000","last_peered":"2024-09-14T11:59:24.254538+0000","last_clean":"2024-09-14T11:59:24.254538+0000","last_became_active":"2024-09-14T10:56:49.745856+0000","last_became_peered":"2024-09-14T10:56:49.745856+0000","last_unstale":"2024-09-14T11:59:24.254538+0000","last_undegraded":"2024-09-14T11:59:24.254538+0000","last_fullsized":"2024-09-14T11:59:24.254538+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:59:24.254431+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:59:24.254431+0000","last_clean_scrub_stamp":"2024-09-14T11:59:24.254431+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:11.699979+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":154,"num_read_kb":139,"num_write":306,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"263'768","reported_seq":2689,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.761030+0000","last_change":"2024-09-14T11:58:51.760938+0000","last_active":"2024-09-14T11:58:51.761030+0000","last_peered":"2024-09-14T11:58:51.761030+0000","last_clean":"2024-09-14T11:58:51.761030+0000","last_became_active":"2024-09-14T10:56:41.693979+0000","last_became_peered":"2024-09-14T10:56:41.693979+0000","last_unstale":"2024-09-14T11:58:51.761030+0000","last_undegraded":"2024-09-14T11:58:51.761030+0000","last_fullsized":"2024-09-14T11:58:51.761030+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'768","last_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_deep_scrub":"263'768","last_deep_scrub_stamp":"2024-09-14T11:58:51.760830+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.760830+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":700,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:54:14.067687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4291,"num_read_kb":3906,"num_write":1116,"num_write_kb":512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4017,"num_omap_keys":16,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"263'396","reported_seq":1063,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.685593+0000","last_change":"2024-09-14T11:58:46.685522+0000","last_active":"2024-09-14T11:58:46.685593+0000","last_peered":"2024-09-14T11:58:46.685593+0000","last_clean":"2024-09-14T11:58:46.685593+0000","last_became_active":"2024-09-14T10:56:39.681698+0000","last_became_peered":"2024-09-14T10:56:39.681698+0000","last_unstale":"2024-09-14T11:58:46.685593+0000","last_undegraded":"2024-09-14T11:58:46.685593+0000","last_fullsized":"2024-09-14T11:58:46.685593+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'396","last_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_deep_scrub":"263'396","last_deep_scrub_stamp":"2024-09-14T11:58:46.685398+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.685398+0000","objects_scrubbed":7,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:45.698748+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":687,"num_read_kb":27548,"num_write":1230,"num_write_kb":40545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.121299+0000","last_change":"2024-09-14T11:58:59.121243+0000","last_active":"2024-09-14T11:58:59.121299+0000","last_peered":"2024-09-14T11:58:59.121299+0000","last_clean":"2024-09-14T11:58:59.121299+0000","last_became_active":"2024-09-14T10:56:43.707090+0000","last_became_peered":"2024-09-14T10:56:43.707090+0000","last_unstale":"2024-09-14T11:58:59.121299+0000","last_undegraded":"2024-09-14T11:58:59.121299+0000","last_fullsized":"2024-09-14T11:58:59.121299+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.121156+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.121156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.424441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"263'352","reported_seq":958,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.098174+0000","last_change":"2024-09-14T11:58:59.098104+0000","last_active":"2024-09-14T11:58:59.098174+0000","last_peered":"2024-09-14T11:58:59.098174+0000","last_clean":"2024-09-14T11:58:59.098174+0000","last_became_active":"2024-09-14T10:56:45.709478+0000","last_became_peered":"2024-09-14T10:56:45.709478+0000","last_unstale":"2024-09-14T11:58:59.098174+0000","last_undegraded":"2024-09-14T11:58:59.098174+0000","last_fullsized":"2024-09-14T11:58:59.098174+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:59.098007+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.098007+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:42.018589+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46049,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":572,"num_read_kb":1310,"num_write":462,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"263'754","reported_seq":2340,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.094451+0000","last_change":"2024-09-14T11:59:02.094373+0000","last_active":"2024-09-14T11:59:02.094451+0000","last_peered":"2024-09-14T11:59:02.094451+0000","last_clean":"2024-09-14T11:59:02.094451+0000","last_became_active":"2024-09-14T10:56:47.727681+0000","last_became_peered":"2024-09-14T10:56:47.727681+0000","last_unstale":"2024-09-14T11:59:02.094451+0000","last_undegraded":"2024-09-14T11:59:02.094451+0000","last_fullsized":"2024-09-14T11:59:02.094451+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'754","last_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_deep_scrub":"263'754","last_deep_scrub_stamp":"2024-09-14T11:59:02.094282+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.094282+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:59.227105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"263'123","reported_seq":624,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.151465+0000","last_change":"2024-09-14T11:59:08.151371+0000","last_active":"2024-09-14T11:59:08.151465+0000","last_peered":"2024-09-14T11:59:08.151465+0000","last_clean":"2024-09-14T11:59:08.151465+0000","last_became_active":"2024-09-14T10:56:49.745895+0000","last_became_peered":"2024-09-14T10:56:49.745895+0000","last_unstale":"2024-09-14T11:59:08.151465+0000","last_undegraded":"2024-09-14T11:59:08.151465+0000","last_fullsized":"2024-09-14T11:59:08.151465+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:08.151256+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.151256+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:32.059464+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":116,"num_write":294,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"263'748","reported_seq":2270,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.737402+0000","last_change":"2024-09-14T11:58:52.737338+0000","last_active":"2024-09-14T11:58:52.737402+0000","last_peered":"2024-09-14T11:58:52.737402+0000","last_clean":"2024-09-14T11:58:52.737402+0000","last_became_active":"2024-09-14T10:56:41.687083+0000","last_became_peered":"2024-09-14T10:56:41.687083+0000","last_unstale":"2024-09-14T11:58:52.737402+0000","last_undegraded":"2024-09-14T11:58:52.737402+0000","last_fullsized":"2024-09-14T11:58:52.737402+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'748","last_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_deep_scrub":"263'748","last_deep_scrub_stamp":"2024-09-14T11:58:52.737257+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.737257+0000","objects_scrubbed":2,"log_size":48,"log_dups_size":700,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:36.814154+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3644,"num_read_kb":3294,"num_write":992,"num_write_kb":376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"263'364","reported_seq":1008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.699843+0000","last_change":"2024-09-14T11:58:45.699782+0000","last_active":"2024-09-14T11:58:45.699843+0000","last_peered":"2024-09-14T11:58:45.699843+0000","last_clean":"2024-09-14T11:58:45.699843+0000","last_became_active":"2024-09-14T10:56:39.682938+0000","last_became_peered":"2024-09-14T10:56:39.682938+0000","last_unstale":"2024-09-14T11:58:45.699843+0000","last_undegraded":"2024-09-14T11:58:45.699843+0000","last_fullsized":"2024-09-14T11:58:45.699843+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'364","last_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_deep_scrub":"263'364","last_deep_scrub_stamp":"2024-09-14T11:58:45.699650+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.699650+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:10.613326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":558,"num_read_kb":90386,"num_write":1114,"num_write_kb":63478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"263'4","reported_seq":1458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.598713+0000","last_change":"2024-09-14T11:59:07.598642+0000","last_active":"2024-09-14T11:59:07.598713+0000","last_peered":"2024-09-14T11:59:07.598713+0000","last_clean":"2024-09-14T11:59:07.598713+0000","last_became_active":"2024-09-14T10:56:43.700750+0000","last_became_peered":"2024-09-14T10:56:43.700750+0000","last_unstale":"2024-09-14T11:59:07.598713+0000","last_undegraded":"2024-09-14T11:59:07.598713+0000","last_fullsized":"2024-09-14T11:59:07.598713+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:59:07.598558+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.598558+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:48.979302+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":960,"num_read_kb":960,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"263'97","reported_seq":630,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.229724+0000","last_change":"2024-09-14T11:59:08.229635+0000","last_active":"2024-09-14T11:59:08.229724+0000","last_peered":"2024-09-14T11:59:08.229724+0000","last_clean":"2024-09-14T11:59:08.229724+0000","last_became_active":"2024-09-14T10:56:45.713600+0000","last_became_peered":"2024-09-14T10:56:45.713600+0000","last_unstale":"2024-09-14T11:59:08.229724+0000","last_undegraded":"2024-09-14T11:59:08.229724+0000","last_fullsized":"2024-09-14T11:59:08.229724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'97","last_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_deep_scrub":"263'97","last_deep_scrub_stamp":"2024-09-14T11:59:08.229543+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.229543+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:06.240077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":107,"num_read_kb":101,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"263'776","reported_seq":2410,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.752788+0000","last_change":"2024-09-14T11:59:03.752708+0000","last_active":"2024-09-14T11:59:03.752788+0000","last_peered":"2024-09-14T11:59:03.752788+0000","last_clean":"2024-09-14T11:59:03.752788+0000","last_became_active":"2024-09-14T10:56:47.728481+0000","last_became_peered":"2024-09-14T10:56:47.728481+0000","last_unstale":"2024-09-14T11:59:03.752788+0000","last_undegraded":"2024-09-14T11:59:03.752788+0000","last_fullsized":"2024-09-14T11:59:03.752788+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:03.752612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.752612+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:52.775220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"263'162","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.704072+0000","last_change":"2024-09-14T11:59:19.704011+0000","last_active":"2024-09-14T11:59:19.704072+0000","last_peered":"2024-09-14T11:59:19.704072+0000","last_clean":"2024-09-14T11:59:19.704072+0000","last_became_active":"2024-09-14T10:56:49.746403+0000","last_became_peered":"2024-09-14T10:56:49.746403+0000","last_unstale":"2024-09-14T11:59:19.704072+0000","last_undegraded":"2024-09-14T11:59:19.704072+0000","last_fullsized":"2024-09-14T11:59:19.704072+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'162","last_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_deep_scrub":"263'162","last_deep_scrub_stamp":"2024-09-14T11:59:19.703915+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.703915+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:03.125097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":161,"num_read_kb":149,"num_write":392,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"263'790","reported_seq":2353,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.214502+0000","last_change":"2024-09-14T11:58:54.214441+0000","last_active":"2024-09-14T11:58:54.214502+0000","last_peered":"2024-09-14T11:58:54.214502+0000","last_clean":"2024-09-14T11:58:54.214502+0000","last_became_active":"2024-09-14T10:56:41.697478+0000","last_became_peered":"2024-09-14T10:56:41.697478+0000","last_unstale":"2024-09-14T11:58:54.214502+0000","last_undegraded":"2024-09-14T11:58:54.214502+0000","last_fullsized":"2024-09-14T11:58:54.214502+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'790","last_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_deep_scrub":"263'790","last_deep_scrub_stamp":"2024-09-14T11:58:54.214346+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.214346+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:58:33.379939+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3735,"num_read_kb":3378,"num_write":1025,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"263'328","reported_seq":935,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.320537+0000","last_change":"2024-09-14T11:58:48.320469+0000","last_active":"2024-09-14T11:58:48.320537+0000","last_peered":"2024-09-14T11:58:48.320537+0000","last_clean":"2024-09-14T11:58:48.320537+0000","last_became_active":"2024-09-14T10:57:15.794896+0000","last_became_peered":"2024-09-14T10:57:15.794896+0000","last_unstale":"2024-09-14T11:58:48.320537+0000","last_undegraded":"2024-09-14T11:58:48.320537+0000","last_fullsized":"2024-09-14T11:58:48.320537+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:58:48.320357+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.320357+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:05.438966+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029101,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":538,"num_read_kb":1389,"num_write":1004,"num_write_kb":10621,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,4],"acting":[3,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.890178+0000","last_change":"2024-09-14T11:59:06.890106+0000","last_active":"2024-09-14T11:59:06.890178+0000","last_peered":"2024-09-14T11:59:06.890178+0000","last_clean":"2024-09-14T11:59:06.890178+0000","last_became_active":"2024-09-14T10:56:43.698601+0000","last_became_peered":"2024-09-14T10:56:43.698601+0000","last_unstale":"2024-09-14T11:59:06.890178+0000","last_undegraded":"2024-09-14T11:59:06.890178+0000","last_fullsized":"2024-09-14T11:59:06.890178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.890026+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.890026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:38.506072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"263'404","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.470130+0000","last_change":"2024-09-14T11:59:13.470070+0000","last_active":"2024-09-14T11:59:13.470130+0000","last_peered":"2024-09-14T11:59:13.470130+0000","last_clean":"2024-09-14T11:59:13.470130+0000","last_became_active":"2024-09-14T10:56:45.718676+0000","last_became_peered":"2024-09-14T10:56:45.718676+0000","last_unstale":"2024-09-14T11:59:13.470130+0000","last_undegraded":"2024-09-14T11:59:13.470130+0000","last_fullsized":"2024-09-14T11:59:13.470130+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'404","last_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_deep_scrub":"263'404","last_deep_scrub_stamp":"2024-09-14T11:59:13.469964+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.469964+0000","objects_scrubbed":9,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:32.308998+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45959,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1239,"num_read_kb":1795,"num_write":1786,"num_write_kb":1623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516348,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.747733+0000","last_change":"2024-09-14T11:59:02.747632+0000","last_active":"2024-09-14T11:59:02.747733+0000","last_peered":"2024-09-14T11:59:02.747733+0000","last_clean":"2024-09-14T11:59:02.747733+0000","last_became_active":"2024-09-14T10:56:47.735597+0000","last_became_peered":"2024-09-14T10:56:47.735597+0000","last_unstale":"2024-09-14T11:59:02.747733+0000","last_undegraded":"2024-09-14T11:59:02.747733+0000","last_fullsized":"2024-09-14T11:59:02.747733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.747498+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.747498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:34.505006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"263'197","reported_seq":700,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.165634+0000","last_change":"2024-09-14T11:59:09.165579+0000","last_active":"2024-09-14T11:59:09.165634+0000","last_peered":"2024-09-14T11:59:09.165634+0000","last_clean":"2024-09-14T11:59:09.165634+0000","last_became_active":"2024-09-14T10:56:49.742991+0000","last_became_peered":"2024-09-14T10:56:49.742991+0000","last_unstale":"2024-09-14T11:59:09.165634+0000","last_undegraded":"2024-09-14T11:59:09.165634+0000","last_fullsized":"2024-09-14T11:59:09.165634+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'197","last_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_deep_scrub":"263'197","last_deep_scrub_stamp":"2024-09-14T11:59:09.165485+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.165485+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:37.416199+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":433,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"263'648","reported_seq":2133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.745492+0000","last_change":"2024-09-14T11:58:53.745432+0000","last_active":"2024-09-14T11:58:53.745492+0000","last_peered":"2024-09-14T11:58:53.745492+0000","last_clean":"2024-09-14T11:58:53.745492+0000","last_became_active":"2024-09-14T10:56:41.691903+0000","last_became_peered":"2024-09-14T10:56:41.691903+0000","last_unstale":"2024-09-14T11:58:53.745492+0000","last_undegraded":"2024-09-14T11:58:53.745492+0000","last_fullsized":"2024-09-14T11:58:53.745492+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'648","last_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_deep_scrub":"263'648","last_deep_scrub_stamp":"2024-09-14T11:58:53.745349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.745349+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":600,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:32.204852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3800,"num_read_kb":3507,"num_write":963,"num_write_kb":382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"263'74","reported_seq":614,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.168663+0000","last_change":"2024-09-14T11:58:46.168663+0000","last_active":"2024-09-14T11:58:46.168663+0000","last_peered":"2024-09-14T11:58:46.168663+0000","last_clean":"2024-09-14T11:58:46.168663+0000","last_became_active":"2024-09-14T10:56:23.584060+0000","last_became_peered":"2024-09-14T10:56:23.584060+0000","last_unstale":"2024-09-14T11:58:46.168663+0000","last_undegraded":"2024-09-14T11:58:46.168663+0000","last_fullsized":"2024-09-14T11:58:46.168663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'74","last_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_deep_scrub":"263'74","last_deep_scrub_stamp":"2024-09-14T11:58:46.168543+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.168543+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:01.548000+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"263'2","reported_seq":525,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.569275+0000","last_change":"2024-09-14T11:58:46.569219+0000","last_active":"2024-09-14T11:58:46.569275+0000","last_peered":"2024-09-14T11:58:46.569275+0000","last_clean":"2024-09-14T11:58:46.569275+0000","last_became_active":"2024-09-14T10:56:30.608331+0000","last_became_peered":"2024-09-14T10:56:30.608331+0000","last_unstale":"2024-09-14T11:58:46.569275+0000","last_undegraded":"2024-09-14T11:58:46.569275+0000","last_fullsized":"2024-09-14T11:58:46.569275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:46.569138+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.569138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:18.058116+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00043008599999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"263'352","reported_seq":1017,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.444433+0000","last_change":"2024-09-14T11:58:44.444382+0000","last_active":"2024-09-14T11:58:44.444433+0000","last_peered":"2024-09-14T11:58:44.444433+0000","last_clean":"2024-09-14T11:58:44.444433+0000","last_became_active":"2024-09-14T10:56:39.682247+0000","last_became_peered":"2024-09-14T10:56:39.682247+0000","last_unstale":"2024-09-14T11:58:44.444433+0000","last_undegraded":"2024-09-14T11:58:44.444433+0000","last_fullsized":"2024-09-14T11:58:44.444433+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'352","last_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_deep_scrub":"263'352","last_deep_scrub_stamp":"2024-09-14T11:58:44.444289+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.444289+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:32.649496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":656,"num_read_kb":39235,"num_write":1025,"num_write_kb":52677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.108459+0000","last_change":"2024-09-14T11:59:04.108374+0000","last_active":"2024-09-14T11:59:04.108459+0000","last_peered":"2024-09-14T11:59:04.108459+0000","last_clean":"2024-09-14T11:59:04.108459+0000","last_became_active":"2024-09-14T10:56:43.701653+0000","last_became_peered":"2024-09-14T10:56:43.701653+0000","last_unstale":"2024-09-14T11:59:04.108459+0000","last_undegraded":"2024-09-14T11:59:04.108459+0000","last_fullsized":"2024-09-14T11:59:04.108459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.108274+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.108274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:55:04.664406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"263'800","reported_seq":1507,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.503767+0000","last_change":"2024-09-14T11:59:11.503710+0000","last_active":"2024-09-14T11:59:11.503767+0000","last_peered":"2024-09-14T11:59:11.503767+0000","last_clean":"2024-09-14T11:59:11.503767+0000","last_became_active":"2024-09-14T10:56:45.715494+0000","last_became_peered":"2024-09-14T10:56:45.715494+0000","last_unstale":"2024-09-14T11:59:11.503767+0000","last_undegraded":"2024-09-14T11:59:11.503767+0000","last_fullsized":"2024-09-14T11:59:11.503767+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:11.503605+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.503605+0000","objects_scrubbed":6,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:34.646109+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159942,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1557,"num_read_kb":3699,"num_write":1498,"num_write_kb":1345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":106782,"num_omap_keys":256,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.022630+0000","last_change":"2024-09-14T11:59:06.022564+0000","last_active":"2024-09-14T11:59:06.022630+0000","last_peered":"2024-09-14T11:59:06.022630+0000","last_clean":"2024-09-14T11:59:06.022630+0000","last_became_active":"2024-09-14T10:56:47.735649+0000","last_became_peered":"2024-09-14T10:56:47.735649+0000","last_unstale":"2024-09-14T11:59:06.022630+0000","last_undegraded":"2024-09-14T11:59:06.022630+0000","last_fullsized":"2024-09-14T11:59:06.022630+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.022472+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.022472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:49.065861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"263'192","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.787470+0000","last_change":"2024-09-14T11:59:08.787410+0000","last_active":"2024-09-14T11:59:08.787470+0000","last_peered":"2024-09-14T11:59:08.787470+0000","last_clean":"2024-09-14T11:59:08.787470+0000","last_became_active":"2024-09-14T10:56:49.743263+0000","last_became_peered":"2024-09-14T10:56:49.743263+0000","last_unstale":"2024-09-14T11:59:08.787470+0000","last_undegraded":"2024-09-14T11:59:08.787470+0000","last_fullsized":"2024-09-14T11:59:08.787470+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'192","last_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_deep_scrub":"263'192","last_deep_scrub_stamp":"2024-09-14T11:59:08.787313+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.787313+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:32.951609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":834,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":462,"num_read_kb":449,"num_write":392,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"263'471","reported_seq":2009,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.091215+0000","last_change":"2024-09-14T11:58:51.091140+0000","last_active":"2024-09-14T11:58:51.091215+0000","last_peered":"2024-09-14T11:58:51.091215+0000","last_clean":"2024-09-14T11:58:51.091215+0000","last_became_active":"2024-09-14T10:56:41.699665+0000","last_became_peered":"2024-09-14T10:56:41.699665+0000","last_unstale":"2024-09-14T11:58:51.091215+0000","last_undegraded":"2024-09-14T11:58:51.091215+0000","last_fullsized":"2024-09-14T11:58:51.091215+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'471","last_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_deep_scrub":"263'471","last_deep_scrub_stamp":"2024-09-14T11:58:51.091045+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.091045+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:45.745869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2434,"num_read_kb":2275,"num_write":569,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":521,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.185772+0000","last_change":"2024-09-14T11:58:47.185772+0000","last_active":"2024-09-14T11:58:47.185772+0000","last_peered":"2024-09-14T11:58:47.185772+0000","last_clean":"2024-09-14T11:58:47.185772+0000","last_became_active":"2024-09-14T10:56:30.608214+0000","last_became_peered":"2024-09-14T10:56:30.608214+0000","last_unstale":"2024-09-14T11:58:47.185772+0000","last_undegraded":"2024-09-14T11:58:47.185772+0000","last_fullsized":"2024-09-14T11:58:47.185772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:47.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:42.752443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052865300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"263'294","reported_seq":899,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.189454+0000","last_change":"2024-09-14T11:58:43.189335+0000","last_active":"2024-09-14T11:58:43.189454+0000","last_peered":"2024-09-14T11:58:43.189454+0000","last_clean":"2024-09-14T11:58:43.189454+0000","last_became_active":"2024-09-14T10:56:39.691547+0000","last_became_peered":"2024-09-14T10:56:39.691547+0000","last_unstale":"2024-09-14T11:58:43.189454+0000","last_undegraded":"2024-09-14T11:58:43.189454+0000","last_fullsized":"2024-09-14T11:58:43.189454+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'294","last_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_deep_scrub":"263'294","last_deep_scrub_stamp":"2024-09-14T11:58:43.189192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.189192+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:06.174639+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":441,"num_read_kb":19285,"num_write":870,"num_write_kb":35738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.631742+0000","last_change":"2024-09-14T11:59:06.631675+0000","last_active":"2024-09-14T11:59:06.631742+0000","last_peered":"2024-09-14T11:59:06.631742+0000","last_clean":"2024-09-14T11:59:06.631742+0000","last_became_active":"2024-09-14T10:56:43.701427+0000","last_became_peered":"2024-09-14T10:56:43.701427+0000","last_unstale":"2024-09-14T11:59:06.631742+0000","last_undegraded":"2024-09-14T11:59:06.631742+0000","last_fullsized":"2024-09-14T11:59:06.631742+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.631578+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.631578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:27.585412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"263'1337","reported_seq":3031,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.084394+0000","last_change":"2024-09-14T11:59:04.084328+0000","last_active":"2024-09-14T11:59:04.084394+0000","last_peered":"2024-09-14T11:59:04.084394+0000","last_clean":"2024-09-14T11:59:04.084394+0000","last_became_active":"2024-09-14T10:56:45.719597+0000","last_became_peered":"2024-09-14T10:56:45.719597+0000","last_unstale":"2024-09-14T11:59:04.084394+0000","last_undegraded":"2024-09-14T11:59:04.084394+0000","last_fullsized":"2024-09-14T11:59:04.084394+0000","mapping_epoch":31,"log_start":"263'1300","ondisk_log_start":"263'1300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1337","last_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_deep_scrub":"263'1337","last_deep_scrub_stamp":"2024-09-14T11:59:04.084232+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.084232+0000","objects_scrubbed":12,"log_size":37,"log_dups_size":1300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:49.280837+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147529,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2108,"num_read_kb":4061,"num_write":1198,"num_write_kb":1001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.204755+0000","last_change":"2024-09-14T11:59:14.204694+0000","last_active":"2024-09-14T11:59:14.204755+0000","last_peered":"2024-09-14T11:59:14.204755+0000","last_clean":"2024-09-14T11:59:14.204755+0000","last_became_active":"2024-09-14T10:56:47.734228+0000","last_became_peered":"2024-09-14T10:56:47.734228+0000","last_unstale":"2024-09-14T11:59:14.204755+0000","last_undegraded":"2024-09-14T11:59:14.204755+0000","last_fullsized":"2024-09-14T11:59:14.204755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.204609+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.204609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:29.615881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"263'95","reported_seq":600,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.143259+0000","last_change":"2024-09-14T11:59:12.143196+0000","last_active":"2024-09-14T11:59:12.143259+0000","last_peered":"2024-09-14T11:59:12.143259+0000","last_clean":"2024-09-14T11:59:12.143259+0000","last_became_active":"2024-09-14T10:56:49.740879+0000","last_became_peered":"2024-09-14T10:56:49.740879+0000","last_unstale":"2024-09-14T11:59:12.143259+0000","last_undegraded":"2024-09-14T11:59:12.143259+0000","last_fullsized":"2024-09-14T11:59:12.143259+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'95","last_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_deep_scrub":"263'95","last_deep_scrub_stamp":"2024-09-14T11:59:12.143119+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.143119+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:39.907735+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":218,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"263'940","reported_seq":2816,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.240569+0000","last_change":"2024-09-14T11:58:52.240513+0000","last_active":"2024-09-14T11:58:52.240569+0000","last_peered":"2024-09-14T11:58:52.240569+0000","last_clean":"2024-09-14T11:58:52.240569+0000","last_became_active":"2024-09-14T10:56:41.697819+0000","last_became_peered":"2024-09-14T10:56:41.697819+0000","last_unstale":"2024-09-14T11:58:52.240569+0000","last_undegraded":"2024-09-14T11:58:52.240569+0000","last_fullsized":"2024-09-14T11:58:52.240569+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'940","last_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_deep_scrub":"263'940","last_deep_scrub_stamp":"2024-09-14T11:58:52.240421+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.240421+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":900,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:19.620785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4670,"num_read_kb":4223,"num_write":1218,"num_write_kb":446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":535,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.087405+0000","last_change":"2024-09-14T11:58:44.087353+0000","last_active":"2024-09-14T11:58:44.087405+0000","last_peered":"2024-09-14T11:58:44.087405+0000","last_clean":"2024-09-14T11:58:44.087405+0000","last_became_active":"2024-09-14T10:56:30.604412+0000","last_became_peered":"2024-09-14T10:56:30.604412+0000","last_unstale":"2024-09-14T11:58:44.087405+0000","last_undegraded":"2024-09-14T11:58:44.087405+0000","last_fullsized":"2024-09-14T11:58:44.087405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:44.087274+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.087274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:51.959220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062651299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"263'321","reported_seq":950,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.207333+0000","last_change":"2024-09-14T11:58:44.207283+0000","last_active":"2024-09-14T11:58:44.207333+0000","last_peered":"2024-09-14T11:58:44.207333+0000","last_clean":"2024-09-14T11:58:44.207333+0000","last_became_active":"2024-09-14T10:56:39.676485+0000","last_became_peered":"2024-09-14T10:56:39.676485+0000","last_unstale":"2024-09-14T11:58:44.207333+0000","last_undegraded":"2024-09-14T11:58:44.207333+0000","last_fullsized":"2024-09-14T11:58:44.207333+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'321","last_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_deep_scrub":"263'321","last_deep_scrub_stamp":"2024-09-14T11:58:44.207202+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.207202+0000","objects_scrubbed":2,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:07.074753+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":545,"num_read_kb":14745,"num_write":993,"num_write_kb":27115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"263'2","reported_seq":509,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.123433+0000","last_change":"2024-09-14T11:58:52.123366+0000","last_active":"2024-09-14T11:58:52.123433+0000","last_peered":"2024-09-14T11:58:52.123433+0000","last_clean":"2024-09-14T11:58:52.123433+0000","last_became_active":"2024-09-14T10:56:43.701424+0000","last_became_peered":"2024-09-14T10:56:43.701424+0000","last_unstale":"2024-09-14T11:58:52.123433+0000","last_undegraded":"2024-09-14T11:58:52.123433+0000","last_fullsized":"2024-09-14T11:58:52.123433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:58:52.123283+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.123283+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:36:43.905032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"263'300","reported_seq":1582,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.173907+0000","last_change":"2024-09-14T11:59:09.173844+0000","last_active":"2024-09-14T11:59:09.173907+0000","last_peered":"2024-09-14T11:59:09.173907+0000","last_clean":"2024-09-14T11:59:09.173907+0000","last_became_active":"2024-09-14T10:56:45.719908+0000","last_became_peered":"2024-09-14T10:56:45.719908+0000","last_unstale":"2024-09-14T11:59:09.173907+0000","last_undegraded":"2024-09-14T11:59:09.173907+0000","last_fullsized":"2024-09-14T11:59:09.173907+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'300","last_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_deep_scrub":"263'300","last_deep_scrub_stamp":"2024-09-14T11:59:09.173746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.173746+0000","objects_scrubbed":9,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:19.388852+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":237,"num_read_kb":227,"num_write":213,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.984467+0000","last_change":"2024-09-14T11:59:04.984412+0000","last_active":"2024-09-14T11:59:04.984467+0000","last_peered":"2024-09-14T11:59:04.984467+0000","last_clean":"2024-09-14T11:59:04.984467+0000","last_became_active":"2024-09-14T10:56:47.736759+0000","last_became_peered":"2024-09-14T10:56:47.736759+0000","last_unstale":"2024-09-14T11:59:04.984467+0000","last_undegraded":"2024-09-14T11:59:04.984467+0000","last_fullsized":"2024-09-14T11:59:04.984467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.984302+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.984302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:51.608454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"263'266","reported_seq":868,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.282846+0000","last_change":"2024-09-14T11:59:20.282776+0000","last_active":"2024-09-14T11:59:20.282846+0000","last_peered":"2024-09-14T11:59:20.282846+0000","last_clean":"2024-09-14T11:59:20.282846+0000","last_became_active":"2024-09-14T10:56:49.741353+0000","last_became_peered":"2024-09-14T10:56:49.741353+0000","last_unstale":"2024-09-14T11:59:20.282846+0000","last_undegraded":"2024-09-14T11:59:20.282846+0000","last_fullsized":"2024-09-14T11:59:20.282846+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'266","last_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_deep_scrub":"263'266","last_deep_scrub_stamp":"2024-09-14T11:59:20.282670+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.282670+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:28.650824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":831,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":490,"num_read_kb":514,"num_write":589,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"263'532","reported_seq":2146,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.215680+0000","last_change":"2024-09-14T11:58:55.215616+0000","last_active":"2024-09-14T11:58:55.215680+0000","last_peered":"2024-09-14T11:58:55.215680+0000","last_clean":"2024-09-14T11:58:55.215680+0000","last_became_active":"2024-09-14T10:56:41.690876+0000","last_became_peered":"2024-09-14T10:56:41.690876+0000","last_unstale":"2024-09-14T11:58:55.215680+0000","last_undegraded":"2024-09-14T11:58:55.215680+0000","last_fullsized":"2024-09-14T11:58:55.215680+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.215524+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.215524+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:07.598615+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2887,"num_read_kb":2676,"num_write":654,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"263'3","reported_seq":526,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.528258+0000","last_change":"2024-09-14T11:58:45.528200+0000","last_active":"2024-09-14T11:58:45.528258+0000","last_peered":"2024-09-14T11:58:45.528258+0000","last_clean":"2024-09-14T11:58:45.528258+0000","last_became_active":"2024-09-14T10:56:30.607722+0000","last_became_peered":"2024-09-14T10:56:30.607722+0000","last_unstale":"2024-09-14T11:58:45.528258+0000","last_undegraded":"2024-09-14T11:58:45.528258+0000","last_fullsized":"2024-09-14T11:58:45.528258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-14T11:58:45.528111+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.528111+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:55.865518+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001121761,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"263'318","reported_seq":959,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.744061+0000","last_change":"2024-09-14T11:58:44.744001+0000","last_active":"2024-09-14T11:58:44.744061+0000","last_peered":"2024-09-14T11:58:44.744061+0000","last_clean":"2024-09-14T11:58:44.744061+0000","last_became_active":"2024-09-14T10:56:39.677059+0000","last_became_peered":"2024-09-14T10:56:39.677059+0000","last_unstale":"2024-09-14T11:58:44.744061+0000","last_undegraded":"2024-09-14T11:58:44.744061+0000","last_fullsized":"2024-09-14T11:58:44.744061+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'318","last_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_deep_scrub":"263'318","last_deep_scrub_stamp":"2024-09-14T11:58:44.743862+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.743862+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.790267+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":516,"num_read_kb":28769,"num_write":1006,"num_write_kb":26192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.075990+0000","last_change":"2024-09-14T11:59:11.075932+0000","last_active":"2024-09-14T11:59:11.075990+0000","last_peered":"2024-09-14T11:59:11.075990+0000","last_clean":"2024-09-14T11:59:11.075990+0000","last_became_active":"2024-09-14T10:56:43.703544+0000","last_became_peered":"2024-09-14T10:56:43.703544+0000","last_unstale":"2024-09-14T11:59:11.075990+0000","last_undegraded":"2024-09-14T11:59:11.075990+0000","last_fullsized":"2024-09-14T11:59:11.075990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:11.075841+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.075841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:14.957973+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"263'149","reported_seq":706,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.277368+0000","last_change":"2024-09-14T11:59:13.277307+0000","last_active":"2024-09-14T11:59:13.277368+0000","last_peered":"2024-09-14T11:59:13.277368+0000","last_clean":"2024-09-14T11:59:13.277368+0000","last_became_active":"2024-09-14T10:56:45.722780+0000","last_became_peered":"2024-09-14T10:56:45.722780+0000","last_unstale":"2024-09-14T11:59:13.277368+0000","last_undegraded":"2024-09-14T11:59:13.277368+0000","last_fullsized":"2024-09-14T11:59:13.277368+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'149","last_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_deep_scrub":"263'149","last_deep_scrub_stamp":"2024-09-14T11:59:13.277197+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.277197+0000","objects_scrubbed":7,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:07.842082+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":178,"num_read_kb":172,"num_write":128,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.741570+0000","last_change":"2024-09-14T11:59:01.741491+0000","last_active":"2024-09-14T11:59:01.741570+0000","last_peered":"2024-09-14T11:59:01.741570+0000","last_clean":"2024-09-14T11:59:01.741570+0000","last_became_active":"2024-09-14T10:56:47.734695+0000","last_became_peered":"2024-09-14T10:56:47.734695+0000","last_unstale":"2024-09-14T11:59:01.741570+0000","last_undegraded":"2024-09-14T11:59:01.741570+0000","last_fullsized":"2024-09-14T11:59:01.741570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.741352+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.741352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:48.805285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"263'143","reported_seq":728,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.291769+0000","last_change":"2024-09-14T11:59:19.291665+0000","last_active":"2024-09-14T11:59:19.291769+0000","last_peered":"2024-09-14T11:59:19.291769+0000","last_clean":"2024-09-14T11:59:19.291769+0000","last_became_active":"2024-09-14T10:56:49.745718+0000","last_became_peered":"2024-09-14T10:56:49.745718+0000","last_unstale":"2024-09-14T11:59:19.291769+0000","last_undegraded":"2024-09-14T11:59:19.291769+0000","last_fullsized":"2024-09-14T11:59:19.291769+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'143","last_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_deep_scrub":"263'143","last_deep_scrub_stamp":"2024-09-14T11:59:19.291569+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.291569+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:45.556534+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":394,"num_read_kb":347,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"263'389","reported_seq":1850,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.196607+0000","last_change":"2024-09-14T11:58:51.196546+0000","last_active":"2024-09-14T11:58:51.196607+0000","last_peered":"2024-09-14T11:58:51.196607+0000","last_clean":"2024-09-14T11:58:51.196607+0000","last_became_active":"2024-09-14T10:56:41.692806+0000","last_became_peered":"2024-09-14T10:56:41.692806+0000","last_unstale":"2024-09-14T11:58:51.196607+0000","last_undegraded":"2024-09-14T11:58:51.196607+0000","last_fullsized":"2024-09-14T11:58:51.196607+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'389","last_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_deep_scrub":"263'389","last_deep_scrub_stamp":"2024-09-14T11:58:51.196437+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.196437+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:05.805557+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2097,"num_read_kb":1986,"num_write":436,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"263'431","reported_seq":1090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.608058+0000","last_change":"2024-09-14T11:58:48.607993+0000","last_active":"2024-09-14T11:58:48.608058+0000","last_peered":"2024-09-14T11:58:48.608058+0000","last_clean":"2024-09-14T11:58:48.608058+0000","last_became_active":"2024-09-14T10:56:39.690054+0000","last_became_peered":"2024-09-14T10:56:39.690054+0000","last_unstale":"2024-09-14T11:58:48.608058+0000","last_undegraded":"2024-09-14T11:58:48.608058+0000","last_fullsized":"2024-09-14T11:58:48.608058+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'431","last_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_deep_scrub":"263'431","last_deep_scrub_stamp":"2024-09-14T11:58:48.607870+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.607870+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:44.650142+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":3743,"num_write":1340,"num_write_kb":40434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:43.231477+0000","last_change":"2024-09-14T11:58:43.231436+0000","last_active":"2024-09-14T11:58:43.231477+0000","last_peered":"2024-09-14T11:58:43.231477+0000","last_clean":"2024-09-14T11:58:43.231477+0000","last_became_active":"2024-09-14T10:56:30.974874+0000","last_became_peered":"2024-09-14T10:56:30.974874+0000","last_unstale":"2024-09-14T11:58:43.231477+0000","last_undegraded":"2024-09-14T11:58:43.231477+0000","last_fullsized":"2024-09-14T11:58:43.231477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:43.231372+0000","last_clean_scrub_stamp":"2024-09-14T11:58:43.231372+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:04.024193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071814700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.032264+0000","last_change":"2024-09-14T11:59:02.032210+0000","last_active":"2024-09-14T11:59:02.032264+0000","last_peered":"2024-09-14T11:59:02.032264+0000","last_clean":"2024-09-14T11:59:02.032264+0000","last_became_active":"2024-09-14T10:56:43.699767+0000","last_became_peered":"2024-09-14T10:56:43.699767+0000","last_unstale":"2024-09-14T11:59:02.032264+0000","last_undegraded":"2024-09-14T11:59:02.032264+0000","last_fullsized":"2024-09-14T11:59:02.032264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.032101+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.032101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:33:08.130324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"263'621","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.011394+0000","last_change":"2024-09-14T11:59:00.011394+0000","last_active":"2024-09-14T11:59:00.011394+0000","last_peered":"2024-09-14T11:59:00.011394+0000","last_clean":"2024-09-14T11:59:00.011394+0000","last_became_active":"2024-09-14T10:56:45.715907+0000","last_became_peered":"2024-09-14T10:56:45.715907+0000","last_unstale":"2024-09-14T11:59:00.011394+0000","last_undegraded":"2024-09-14T11:59:00.011394+0000","last_fullsized":"2024-09-14T11:59:00.011394+0000","mapping_epoch":31,"log_start":"263'600","ondisk_log_start":"263'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'621","last_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_deep_scrub":"263'621","last_deep_scrub_stamp":"2024-09-14T11:59:00.011288+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.011288+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":600,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:50.798461+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1023,"num_read_kb":2305,"num_write":884,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.705324+0000","last_change":"2024-09-14T11:59:15.705258+0000","last_active":"2024-09-14T11:59:15.705324+0000","last_peered":"2024-09-14T11:59:15.705324+0000","last_clean":"2024-09-14T11:59:15.705324+0000","last_became_active":"2024-09-14T10:56:47.731677+0000","last_became_peered":"2024-09-14T10:56:47.731677+0000","last_unstale":"2024-09-14T11:59:15.705324+0000","last_undegraded":"2024-09-14T11:59:15.705324+0000","last_fullsized":"2024-09-14T11:59:15.705324+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.705170+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.705170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:32.898069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"263'173","reported_seq":694,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.119730+0000","last_change":"2024-09-14T11:59:19.119668+0000","last_active":"2024-09-14T11:59:19.119730+0000","last_peered":"2024-09-14T11:59:19.119730+0000","last_clean":"2024-09-14T11:59:19.119730+0000","last_became_active":"2024-09-14T10:56:49.747802+0000","last_became_peered":"2024-09-14T10:56:49.747802+0000","last_unstale":"2024-09-14T11:59:19.119730+0000","last_undegraded":"2024-09-14T11:59:19.119730+0000","last_fullsized":"2024-09-14T11:59:19.119730+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'173","last_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_deep_scrub":"263'173","last_deep_scrub_stamp":"2024-09-14T11:59:19.119565+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.119565+0000","objects_scrubbed":5,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:16.877063+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":925,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":236,"num_read_kb":212,"num_write":432,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"263'532","reported_seq":2044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.066843+0000","last_change":"2024-09-14T11:58:55.066775+0000","last_active":"2024-09-14T11:58:55.066843+0000","last_peered":"2024-09-14T11:58:55.066843+0000","last_clean":"2024-09-14T11:58:55.066843+0000","last_became_active":"2024-09-14T10:56:41.699966+0000","last_became_peered":"2024-09-14T10:56:41.699966+0000","last_unstale":"2024-09-14T11:58:55.066843+0000","last_undegraded":"2024-09-14T11:58:55.066843+0000","last_fullsized":"2024-09-14T11:58:55.066843+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'532","last_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_deep_scrub":"263'532","last_deep_scrub_stamp":"2024-09-14T11:58:55.066670+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.066670+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:41.411005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2798,"num_read_kb":2550,"num_write":712,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"263'306","reported_seq":937,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.152742+0000","last_change":"2024-09-14T11:58:50.152595+0000","last_active":"2024-09-14T11:58:50.152742+0000","last_peered":"2024-09-14T11:58:50.152742+0000","last_clean":"2024-09-14T11:58:50.152742+0000","last_became_active":"2024-09-14T10:56:39.675064+0000","last_became_peered":"2024-09-14T10:56:39.675064+0000","last_unstale":"2024-09-14T11:58:50.152742+0000","last_undegraded":"2024-09-14T11:58:50.152742+0000","last_fullsized":"2024-09-14T11:58:50.152742+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'306","last_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_deep_scrub":"263'306","last_deep_scrub_stamp":"2024-09-14T11:58:50.152451+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.152451+0000","objects_scrubbed":5,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:15.470870+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":514,"num_read_kb":39755,"num_write":947,"num_write_kb":33387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":520,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.221566+0000","last_change":"2024-09-14T11:58:48.221461+0000","last_active":"2024-09-14T11:58:48.221566+0000","last_peered":"2024-09-14T11:58:48.221566+0000","last_clean":"2024-09-14T11:58:48.221566+0000","last_became_active":"2024-09-14T10:56:30.974780+0000","last_became_peered":"2024-09-14T10:56:30.974780+0000","last_unstale":"2024-09-14T11:58:48.221566+0000","last_undegraded":"2024-09-14T11:58:48.221566+0000","last_fullsized":"2024-09-14T11:58:48.221566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:48.221349+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.221349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:16.934950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00058086800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.788591+0000","last_change":"2024-09-14T11:58:57.788524+0000","last_active":"2024-09-14T11:58:57.788591+0000","last_peered":"2024-09-14T11:58:57.788591+0000","last_clean":"2024-09-14T11:58:57.788591+0000","last_became_active":"2024-09-14T10:56:43.697980+0000","last_became_peered":"2024-09-14T10:56:43.697980+0000","last_unstale":"2024-09-14T11:58:57.788591+0000","last_undegraded":"2024-09-14T11:58:57.788591+0000","last_fullsized":"2024-09-14T11:58:57.788591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:57.788438+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.788438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.196517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"263'198","reported_seq":781,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.091120+0000","last_change":"2024-09-14T11:59:03.091060+0000","last_active":"2024-09-14T11:59:03.091120+0000","last_peered":"2024-09-14T11:59:03.091120+0000","last_clean":"2024-09-14T11:59:03.091120+0000","last_became_active":"2024-09-14T10:56:45.710863+0000","last_became_peered":"2024-09-14T10:56:45.710863+0000","last_unstale":"2024-09-14T11:59:03.091120+0000","last_undegraded":"2024-09-14T11:59:03.091120+0000","last_fullsized":"2024-09-14T11:59:03.091120+0000","mapping_epoch":31,"log_start":"260'100","ondisk_log_start":"260'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'198","last_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_deep_scrub":"263'198","last_deep_scrub_stamp":"2024-09-14T11:59:03.090961+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.090961+0000","objects_scrubbed":7,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:07.204455+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":250,"num_read_kb":236,"num_write":170,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"263'800","reported_seq":2606,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.406681+0000","last_change":"2024-09-14T11:59:15.406681+0000","last_active":"2024-09-14T11:59:15.406681+0000","last_peered":"2024-09-14T11:59:15.406681+0000","last_clean":"2024-09-14T11:59:15.406681+0000","last_became_active":"2024-09-14T10:56:47.728439+0000","last_became_peered":"2024-09-14T10:56:47.728439+0000","last_unstale":"2024-09-14T11:59:15.406681+0000","last_undegraded":"2024-09-14T11:59:15.406681+0000","last_fullsized":"2024-09-14T11:59:15.406681+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'800","last_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_deep_scrub":"263'800","last_deep_scrub_stamp":"2024-09-14T11:59:15.406593+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.406593+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:33.921083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"263'137","reported_seq":638,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.322847+0000","last_change":"2024-09-14T11:59:19.322847+0000","last_active":"2024-09-14T11:59:19.322847+0000","last_peered":"2024-09-14T11:59:19.322847+0000","last_clean":"2024-09-14T11:59:19.322847+0000","last_became_active":"2024-09-14T10:56:49.736392+0000","last_became_peered":"2024-09-14T10:56:49.736392+0000","last_unstale":"2024-09-14T11:59:19.322847+0000","last_undegraded":"2024-09-14T11:59:19.322847+0000","last_fullsized":"2024-09-14T11:59:19.322847+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:19.322696+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.322696+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:24.890324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":707,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"263'407","reported_seq":1841,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.283321+0000","last_change":"2024-09-14T11:58:55.283205+0000","last_active":"2024-09-14T11:58:55.283321+0000","last_peered":"2024-09-14T11:58:55.283321+0000","last_clean":"2024-09-14T11:58:55.283321+0000","last_became_active":"2024-09-14T10:56:41.695843+0000","last_became_peered":"2024-09-14T10:56:41.695843+0000","last_unstale":"2024-09-14T11:58:55.283321+0000","last_undegraded":"2024-09-14T11:58:55.283321+0000","last_fullsized":"2024-09-14T11:58:55.283321+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'407","last_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_deep_scrub":"263'407","last_deep_scrub_stamp":"2024-09-14T11:58:55.283109+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.283109+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:35:51.916150+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2125,"num_read_kb":1990,"num_write":475,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"263'358","reported_seq":1023,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.209925+0000","last_change":"2024-09-14T11:58:51.209859+0000","last_active":"2024-09-14T11:58:51.209925+0000","last_peered":"2024-09-14T11:58:51.209925+0000","last_clean":"2024-09-14T11:58:51.209925+0000","last_became_active":"2024-09-14T10:56:39.688924+0000","last_became_peered":"2024-09-14T10:56:39.688924+0000","last_unstale":"2024-09-14T11:58:51.209925+0000","last_undegraded":"2024-09-14T11:58:51.209925+0000","last_fullsized":"2024-09-14T11:58:51.209925+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'358","last_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_deep_scrub":"263'358","last_deep_scrub_stamp":"2024-09-14T11:58:51.209715+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.209715+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:49.586185+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":699,"num_read_kb":30583,"num_write":1068,"num_write_kb":25625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":532,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.215800+0000","last_change":"2024-09-14T11:58:45.215756+0000","last_active":"2024-09-14T11:58:45.215800+0000","last_peered":"2024-09-14T11:58:45.215800+0000","last_clean":"2024-09-14T11:58:45.215800+0000","last_became_active":"2024-09-14T10:56:30.611616+0000","last_became_peered":"2024-09-14T10:56:30.611616+0000","last_unstale":"2024-09-14T11:58:45.215800+0000","last_undegraded":"2024-09-14T11:58:45.215800+0000","last_fullsized":"2024-09-14T11:58:45.215800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.215695+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.215695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:39:26.730819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056959800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":510,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.845801+0000","last_change":"2024-09-14T11:59:05.845748+0000","last_active":"2024-09-14T11:59:05.845801+0000","last_peered":"2024-09-14T11:59:05.845801+0000","last_clean":"2024-09-14T11:59:05.845801+0000","last_became_active":"2024-09-14T10:56:43.702828+0000","last_became_peered":"2024-09-14T10:56:43.702828+0000","last_unstale":"2024-09-14T11:59:05.845801+0000","last_undegraded":"2024-09-14T11:59:05.845801+0000","last_fullsized":"2024-09-14T11:59:05.845801+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.845663+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.845663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:31.163427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"263'124","reported_seq":681,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.816674+0000","last_change":"2024-09-14T11:59:09.816611+0000","last_active":"2024-09-14T11:59:09.816674+0000","last_peered":"2024-09-14T11:59:09.816674+0000","last_clean":"2024-09-14T11:59:09.816674+0000","last_became_active":"2024-09-14T10:56:45.722072+0000","last_became_peered":"2024-09-14T10:56:45.722072+0000","last_unstale":"2024-09-14T11:59:09.816674+0000","last_undegraded":"2024-09-14T11:59:09.816674+0000","last_fullsized":"2024-09-14T11:59:09.816674+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'124","last_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_deep_scrub":"263'124","last_deep_scrub_stamp":"2024-09-14T11:59:09.816525+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.816525+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:12.664495+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":149,"num_read_kb":144,"num_write":98,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"263'814","reported_seq":3008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.285037+0000","last_change":"2024-09-14T11:59:18.285037+0000","last_active":"2024-09-14T11:59:18.285037+0000","last_peered":"2024-09-14T11:59:18.285037+0000","last_clean":"2024-09-14T11:59:18.285037+0000","last_became_active":"2024-09-14T10:56:47.730609+0000","last_became_peered":"2024-09-14T10:56:47.730609+0000","last_unstale":"2024-09-14T11:59:18.285037+0000","last_undegraded":"2024-09-14T11:59:18.285037+0000","last_fullsized":"2024-09-14T11:59:18.285037+0000","mapping_epoch":33,"log_start":"263'801","ondisk_log_start":"263'801","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'814","last_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_deep_scrub":"263'814","last_deep_scrub_stamp":"2024-09-14T11:59:18.284950+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.284950+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":801,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:39.729906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"263'293","reported_seq":813,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.079701+0000","last_change":"2024-09-14T11:59:17.079637+0000","last_active":"2024-09-14T11:59:17.079701+0000","last_peered":"2024-09-14T11:59:17.079701+0000","last_clean":"2024-09-14T11:59:17.079701+0000","last_became_active":"2024-09-14T10:56:49.747104+0000","last_became_peered":"2024-09-14T10:56:49.747104+0000","last_unstale":"2024-09-14T11:59:17.079701+0000","last_undegraded":"2024-09-14T11:59:17.079701+0000","last_fullsized":"2024-09-14T11:59:17.079701+0000","mapping_epoch":35,"log_start":"263'200","ondisk_log_start":"263'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'293","last_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_deep_scrub":"263'293","last_deep_scrub_stamp":"2024-09-14T11:59:17.079557+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.079557+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:32:49.126100+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":333,"num_read_kb":333,"num_write":610,"num_write_kb":200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"263'799","reported_seq":2458,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.756071+0000","last_change":"2024-09-14T11:58:48.756014+0000","last_active":"2024-09-14T11:58:48.756071+0000","last_peered":"2024-09-14T11:58:48.756071+0000","last_clean":"2024-09-14T11:58:48.756071+0000","last_became_active":"2024-09-14T10:56:41.690845+0000","last_became_peered":"2024-09-14T10:56:41.690845+0000","last_unstale":"2024-09-14T11:58:48.756071+0000","last_undegraded":"2024-09-14T11:58:48.756071+0000","last_fullsized":"2024-09-14T11:58:48.756071+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'799","last_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_deep_scrub":"263'799","last_deep_scrub_stamp":"2024-09-14T11:58:48.755922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.755922+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:53.686958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4126,"num_read_kb":3765,"num_write":1052,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"263'458","reported_seq":1184,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.129906+0000","last_change":"2024-09-14T11:58:46.129855+0000","last_active":"2024-09-14T11:58:46.129906+0000","last_peered":"2024-09-14T11:58:46.129906+0000","last_clean":"2024-09-14T11:58:46.129906+0000","last_became_active":"2024-09-14T10:56:39.692221+0000","last_became_peered":"2024-09-14T10:56:39.692221+0000","last_unstale":"2024-09-14T11:58:46.129906+0000","last_undegraded":"2024-09-14T11:58:46.129906+0000","last_fullsized":"2024-09-14T11:58:46.129906+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'458","last_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_deep_scrub":"263'458","last_deep_scrub_stamp":"2024-09-14T11:58:46.129767+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.129767+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:43.560691+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1014,"num_read_kb":14136,"num_write":1501,"num_write_kb":40169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:45.707186+0000","last_change":"2024-09-14T11:58:45.707137+0000","last_active":"2024-09-14T11:58:45.707186+0000","last_peered":"2024-09-14T11:58:45.707186+0000","last_clean":"2024-09-14T11:58:45.707186+0000","last_became_active":"2024-09-14T10:56:30.611522+0000","last_became_peered":"2024-09-14T10:56:30.611522+0000","last_unstale":"2024-09-14T11:58:45.707186+0000","last_undegraded":"2024-09-14T11:58:45.707186+0000","last_fullsized":"2024-09-14T11:58:45.707186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:45.707053+0000","last_clean_scrub_stamp":"2024-09-14T11:58:45.707053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.841690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051076699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.273723+0000","last_change":"2024-09-14T11:59:01.273664+0000","last_active":"2024-09-14T11:59:01.273723+0000","last_peered":"2024-09-14T11:59:01.273723+0000","last_clean":"2024-09-14T11:59:01.273723+0000","last_became_active":"2024-09-14T10:56:43.703007+0000","last_became_peered":"2024-09-14T10:56:43.703007+0000","last_unstale":"2024-09-14T11:59:01.273723+0000","last_undegraded":"2024-09-14T11:59:01.273723+0000","last_fullsized":"2024-09-14T11:59:01.273723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:01.273570+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.273570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:42.443452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"263'782","reported_seq":1508,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.198534+0000","last_change":"2024-09-14T11:59:08.198466+0000","last_active":"2024-09-14T11:59:08.198534+0000","last_peered":"2024-09-14T11:59:08.198534+0000","last_clean":"2024-09-14T11:59:08.198534+0000","last_became_active":"2024-09-14T10:56:45.720607+0000","last_became_peered":"2024-09-14T10:56:45.720607+0000","last_unstale":"2024-09-14T11:59:08.198534+0000","last_undegraded":"2024-09-14T11:59:08.198534+0000","last_fullsized":"2024-09-14T11:59:08.198534+0000","mapping_epoch":31,"log_start":"263'700","ondisk_log_start":"263'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'782","last_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_deep_scrub":"263'782","last_deep_scrub_stamp":"2024-09-14T11:59:08.198359+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.198359+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:08.340430+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174537,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1390,"num_read_kb":3483,"num_write":1134,"num_write_kb":959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.233728+0000","last_change":"2024-09-14T11:59:12.233637+0000","last_active":"2024-09-14T11:59:12.233728+0000","last_peered":"2024-09-14T11:59:12.233728+0000","last_clean":"2024-09-14T11:59:12.233728+0000","last_became_active":"2024-09-14T10:56:47.731097+0000","last_became_peered":"2024-09-14T10:56:47.731097+0000","last_unstale":"2024-09-14T11:59:12.233728+0000","last_undegraded":"2024-09-14T11:59:12.233728+0000","last_fullsized":"2024-09-14T11:59:12.233728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:12.233510+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.233510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:37.460007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"263'157","reported_seq":703,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.335894+0000","last_change":"2024-09-14T11:59:18.335827+0000","last_active":"2024-09-14T11:59:18.335894+0000","last_peered":"2024-09-14T11:59:18.335894+0000","last_clean":"2024-09-14T11:59:18.335894+0000","last_became_active":"2024-09-14T10:56:49.746464+0000","last_became_peered":"2024-09-14T10:56:49.746464+0000","last_unstale":"2024-09-14T11:59:18.335894+0000","last_undegraded":"2024-09-14T11:59:18.335894+0000","last_fullsized":"2024-09-14T11:59:18.335894+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'157","last_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_deep_scrub":"263'157","last_deep_scrub_stamp":"2024-09-14T11:59:18.335731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.335731+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:55.839157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":630,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":350,"num_read_kb":293,"num_write":359,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"263'169","reported_seq":724,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.122842+0000","last_change":"2024-09-14T11:59:21.122780+0000","last_active":"2024-09-14T11:59:21.122842+0000","last_peered":"2024-09-14T11:59:21.122842+0000","last_clean":"2024-09-14T11:59:21.122842+0000","last_became_active":"2024-09-14T10:56:49.746639+0000","last_became_peered":"2024-09-14T10:56:49.746639+0000","last_unstale":"2024-09-14T11:59:21.122842+0000","last_undegraded":"2024-09-14T11:59:21.122842+0000","last_fullsized":"2024-09-14T11:59:21.122842+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'169","last_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_deep_scrub":"263'169","last_deep_scrub_stamp":"2024-09-14T11:59:21.122685+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.122685+0000","objects_scrubbed":1,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:05.175454+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":235,"num_read_kb":234,"num_write":393,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"263'1125","reported_seq":2693,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.774111+0000","last_change":"2024-09-14T11:58:53.774053+0000","last_active":"2024-09-14T11:58:53.774111+0000","last_peered":"2024-09-14T11:58:53.774111+0000","last_clean":"2024-09-14T11:58:53.774111+0000","last_became_active":"2024-09-14T10:56:41.687509+0000","last_became_peered":"2024-09-14T10:56:41.687509+0000","last_unstale":"2024-09-14T11:58:53.774111+0000","last_undegraded":"2024-09-14T11:58:53.774111+0000","last_fullsized":"2024-09-14T11:58:53.774111+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1125","last_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_deep_scrub":"263'1125","last_deep_scrub_stamp":"2024-09-14T11:58:53.773964+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.773964+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":1100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:47:13.075424+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5120,"num_read_kb":4523,"num_write":1529,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"263'419","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.745614+0000","last_change":"2024-09-14T11:58:47.745556+0000","last_active":"2024-09-14T11:58:47.745614+0000","last_peered":"2024-09-14T11:58:47.745614+0000","last_clean":"2024-09-14T11:58:47.745614+0000","last_became_active":"2024-09-14T10:56:39.670420+0000","last_became_peered":"2024-09-14T10:56:39.670420+0000","last_unstale":"2024-09-14T11:58:47.745614+0000","last_undegraded":"2024-09-14T11:58:47.745614+0000","last_fullsized":"2024-09-14T11:58:47.745614+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'419","last_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_deep_scrub":"263'419","last_deep_scrub_stamp":"2024-09-14T11:58:47.745449+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.745449+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:44.093108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":639,"num_read_kb":10191,"num_write":1201,"num_write_kb":33080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":503,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.112827+0000","last_change":"2024-09-14T11:59:00.112762+0000","last_active":"2024-09-14T11:59:00.112827+0000","last_peered":"2024-09-14T11:59:00.112827+0000","last_clean":"2024-09-14T11:59:00.112827+0000","last_became_active":"2024-09-14T10:56:43.704708+0000","last_became_peered":"2024-09-14T10:56:43.704708+0000","last_unstale":"2024-09-14T11:59:00.112827+0000","last_undegraded":"2024-09-14T11:59:00.112827+0000","last_fullsized":"2024-09-14T11:59:00.112827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.112668+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.112668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:44:16.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"263'338","reported_seq":925,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.231508+0000","last_change":"2024-09-14T11:59:09.231431+0000","last_active":"2024-09-14T11:59:09.231508+0000","last_peered":"2024-09-14T11:59:09.231508+0000","last_clean":"2024-09-14T11:59:09.231508+0000","last_became_active":"2024-09-14T10:56:45.717238+0000","last_became_peered":"2024-09-14T10:56:45.717238+0000","last_unstale":"2024-09-14T11:59:09.231508+0000","last_undegraded":"2024-09-14T11:59:09.231508+0000","last_fullsized":"2024-09-14T11:59:09.231508+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:59:09.231332+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.231332+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:55.280074+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":1418,"num_write":456,"num_write_kb":402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.238890+0000","last_change":"2024-09-14T11:59:21.238818+0000","last_active":"2024-09-14T11:59:21.238890+0000","last_peered":"2024-09-14T11:59:21.238890+0000","last_clean":"2024-09-14T11:59:21.238890+0000","last_became_active":"2024-09-14T10:56:47.725197+0000","last_became_peered":"2024-09-14T10:56:47.725197+0000","last_unstale":"2024-09-14T11:59:21.238890+0000","last_undegraded":"2024-09-14T11:59:21.238890+0000","last_fullsized":"2024-09-14T11:59:21.238890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:21.238721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.238721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:05.674834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"263'145","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:25.284064+0000","last_change":"2024-09-14T11:59:25.284064+0000","last_active":"2024-09-14T11:59:25.284064+0000","last_peered":"2024-09-14T11:59:25.284064+0000","last_clean":"2024-09-14T11:59:25.284064+0000","last_became_active":"2024-09-14T10:56:49.743021+0000","last_became_peered":"2024-09-14T10:56:49.743021+0000","last_unstale":"2024-09-14T11:59:25.284064+0000","last_undegraded":"2024-09-14T11:59:25.284064+0000","last_fullsized":"2024-09-14T11:59:25.284064+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'145","last_scrub_stamp":"2024-09-14T11:59:25.283964+0000","last_deep_scrub":"263'145","last_deep_scrub_stamp":"2024-09-14T11:59:25.283964+0000","last_clean_scrub_stamp":"2024-09-14T11:59:25.283964+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:33.972463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":366,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"263'1059","reported_seq":2877,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.245877+0000","last_change":"2024-09-14T11:58:53.245818+0000","last_active":"2024-09-14T11:58:53.245877+0000","last_peered":"2024-09-14T11:58:53.245877+0000","last_clean":"2024-09-14T11:58:53.245877+0000","last_became_active":"2024-09-14T10:56:41.692445+0000","last_became_peered":"2024-09-14T10:56:41.692445+0000","last_unstale":"2024-09-14T11:58:53.245877+0000","last_undegraded":"2024-09-14T11:58:53.245877+0000","last_fullsized":"2024-09-14T11:58:53.245877+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1059","last_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_deep_scrub":"263'1059","last_deep_scrub_stamp":"2024-09-14T11:58:53.245711+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.245711+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":1000,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:12.381249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5179,"num_read_kb":4606,"num_write":1436,"num_write_kb":564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"263'438","reported_seq":1124,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.173659+0000","last_change":"2024-09-14T11:58:54.173546+0000","last_active":"2024-09-14T11:58:54.173659+0000","last_peered":"2024-09-14T11:58:54.173659+0000","last_clean":"2024-09-14T11:58:54.173659+0000","last_became_active":"2024-09-14T10:56:39.696510+0000","last_became_peered":"2024-09-14T10:56:39.696510+0000","last_unstale":"2024-09-14T11:58:54.173659+0000","last_undegraded":"2024-09-14T11:58:54.173659+0000","last_fullsized":"2024-09-14T11:58:54.173659+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'438","last_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_deep_scrub":"263'438","last_deep_scrub_stamp":"2024-09-14T11:58:54.173383+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.173383+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:17.863811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":832,"num_read_kb":46830,"num_write":1292,"num_write_kb":54563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,0,4],"acting":[7,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.197226+0000","last_change":"2024-09-14T11:59:06.197160+0000","last_active":"2024-09-14T11:59:06.197226+0000","last_peered":"2024-09-14T11:59:06.197226+0000","last_clean":"2024-09-14T11:59:06.197226+0000","last_became_active":"2024-09-14T10:56:43.695050+0000","last_became_peered":"2024-09-14T10:56:43.695050+0000","last_unstale":"2024-09-14T11:59:06.197226+0000","last_undegraded":"2024-09-14T11:59:06.197226+0000","last_fullsized":"2024-09-14T11:59:06.197226+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.197073+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.197073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:45.229151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"263'49","reported_seq":556,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.039901+0000","last_change":"2024-09-14T11:59:03.039824+0000","last_active":"2024-09-14T11:59:03.039901+0000","last_peered":"2024-09-14T11:59:03.039901+0000","last_clean":"2024-09-14T11:59:03.039901+0000","last_became_active":"2024-09-14T10:56:45.718911+0000","last_became_peered":"2024-09-14T10:56:45.718911+0000","last_unstale":"2024-09-14T11:59:03.039901+0000","last_undegraded":"2024-09-14T11:59:03.039901+0000","last_fullsized":"2024-09-14T11:59:03.039901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'49","last_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_deep_scrub":"263'49","last_deep_scrub_stamp":"2024-09-14T11:59:03.039699+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.039699+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:26.320715+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":42,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":482,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.195634+0000","last_change":"2024-09-14T11:59:15.195567+0000","last_active":"2024-09-14T11:59:15.195634+0000","last_peered":"2024-09-14T11:59:15.195634+0000","last_clean":"2024-09-14T11:59:15.195634+0000","last_became_active":"2024-09-14T10:56:47.734624+0000","last_became_peered":"2024-09-14T10:56:47.734624+0000","last_unstale":"2024-09-14T11:59:15.195634+0000","last_undegraded":"2024-09-14T11:59:15.195634+0000","last_fullsized":"2024-09-14T11:59:15.195634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:15.195475+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.195475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:39:39.566828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"263'193","reported_seq":708,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.092260+0000","last_change":"2024-09-14T11:59:20.092198+0000","last_active":"2024-09-14T11:59:20.092260+0000","last_peered":"2024-09-14T11:59:20.092260+0000","last_clean":"2024-09-14T11:59:20.092260+0000","last_became_active":"2024-09-14T10:56:49.747795+0000","last_became_peered":"2024-09-14T10:56:49.747795+0000","last_unstale":"2024-09-14T11:59:20.092260+0000","last_undegraded":"2024-09-14T11:59:20.092260+0000","last_fullsized":"2024-09-14T11:59:20.092260+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'193","last_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_deep_scrub":"263'193","last_deep_scrub_stamp":"2024-09-14T11:59:20.092085+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.092085+0000","objects_scrubbed":2,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:45.013902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":274,"num_read_kb":271,"num_write":429,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"263'556","reported_seq":2144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.329648+0000","last_change":"2024-09-14T11:58:56.329578+0000","last_active":"2024-09-14T11:58:56.329648+0000","last_peered":"2024-09-14T11:58:56.329648+0000","last_clean":"2024-09-14T11:58:56.329648+0000","last_became_active":"2024-09-14T10:56:41.695149+0000","last_became_peered":"2024-09-14T10:56:41.695149+0000","last_unstale":"2024-09-14T11:58:56.329648+0000","last_undegraded":"2024-09-14T11:58:56.329648+0000","last_fullsized":"2024-09-14T11:58:56.329648+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'556","last_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_deep_scrub":"263'556","last_deep_scrub_stamp":"2024-09-14T11:58:56.329487+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.329487+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:08:16.173830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2824,"num_read_kb":2591,"num_write":697,"num_write_kb":217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"263'400","reported_seq":1084,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.572300+0000","last_change":"2024-09-14T11:58:47.572237+0000","last_active":"2024-09-14T11:58:47.572300+0000","last_peered":"2024-09-14T11:58:47.572300+0000","last_clean":"2024-09-14T11:58:47.572300+0000","last_became_active":"2024-09-14T10:56:39.690016+0000","last_became_peered":"2024-09-14T10:56:39.690016+0000","last_unstale":"2024-09-14T11:58:47.572300+0000","last_undegraded":"2024-09-14T11:58:47.572300+0000","last_fullsized":"2024-09-14T11:58:47.572300+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'400","last_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_deep_scrub":"263'400","last_deep_scrub_stamp":"2024-09-14T11:58:47.572136+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.572136+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:10.322151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":842,"num_read_kb":27462,"num_write":1412,"num_write_kb":32109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":490,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.154895+0000","last_change":"2024-09-14T11:59:07.154840+0000","last_active":"2024-09-14T11:59:07.154895+0000","last_peered":"2024-09-14T11:59:07.154895+0000","last_clean":"2024-09-14T11:59:07.154895+0000","last_became_active":"2024-09-14T10:56:43.698336+0000","last_became_peered":"2024-09-14T10:56:43.698336+0000","last_unstale":"2024-09-14T11:59:07.154895+0000","last_undegraded":"2024-09-14T11:59:07.154895+0000","last_fullsized":"2024-09-14T11:59:07.154895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.154746+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.154746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:10.308624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"263'332","reported_seq":936,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.282894+0000","last_change":"2024-09-14T11:59:14.282815+0000","last_active":"2024-09-14T11:59:14.282894+0000","last_peered":"2024-09-14T11:59:14.282894+0000","last_clean":"2024-09-14T11:59:14.282894+0000","last_became_active":"2024-09-14T10:56:45.715492+0000","last_became_peered":"2024-09-14T10:56:45.715492+0000","last_unstale":"2024-09-14T11:59:14.282894+0000","last_undegraded":"2024-09-14T11:59:14.282894+0000","last_fullsized":"2024-09-14T11:59:14.282894+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'332","last_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_deep_scrub":"263'332","last_deep_scrub_stamp":"2024-09-14T11:59:14.282700+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.282700+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:59.118738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45306,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":542,"num_read_kb":1216,"num_write":428,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":485,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:04.733197+0000","last_change":"2024-09-14T11:59:04.733126+0000","last_active":"2024-09-14T11:59:04.733197+0000","last_peered":"2024-09-14T11:59:04.733197+0000","last_clean":"2024-09-14T11:59:04.733197+0000","last_became_active":"2024-09-14T10:56:47.732512+0000","last_became_peered":"2024-09-14T10:56:47.732512+0000","last_unstale":"2024-09-14T11:59:04.733197+0000","last_undegraded":"2024-09-14T11:59:04.733197+0000","last_fullsized":"2024-09-14T11:59:04.733197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:04.733044+0000","last_clean_scrub_stamp":"2024-09-14T11:59:04.733044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:38.911493+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"263'133","reported_seq":636,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.229832+0000","last_change":"2024-09-14T11:59:22.229765+0000","last_active":"2024-09-14T11:59:22.229832+0000","last_peered":"2024-09-14T11:59:22.229832+0000","last_clean":"2024-09-14T11:59:22.229832+0000","last_became_active":"2024-09-14T10:56:49.744687+0000","last_became_peered":"2024-09-14T10:56:49.744687+0000","last_unstale":"2024-09-14T11:59:22.229832+0000","last_undegraded":"2024-09-14T11:59:22.229832+0000","last_fullsized":"2024-09-14T11:59:22.229832+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'133","last_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_deep_scrub":"263'133","last_deep_scrub_stamp":"2024-09-14T11:59:22.229680+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.229680+0000","objects_scrubbed":1,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:51.141588+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":148,"num_read_kb":146,"num_write":309,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"263'546","reported_seq":2242,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.288427+0000","last_change":"2024-09-14T11:58:58.288352+0000","last_active":"2024-09-14T11:58:58.288427+0000","last_peered":"2024-09-14T11:58:58.288427+0000","last_clean":"2024-09-14T11:58:58.288427+0000","last_became_active":"2024-09-14T10:56:41.692127+0000","last_became_peered":"2024-09-14T10:56:41.692127+0000","last_unstale":"2024-09-14T11:58:58.288427+0000","last_undegraded":"2024-09-14T11:58:58.288427+0000","last_fullsized":"2024-09-14T11:58:58.288427+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'546","last_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_deep_scrub":"263'546","last_deep_scrub_stamp":"2024-09-14T11:58:58.288260+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.288260+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:34.628427+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2915,"num_read_kb":2704,"num_write":667,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"263'377","reported_seq":1044,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:44.149092+0000","last_change":"2024-09-14T11:58:44.149039+0000","last_active":"2024-09-14T11:58:44.149092+0000","last_peered":"2024-09-14T11:58:44.149092+0000","last_clean":"2024-09-14T11:58:44.149092+0000","last_became_active":"2024-09-14T10:56:39.690997+0000","last_became_peered":"2024-09-14T10:56:39.690997+0000","last_unstale":"2024-09-14T11:58:44.149092+0000","last_undegraded":"2024-09-14T11:58:44.149092+0000","last_fullsized":"2024-09-14T11:58:44.149092+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:44.148961+0000","last_clean_scrub_stamp":"2024-09-14T11:58:44.148961+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:02.627312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":41704,"num_write":1258,"num_write_kb":41902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.766875+0000","last_change":"2024-09-14T11:58:59.766783+0000","last_active":"2024-09-14T11:58:59.766875+0000","last_peered":"2024-09-14T11:58:59.766875+0000","last_clean":"2024-09-14T11:58:59.766875+0000","last_became_active":"2024-09-14T10:56:43.703766+0000","last_became_peered":"2024-09-14T10:56:43.703766+0000","last_unstale":"2024-09-14T11:58:59.766875+0000","last_undegraded":"2024-09-14T11:58:59.766875+0000","last_fullsized":"2024-09-14T11:58:59.766875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:59.766639+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.766639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:45.001749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"263'286","reported_seq":855,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.186784+0000","last_change":"2024-09-14T11:59:12.186708+0000","last_active":"2024-09-14T11:59:12.186784+0000","last_peered":"2024-09-14T11:59:12.186784+0000","last_clean":"2024-09-14T11:59:12.186784+0000","last_became_active":"2024-09-14T10:56:45.716445+0000","last_became_peered":"2024-09-14T10:56:45.716445+0000","last_unstale":"2024-09-14T11:59:12.186784+0000","last_undegraded":"2024-09-14T11:59:12.186784+0000","last_fullsized":"2024-09-14T11:59:12.186784+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'286","last_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_deep_scrub":"263'286","last_deep_scrub_stamp":"2024-09-14T11:59:12.186612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.186612+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:43.838896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50808,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":468,"num_read_kb":1119,"num_write":378,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.021197+0000","last_change":"2024-09-14T11:59:07.021108+0000","last_active":"2024-09-14T11:59:07.021197+0000","last_peered":"2024-09-14T11:59:07.021197+0000","last_clean":"2024-09-14T11:59:07.021197+0000","last_became_active":"2024-09-14T10:56:47.735766+0000","last_became_peered":"2024-09-14T10:56:47.735766+0000","last_unstale":"2024-09-14T11:59:07.021197+0000","last_undegraded":"2024-09-14T11:59:07.021197+0000","last_fullsized":"2024-09-14T11:59:07.021197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.021000+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.021000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:10.337668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"263'483","reported_seq":2287,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.786147+0000","last_change":"2024-09-14T11:58:55.786085+0000","last_active":"2024-09-14T11:58:55.786147+0000","last_peered":"2024-09-14T11:58:55.786147+0000","last_clean":"2024-09-14T11:58:55.786147+0000","last_became_active":"2024-09-14T10:56:41.690263+0000","last_became_peered":"2024-09-14T10:56:41.690263+0000","last_unstale":"2024-09-14T11:58:55.786147+0000","last_undegraded":"2024-09-14T11:58:55.786147+0000","last_fullsized":"2024-09-14T11:58:55.786147+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'483","last_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_deep_scrub":"263'483","last_deep_scrub_stamp":"2024-09-14T11:58:55.786005+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.786005+0000","objects_scrubbed":2,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:32.817114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3167,"num_read_kb":3029,"num_write":579,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2487,"num_omap_keys":10,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"263'309","reported_seq":966,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.219125+0000","last_change":"2024-09-14T11:58:52.219033+0000","last_active":"2024-09-14T11:58:52.219125+0000","last_peered":"2024-09-14T11:58:52.219125+0000","last_clean":"2024-09-14T11:58:52.219125+0000","last_became_active":"2024-09-14T10:56:39.679998+0000","last_became_peered":"2024-09-14T10:56:39.679998+0000","last_unstale":"2024-09-14T11:58:52.219125+0000","last_undegraded":"2024-09-14T11:58:52.219125+0000","last_fullsized":"2024-09-14T11:58:52.219125+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'309","last_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_deep_scrub":"263'309","last_deep_scrub_stamp":"2024-09-14T11:58:52.218942+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.218942+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.549674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":570,"num_read_kb":63784,"num_write":891,"num_write_kb":26404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"263'4","reported_seq":986,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.961984+0000","last_change":"2024-09-14T11:58:58.961984+0000","last_active":"2024-09-14T11:58:58.961984+0000","last_peered":"2024-09-14T11:58:58.961984+0000","last_clean":"2024-09-14T11:58:58.961984+0000","last_became_active":"2024-09-14T10:56:43.698234+0000","last_became_peered":"2024-09-14T10:56:43.698234+0000","last_unstale":"2024-09-14T11:58:58.961984+0000","last_undegraded":"2024-09-14T11:58:58.961984+0000","last_fullsized":"2024-09-14T11:58:58.961984+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-14T11:58:58.961880+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.961880+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:14:20.687210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":730,"num_read_kb":728,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"263'502","reported_seq":1144,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.080424+0000","last_change":"2024-09-14T11:59:06.080362+0000","last_active":"2024-09-14T11:59:06.080424+0000","last_peered":"2024-09-14T11:59:06.080424+0000","last_clean":"2024-09-14T11:59:06.080424+0000","last_became_active":"2024-09-14T10:56:45.720094+0000","last_became_peered":"2024-09-14T10:56:45.720094+0000","last_unstale":"2024-09-14T11:59:06.080424+0000","last_undegraded":"2024-09-14T11:59:06.080424+0000","last_fullsized":"2024-09-14T11:59:06.080424+0000","mapping_epoch":31,"log_start":"263'400","ondisk_log_start":"263'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'502","last_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_deep_scrub":"263'502","last_deep_scrub_stamp":"2024-09-14T11:59:06.080267+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.080267+0000","objects_scrubbed":6,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:09:23.259445+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98383,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":902,"num_read_kb":2267,"num_write":774,"num_write_kb":700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":483,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.393681+0000","last_change":"2024-09-14T11:59:16.393625+0000","last_active":"2024-09-14T11:59:16.393681+0000","last_peered":"2024-09-14T11:59:16.393681+0000","last_clean":"2024-09-14T11:59:16.393681+0000","last_became_active":"2024-09-14T10:56:47.731519+0000","last_became_peered":"2024-09-14T10:56:47.731519+0000","last_unstale":"2024-09-14T11:59:16.393681+0000","last_undegraded":"2024-09-14T11:59:16.393681+0000","last_fullsized":"2024-09-14T11:59:16.393681+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:16.393539+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.393539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:39.648638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"263'142","reported_seq":646,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:23.226914+0000","last_change":"2024-09-14T11:59:23.226854+0000","last_active":"2024-09-14T11:59:23.226914+0000","last_peered":"2024-09-14T11:59:23.226914+0000","last_clean":"2024-09-14T11:59:23.226914+0000","last_became_active":"2024-09-14T10:56:49.738187+0000","last_became_peered":"2024-09-14T10:56:49.738187+0000","last_unstale":"2024-09-14T11:59:23.226914+0000","last_undegraded":"2024-09-14T11:59:23.226914+0000","last_fullsized":"2024-09-14T11:59:23.226914+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'142","last_scrub_stamp":"2024-09-14T11:59:23.226760+0000","last_deep_scrub":"263'142","last_deep_scrub_stamp":"2024-09-14T11:59:23.226760+0000","last_clean_scrub_stamp":"2024-09-14T11:59:23.226760+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:38.924705+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":172,"num_read_kb":183,"num_write":307,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"263'457","reported_seq":2090,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.051229+0000","last_change":"2024-09-14T11:58:56.051229+0000","last_active":"2024-09-14T11:58:56.051229+0000","last_peered":"2024-09-14T11:58:56.051229+0000","last_clean":"2024-09-14T11:58:56.051229+0000","last_became_active":"2024-09-14T10:56:41.691103+0000","last_became_peered":"2024-09-14T10:56:41.691103+0000","last_unstale":"2024-09-14T11:58:56.051229+0000","last_undegraded":"2024-09-14T11:58:56.051229+0000","last_fullsized":"2024-09-14T11:58:56.051229+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'457","last_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_deep_scrub":"263'457","last_deep_scrub_stamp":"2024-09-14T11:58:56.051133+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.051133+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:38.593201+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2523,"num_read_kb":2383,"num_write":535,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"263'347","reported_seq":992,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.201509+0000","last_change":"2024-09-14T11:58:46.201425+0000","last_active":"2024-09-14T11:58:46.201509+0000","last_peered":"2024-09-14T11:58:46.201509+0000","last_clean":"2024-09-14T11:58:46.201509+0000","last_became_active":"2024-09-14T10:56:39.673400+0000","last_became_peered":"2024-09-14T10:56:39.673400+0000","last_unstale":"2024-09-14T11:58:46.201509+0000","last_undegraded":"2024-09-14T11:58:46.201509+0000","last_fullsized":"2024-09-14T11:58:46.201509+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'347","last_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_deep_scrub":"263'347","last_deep_scrub_stamp":"2024-09-14T11:58:46.201295+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.201295+0000","objects_scrubbed":2,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:11.588159+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":604,"num_read_kb":50717,"num_write":1053,"num_write_kb":48093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.777074+0000","last_change":"2024-09-14T11:59:00.776994+0000","last_active":"2024-09-14T11:59:00.777074+0000","last_peered":"2024-09-14T11:59:00.777074+0000","last_clean":"2024-09-14T11:59:00.777074+0000","last_became_active":"2024-09-14T10:56:43.701437+0000","last_became_peered":"2024-09-14T10:56:43.701437+0000","last_unstale":"2024-09-14T11:59:00.777074+0000","last_undegraded":"2024-09-14T11:59:00.777074+0000","last_fullsized":"2024-09-14T11:59:00.777074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:00.776887+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.776887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:11:37.705302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"263'322","reported_seq":910,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.209305+0000","last_change":"2024-09-14T11:59:13.209243+0000","last_active":"2024-09-14T11:59:13.209305+0000","last_peered":"2024-09-14T11:59:13.209305+0000","last_clean":"2024-09-14T11:59:13.209305+0000","last_became_active":"2024-09-14T10:56:45.719613+0000","last_became_peered":"2024-09-14T10:56:45.719613+0000","last_unstale":"2024-09-14T11:59:13.209305+0000","last_undegraded":"2024-09-14T11:59:13.209305+0000","last_fullsized":"2024-09-14T11:59:13.209305+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'322","last_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_deep_scrub":"263'322","last_deep_scrub_stamp":"2024-09-14T11:59:13.209134+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.209134+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:29.981909+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51994,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":540,"num_read_kb":1196,"num_write":444,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":493,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.132697+0000","last_change":"2024-09-14T11:59:10.132626+0000","last_active":"2024-09-14T11:59:10.132697+0000","last_peered":"2024-09-14T11:59:10.132697+0000","last_clean":"2024-09-14T11:59:10.132697+0000","last_became_active":"2024-09-14T10:56:47.726216+0000","last_became_peered":"2024-09-14T10:56:47.726216+0000","last_unstale":"2024-09-14T11:59:10.132697+0000","last_undegraded":"2024-09-14T11:59:10.132697+0000","last_fullsized":"2024-09-14T11:59:10.132697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.132530+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.132530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:41.624497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"263'155","reported_seq":656,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.777881+0000","last_change":"2024-09-14T11:59:09.777821+0000","last_active":"2024-09-14T11:59:09.777881+0000","last_peered":"2024-09-14T11:59:09.777881+0000","last_clean":"2024-09-14T11:59:09.777881+0000","last_became_active":"2024-09-14T10:56:49.742622+0000","last_became_peered":"2024-09-14T10:56:49.742622+0000","last_unstale":"2024-09-14T11:59:09.777881+0000","last_undegraded":"2024-09-14T11:59:09.777881+0000","last_fullsized":"2024-09-14T11:59:09.777881+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'155","last_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_deep_scrub":"263'155","last_deep_scrub_stamp":"2024-09-14T11:59:09.777731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.777731+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:44.407066+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1619,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":183,"num_write":436,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"263'557","reported_seq":2173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.195787+0000","last_change":"2024-09-14T11:59:03.195720+0000","last_active":"2024-09-14T11:59:03.195787+0000","last_peered":"2024-09-14T11:59:03.195787+0000","last_clean":"2024-09-14T11:59:03.195787+0000","last_became_active":"2024-09-14T10:56:41.685525+0000","last_became_peered":"2024-09-14T10:56:41.685525+0000","last_unstale":"2024-09-14T11:59:03.195787+0000","last_undegraded":"2024-09-14T11:59:03.195787+0000","last_fullsized":"2024-09-14T11:59:03.195787+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'557","last_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_deep_scrub":"263'557","last_deep_scrub_stamp":"2024-09-14T11:59:03.195624+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.195624+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:14.590310+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2925,"num_read_kb":2695,"num_write":700,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"263'339","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.715221+0000","last_change":"2024-09-14T11:58:46.715160+0000","last_active":"2024-09-14T11:58:46.715221+0000","last_peered":"2024-09-14T11:58:46.715221+0000","last_clean":"2024-09-14T11:58:46.715221+0000","last_became_active":"2024-09-14T10:56:39.682190+0000","last_became_peered":"2024-09-14T10:56:39.682190+0000","last_unstale":"2024-09-14T11:58:46.715221+0000","last_undegraded":"2024-09-14T11:58:46.715221+0000","last_fullsized":"2024-09-14T11:58:46.715221+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'339","last_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_deep_scrub":"263'339","last_deep_scrub_stamp":"2024-09-14T11:58:46.715001+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.715001+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.562859+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":591,"num_read_kb":82907,"num_write":1088,"num_write_kb":44688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:08.817803+0000","last_change":"2024-09-14T11:59:08.817719+0000","last_active":"2024-09-14T11:59:08.817803+0000","last_peered":"2024-09-14T11:59:08.817803+0000","last_clean":"2024-09-14T11:59:08.817803+0000","last_became_active":"2024-09-14T10:56:43.704286+0000","last_became_peered":"2024-09-14T10:56:43.704286+0000","last_unstale":"2024-09-14T11:59:08.817803+0000","last_undegraded":"2024-09-14T11:59:08.817803+0000","last_fullsized":"2024-09-14T11:59:08.817803+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:08.817631+0000","last_clean_scrub_stamp":"2024-09-14T11:59:08.817631+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:04.693866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"263'311","reported_seq":901,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:11.220153+0000","last_change":"2024-09-14T11:59:11.220081+0000","last_active":"2024-09-14T11:59:11.220153+0000","last_peered":"2024-09-14T11:59:11.220153+0000","last_clean":"2024-09-14T11:59:11.220153+0000","last_became_active":"2024-09-14T10:56:45.713124+0000","last_became_peered":"2024-09-14T10:56:45.713124+0000","last_unstale":"2024-09-14T11:59:11.220153+0000","last_undegraded":"2024-09-14T11:59:11.220153+0000","last_fullsized":"2024-09-14T11:59:11.220153+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'311","last_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_deep_scrub":"263'311","last_deep_scrub_stamp":"2024-09-14T11:59:11.219995+0000","last_clean_scrub_stamp":"2024-09-14T11:59:11.219995+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:55.442982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47483,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":491,"num_read_kb":1144,"num_write":396,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.100004+0000","last_change":"2024-09-14T11:59:07.100004+0000","last_active":"2024-09-14T11:59:07.100004+0000","last_peered":"2024-09-14T11:59:07.100004+0000","last_clean":"2024-09-14T11:59:07.100004+0000","last_became_active":"2024-09-14T10:56:47.733049+0000","last_became_peered":"2024-09-14T10:56:47.733049+0000","last_unstale":"2024-09-14T11:59:07.100004+0000","last_undegraded":"2024-09-14T11:59:07.100004+0000","last_fullsized":"2024-09-14T11:59:07.100004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.099923+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.099923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:57.135245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"263'171","reported_seq":673,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:20.261293+0000","last_change":"2024-09-14T11:59:20.261233+0000","last_active":"2024-09-14T11:59:20.261293+0000","last_peered":"2024-09-14T11:59:20.261293+0000","last_clean":"2024-09-14T11:59:20.261293+0000","last_became_active":"2024-09-14T10:56:49.745551+0000","last_became_peered":"2024-09-14T10:56:49.745551+0000","last_unstale":"2024-09-14T11:59:20.261293+0000","last_undegraded":"2024-09-14T11:59:20.261293+0000","last_fullsized":"2024-09-14T11:59:20.261293+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'171","last_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_deep_scrub":"263'171","last_deep_scrub_stamp":"2024-09-14T11:59:20.261131+0000","last_clean_scrub_stamp":"2024-09-14T11:59:20.261131+0000","objects_scrubbed":5,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:57:48.354170+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1235,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":176,"num_read_kb":155,"num_write":322,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"263'530","reported_seq":2219,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.149325+0000","last_change":"2024-09-14T11:58:51.149263+0000","last_active":"2024-09-14T11:58:51.149325+0000","last_peered":"2024-09-14T11:58:51.149325+0000","last_clean":"2024-09-14T11:58:51.149325+0000","last_became_active":"2024-09-14T10:56:41.685967+0000","last_became_peered":"2024-09-14T10:56:41.685967+0000","last_unstale":"2024-09-14T11:58:51.149325+0000","last_undegraded":"2024-09-14T11:58:51.149325+0000","last_fullsized":"2024-09-14T11:58:51.149325+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'530","last_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_deep_scrub":"263'530","last_deep_scrub_stamp":"2024-09-14T11:58:51.149169+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.149169+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:45.648421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2748,"num_read_kb":2570,"num_write":624,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"263'377","reported_seq":1039,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.124810+0000","last_change":"2024-09-14T11:58:48.124725+0000","last_active":"2024-09-14T11:58:48.124810+0000","last_peered":"2024-09-14T11:58:48.124810+0000","last_clean":"2024-09-14T11:58:48.124810+0000","last_became_active":"2024-09-14T10:57:16.216144+0000","last_became_peered":"2024-09-14T10:57:16.216144+0000","last_unstale":"2024-09-14T11:58:48.124810+0000","last_undegraded":"2024-09-14T11:58:48.124810+0000","last_fullsized":"2024-09-14T11:58:48.124810+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'377","last_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_deep_scrub":"263'377","last_deep_scrub_stamp":"2024-09-14T11:58:48.124576+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.124576+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:36.223458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":617,"num_read_kb":42073,"num_write":1144,"num_write_kb":52768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,1],"acting":[0,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.117211+0000","last_change":"2024-09-14T11:59:02.117157+0000","last_active":"2024-09-14T11:59:02.117211+0000","last_peered":"2024-09-14T11:59:02.117211+0000","last_clean":"2024-09-14T11:59:02.117211+0000","last_became_active":"2024-09-14T10:56:43.707325+0000","last_became_peered":"2024-09-14T10:56:43.707325+0000","last_unstale":"2024-09-14T11:59:02.117211+0000","last_undegraded":"2024-09-14T11:59:02.117211+0000","last_fullsized":"2024-09-14T11:59:02.117211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:02.117068+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.117068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:46.630742+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"263'108","reported_seq":650,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.745968+0000","last_change":"2024-09-14T11:59:13.745968+0000","last_active":"2024-09-14T11:59:13.745968+0000","last_peered":"2024-09-14T11:59:13.745968+0000","last_clean":"2024-09-14T11:59:13.745968+0000","last_became_active":"2024-09-14T10:56:45.722970+0000","last_became_peered":"2024-09-14T10:56:45.722970+0000","last_unstale":"2024-09-14T11:59:13.745968+0000","last_undegraded":"2024-09-14T11:59:13.745968+0000","last_fullsized":"2024-09-14T11:59:13.745968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'108","last_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_deep_scrub":"263'108","last_deep_scrub_stamp":"2024-09-14T11:59:13.745840+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.745840+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:38.399592+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":107,"num_write":84,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2688,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"263'777","reported_seq":4318,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.779729+0000","last_change":"2024-09-14T11:59:07.779669+0000","last_active":"2024-09-14T11:59:07.779729+0000","last_peered":"2024-09-14T11:59:07.779729+0000","last_clean":"2024-09-14T11:59:07.779729+0000","last_became_active":"2024-09-14T10:56:47.724753+0000","last_became_peered":"2024-09-14T10:56:47.724753+0000","last_unstale":"2024-09-14T11:59:07.779729+0000","last_undegraded":"2024-09-14T11:59:07.779729+0000","last_fullsized":"2024-09-14T11:59:07.779729+0000","mapping_epoch":33,"log_start":"263'700","ondisk_log_start":"263'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'777","last_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_deep_scrub":"263'777","last_deep_scrub_stamp":"2024-09-14T11:59:07.779585+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.779585+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":700,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:43:41.418684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"263'123","reported_seq":620,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:18.104571+0000","last_change":"2024-09-14T11:59:18.104511+0000","last_active":"2024-09-14T11:59:18.104571+0000","last_peered":"2024-09-14T11:59:18.104571+0000","last_clean":"2024-09-14T11:59:18.104571+0000","last_became_active":"2024-09-14T10:56:49.750692+0000","last_became_peered":"2024-09-14T10:56:49.750692+0000","last_unstale":"2024-09-14T11:59:18.104571+0000","last_undegraded":"2024-09-14T11:59:18.104571+0000","last_fullsized":"2024-09-14T11:59:18.104571+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'123","last_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_deep_scrub":"263'123","last_deep_scrub_stamp":"2024-09-14T11:59:18.104432+0000","last_clean_scrub_stamp":"2024-09-14T11:59:18.104432+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:04.905650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":151,"num_read_kb":141,"num_write":292,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"263'414","reported_seq":2038,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.771567+0000","last_change":"2024-09-14T11:58:56.771503+0000","last_active":"2024-09-14T11:58:56.771567+0000","last_peered":"2024-09-14T11:58:56.771567+0000","last_clean":"2024-09-14T11:58:56.771567+0000","last_became_active":"2024-09-14T10:56:41.697308+0000","last_became_peered":"2024-09-14T10:56:41.697308+0000","last_unstale":"2024-09-14T11:58:56.771567+0000","last_undegraded":"2024-09-14T11:58:56.771567+0000","last_fullsized":"2024-09-14T11:58:56.771567+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'414","last_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_deep_scrub":"263'414","last_deep_scrub_stamp":"2024-09-14T11:58:56.771427+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.771427+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":400,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:50.649246+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2313,"num_read_kb":2216,"num_write":465,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"263'292","reported_seq":887,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.632108+0000","last_change":"2024-09-14T11:58:50.632043+0000","last_active":"2024-09-14T11:58:50.632108+0000","last_peered":"2024-09-14T11:58:50.632108+0000","last_clean":"2024-09-14T11:58:50.632108+0000","last_became_active":"2024-09-14T10:56:39.680062+0000","last_became_peered":"2024-09-14T10:56:39.680062+0000","last_unstale":"2024-09-14T11:58:50.632108+0000","last_undegraded":"2024-09-14T11:58:50.632108+0000","last_fullsized":"2024-09-14T11:58:50.632108+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'292","last_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_deep_scrub":"263'292","last_deep_scrub_stamp":"2024-09-14T11:58:50.631922+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.631922+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:24.620243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":465,"num_read_kb":9665,"num_write":976,"num_write_kb":25747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:06.128127+0000","last_change":"2024-09-14T11:59:06.128064+0000","last_active":"2024-09-14T11:59:06.128127+0000","last_peered":"2024-09-14T11:59:06.128127+0000","last_clean":"2024-09-14T11:59:06.128127+0000","last_became_active":"2024-09-14T10:56:43.698275+0000","last_became_peered":"2024-09-14T10:56:43.698275+0000","last_unstale":"2024-09-14T11:59:06.128127+0000","last_undegraded":"2024-09-14T11:59:06.128127+0000","last_fullsized":"2024-09-14T11:59:06.128127+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:06.127974+0000","last_clean_scrub_stamp":"2024-09-14T11:59:06.127974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:38.733610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"263'328","reported_seq":920,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.421885+0000","last_change":"2024-09-14T11:59:14.421820+0000","last_active":"2024-09-14T11:59:14.421885+0000","last_peered":"2024-09-14T11:59:14.421885+0000","last_clean":"2024-09-14T11:59:14.421885+0000","last_became_active":"2024-09-14T10:56:45.718506+0000","last_became_peered":"2024-09-14T10:56:45.718506+0000","last_unstale":"2024-09-14T11:59:14.421885+0000","last_undegraded":"2024-09-14T11:59:14.421885+0000","last_fullsized":"2024-09-14T11:59:14.421885+0000","mapping_epoch":31,"log_start":"263'300","ondisk_log_start":"263'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'328","last_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_deep_scrub":"263'328","last_deep_scrub_stamp":"2024-09-14T11:59:14.421721+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.421721+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:18.045444+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53922,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1127,"num_write":414,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":488,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:10.066673+0000","last_change":"2024-09-14T11:59:10.066601+0000","last_active":"2024-09-14T11:59:10.066673+0000","last_peered":"2024-09-14T11:59:10.066673+0000","last_clean":"2024-09-14T11:59:10.066673+0000","last_became_active":"2024-09-14T10:56:47.733075+0000","last_became_peered":"2024-09-14T10:56:47.733075+0000","last_unstale":"2024-09-14T11:59:10.066673+0000","last_undegraded":"2024-09-14T11:59:10.066673+0000","last_fullsized":"2024-09-14T11:59:10.066673+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:10.066508+0000","last_clean_scrub_stamp":"2024-09-14T11:59:10.066508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:11:04.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"263'127","reported_seq":626,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:19.116100+0000","last_change":"2024-09-14T11:59:19.116026+0000","last_active":"2024-09-14T11:59:19.116100+0000","last_peered":"2024-09-14T11:59:19.116100+0000","last_clean":"2024-09-14T11:59:19.116100+0000","last_became_active":"2024-09-14T10:56:49.749442+0000","last_became_peered":"2024-09-14T10:56:49.749442+0000","last_unstale":"2024-09-14T11:59:19.116100+0000","last_undegraded":"2024-09-14T11:59:19.116100+0000","last_fullsized":"2024-09-14T11:59:19.116100+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'127","last_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_deep_scrub":"263'127","last_deep_scrub_stamp":"2024-09-14T11:59:19.115921+0000","last_clean_scrub_stamp":"2024-09-14T11:59:19.115921+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:59.392234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":169,"num_read_kb":154,"num_write":309,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"263'399","reported_seq":1845,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.798794+0000","last_change":"2024-09-14T11:58:57.798697+0000","last_active":"2024-09-14T11:58:57.798794+0000","last_peered":"2024-09-14T11:58:57.798794+0000","last_clean":"2024-09-14T11:58:57.798794+0000","last_became_active":"2024-09-14T10:56:41.694971+0000","last_became_peered":"2024-09-14T10:56:41.694971+0000","last_unstale":"2024-09-14T11:58:57.798794+0000","last_undegraded":"2024-09-14T11:58:57.798794+0000","last_fullsized":"2024-09-14T11:58:57.798794+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'399","last_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_deep_scrub":"263'399","last_deep_scrub_stamp":"2024-09-14T11:58:57.798592+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.798592+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:10.547579+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2159,"num_read_kb":2030,"num_write":458,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"263'329","reported_seq":979,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.595764+0000","last_change":"2024-09-14T11:58:49.595701+0000","last_active":"2024-09-14T11:58:49.595764+0000","last_peered":"2024-09-14T11:58:49.595764+0000","last_clean":"2024-09-14T11:58:49.595764+0000","last_became_active":"2024-09-14T10:56:39.680957+0000","last_became_peered":"2024-09-14T10:56:39.680957+0000","last_unstale":"2024-09-14T11:58:49.595764+0000","last_undegraded":"2024-09-14T11:58:49.595764+0000","last_fullsized":"2024-09-14T11:58:49.595764+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'329","last_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_deep_scrub":"263'329","last_deep_scrub_stamp":"2024-09-14T11:58:49.595597+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.595597+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:36:05.088352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":577,"num_read_kb":29813,"num_write":1080,"num_write_kb":25146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":491,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.564191+0000","last_change":"2024-09-14T11:59:09.564131+0000","last_active":"2024-09-14T11:59:09.564191+0000","last_peered":"2024-09-14T11:59:09.564191+0000","last_clean":"2024-09-14T11:59:09.564191+0000","last_became_active":"2024-09-14T10:56:43.698085+0000","last_became_peered":"2024-09-14T10:56:43.698085+0000","last_unstale":"2024-09-14T11:59:09.564191+0000","last_undegraded":"2024-09-14T11:59:09.564191+0000","last_fullsized":"2024-09-14T11:59:09.564191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:09.564019+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.564019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:59.535304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"263'289","reported_seq":864,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:09.080150+0000","last_change":"2024-09-14T11:59:09.080079+0000","last_active":"2024-09-14T11:59:09.080150+0000","last_peered":"2024-09-14T11:59:09.080150+0000","last_clean":"2024-09-14T11:59:09.080150+0000","last_became_active":"2024-09-14T10:56:45.713950+0000","last_became_peered":"2024-09-14T10:56:45.713950+0000","last_unstale":"2024-09-14T11:59:09.080150+0000","last_undegraded":"2024-09-14T11:59:09.080150+0000","last_fullsized":"2024-09-14T11:59:09.080150+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'289","last_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_deep_scrub":"263'289","last_deep_scrub_stamp":"2024-09-14T11:59:09.079948+0000","last_clean_scrub_stamp":"2024-09-14T11:59:09.079948+0000","objects_scrubbed":4,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:36.756322+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":470,"num_read_kb":1140,"num_write":380,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":484,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.776007+0000","last_change":"2024-09-14T11:59:05.775934+0000","last_active":"2024-09-14T11:59:05.776007+0000","last_peered":"2024-09-14T11:59:05.776007+0000","last_clean":"2024-09-14T11:59:05.776007+0000","last_became_active":"2024-09-14T10:56:47.734781+0000","last_became_peered":"2024-09-14T10:56:47.734781+0000","last_unstale":"2024-09-14T11:59:05.776007+0000","last_undegraded":"2024-09-14T11:59:05.776007+0000","last_fullsized":"2024-09-14T11:59:05.776007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:05.775845+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.775845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:06.480989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"263'106","reported_seq":625,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:22.239560+0000","last_change":"2024-09-14T11:59:22.239465+0000","last_active":"2024-09-14T11:59:22.239560+0000","last_peered":"2024-09-14T11:59:22.239560+0000","last_clean":"2024-09-14T11:59:22.239560+0000","last_became_active":"2024-09-14T10:56:49.737637+0000","last_became_peered":"2024-09-14T10:56:49.737637+0000","last_unstale":"2024-09-14T11:59:22.239560+0000","last_undegraded":"2024-09-14T11:59:22.239560+0000","last_fullsized":"2024-09-14T11:59:22.239560+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'106","last_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_deep_scrub":"263'106","last_deep_scrub_stamp":"2024-09-14T11:59:22.239338+0000","last_clean_scrub_stamp":"2024-09-14T11:59:22.239338+0000","objects_scrubbed":1,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:32.855003+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":151,"num_write":265,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"263'353","reported_seq":1790,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.647791+0000","last_change":"2024-09-14T11:59:01.647791+0000","last_active":"2024-09-14T11:59:01.647791+0000","last_peered":"2024-09-14T11:59:01.647791+0000","last_clean":"2024-09-14T11:59:01.647791+0000","last_became_active":"2024-09-14T10:57:15.793509+0000","last_became_peered":"2024-09-14T10:57:15.793509+0000","last_unstale":"2024-09-14T11:59:01.647791+0000","last_undegraded":"2024-09-14T11:59:01.647791+0000","last_fullsized":"2024-09-14T11:59:01.647791+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'353","last_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_deep_scrub":"263'353","last_deep_scrub_stamp":"2024-09-14T11:59:01.647703+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.647703+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:52.541769+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1979,"num_read_kb":1902,"num_write":390,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"263'405","reported_seq":1077,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.374616+0000","last_change":"2024-09-14T11:58:46.374551+0000","last_active":"2024-09-14T11:58:46.374616+0000","last_peered":"2024-09-14T11:58:46.374616+0000","last_clean":"2024-09-14T11:58:46.374616+0000","last_became_active":"2024-09-14T10:56:39.693375+0000","last_became_peered":"2024-09-14T10:56:39.693375+0000","last_unstale":"2024-09-14T11:58:46.374616+0000","last_undegraded":"2024-09-14T11:58:46.374616+0000","last_fullsized":"2024-09-14T11:58:46.374616+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'405","last_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_deep_scrub":"263'405","last_deep_scrub_stamp":"2024-09-14T11:58:46.374434+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.374434+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:59.892127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":727,"num_read_kb":11025,"num_write":1267,"num_write_kb":47290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:07.860273+0000","last_change":"2024-09-14T11:59:07.860193+0000","last_active":"2024-09-14T11:59:07.860273+0000","last_peered":"2024-09-14T11:59:07.860273+0000","last_clean":"2024-09-14T11:59:07.860273+0000","last_became_active":"2024-09-14T10:56:43.701581+0000","last_became_peered":"2024-09-14T10:56:43.701581+0000","last_unstale":"2024-09-14T11:59:07.860273+0000","last_undegraded":"2024-09-14T11:59:07.860273+0000","last_fullsized":"2024-09-14T11:59:07.860273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:07.860100+0000","last_clean_scrub_stamp":"2024-09-14T11:59:07.860100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:58.269568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"263'240","reported_seq":804,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:15.311259+0000","last_change":"2024-09-14T11:59:15.311185+0000","last_active":"2024-09-14T11:59:15.311259+0000","last_peered":"2024-09-14T11:59:15.311259+0000","last_clean":"2024-09-14T11:59:15.311259+0000","last_became_active":"2024-09-14T10:56:45.717085+0000","last_became_peered":"2024-09-14T10:56:45.717085+0000","last_unstale":"2024-09-14T11:59:15.311259+0000","last_undegraded":"2024-09-14T11:59:15.311259+0000","last_fullsized":"2024-09-14T11:59:15.311259+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'240","last_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_deep_scrub":"263'240","last_deep_scrub_stamp":"2024-09-14T11:59:15.311087+0000","last_clean_scrub_stamp":"2024-09-14T11:59:15.311087+0000","objects_scrubbed":3,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:06.682204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":992,"num_write":326,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:17.725892+0000","last_change":"2024-09-14T11:59:17.725830+0000","last_active":"2024-09-14T11:59:17.725892+0000","last_peered":"2024-09-14T11:59:17.725892+0000","last_clean":"2024-09-14T11:59:17.725892+0000","last_became_active":"2024-09-14T10:56:47.727293+0000","last_became_peered":"2024-09-14T10:56:47.727293+0000","last_unstale":"2024-09-14T11:59:17.725892+0000","last_undegraded":"2024-09-14T11:59:17.725892+0000","last_fullsized":"2024-09-14T11:59:17.725892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:17.725743+0000","last_clean_scrub_stamp":"2024-09-14T11:59:17.725743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:34.728408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"263'165","reported_seq":1629,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:21.140834+0000","last_change":"2024-09-14T11:59:21.140772+0000","last_active":"2024-09-14T11:59:21.140834+0000","last_peered":"2024-09-14T11:59:21.140834+0000","last_clean":"2024-09-14T11:59:21.140834+0000","last_became_active":"2024-09-14T10:56:49.749041+0000","last_became_peered":"2024-09-14T10:56:49.749041+0000","last_unstale":"2024-09-14T11:59:21.140834+0000","last_undegraded":"2024-09-14T11:59:21.140834+0000","last_fullsized":"2024-09-14T11:59:21.140834+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'165","last_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_deep_scrub":"263'165","last_deep_scrub_stamp":"2024-09-14T11:59:21.140669+0000","last_clean_scrub_stamp":"2024-09-14T11:59:21.140669+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:41.420270+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":680,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1196,"num_read_kb":1186,"num_write":368,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"263'472","reported_seq":2236,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.777136+0000","last_change":"2024-09-14T11:58:55.777077+0000","last_active":"2024-09-14T11:58:55.777136+0000","last_peered":"2024-09-14T11:58:55.777136+0000","last_clean":"2024-09-14T11:58:55.777136+0000","last_became_active":"2024-09-14T10:56:41.687271+0000","last_became_peered":"2024-09-14T10:56:41.687271+0000","last_unstale":"2024-09-14T11:58:55.777136+0000","last_undegraded":"2024-09-14T11:58:55.777136+0000","last_fullsized":"2024-09-14T11:58:55.777136+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'472","last_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_deep_scrub":"263'472","last_deep_scrub_stamp":"2024-09-14T11:58:55.776981+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.776981+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:11:44.267879+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2631,"num_write":538,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2936,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"263'401","reported_seq":1075,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.196208+0000","last_change":"2024-09-14T11:58:47.196149+0000","last_active":"2024-09-14T11:58:47.196208+0000","last_peered":"2024-09-14T11:58:47.196208+0000","last_clean":"2024-09-14T11:58:47.196208+0000","last_became_active":"2024-09-14T10:57:16.215420+0000","last_became_peered":"2024-09-14T10:57:16.215420+0000","last_unstale":"2024-09-14T11:58:47.196208+0000","last_undegraded":"2024-09-14T11:58:47.196208+0000","last_fullsized":"2024-09-14T11:58:47.196208+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'401","last_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_deep_scrub":"263'401","last_deep_scrub_stamp":"2024-09-14T11:58:47.196028+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.196028+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:01:09.718768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":747,"num_read_kb":46945,"num_write":1297,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"263'2","reported_seq":504,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:01.080596+0000","last_change":"2024-09-14T11:59:01.080514+0000","last_active":"2024-09-14T11:59:01.080596+0000","last_peered":"2024-09-14T11:59:01.080596+0000","last_clean":"2024-09-14T11:59:01.080596+0000","last_became_active":"2024-09-14T10:56:43.704156+0000","last_became_peered":"2024-09-14T10:56:43.704156+0000","last_unstale":"2024-09-14T11:59:01.080596+0000","last_undegraded":"2024-09-14T11:59:01.080596+0000","last_fullsized":"2024-09-14T11:59:01.080596+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-14T11:59:01.080425+0000","last_clean_scrub_stamp":"2024-09-14T11:59:01.080425+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:29:41.322185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"263'305","reported_seq":905,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.789404+0000","last_change":"2024-09-14T11:59:12.789300+0000","last_active":"2024-09-14T11:59:12.789404+0000","last_peered":"2024-09-14T11:59:12.789404+0000","last_clean":"2024-09-14T11:59:12.789404+0000","last_became_active":"2024-09-14T10:56:45.719876+0000","last_became_peered":"2024-09-14T10:56:45.719876+0000","last_unstale":"2024-09-14T11:59:12.789404+0000","last_undegraded":"2024-09-14T11:59:12.789404+0000","last_fullsized":"2024-09-14T11:59:12.789404+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'305","last_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_deep_scrub":"263'305","last_deep_scrub_stamp":"2024-09-14T11:59:12.789182+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.789182+0000","objects_scrubbed":4,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:43.211846+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":486,"num_read_kb":1073,"num_write":380,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:14.117611+0000","last_change":"2024-09-14T11:59:14.117549+0000","last_active":"2024-09-14T11:59:14.117611+0000","last_peered":"2024-09-14T11:59:14.117611+0000","last_clean":"2024-09-14T11:59:14.117611+0000","last_became_active":"2024-09-14T10:56:47.735699+0000","last_became_peered":"2024-09-14T10:56:47.735699+0000","last_unstale":"2024-09-14T11:59:14.117611+0000","last_undegraded":"2024-09-14T11:59:14.117611+0000","last_fullsized":"2024-09-14T11:59:14.117611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:59:14.117458+0000","last_clean_scrub_stamp":"2024-09-14T11:59:14.117458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:26.797657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"263'137","reported_seq":662,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:16.714249+0000","last_change":"2024-09-14T11:59:16.714249+0000","last_active":"2024-09-14T11:59:16.714249+0000","last_peered":"2024-09-14T11:59:16.714249+0000","last_clean":"2024-09-14T11:59:16.714249+0000","last_became_active":"2024-09-14T10:56:49.746955+0000","last_became_peered":"2024-09-14T10:56:49.746955+0000","last_unstale":"2024-09-14T11:59:16.714249+0000","last_undegraded":"2024-09-14T11:59:16.714249+0000","last_fullsized":"2024-09-14T11:59:16.714249+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'137","last_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_deep_scrub":"263'137","last_deep_scrub_stamp":"2024-09-14T11:59:16.714152+0000","last_clean_scrub_stamp":"2024-09-14T11:59:16.714152+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:50.948493+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":235,"num_read_kb":199,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"263'586","reported_seq":2266,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:56.175710+0000","last_change":"2024-09-14T11:58:56.175638+0000","last_active":"2024-09-14T11:58:56.175710+0000","last_peered":"2024-09-14T11:58:56.175710+0000","last_clean":"2024-09-14T11:58:56.175710+0000","last_became_active":"2024-09-14T10:56:41.697410+0000","last_became_peered":"2024-09-14T10:56:41.697410+0000","last_unstale":"2024-09-14T11:58:56.175710+0000","last_undegraded":"2024-09-14T11:58:56.175710+0000","last_fullsized":"2024-09-14T11:58:56.175710+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'586","last_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_deep_scrub":"263'586","last_deep_scrub_stamp":"2024-09-14T11:58:56.175551+0000","last_clean_scrub_stamp":"2024-09-14T11:58:56.175551+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:06.302948+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3176,"num_read_kb":2908,"num_write":752,"num_write_kb":228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2003,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"263'351","reported_seq":1033,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.760102+0000","last_change":"2024-09-14T11:58:49.760006+0000","last_active":"2024-09-14T11:58:49.760102+0000","last_peered":"2024-09-14T11:58:49.760102+0000","last_clean":"2024-09-14T11:58:49.760102+0000","last_became_active":"2024-09-14T10:56:39.672790+0000","last_became_peered":"2024-09-14T10:56:39.672790+0000","last_unstale":"2024-09-14T11:58:49.760102+0000","last_undegraded":"2024-09-14T11:58:49.760102+0000","last_fullsized":"2024-09-14T11:58:49.760102+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'351","last_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_deep_scrub":"263'351","last_deep_scrub_stamp":"2024-09-14T11:58:49.759805+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.759805+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:27.741535+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730144,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":646,"num_read_kb":60949,"num_write":1082,"num_write_kb":29322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"263'1054","reported_seq":2944,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.153388+0000","last_change":"2024-09-14T11:58:58.153320+0000","last_active":"2024-09-14T11:58:58.153388+0000","last_peered":"2024-09-14T11:58:58.153388+0000","last_clean":"2024-09-14T11:58:58.153388+0000","last_became_active":"2024-09-14T10:56:41.690192+0000","last_became_peered":"2024-09-14T10:56:41.690192+0000","last_unstale":"2024-09-14T11:58:58.153388+0000","last_undegraded":"2024-09-14T11:58:58.153388+0000","last_fullsized":"2024-09-14T11:58:58.153388+0000","mapping_epoch":27,"log_start":"263'1000","ondisk_log_start":"263'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1054","last_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_deep_scrub":"263'1054","last_deep_scrub_stamp":"2024-09-14T11:58:58.153235+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.153235+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":1000,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:25.111446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5249,"num_read_kb":4703,"num_write":1459,"num_write_kb":594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3040,"num_omap_keys":12,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"263'359","reported_seq":1025,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:46.165462+0000","last_change":"2024-09-14T11:58:46.165361+0000","last_active":"2024-09-14T11:58:46.165462+0000","last_peered":"2024-09-14T11:58:46.165462+0000","last_clean":"2024-09-14T11:58:46.165462+0000","last_became_active":"2024-09-14T10:56:39.682564+0000","last_became_peered":"2024-09-14T10:56:39.682564+0000","last_unstale":"2024-09-14T11:58:46.165462+0000","last_undegraded":"2024-09-14T11:58:46.165462+0000","last_fullsized":"2024-09-14T11:58:46.165462+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:46.165246+0000","last_clean_scrub_stamp":"2024-09-14T11:58:46.165246+0000","objects_scrubbed":6,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:16.126478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":628,"num_read_kb":22760,"num_write":1134,"num_write_kb":50185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"263'1000","reported_seq":2623,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.625700+0000","last_change":"2024-09-14T11:59:00.625634+0000","last_active":"2024-09-14T11:59:00.625700+0000","last_peered":"2024-09-14T11:59:00.625700+0000","last_clean":"2024-09-14T11:59:00.625700+0000","last_became_active":"2024-09-14T10:56:41.689649+0000","last_became_peered":"2024-09-14T10:56:41.689649+0000","last_unstale":"2024-09-14T11:59:00.625700+0000","last_undegraded":"2024-09-14T11:59:00.625700+0000","last_fullsized":"2024-09-14T11:59:00.625700+0000","mapping_epoch":27,"log_start":"263'900","ondisk_log_start":"263'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1000","last_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_deep_scrub":"263'1000","last_deep_scrub_stamp":"2024-09-14T11:59:00.625532+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.625532+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":900,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:45.706881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4610,"num_read_kb":4085,"num_write":1343,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"263'338","reported_seq":1079,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:51.660072+0000","last_change":"2024-09-14T11:58:51.659978+0000","last_active":"2024-09-14T11:58:51.660072+0000","last_peered":"2024-09-14T11:58:51.660072+0000","last_clean":"2024-09-14T11:58:51.660072+0000","last_became_active":"2024-09-14T10:56:39.691149+0000","last_became_peered":"2024-09-14T10:56:39.691149+0000","last_unstale":"2024-09-14T11:58:51.660072+0000","last_undegraded":"2024-09-14T11:58:51.660072+0000","last_fullsized":"2024-09-14T11:58:51.660072+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'338","last_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_deep_scrub":"263'338","last_deep_scrub_stamp":"2024-09-14T11:58:51.659787+0000","last_clean_scrub_stamp":"2024-09-14T11:58:51.659787+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:18.224027+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460204,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":988,"num_read_kb":42151,"num_write":1083,"num_write_kb":33234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"263'861","reported_seq":2452,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:57.135105+0000","last_change":"2024-09-14T11:58:57.135043+0000","last_active":"2024-09-14T11:58:57.135105+0000","last_peered":"2024-09-14T11:58:57.135105+0000","last_clean":"2024-09-14T11:58:57.135105+0000","last_became_active":"2024-09-14T10:56:41.689060+0000","last_became_peered":"2024-09-14T10:56:41.689060+0000","last_unstale":"2024-09-14T11:58:57.135105+0000","last_undegraded":"2024-09-14T11:58:57.135105+0000","last_fullsized":"2024-09-14T11:58:57.135105+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'861","last_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_deep_scrub":"263'861","last_deep_scrub_stamp":"2024-09-14T11:58:57.134958+0000","last_clean_scrub_stamp":"2024-09-14T11:58:57.134958+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":800,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:38.253599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4023,"num_read_kb":3603,"num_write":1133,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"263'372","reported_seq":1082,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.137502+0000","last_change":"2024-09-14T11:58:50.137399+0000","last_active":"2024-09-14T11:58:50.137502+0000","last_peered":"2024-09-14T11:58:50.137502+0000","last_clean":"2024-09-14T11:58:50.137502+0000","last_became_active":"2024-09-14T10:56:39.690954+0000","last_became_peered":"2024-09-14T10:56:39.690954+0000","last_unstale":"2024-09-14T11:58:50.137502+0000","last_undegraded":"2024-09-14T11:58:50.137502+0000","last_fullsized":"2024-09-14T11:58:50.137502+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'372","last_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_deep_scrub":"263'372","last_deep_scrub_stamp":"2024-09-14T11:58:50.137192+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.137192+0000","objects_scrubbed":7,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:56.624534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":875,"num_read_kb":14120,"num_write":1246,"num_write_kb":27949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"263'1638","reported_seq":3367,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.242879+0000","last_change":"2024-09-14T11:59:02.242786+0000","last_active":"2024-09-14T11:59:02.242879+0000","last_peered":"2024-09-14T11:59:02.242879+0000","last_clean":"2024-09-14T11:59:02.242879+0000","last_became_active":"2024-09-14T10:56:41.696301+0000","last_became_peered":"2024-09-14T10:56:41.696301+0000","last_unstale":"2024-09-14T11:59:02.242879+0000","last_undegraded":"2024-09-14T11:59:02.242879+0000","last_fullsized":"2024-09-14T11:59:02.242879+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1638","last_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_deep_scrub":"263'1638","last_deep_scrub_stamp":"2024-09-14T11:59:02.242676+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.242676+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":1600,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:30.360125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":7564,"num_read_kb":6631,"num_write":2292,"num_write_kb":993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":478,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"263'410","reported_seq":1080,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.363215+0000","last_change":"2024-09-14T11:58:47.363150+0000","last_active":"2024-09-14T11:58:47.363215+0000","last_peered":"2024-09-14T11:58:47.363215+0000","last_clean":"2024-09-14T11:58:47.363215+0000","last_became_active":"2024-09-14T10:56:39.676187+0000","last_became_peered":"2024-09-14T10:56:39.676187+0000","last_unstale":"2024-09-14T11:58:47.363215+0000","last_undegraded":"2024-09-14T11:58:47.363215+0000","last_fullsized":"2024-09-14T11:58:47.363215+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:58:47.363039+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.363039+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:01.895164+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":770,"num_read_kb":3391,"num_write":1187,"num_write_kb":29341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"263'527","reported_seq":2249,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:02.787198+0000","last_change":"2024-09-14T11:59:02.787143+0000","last_active":"2024-09-14T11:59:02.787198+0000","last_peered":"2024-09-14T11:59:02.787198+0000","last_clean":"2024-09-14T11:59:02.787198+0000","last_became_active":"2024-09-14T10:56:41.687243+0000","last_became_peered":"2024-09-14T10:56:41.687243+0000","last_unstale":"2024-09-14T11:59:02.787198+0000","last_undegraded":"2024-09-14T11:59:02.787198+0000","last_fullsized":"2024-09-14T11:59:02.787198+0000","mapping_epoch":27,"log_start":"263'500","ondisk_log_start":"263'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'527","last_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_deep_scrub":"263'527","last_deep_scrub_stamp":"2024-09-14T11:59:02.787058+0000","last_clean_scrub_stamp":"2024-09-14T11:59:02.787058+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:30.375500+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2838,"num_read_kb":2654,"num_write":634,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"263'413","reported_seq":1161,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:47.188464+0000","last_change":"2024-09-14T11:58:47.188393+0000","last_active":"2024-09-14T11:58:47.188464+0000","last_peered":"2024-09-14T11:58:47.188464+0000","last_clean":"2024-09-14T11:58:47.188464+0000","last_became_active":"2024-09-14T10:56:39.671222+0000","last_became_peered":"2024-09-14T10:56:39.671222+0000","last_unstale":"2024-09-14T11:58:47.188464+0000","last_undegraded":"2024-09-14T11:58:47.188464+0000","last_fullsized":"2024-09-14T11:58:47.188464+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'413","last_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_deep_scrub":"263'413","last_deep_scrub_stamp":"2024-09-14T11:58:47.188302+0000","last_clean_scrub_stamp":"2024-09-14T11:58:47.188302+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:16.690313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1077,"num_read_kb":5071,"num_write":1242,"num_write_kb":36681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"263'776","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.236909+0000","last_change":"2024-09-14T11:59:00.236838+0000","last_active":"2024-09-14T11:59:00.236909+0000","last_peered":"2024-09-14T11:59:00.236909+0000","last_clean":"2024-09-14T11:59:00.236909+0000","last_became_active":"2024-09-14T10:56:41.691391+0000","last_became_peered":"2024-09-14T10:56:41.691391+0000","last_unstale":"2024-09-14T11:59:00.236909+0000","last_undegraded":"2024-09-14T11:59:00.236909+0000","last_fullsized":"2024-09-14T11:59:00.236909+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'776","last_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_deep_scrub":"263'776","last_deep_scrub_stamp":"2024-09-14T11:59:00.236741+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.236741+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:54.394852+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3686,"num_read_kb":3338,"num_write":1018,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"263'362","reported_seq":1002,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.715869+0000","last_change":"2024-09-14T11:58:48.715807+0000","last_active":"2024-09-14T11:58:48.715869+0000","last_peered":"2024-09-14T11:58:48.715869+0000","last_clean":"2024-09-14T11:58:48.715869+0000","last_became_active":"2024-09-14T10:56:39.686213+0000","last_became_peered":"2024-09-14T10:56:39.686213+0000","last_unstale":"2024-09-14T11:58:48.715869+0000","last_undegraded":"2024-09-14T11:58:48.715869+0000","last_fullsized":"2024-09-14T11:58:48.715869+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'362","last_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_deep_scrub":"263'362","last_deep_scrub_stamp":"2024-09-14T11:58:48.715659+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.715659+0000","objects_scrubbed":6,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:22.302518+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":616,"num_read_kb":6911,"num_write":1146,"num_write_kb":15889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"263'416","reported_seq":1956,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.754902+0000","last_change":"2024-09-14T11:58:54.754848+0000","last_active":"2024-09-14T11:58:54.754902+0000","last_peered":"2024-09-14T11:58:54.754902+0000","last_clean":"2024-09-14T11:58:54.754902+0000","last_became_active":"2024-09-14T10:56:41.685389+0000","last_became_peered":"2024-09-14T10:56:41.685389+0000","last_unstale":"2024-09-14T11:58:54.754902+0000","last_undegraded":"2024-09-14T11:58:54.754902+0000","last_fullsized":"2024-09-14T11:58:54.754902+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'416","last_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_deep_scrub":"263'416","last_deep_scrub_stamp":"2024-09-14T11:58:54.754764+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.754764+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:57.847444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2182,"num_read_kb":2084,"num_write":461,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":273,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"263'437","reported_seq":1306,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.244343+0000","last_change":"2024-09-14T11:58:53.244256+0000","last_active":"2024-09-14T11:58:53.244343+0000","last_peered":"2024-09-14T11:58:53.244343+0000","last_clean":"2024-09-14T11:58:53.244343+0000","last_became_active":"2024-09-14T10:56:39.676629+0000","last_became_peered":"2024-09-14T10:56:39.676629+0000","last_unstale":"2024-09-14T11:58:53.244343+0000","last_undegraded":"2024-09-14T11:58:53.244343+0000","last_fullsized":"2024-09-14T11:58:53.244343+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'437","last_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_deep_scrub":"263'437","last_deep_scrub_stamp":"2024-09-14T11:58:53.244161+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.244161+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.178653+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1316,"num_read_kb":48095,"num_write":1372,"num_write_kb":34620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"263'719","reported_seq":2058,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:13.085668+0000","last_change":"2024-09-14T11:59:13.085584+0000","last_active":"2024-09-14T11:59:13.085668+0000","last_peered":"2024-09-14T11:59:13.085668+0000","last_clean":"2024-09-14T11:59:13.085668+0000","last_became_active":"2024-09-14T10:56:41.696618+0000","last_became_peered":"2024-09-14T10:56:41.696618+0000","last_unstale":"2024-09-14T11:59:13.085668+0000","last_undegraded":"2024-09-14T11:59:13.085668+0000","last_fullsized":"2024-09-14T11:59:13.085668+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'719","last_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_deep_scrub":"263'719","last_deep_scrub_stamp":"2024-09-14T11:59:13.085497+0000","last_clean_scrub_stamp":"2024-09-14T11:59:13.085497+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":700,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:27:04.036153+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3297,"num_read_kb":2945,"num_write":925,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"263'420","reported_seq":1133,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.700339+0000","last_change":"2024-09-14T11:58:52.700278+0000","last_active":"2024-09-14T11:58:52.700339+0000","last_peered":"2024-09-14T11:58:52.700339+0000","last_clean":"2024-09-14T11:58:52.700339+0000","last_became_active":"2024-09-14T10:56:39.680317+0000","last_became_peered":"2024-09-14T10:56:39.680317+0000","last_unstale":"2024-09-14T11:58:52.700339+0000","last_undegraded":"2024-09-14T11:58:52.700339+0000","last_fullsized":"2024-09-14T11:58:52.700339+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'420","last_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_deep_scrub":"263'420","last_deep_scrub_stamp":"2024-09-14T11:58:52.700176+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.700176+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:03.862543+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":12822,"num_write":1366,"num_write_kb":36562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"263'499","reported_seq":2147,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.765045+0000","last_change":"2024-09-14T11:59:00.764942+0000","last_active":"2024-09-14T11:59:00.765045+0000","last_peered":"2024-09-14T11:59:00.765045+0000","last_clean":"2024-09-14T11:59:00.765045+0000","last_became_active":"2024-09-14T10:56:41.694093+0000","last_became_peered":"2024-09-14T10:56:41.694093+0000","last_unstale":"2024-09-14T11:59:00.765045+0000","last_undegraded":"2024-09-14T11:59:00.765045+0000","last_fullsized":"2024-09-14T11:59:00.765045+0000","mapping_epoch":27,"log_start":"263'400","ondisk_log_start":"263'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'499","last_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_deep_scrub":"263'499","last_deep_scrub_stamp":"2024-09-14T11:59:00.764847+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.764847+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:24.807051+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2742,"num_read_kb":2577,"num_write":644,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"263'451","reported_seq":1300,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.271784+0000","last_change":"2024-09-14T11:58:49.271709+0000","last_active":"2024-09-14T11:58:49.271784+0000","last_peered":"2024-09-14T11:58:49.271784+0000","last_clean":"2024-09-14T11:58:49.271784+0000","last_became_active":"2024-09-14T10:56:39.679417+0000","last_became_peered":"2024-09-14T10:56:39.679417+0000","last_unstale":"2024-09-14T11:58:49.271784+0000","last_undegraded":"2024-09-14T11:58:49.271784+0000","last_fullsized":"2024-09-14T11:58:49.271784+0000","mapping_epoch":25,"log_start":"263'400","ondisk_log_start":"263'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'451","last_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_deep_scrub":"263'451","last_deep_scrub_stamp":"2024-09-14T11:58:49.271605+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.271605+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:36.880499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1544,"num_read_kb":34981,"num_write":1381,"num_write_kb":31832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"263'1165","reported_seq":2734,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.151598+0000","last_change":"2024-09-14T11:58:49.151543+0000","last_active":"2024-09-14T11:58:49.151598+0000","last_peered":"2024-09-14T11:58:49.151598+0000","last_clean":"2024-09-14T11:58:49.151598+0000","last_became_active":"2024-09-14T10:56:41.684448+0000","last_became_peered":"2024-09-14T10:56:41.684448+0000","last_unstale":"2024-09-14T11:58:49.151598+0000","last_undegraded":"2024-09-14T11:58:49.151598+0000","last_fullsized":"2024-09-14T11:58:49.151598+0000","mapping_epoch":27,"log_start":"263'1100","ondisk_log_start":"263'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1165","last_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_deep_scrub":"263'1165","last_deep_scrub_stamp":"2024-09-14T11:58:49.151466+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.151466+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":1100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:18.332268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5304,"num_read_kb":4684,"num_write":1603,"num_write_kb":652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"263'313","reported_seq":906,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:53.736441+0000","last_change":"2024-09-14T11:58:53.736359+0000","last_active":"2024-09-14T11:58:53.736441+0000","last_peered":"2024-09-14T11:58:53.736441+0000","last_clean":"2024-09-14T11:58:53.736441+0000","last_became_active":"2024-09-14T10:56:39.692248+0000","last_became_peered":"2024-09-14T10:56:39.692248+0000","last_unstale":"2024-09-14T11:58:53.736441+0000","last_undegraded":"2024-09-14T11:58:53.736441+0000","last_fullsized":"2024-09-14T11:58:53.736441+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'313","last_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_deep_scrub":"263'313","last_deep_scrub_stamp":"2024-09-14T11:58:53.736196+0000","last_clean_scrub_stamp":"2024-09-14T11:58:53.736196+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:44.006375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":479,"num_read_kb":3420,"num_write":993,"num_write_kb":46130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"263'622","reported_seq":2445,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:58.810981+0000","last_change":"2024-09-14T11:58:58.810902+0000","last_active":"2024-09-14T11:58:58.810981+0000","last_peered":"2024-09-14T11:58:58.810981+0000","last_clean":"2024-09-14T11:58:58.810981+0000","last_became_active":"2024-09-14T10:56:41.688495+0000","last_became_peered":"2024-09-14T10:56:41.688495+0000","last_unstale":"2024-09-14T11:58:58.810981+0000","last_undegraded":"2024-09-14T11:58:58.810981+0000","last_fullsized":"2024-09-14T11:58:58.810981+0000","mapping_epoch":27,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'622","last_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_deep_scrub":"263'622","last_deep_scrub_stamp":"2024-09-14T11:58:58.810813+0000","last_clean_scrub_stamp":"2024-09-14T11:58:58.810813+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":600,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:28.032812+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3346,"num_read_kb":3087,"num_write":748,"num_write_kb":222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2730,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"263'341","reported_seq":994,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:52.055100+0000","last_change":"2024-09-14T11:58:52.055033+0000","last_active":"2024-09-14T11:58:52.055100+0000","last_peered":"2024-09-14T11:58:52.055100+0000","last_clean":"2024-09-14T11:58:52.055100+0000","last_became_active":"2024-09-14T10:57:16.314153+0000","last_became_peered":"2024-09-14T10:57:16.314153+0000","last_unstale":"2024-09-14T11:58:52.055100+0000","last_undegraded":"2024-09-14T11:58:52.055100+0000","last_fullsized":"2024-09-14T11:58:52.055100+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'341","last_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_deep_scrub":"263'341","last_deep_scrub_stamp":"2024-09-14T11:58:52.054914+0000","last_clean_scrub_stamp":"2024-09-14T11:58:52.054914+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:01.336250+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":619,"num_read_kb":7722,"num_write":1033,"num_write_kb":31522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,6],"acting":[0,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"263'1677","reported_seq":3386,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:00.173758+0000","last_change":"2024-09-14T11:59:00.173696+0000","last_active":"2024-09-14T11:59:00.173758+0000","last_peered":"2024-09-14T11:59:00.173758+0000","last_clean":"2024-09-14T11:59:00.173758+0000","last_became_active":"2024-09-14T10:56:41.701391+0000","last_became_peered":"2024-09-14T10:56:41.701391+0000","last_unstale":"2024-09-14T11:59:00.173758+0000","last_undegraded":"2024-09-14T11:59:00.173758+0000","last_fullsized":"2024-09-14T11:59:00.173758+0000","mapping_epoch":27,"log_start":"263'1600","ondisk_log_start":"263'1600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'1677","last_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_deep_scrub":"263'1677","last_deep_scrub_stamp":"2024-09-14T11:59:00.173612+0000","last_clean_scrub_stamp":"2024-09-14T11:59:00.173612+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":1600,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:32:07.415310+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7569,"num_read_kb":6568,"num_write":2364,"num_write_kb":1048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2266,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"263'359","reported_seq":1105,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:50.767011+0000","last_change":"2024-09-14T11:58:50.766923+0000","last_active":"2024-09-14T11:58:50.767011+0000","last_peered":"2024-09-14T11:58:50.767011+0000","last_clean":"2024-09-14T11:58:50.767011+0000","last_became_active":"2024-09-14T10:56:39.685211+0000","last_became_peered":"2024-09-14T10:56:39.685211+0000","last_unstale":"2024-09-14T11:58:50.767011+0000","last_undegraded":"2024-09-14T11:58:50.767011+0000","last_fullsized":"2024-09-14T11:58:50.767011+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'359","last_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_deep_scrub":"263'359","last_deep_scrub_stamp":"2024-09-14T11:58:50.766799+0000","last_clean_scrub_stamp":"2024-09-14T11:58:50.766799+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:21.140749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730128,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":733,"num_read_kb":21069,"num_write":1116,"num_write_kb":31542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"263'704","reported_seq":2121,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.036238+0000","last_change":"2024-09-14T11:58:54.036175+0000","last_active":"2024-09-14T11:58:54.036238+0000","last_peered":"2024-09-14T11:58:54.036238+0000","last_clean":"2024-09-14T11:58:54.036238+0000","last_became_active":"2024-09-14T10:57:15.794574+0000","last_became_peered":"2024-09-14T10:57:15.794574+0000","last_unstale":"2024-09-14T11:58:54.036238+0000","last_undegraded":"2024-09-14T11:58:54.036238+0000","last_fullsized":"2024-09-14T11:58:54.036238+0000","mapping_epoch":38,"log_start":"263'600","ondisk_log_start":"263'600","created":27,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'704","last_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_deep_scrub":"263'704","last_deep_scrub_stamp":"2024-09-14T11:58:54.036089+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.036089+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":600,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:18.473534+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3357,"num_read_kb":3024,"num_write":937,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"263'327","reported_seq":938,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.208428+0000","last_change":"2024-09-14T11:58:55.208361+0000","last_active":"2024-09-14T11:58:55.208428+0000","last_peered":"2024-09-14T11:58:55.208428+0000","last_clean":"2024-09-14T11:58:55.208428+0000","last_became_active":"2024-09-14T10:56:39.690110+0000","last_became_peered":"2024-09-14T10:56:39.690110+0000","last_unstale":"2024-09-14T11:58:55.208428+0000","last_undegraded":"2024-09-14T11:58:55.208428+0000","last_fullsized":"2024-09-14T11:58:55.208428+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'327","last_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_deep_scrub":"263'327","last_deep_scrub_stamp":"2024-09-14T11:58:55.208243+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.208243+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:46.410805+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":526,"num_read_kb":36238,"num_write":1055,"num_write_kb":31088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"263'410","reported_seq":1912,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:05.214647+0000","last_change":"2024-09-14T11:59:05.214583+0000","last_active":"2024-09-14T11:59:05.214647+0000","last_peered":"2024-09-14T11:59:05.214647+0000","last_clean":"2024-09-14T11:59:05.214647+0000","last_became_active":"2024-09-14T10:56:41.689965+0000","last_became_peered":"2024-09-14T10:56:41.689965+0000","last_unstale":"2024-09-14T11:59:05.214647+0000","last_undegraded":"2024-09-14T11:59:05.214647+0000","last_fullsized":"2024-09-14T11:59:05.214647+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'410","last_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_deep_scrub":"263'410","last_deep_scrub_stamp":"2024-09-14T11:59:05.214496+0000","last_clean_scrub_stamp":"2024-09-14T11:59:05.214496+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:43.529192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2257,"num_read_kb":2128,"num_write":485,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"263'371","reported_seq":1110,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:48.189379+0000","last_change":"2024-09-14T11:58:48.189295+0000","last_active":"2024-09-14T11:58:48.189379+0000","last_peered":"2024-09-14T11:58:48.189379+0000","last_clean":"2024-09-14T11:58:48.189379+0000","last_became_active":"2024-09-14T10:57:16.215402+0000","last_became_peered":"2024-09-14T10:57:16.215402+0000","last_unstale":"2024-09-14T11:58:48.189379+0000","last_undegraded":"2024-09-14T11:58:48.189379+0000","last_fullsized":"2024-09-14T11:58:48.189379+0000","mapping_epoch":38,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'371","last_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_deep_scrub":"263'371","last_deep_scrub_stamp":"2024-09-14T11:58:48.189198+0000","last_clean_scrub_stamp":"2024-09-14T11:58:48.189198+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:51.338474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":882,"num_read_kb":32736,"num_write":1182,"num_write_kb":24470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"263'728","reported_seq":2264,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:59.188566+0000","last_change":"2024-09-14T11:58:59.188459+0000","last_active":"2024-09-14T11:58:59.188566+0000","last_peered":"2024-09-14T11:58:59.188566+0000","last_clean":"2024-09-14T11:58:59.188566+0000","last_became_active":"2024-09-14T10:56:41.695080+0000","last_became_peered":"2024-09-14T10:56:41.695080+0000","last_unstale":"2024-09-14T11:58:59.188566+0000","last_undegraded":"2024-09-14T11:58:59.188566+0000","last_fullsized":"2024-09-14T11:58:59.188566+0000","mapping_epoch":27,"log_start":"263'700","ondisk_log_start":"263'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'728","last_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_deep_scrub":"263'728","last_deep_scrub_stamp":"2024-09-14T11:58:59.188347+0000","last_clean_scrub_stamp":"2024-09-14T11:58:59.188347+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":700,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:48.449081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3534,"num_read_kb":3214,"num_write":940,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"263'355","reported_seq":1021,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:54.698532+0000","last_change":"2024-09-14T11:58:54.698436+0000","last_active":"2024-09-14T11:58:54.698532+0000","last_peered":"2024-09-14T11:58:54.698532+0000","last_clean":"2024-09-14T11:58:54.698532+0000","last_became_active":"2024-09-14T10:56:39.685264+0000","last_became_peered":"2024-09-14T10:56:39.685264+0000","last_unstale":"2024-09-14T11:58:54.698532+0000","last_undegraded":"2024-09-14T11:58:54.698532+0000","last_fullsized":"2024-09-14T11:58:54.698532+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'355","last_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_deep_scrub":"263'355","last_deep_scrub_stamp":"2024-09-14T11:58:54.698288+0000","last_clean_scrub_stamp":"2024-09-14T11:58:54.698288+0000","objects_scrubbed":5,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:08.401763+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":657,"num_read_kb":35326,"num_write":1083,"num_write_kb":33504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,4,6],"acting":[5,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"263'299","reported_seq":903,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:55.679579+0000","last_change":"2024-09-14T11:58:55.679499+0000","last_active":"2024-09-14T11:58:55.679579+0000","last_peered":"2024-09-14T11:58:55.679579+0000","last_clean":"2024-09-14T11:58:55.679579+0000","last_became_active":"2024-09-14T10:56:39.685561+0000","last_became_peered":"2024-09-14T10:56:39.685561+0000","last_unstale":"2024-09-14T11:58:55.679579+0000","last_undegraded":"2024-09-14T11:58:55.679579+0000","last_fullsized":"2024-09-14T11:58:55.679579+0000","mapping_epoch":25,"log_start":"263'200","ondisk_log_start":"263'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'299","last_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_deep_scrub":"263'299","last_deep_scrub_stamp":"2024-09-14T11:58:55.679380+0000","last_clean_scrub_stamp":"2024-09-14T11:58:55.679380+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:13:45.132704+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3152118,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":8144,"num_write":967,"num_write_kb":31083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"263'850","reported_seq":2550,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:12.088899+0000","last_change":"2024-09-14T11:59:12.088830+0000","last_active":"2024-09-14T11:59:12.088899+0000","last_peered":"2024-09-14T11:59:12.088899+0000","last_clean":"2024-09-14T11:59:12.088899+0000","last_became_active":"2024-09-14T10:56:41.697043+0000","last_became_peered":"2024-09-14T10:56:41.697043+0000","last_unstale":"2024-09-14T11:59:12.088899+0000","last_undegraded":"2024-09-14T11:59:12.088899+0000","last_fullsized":"2024-09-14T11:59:12.088899+0000","mapping_epoch":27,"log_start":"263'800","ondisk_log_start":"263'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'850","last_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_deep_scrub":"263'850","last_deep_scrub_stamp":"2024-09-14T11:59:12.088731+0000","last_clean_scrub_stamp":"2024-09-14T11:59:12.088731+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":800,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:07.995815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4087,"num_read_kb":3706,"num_write":1074,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"263'398","reported_seq":1173,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:58:49.117096+0000","last_change":"2024-09-14T11:58:49.117031+0000","last_active":"2024-09-14T11:58:49.117096+0000","last_peered":"2024-09-14T11:58:49.117096+0000","last_clean":"2024-09-14T11:58:49.117096+0000","last_became_active":"2024-09-14T10:56:39.678111+0000","last_became_peered":"2024-09-14T10:56:39.678111+0000","last_unstale":"2024-09-14T11:58:49.117096+0000","last_undegraded":"2024-09-14T11:58:49.117096+0000","last_fullsized":"2024-09-14T11:58:49.117096+0000","mapping_epoch":25,"log_start":"263'300","ondisk_log_start":"263'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'398","last_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_deep_scrub":"263'398","last_deep_scrub_stamp":"2024-09-14T11:58:49.116906+0000","last_clean_scrub_stamp":"2024-09-14T11:58:49.116906+0000","objects_scrubbed":8,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:11.076523+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1019,"num_read_kb":40288,"num_write":1313,"num_write_kb":43086,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"263'392","reported_seq":2008,"reported_epoch":263,"state":"active+clean","last_fresh":"2024-09-14T11:59:03.625356+0000","last_change":"2024-09-14T11:59:03.625263+0000","last_active":"2024-09-14T11:59:03.625356+0000","last_peered":"2024-09-14T11:59:03.625356+0000","last_clean":"2024-09-14T11:59:03.625356+0000","last_became_active":"2024-09-14T10:56:41.693070+0000","last_became_peered":"2024-09-14T10:56:41.693070+0000","last_unstale":"2024-09-14T11:59:03.625356+0000","last_undegraded":"2024-09-14T11:59:03.625356+0000","last_fullsized":"2024-09-14T11:59:03.625356+0000","mapping_epoch":27,"log_start":"263'300","ondisk_log_start":"263'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'392","last_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_deep_scrub":"263'392","last_deep_scrub_stamp":"2024-09-14T11:59:03.625149+0000","last_clean_scrub_stamp":"2024-09-14T11:59:03.625149+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:36.235567+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2325,"num_read_kb":2239,"num_write":446,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10481,"num_read_kb":8479,"num_write":3031,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":971,"ondisk_log_size":971,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15525,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15185,"num_read_kb":14843,"num_write":17054,"num_write_kb":4984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2699,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":31050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1885,"ondisk_log_size":1885,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":505,"ondisk_log_size":505,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1660817,"num_objects":197,"num_object_clones":0,"num_object_copies":394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":197,"num_whiteouts":0,"num_read":18638,"num_read_kb":39748,"num_write":15595,"num_write_kb":12041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":702580,"num_omap_keys":1622,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2092,"ondisk_log_size":2092,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2422,"num_read_kb":2887,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":221015,"num_read_kb":201917,"num_write":56148,"num_write_kb":19258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35737,"num_omap_keys":144,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3751,"ondisk_log_size":3751,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":43145697,"num_objects":280,"num_object_clones":0,"num_object_copies":1120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":280,"num_whiteouts":0,"num_read":44629,"num_read_kb":1932119,"num_write":73662,"num_write_kb":2303302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":59392000,"data_stored":59392000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3707,"ondisk_log_size":3707,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":187491,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":178270,"num_write":190,"num_write_kb":136272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424510211,"num_pgs":107,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":296288,"kb_used_data":12432,"kb_used_omap":1,"kb_used_meta":283838,"kb_avail":94075552,"statfs":{"total":96636764160,"available":96333365248,"internally_reserved":0,"allocated":12730368,"data_stored":10789257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":290650566},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510208,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130676,"kb_used_data":13412,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94241164,"statfs":{"total":96636764160,"available":96502951936,"internally_reserved":0,"allocated":13733888,"data_stored":11812366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542910,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313544,"kb_used_data":11640,"kb_used_omap":1,"kb_used_meta":301886,"kb_avail":94058296,"statfs":{"total":96636764160,"available":96315695104,"internally_reserved":0,"allocated":11919360,"data_stored":9919858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":309131722},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542913,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176908,"kb_used_data":11132,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94194932,"statfs":{"total":96636764160,"available":96455610368,"internally_reserved":0,"allocated":11399168,"data_stored":9381666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542911,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301348,"kb_used_data":9172,"kb_used_omap":1,"kb_used_meta":292158,"kb_avail":94070492,"statfs":{"total":96636764160,"available":96328183808,"internally_reserved":0,"allocated":9392128,"data_stored":7423434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":299170247},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542915,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121572,"kb_used_data":5716,"kb_used_omap":1,"kb_used_meta":115838,"kb_avail":94250268,"statfs":{"total":96636764160,"available":96512274432,"internally_reserved":0,"allocated":5853184,"data_stored":3932499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118618565},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542912,"num_pgs":120,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188836,"kb_used_data":13332,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94183004,"statfs":{"total":96636764160,"available":96443396096,"internally_reserved":0,"allocated":13651968,"data_stored":11690363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542911,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":285244,"kb_used_data":15276,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94086596,"statfs":{"total":96636764160,"available":96344674304,"internally_reserved":0,"allocated":15642624,"data_stored":13655531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":276429253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1679360,"data_stored":1679360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5169152,"data_stored":5169152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":9560064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7127040,"data_stored":7127040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8536064,"data_stored":8536064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7073792,"data_stored":7073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T12:00:07.858 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T12:00:08.201 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T12:00:08.201 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T12:00:08.202 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T12:00:08.202 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.245 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T12:00:08.246 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T12:00:08.246 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.293 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T12:00:08.294 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T12:00:08.294 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.340 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T12:00:08.341 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T12:00:08.341 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.396 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T12:00:08.396 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T12:00:08.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.450 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T12:00:08.451 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T12:00:08.451 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.505 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T12:00:08.505 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T12:00:08.505 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.558 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T12:00:08.558 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T12:00:08.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.603 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T12:00:08.604 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T12:00:08.604 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T12:00:08.604 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.630 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T12:00:08.631 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T12:00:08.631 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.662 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T12:00:08.662 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T12:00:08.662 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T12:00:08.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.687 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T12:00:08.688 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T12:00:08.688 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.741 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T12:00:08.741 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T12:00:08.741 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T12:00:08.754 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T12:00:08.754 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T12:00:08.755 DEBUG:teuthology.orchestra.run.smithi029:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T12:00:08.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T12:00:08.824 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T12:00:09.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T12:00:09.134 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T12:00:09.227 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T12:00:09.227 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T12:00:09.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T12:00:09.307 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T12:00:09.402 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T12:00:09.402 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T12:00:09.599 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T12:00:09.599 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T12:00:09.694 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T12:00:09.694 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T12:00:09.764 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T12:00:09.764 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T12:00:09.849 INFO:tasks.ceph:Archiving mon data... 2024-09-14T12:00:09.851 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/data/mon.a.tgz 2024-09-14T12:00:09.851 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-14T12:00:09.884 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.r2MeRBqqlp 2024-09-14T12:00:09.884 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.r2MeRBqqlp 2024-09-14T12:00:10.093 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.r2MeRBqqlp 2024-09-14T12:00:10.207 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.r2MeRBqqlp is 483KB 2024-09-14T12:00:10.308 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.r2MeRBqqlp 2024-09-14T12:00:10.338 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/data/mon.c.tgz 2024-09-14T12:00:10.338 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2024-09-14T12:00:10.407 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.lnue9GHVMS 2024-09-14T12:00:10.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lnue9GHVMS 2024-09-14T12:00:10.594 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.lnue9GHVMS 2024-09-14T12:00:10.707 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.lnue9GHVMS is 488KB 2024-09-14T12:00:10.793 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.lnue9GHVMS 2024-09-14T12:00:10.822 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/data/mon.b.tgz 2024-09-14T12:00:10.823 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-14T12:00:10.857 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.8a22QJpz9h 2024-09-14T12:00:10.858 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8a22QJpz9h 2024-09-14T12:00:11.061 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.8a22QJpz9h 2024-09-14T12:00:11.172 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.8a22QJpz9h is 487KB 2024-09-14T12:00:11.273 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.8a22QJpz9h 2024-09-14T12:00:11.302 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T12:00:11.302 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:00:11.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T12:00:11.494 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:00:11.523 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T12:00:11.523 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T12:00:11.526 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi029/crash 2024-09-14T12:00:11.527 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:00:11.568 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi073/crash 2024-09-14T12:00:11.569 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T12:00:11.607 INFO:tasks.ceph:Compressing logs... 2024-09-14T12:00:11.608 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:00:11.613 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T12:00:11.650 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T12:00:11.651 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187821.log 2024-09-14T12:00:11.702 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32905.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32861.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32817.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz --verbose 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr: -- /var/log/ceph/ceph-client.admin.32586.log 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32630.log 0.0% 2024-09-14T12:00:11.703 INFO:teuthology.orchestra.run.smithi073.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32861.log.gz 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32586.log.gz 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32630.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32630.log.gz 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32674.log: 26.7% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32729.log 2024-09-14T12:00:11.704 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ceph-client.admin.32729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32729.log.gz 2024-09-14T12:00:11.705 INFO:teuthology.orchestra.run.smithi073.stderr: 87.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.0.log: -- /var/log/ceph/ceph-client.admin.80372.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161682.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.187821.log: /var/log/ceph/ceph-client.admin.80372.log: 82.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.187821.log.gz -5 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33502.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.80372.log.gz 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.161682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83906.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.161682.log.gz 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79194.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33502.log.gz 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.83906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95098.log 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.83906.log.gz 2024-09-14T12:00:11.782 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.79194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57205.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.79194.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.95098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183824.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.95098.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.57205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181997.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.57205.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.183824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185651.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.183824.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.181997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165902.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181997.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.185651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39595.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.185651.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.165902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173596.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.39595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51856.log 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.165902.log.gz 2024-09-14T12:00:11.783 INFO:teuthology.orchestra.run.smithi029.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.39595.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.173596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74294.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51856.log: 92.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.173596.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.159304.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51856.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156948.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.74294.log: /var/log/ceph/ceph-client.admin.159304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158715.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.159304.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.156948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152236.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.74294.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.156948.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.158715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158715.log.gz 2024-09-14T12:00:11.784 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.152236.log: /var/log/ceph/ceph-client.admin.51904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153414.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.152236.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37731.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.153414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191983.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37731.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.153414.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112769.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37731.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.191983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38831.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191983.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76246.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112769.log.gz 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135744.log 2024-09-14T12:00:11.785 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38831.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.76246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189706.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.76246.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.135744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189779.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.135744.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61424.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189706.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189755.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.189779.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.61424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65109.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.61424.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41452.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189755.log.gz 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.65109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38787.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.41452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181388.log 2024-09-14T12:00:11.786 INFO:teuthology.orchestra.run.smithi029.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.41452.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.65109.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38787.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.38787.log.gz -- 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.122783.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46181.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.181388.log: /var/log/ceph/ceph-client.admin.122783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129265.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.181388.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.122783.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.46181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70068.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.46181.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.129265.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.129265.log.gz 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.70068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64487.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38449.log 2024-09-14T12:00:11.787 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.64487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162860.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38449.log.gz 88.1% 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70068.log.gz 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49500.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.162860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149291.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125731.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162860.log.gz 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.149291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38436.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.149291.log.gz 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.125731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145168.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125731.log.gz 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192949.log 2024-09-14T12:00:11.788 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38436.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.145168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74884.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.145168.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.192949.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.152825.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192949.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.74884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71307.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.74884.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.152825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76856.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.71307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191845.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.76856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180170.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.76856.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.191845.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.152825.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191845.log.gz 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.180170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122194.log 2024-09-14T12:00:11.789 INFO:teuthology.orchestra.run.smithi029.stderr: 84.1%/var/log/ceph/ceph-client.admin.38081.log: -- replaced with /var/log/ceph/ceph-client.0.180170.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120427.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.122194.log: -- /var/log/ceph/ceph-client.admin.192535.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.120427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76066.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.120427.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.71307.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192535.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108056.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.122194.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.76066.log: gzip -5 --verbose -- 24.6% -- replaced with /var/log/ceph/ceph-client.admin.76066.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.192811.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.108056.log: gzip -5 81.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.108056.log.gz 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.0.178952.log 2024-09-14T12:00:11.790 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192719.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192811.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.178952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143990.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.178952.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192719.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.143990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110413.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.143990.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.37649.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.146346.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.110413.log: gzip -5 --verbose 81.9% -- replaced with /var/log/ceph/ceph-client.admin.110413.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.45586.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.146346.log: gzip -5 81.8% --verbose -- /var/log/ceph/ceph-client.admin.132210.log 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146346.log.gz 2024-09-14T12:00:11.791 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.45586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118071.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.45586.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.132210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98632.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.132210.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86262.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7%/var/log/ceph/ceph-client.admin.98632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84495.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118071.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98632.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.86262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88618.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.64487.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.86262.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65728.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.84495.log: /var/log/ceph/ceph-client.admin.88618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189682.log 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.84495.log.gz 2024-09-14T12:00:11.792 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.88618.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.65728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82728.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71971.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189682.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.82728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133977.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82728.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139867.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.71971.log: /var/log/ceph/ceph-client.admin.133977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159893.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 81.9%/var/log/ceph/ceph-client.admin.139867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133977.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.71971.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.139867.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.159893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155181.log 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.159893.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-09-14T12:00:11.793 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.169220.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.155181.log: gzip -5 --verbose 81.5% -- replaced with /var/log/ceph/ceph-client.admin.155181.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.48863.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.169220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148113.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.169220.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109823.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.148113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191799.log 85.4% -- replaced with /var/log/ceph/ceph-client.admin.148113.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109823.log: gzip -5 --verbose 81.7% -- /var/log/ceph/ceph-client.admin.192857.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.109823.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.191799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191799.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66352.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.65728.log.gz 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63128.log 2024-09-14T12:00:11.794 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192857.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62352.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.66352.log: /var/log/ceph/ceph-client.admin.63128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116893.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 52.2% -- replaced with /var/log/ceph/ceph-client.admin.63128.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.admin.62352.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.102755.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 59.9% -- replaced with /var/log/ceph/ceph-client.admin.62352.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56616.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6%/var/log/ceph/ceph-client.admin.102755.log: -- replaced with /var/log/ceph/ceph-client.admin.116893.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.102755.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.56616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38077.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.56616.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38082.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 85.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128087.log 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38077.log: -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2024-09-14T12:00:11.795 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38077.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149880.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38082.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.128087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117482.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.149880.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149880.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.189000.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.117482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117482.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189000.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.128087.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192167.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.189000.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151058.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.66352.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178343.log 2024-09-14T12:00:11.796 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192167.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.151058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138689.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.178343.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.178343.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.138689.log: gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138689.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90386.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.151058.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75475.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.90386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38080.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.90386.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.75475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131621.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.75475.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192765.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.131621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90975.log 2024-09-14T12:00:11.797 INFO:teuthology.orchestra.run.smithi029.stderr: 84.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38445.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.131621.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192765.log: /var/log/ceph/ceph-client.admin.90975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113947.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192765.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188410.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% 94.6% -- replaced with /var/log/ceph/ceph-client.admin.38445.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138100.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.188410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85084.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.188410.log.gz/var/log/ceph/ceph-client.admin.138100.log: 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.90975.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142223.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.138100.log.gz 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.85084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125142.log 2024-09-14T12:00:11.798 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.85084.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.142223.log: gzip 87.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.113947.log.gz -- 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.69447.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.142223.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127498.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.125142.log: /var/log/ceph/ceph-client.admin.69447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161093.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.125142.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.127498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171015.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.127498.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.161093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77720.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.171015.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161093.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192075.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.171015.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.77720.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.69447.log.gz 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192213.log 2024-09-14T12:00:11.799 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5/var/log/ceph/ceph-client.admin.192075.log: --verbose -- /var/log/ceph/ceph-client.admin.59609.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192075.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170407.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192213.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.59609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165313.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.59609.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.170407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115715.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.165313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174812.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.115715.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165313.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132799.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.115715.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.174812.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170407.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.77720.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37672.log 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174812.log.gz 2024-09-14T12:00:11.800 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.132799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33083.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88029.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.132799.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37672.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.33083.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33083.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.88029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130443.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.88029.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139278.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.130443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160483.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.130443.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.139278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.186260.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.160483.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139278.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.50678.log 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160483.log.gz 2024-09-14T12:00:11.801 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.186260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60835.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.186260.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189660.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.50678.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.60835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189660.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.60835.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.189660.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189022.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70688.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42664.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189022.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146935.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.70688.log: /var/log/ceph/ceph-client.0.42664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136922.log 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T12:00:11.802 INFO:teuthology.orchestra.run.smithi029.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.42664.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.146935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167963.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114536.log/var/log/ceph/ceph-client.admin.136922.log: 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.167963.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.136922.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.70688.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58431.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.167963.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183215.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.114536.log: /var/log/ceph/ceph-client.admin.58431.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.114536.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- 86.9% /var/log/ceph/ceph-client.admin.128676.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146935.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.58431.log.gz 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.183215.log: /var/log/ceph/ceph-client.admin.128676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182606.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128676.log.gz/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37869.log 2024-09-14T12:00:11.803 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.183215.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.182606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147524.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.182606.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164086.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37869.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.147524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63002.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.147524.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.164086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108645.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.164086.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.63002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92742.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63002.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.108645.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26986.log 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.92742.log: gzip -5 --verbose -- 81.7% /var/log/ceph/ceph-client.admin.38448.log -- replaced with /var/log/ceph/ceph-client.admin.108645.log.gz 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.804 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.tmp-client.admin.26986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192121.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.92742.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.26986.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100988.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38448.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107467.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192121.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.100988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57794.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.107467.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38079.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100988.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.57794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104522.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57794.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97454.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38079.log: /var/log/ceph/ceph-client.admin.104522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51880.log 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38079.log.gz 2024-09-14T12:00:11.805 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.97454.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.104522.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.107467.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33415.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97454.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105700.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.51880.log: /var/log/ceph/ceph-client.admin.33415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57818.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33415.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51880.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.105700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121016.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.105700.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111002.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.57818.log: /var/log/ceph/ceph-client.admin.121016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89797.log 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57818.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121016.log.gz 2024-09-14T12:00:11.806 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172231.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.89797.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111002.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 81.3% -- replaced with /var/log/ceph/ceph-client.admin.89797.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38083.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.172231.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172231.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38083.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94509.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73112.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.94509.log: gzip -5 --verbose 81.5% -- replaced with /var/log/ceph/ceph-client.admin.94509.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-client.admin.123372.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.73112.log: gzip 80.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.106878.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73112.log.gz 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.123372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80961.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.192673.log 2024-09-14T12:00:11.807 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123372.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.106878.log: /var/log/ceph/ceph-client.admin.80961.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.106878.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.80961.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103933.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191891.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192673.log: /var/log/ceph/ceph-client.admin.103933.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.93331.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192673.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103933.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59020.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.191891.log: /var/log/ceph/ceph-client.admin.93331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191891.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77568.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6%/var/log/ceph/ceph-client.admin.59020.log: -- replaced with /var/log/ceph/ceph-client.admin.93331.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143401.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.59020.log.gz 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103344.log 2024-09-14T12:00:11.808 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.77568.log: /var/log/ceph/ceph-client.admin.143401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105111.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 49.1% -- replaced with /var/log/ceph/ceph-client.admin.77568.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7%/var/log/ceph/ceph-client.admin.103344.log: -- replaced with /var/log/ceph/ceph-client.admin.143401.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.103344.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154592.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.105111.log: gzip -5 81.6% -- replaced with /var/log/ceph/ceph-client.admin.105111.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: --verbose -- /var/log/ceph/ceph-client.admin.137511.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.154592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38450.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.137511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131032.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137511.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62607.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154592.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38450.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.131032.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.131032.log.gz 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38697.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62607.log: /var/log/ceph/ceph-client.admin.192627.log 2024-09-14T12:00:11.809 INFO:teuthology.orchestra.run.smithi029.stderr: 57.0%/var/log/ceph/ceph-client.admin.38697.log: -- replaced with /var/log/ceph/ceph-client.admin.62607.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38697.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135155.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38440.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192627.log: /var/log/ceph/ceph-client.admin.135155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47685.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192627.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38440.log: gzip 81.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.135155.log.gz -- 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.95687.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38440.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73701.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47685.log: /var/log/ceph/ceph-client.admin.95687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89208.log 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.47685.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.73701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95687.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150469.log 84.1% 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73701.log.gz 2024-09-14T12:00:11.810 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129854.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.89208.log: gzip/var/log/ceph/ceph-client.admin.150469.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.99810.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.129854.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.150469.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.89208.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133388.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129854.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.99810.log: gzip -5 --verbose 81.7% -- replaced with /var/log/ceph/ceph-client.admin.99810.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr: -- /var/log/ceph/ceph-osd.2.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.133388.log: gzip -5 --verbose -- 81.6% -- replaced with /var/log/ceph/ceph-client.admin.133388.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr: /var/log/ceph/ceph-client.admin.38076.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63190.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176486.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.63190.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.63190.log.gz 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192029.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47096.log 2024-09-14T12:00:11.811 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.176486.log: /var/log/ceph/ceph-client.admin.192029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192029.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.176486.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38963.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.47096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63786.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.47096.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38963.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60198.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.63786.log: 22.5% -- replaced with /var/log/ceph/ceph-client.admin.63786.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126909.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.60198.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66971.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60198.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38078.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.126909.log: /var/log/ceph/ceph-client.admin.66971.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126909.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57842.log 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38078.log.gz 2024-09-14T12:00:11.812 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81550.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.57842.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57842.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.81550.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.81550.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112180.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66971.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr: 61.8% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184433.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112180.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.48274.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52493.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.184433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192904.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.184433.log.gz 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.52493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134566.log 2024-09-14T12:00:11.813 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192904.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.52493.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40807.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.134566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37823.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.40807.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40807.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165289.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37823.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.134566.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189070.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142812.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189070.log: /var/log/ceph/ceph-client.admin.165289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165289.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.189070.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38986.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.142812.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.142812.log.gz 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189730.log 2024-09-14T12:00:11.814 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.38986.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.38986.log.gz 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162271.log 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189730.log.gz 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68828.log 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.162271.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.162271.log.gz 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113358.log 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.68828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101577.log 2024-09-14T12:00:11.815 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113358.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113358.log.gz 2024-09-14T12:00:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T12:00:11.858 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.101577.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101577.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68828.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98043.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60246.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.98043.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98043.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177734.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.60246.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.60246.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83317.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.177734.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.177734.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124553.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.83317.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83317.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86851.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.124553.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.124553.log.gz 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118660.log 2024-09-14T12:00:11.859 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.86851.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86851.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose 95.1% -- /var/log/ceph/ceph-client.admin.115125.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.118660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62717.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 89.1%/var/log/ceph/ceph-client.admin.115125.log: -- replaced with /var/log/ceph/ceph-client.admin.118660.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115125.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78329.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.62717.log: 46.7% -- replaced with /var/log/ceph/ceph-client.admin.62717.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191937.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:gzip/var/log/ceph/ceph-client.0.78329.log: 93.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.157537.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.78329.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.191937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177125.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191937.log.gz 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.157537.log: /var/log/ceph/ceph-client.admin.192581.log 2024-09-14T12:00:11.860 INFO:teuthology.orchestra.run.smithi029.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.157537.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55438.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.177125.log: /var/log/ceph/ceph-client.admin.192581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141045.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192581.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.177125.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.55438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63064.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.55438.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.141045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192443.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141045.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175878.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.63064.log: /var/log/ceph/ceph-client.admin.192443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163473.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192443.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.175878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99221.log 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.163473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163473.log.gz 2024-09-14T12:00:11.861 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166491.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.99221.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.175878.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160504.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.99221.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.166491.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.166491.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158126.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126320.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.158126.log: /var/log/ceph/ceph-client.admin.160504.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.160504.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158126.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.126320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40198.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126320.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38875.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53671.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.40198.log: 80.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54849.log 2024-09-14T12:00:11.862 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.0.40198.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119838.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53671.log: /var/log/ceph/ceph-client.admin.54849.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.53671.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54849.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92153.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.119838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.191167.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.119838.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.92153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192351.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.191167.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.92153.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54260.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192351.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85673.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.54260.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.54260.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62925.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.85673.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.85673.log.gz 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192397.log 2024-09-14T12:00:11.863 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.62925.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62925.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156359.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192397.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.156359.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.156359.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63064.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123964.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192259.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.123964.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.123964.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49452.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192259.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38283.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.49452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49452.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148702.log 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38283.log.gz 2024-09-14T12:00:11.864 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179561.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.148702.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.148702.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140456.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.179561.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.179561.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189046.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.140456.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.140456.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116304.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.189046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189046.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136333.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.116304.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116304.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190474.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.136333.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136333.log.gz 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42061.log 2024-09-14T12:00:11.865 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.190474.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.190474.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38919.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.42061.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42061.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111591.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.38919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38919.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79783.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.111591.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111591.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109234.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.79783.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79783.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174204.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.109234.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109234.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50089.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.174204.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.174204.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100399.log 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.50089.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.50089.log.gz 2024-09-14T12:00:11.866 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96276.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.100399.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.100399.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87440.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.96276.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96276.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.0.191167.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53082.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.87440.log: -- /var/log/ceph/ceph-client.admin.37585.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87440.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.53082.log: 84.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121605.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53082.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144579.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.121605.log: /var/log/ceph/ceph-client.admin.37585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37585.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121605.log.gz 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154003.log 2024-09-14T12:00:11.867 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102166.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.154003.log: /var/log/ceph/ceph-client.admin.144579.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.154003.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144579.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60222.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.102166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180779.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.102166.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.60222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82139.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.180779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60222.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr: 80.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168612.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.0.180779.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.82139.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82139.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172988.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91564.log 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.168612.log: /var/log/ceph/ceph-client.admin.172988.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.172988.log.gz 2024-09-14T12:00:11.868 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93920.log 2024-09-14T12:00:11.869 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.91564.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91564.log.gz 2024-09-14T12:00:11.869 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56027.log 2024-09-14T12:00:11.869 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.93920.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.93920.log.gz 2024-09-14T12:00:11.869 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192489.log 2024-09-14T12:00:11.883 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.56027.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.56027.log.gz 2024-09-14T12:00:11.883 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106289.log 2024-09-14T12:00:11.883 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192489.log: 0.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168612.log.gz 2024-09-14T12:00:11.883 INFO:teuthology.orchestra.run.smithi029.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192489.log.gz 2024-09-14T12:00:11.883 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38651.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141634.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.106289.log: /var/log/ceph/ceph-client.admin.38651.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106289.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38651.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68209.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185042.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.141634.log: /var/log/ceph/ceph-client.admin.68209.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.141634.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155770.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.185042.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.185042.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163449.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.155770.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.68209.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.155770.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192305.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63722.log 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.163449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163449.log.gz 2024-09-14T12:00:11.884 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.192305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192305.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145757.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119249.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.145757.log: /var/log/ceph/ceph-client.admin.63722.log: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.63722.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145757.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.119249.log: /var/log/ceph/ceph-client.0.43870.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.119249.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165265.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.43870.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43870.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163497.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.165265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165265.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96865.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.163497.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.163497.log.gz 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164675.log 2024-09-14T12:00:11.885 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.96865.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.96865.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171623.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.164675.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.164675.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67590.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.171623.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171623.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43267.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.67590.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.67590.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63898.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.0.43267.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.43267.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37777.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.63898.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.63898.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151647.log 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.37777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37777.log.gz 2024-09-14T12:00:11.886 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.151647.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.151647.log.gz 2024-09-14T12:00:12.307 INFO:teuthology.orchestra.run.smithi073.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T12:00:12.644 INFO:teuthology.orchestra.run.smithi073.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T12:00:12.805 INFO:teuthology.orchestra.run.smithi029.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T12:00:14.866 INFO:teuthology.orchestra.run.smithi029.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T12:00:16.729 INFO:teuthology.orchestra.run.smithi029.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T12:00:20.020 INFO:teuthology.orchestra.run.smithi029.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T12:00:23.156 INFO:teuthology.orchestra.run.smithi073.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T12:00:24.059 INFO:teuthology.orchestra.run.smithi029.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T12:00:24.318 INFO:teuthology.orchestra.run.smithi073.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T12:00:24.691 INFO:teuthology.orchestra.run.smithi073.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T12:00:30.049 INFO:teuthology.orchestra.run.smithi029.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T12:00:30.322 INFO:teuthology.orchestra.run.smithi073.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T12:00:30.324 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-14T12:00:30.324 INFO:teuthology.orchestra.run.smithi073.stderr:real 0m18.647s 2024-09-14T12:00:30.324 INFO:teuthology.orchestra.run.smithi073.stderr:user 0m55.235s 2024-09-14T12:00:30.324 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m1.999s 2024-09-14T12:00:35.514 INFO:teuthology.orchestra.run.smithi029.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T12:00:35.516 INFO:teuthology.orchestra.run.smithi029.stderr: 2024-09-14T12:00:35.516 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m23.876s 2024-09-14T12:00:35.516 INFO:teuthology.orchestra.run.smithi029.stderr:user 1m9.953s 2024-09-14T12:00:35.516 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m2.472s 2024-09-14T12:00:35.517 INFO:tasks.ceph:Archiving logs... 2024-09-14T12:00:35.517 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi029/log 2024-09-14T12:00:35.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:00:47.096 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi073/log 2024-09-14T12:00:47.097 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T12:00:54.884 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T12:00:54.894 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T12:00:54.894 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:00:54.897 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T12:00:54.998 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T12:00:55.009 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T12:00:55.009 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:00:55.011 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T12:00:55.040 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:00:55.041 INFO:teuthology.orchestra.run.smithi029.stderr:bash: line 1: ntpq: command not found 2024-09-14T12:00:55.043 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:00:55.043 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-14T12:00:55.043 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 18 +1886us[+1871us] +/- 44ms 2024-09-14T12:00:55.043 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 213 +2650us[+2674us] +/- 56ms 2024-09-14T12:00:55.044 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -10ms[ -10ms] +/- 103ms 2024-09-14T12:00:55.044 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:00:55.045 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T12:00:55.045 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2024-09-14T12:00:55.045 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +1958us[+1926us] +/- 44ms 2024-09-14T12:00:55.045 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 +2685us[+2685us] +/- 59ms 2024-09-14T12:00:55.046 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -10ms[ -10ms] +/- 103ms 2024-09-14T12:00:55.046 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T12:00:55.046 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T12:00:55.056 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T12:00:55.057 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T12:00:55.090 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:00:55.176 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T12:00:55.250 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:00:55.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:55.293 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T12:00:55.334 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:55.335 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T12:00:55.346 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T12:00:55.390 INFO:teuthology.task.internal:Duration was 4327.592541 seconds 2024-09-14T12:00:55.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T12:00:55.441 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T12:00:55.441 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:00:55.444 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T12:00:55.496 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:00:55.498 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T12:00:55.791 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T12:00:55.791 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2024-09-14T12:00:55.791 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:00:55.828 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-14T12:00:55.828 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T12:00:55.869 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T12:00:55.869 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:00:55.872 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T12:00:55.949 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T12:00:55.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:00:55.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T12:00:56.104 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T12:00:56.116 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T12:00:56.116 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:00:56.157 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T12:00:56.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T12:00:56.207 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:56.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:56.244 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2024-09-14T12:00:56.272 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-14T12:00:56.327 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:56.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:56.355 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T12:00:56.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T12:00:56.395 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T12:00:56.407 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T12:00:56.407 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi029 2024-09-14T12:00:56.408 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:00:56.458 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904142/remote/smithi073 2024-09-14T12:00:56.458 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T12:00:56.504 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T12:00:56.504 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:00:56.507 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T12:00:56.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T12:00:56.580 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T12:00:56.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T12:00:56.608 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T12:00:56.608 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:00:56.611 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T12:00:56.638 INFO:teuthology.orchestra.run.smithi029.stdout: 265602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:00 /home/ubuntu/cephtest 2024-09-14T12:00:56.639 INFO:teuthology.orchestra.run.smithi073.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 12:00 /home/ubuntu/cephtest 2024-09-14T12:00:56.640 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T12:00:56.658 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T12:00:56.760 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4327.592540502548 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T12:00:56.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T12:00:57.029 INFO:teuthology.run:pass